[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:18:46.991554 22701 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.43.126:34023
I20260709 12:18:46.993168 22701 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:18:46.994304 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:47.012213 22708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:47.012225 22710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:47.014225 22701 server_base.cc:1061] running on GCE node
W20260709 12:18:47.012707 22707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:48.233597 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:48.233891 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:48.234148 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599528234121 us; error 0 us; skew 500 ppm
I20260709 12:18:48.235029 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:48.240386 22701 webserver.cc:533] Webserver started at http://127.22.43.126:45041/ using document root <none> and password file <none>
I20260709 12:18:48.241272 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:48.241518 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:48.242033 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:48.248019 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/master-0-root/instance:
uuid: "986a4d1a52b946e0b663a9ca5e60717d"
format_stamp: "Formatted at 2026-07-09 12:18:48 on dist-test-slave-0768"
I20260709 12:18:48.256297 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 12:18:48.261844 22716 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:48.263414 22701 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:18:48.263790 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/master-0-root
uuid: "986a4d1a52b946e0b663a9ca5e60717d"
format_stamp: "Formatted at 2026-07-09 12:18:48 on dist-test-slave-0768"
I20260709 12:18:48.264183 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:48.327335 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:48.328995 22701 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:18:48.329450 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:48.408077 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.126:34023
I20260709 12:18:48.408201 22767 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.126:34023 every 8 connection(s)
I20260709 12:18:48.417486 22768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:48.440277 22768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d: Bootstrap starting.
I20260709 12:18:48.446475 22768 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:48.448367 22768 log.cc:826] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d: Log is configured to *not* fsync() on all Append() calls
I20260709 12:18:48.453058 22768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d: No bootstrap required, opened a new log
I20260709 12:18:48.473747 22768 raft_consensus.cc:359] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "986a4d1a52b946e0b663a9ca5e60717d" member_type: VOTER }
I20260709 12:18:48.474411 22768 raft_consensus.cc:385] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:48.474629 22768 raft_consensus.cc:740] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 986a4d1a52b946e0b663a9ca5e60717d, State: Initialized, Role: FOLLOWER
I20260709 12:18:48.475586 22768 consensus_queue.cc:260] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "986a4d1a52b946e0b663a9ca5e60717d" member_type: VOTER }
I20260709 12:18:48.476063 22768 raft_consensus.cc:399] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:48.476341 22768 raft_consensus.cc:493] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:48.476639 22768 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:48.480753 22768 raft_consensus.cc:515] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "986a4d1a52b946e0b663a9ca5e60717d" member_type: VOTER }
I20260709 12:18:48.481465 22768 leader_election.cc:304] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 986a4d1a52b946e0b663a9ca5e60717d; no voters: 
I20260709 12:18:48.483256 22768 leader_election.cc:290] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:48.483628 22771 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:48.485939 22771 raft_consensus.cc:697] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [term 1 LEADER]: Becoming Leader. State: Replica: 986a4d1a52b946e0b663a9ca5e60717d, State: Running, Role: LEADER
I20260709 12:18:48.486944 22771 consensus_queue.cc:237] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "986a4d1a52b946e0b663a9ca5e60717d" member_type: VOTER }
I20260709 12:18:48.488029 22768 sys_catalog.cc:565] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:48.497751 22772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "986a4d1a52b946e0b663a9ca5e60717d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "986a4d1a52b946e0b663a9ca5e60717d" member_type: VOTER } }
I20260709 12:18:48.498967 22772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:48.498641 22773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 986a4d1a52b946e0b663a9ca5e60717d. Latest consensus state: current_term: 1 leader_uuid: "986a4d1a52b946e0b663a9ca5e60717d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "986a4d1a52b946e0b663a9ca5e60717d" member_type: VOTER } }
I20260709 12:18:48.499363 22773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:48.503124 22780 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:48.515478 22780 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:48.524783 22701 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:48.534365 22780 catalog_manager.cc:1383] Generated new cluster ID: ab3e778da6ea4940a5a22a4490300497
I20260709 12:18:48.534646 22780 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:48.553970 22780 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:48.555640 22780 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:48.569000 22780 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d: Generated new TSK 0
I20260709 12:18:48.570019 22780 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:48.591864 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:48.601847 22790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:48.603145 22791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:48.607658 22793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:48.608521 22701 server_base.cc:1061] running on GCE node
I20260709 12:18:48.609377 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:48.609604 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:48.609827 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599528609803 us; error 0 us; skew 500 ppm
I20260709 12:18:48.610487 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:48.614620 22701 webserver.cc:533] Webserver started at http://127.22.43.65:34031/ using document root <none> and password file <none>
I20260709 12:18:48.615185 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:48.615417 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:48.615717 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:48.616869 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-0-root/instance:
uuid: "89017b6621424a6696e49f037d524851"
format_stamp: "Formatted at 2026-07-09 12:18:48 on dist-test-slave-0768"
I20260709 12:18:48.622521 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:18:48.627004 22798 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:48.627887 22701 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:18:48.628211 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-0-root
uuid: "89017b6621424a6696e49f037d524851"
format_stamp: "Formatted at 2026-07-09 12:18:48 on dist-test-slave-0768"
I20260709 12:18:48.628536 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:48.650372 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:48.651772 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:48.654217 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:48.659118 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:48.659408 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:48.659686 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:48.659885 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:48.763154 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.65:45213
I20260709 12:18:48.763226 22860 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.65:45213 every 8 connection(s)
I20260709 12:18:48.770671 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:48.781004 22865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:48.786576 22866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:48.790634 22868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:48.791941 22701 server_base.cc:1061] running on GCE node
I20260709 12:18:48.792918 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:48.793160 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:48.793445 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599528793422 us; error 0 us; skew 500 ppm
I20260709 12:18:48.794436 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:48.801529 22701 webserver.cc:533] Webserver started at http://127.22.43.66:40165/ using document root <none> and password file <none>
I20260709 12:18:48.802148 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:48.802279 22861 heartbeater.cc:344] Connected to a master server at 127.22.43.126:34023
I20260709 12:18:48.802425 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:48.802767 22861 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:48.802778 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:48.804077 22861 heartbeater.cc:507] Master 127.22.43.126:34023 requested a full tablet report, sending...
I20260709 12:18:48.804450 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-1-root/instance:
uuid: "50e7eefc7699487eaa0f1b500916f17e"
format_stamp: "Formatted at 2026-07-09 12:18:48 on dist-test-slave-0768"
I20260709 12:18:48.808080 22733 ts_manager.cc:194] Registered new tserver with Master: 89017b6621424a6696e49f037d524851 (127.22.43.65:45213)
I20260709 12:18:48.811354 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:18:48.811573 22733 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49982
I20260709 12:18:48.816259 22873 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:48.817194 22701 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:18:48.817564 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-1-root
uuid: "50e7eefc7699487eaa0f1b500916f17e"
format_stamp: "Formatted at 2026-07-09 12:18:48 on dist-test-slave-0768"
I20260709 12:18:48.817981 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:48.835244 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:48.837095 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:48.840027 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:48.844054 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:48.844354 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:48.844661 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:48.844898 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:48.952827 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.66:36561
I20260709 12:18:48.952929 22936 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.66:36561 every 8 connection(s)
I20260709 12:18:48.961496 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:48.970501 22940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:48.976557 22937 heartbeater.cc:344] Connected to a master server at 127.22.43.126:34023
I20260709 12:18:48.977097 22937 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:48.978456 22937 heartbeater.cc:507] Master 127.22.43.126:34023 requested a full tablet report, sending...
I20260709 12:18:48.981447 22733 ts_manager.cc:194] Registered new tserver with Master: 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561)
I20260709 12:18:48.991281 22733 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49990
W20260709 12:18:48.998183 22941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:49.011826 22701 server_base.cc:1061] running on GCE node
W20260709 12:18:49.013381 22943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:49.014750 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:49.015087 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:49.015328 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599529015306 us; error 0 us; skew 500 ppm
I20260709 12:18:49.016260 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:49.019691 22701 webserver.cc:533] Webserver started at http://127.22.43.67:38187/ using document root <none> and password file <none>
I20260709 12:18:49.020248 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:49.020460 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:49.020747 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:49.021943 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-2-root/instance:
uuid: "c626837b190a4555a179db184c87451f"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-0768"
I20260709 12:18:49.026554 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:18:49.030263 22948 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:49.031097 22701 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:18:49.031410 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-2-root
uuid: "c626837b190a4555a179db184c87451f"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-0768"
I20260709 12:18:49.031730 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599526815862-22701-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:49.047819 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:49.049088 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:49.050889 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:49.053674 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:49.053942 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:49.054209 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:49.054389 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:49.142885 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.67:32807
I20260709 12:18:49.142979 23010 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.67:32807 every 8 connection(s)
I20260709 12:18:49.160619 23011 heartbeater.cc:344] Connected to a master server at 127.22.43.126:34023
I20260709 12:18:49.161038 23011 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:49.161832 23011 heartbeater.cc:507] Master 127.22.43.126:34023 requested a full tablet report, sending...
I20260709 12:18:49.163939 22733 ts_manager.cc:194] Registered new tserver with Master: c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:49.164482 22701 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014510823s
I20260709 12:18:49.165369 22733 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49996
I20260709 12:18:49.220547 22733 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50002:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:49.224556 22733 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:49.343055 22976 tablet_service.cc:1511] Processing CreateTablet for tablet af3b6df7fa7143b6bf42bcbaf55046ab (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:49.347934 22976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3b6df7fa7143b6bf42bcbaf55046ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.344389 22975 tablet_service.cc:1511] Processing CreateTablet for tablet 8a150d4ebdd44949aa163f29355354a8 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:49.348359 22972 tablet_service.cc:1511] Processing CreateTablet for tablet bbf1fd0b3bc5473bbe2dcf0b125be521 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:49.350999 22974 tablet_service.cc:1511] Processing CreateTablet for tablet b4bf1a2da1c84d1f82a3c33736f0a79e (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:49.351008 22973 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce773d57686424eb6c5b9fedc276c23 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:49.352092 22975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a150d4ebdd44949aa163f29355354a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.356503 22974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bf1a2da1c84d1f82a3c33736f0a79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.364746 22972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf1fd0b3bc5473bbe2dcf0b125be521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.367776 22825 tablet_service.cc:1511] Processing CreateTablet for tablet 8a150d4ebdd44949aa163f29355354a8 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:49.369906 22825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a150d4ebdd44949aa163f29355354a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.361370 22826 tablet_service.cc:1511] Processing CreateTablet for tablet af3b6df7fa7143b6bf42bcbaf55046ab (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:49.371444 22823 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce773d57686424eb6c5b9fedc276c23 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:49.374909 22973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce773d57686424eb6c5b9fedc276c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.370368 22971 tablet_service.cc:1511] Processing CreateTablet for tablet a8676a96c9094f15a144b8b5ab2ba9e2 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:49.374989 22822 tablet_service.cc:1511] Processing CreateTablet for tablet bbf1fd0b3bc5473bbe2dcf0b125be521 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:49.371049 22824 tablet_service.cc:1511] Processing CreateTablet for tablet b4bf1a2da1c84d1f82a3c33736f0a79e (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:49.379774 22826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3b6df7fa7143b6bf42bcbaf55046ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.381649 22821 tablet_service.cc:1511] Processing CreateTablet for tablet a8676a96c9094f15a144b8b5ab2ba9e2 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:49.383376 22823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce773d57686424eb6c5b9fedc276c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.384619 22971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8676a96c9094f15a144b8b5ab2ba9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.387867 22822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf1fd0b3bc5473bbe2dcf0b125be521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.391088 22824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bf1a2da1c84d1f82a3c33736f0a79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.395052 22820 tablet_service.cc:1511] Processing CreateTablet for tablet 77d85030295c4eb59727de692f2e140a (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:49.395165 22970 tablet_service.cc:1511] Processing CreateTablet for tablet 77d85030295c4eb59727de692f2e140a (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:49.398563 22970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d85030295c4eb59727de692f2e140a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.399748 22821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8676a96c9094f15a144b8b5ab2ba9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.403771 22820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d85030295c4eb59727de692f2e140a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.403287 22819 tablet_service.cc:1511] Processing CreateTablet for tablet fb5b9c40c9184e9d93dba40346d04fa0 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:49.410027 22819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb5b9c40c9184e9d93dba40346d04fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.455732 22969 tablet_service.cc:1511] Processing CreateTablet for tablet fb5b9c40c9184e9d93dba40346d04fa0 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:49.470896 22969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb5b9c40c9184e9d93dba40346d04fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.481142 22899 tablet_service.cc:1511] Processing CreateTablet for tablet b4bf1a2da1c84d1f82a3c33736f0a79e (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:49.485918 22899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bf1a2da1c84d1f82a3c33736f0a79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.480222 22897 tablet_service.cc:1511] Processing CreateTablet for tablet bbf1fd0b3bc5473bbe2dcf0b125be521 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:49.488804 22898 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce773d57686424eb6c5b9fedc276c23 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:49.494875 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf1fd0b3bc5473bbe2dcf0b125be521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.482270 22896 tablet_service.cc:1511] Processing CreateTablet for tablet a8676a96c9094f15a144b8b5ab2ba9e2 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:49.474926 22900 tablet_service.cc:1511] Processing CreateTablet for tablet 8a150d4ebdd44949aa163f29355354a8 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:49.488818 22895 tablet_service.cc:1511] Processing CreateTablet for tablet 77d85030295c4eb59727de692f2e140a (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:49.495043 22901 tablet_service.cc:1511] Processing CreateTablet for tablet af3b6df7fa7143b6bf42bcbaf55046ab (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:49.509719 22818 tablet_service.cc:1511] Processing CreateTablet for tablet 0fba284ca09c49e9b8c37b50ffb2eca5 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:49.506690 22894 tablet_service.cc:1511] Processing CreateTablet for tablet fb5b9c40c9184e9d93dba40346d04fa0 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:49.520049 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce773d57686424eb6c5b9fedc276c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.527169 22901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3b6df7fa7143b6bf42bcbaf55046ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.521960 22818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fba284ca09c49e9b8c37b50ffb2eca5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:49.520874 22781 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:49.533071 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8676a96c9094f15a144b8b5ab2ba9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.537384 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d85030295c4eb59727de692f2e140a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.546382 22900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a150d4ebdd44949aa163f29355354a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.571967 23029 tablet_bootstrap.cc:492] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851: Bootstrap starting.
I20260709 12:18:49.576764 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb5b9c40c9184e9d93dba40346d04fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.606809 22893 tablet_service.cc:1511] Processing CreateTablet for tablet 0fba284ca09c49e9b8c37b50ffb2eca5 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:49.610272 22893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fba284ca09c49e9b8c37b50ffb2eca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.620214 22968 tablet_service.cc:1511] Processing CreateTablet for tablet 0fba284ca09c49e9b8c37b50ffb2eca5 (DEFAULT_TABLE table=test-workload [id=705b69ac69834e9e8e7482069c986ba6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:49.626331 22968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fba284ca09c49e9b8c37b50ffb2eca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.632759 23029 tablet_bootstrap.cc:654] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.664460 23030 tablet_bootstrap.cc:492] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f: Bootstrap starting.
I20260709 12:18:49.711036 23032 tablet_bootstrap.cc:492] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e: Bootstrap starting.
I20260709 12:18:49.713495 23030 tablet_bootstrap.cc:654] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.738572 23029 tablet_bootstrap.cc:492] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851: No bootstrap required, opened a new log
I20260709 12:18:49.739696 23029 ts_tablet_manager.cc:1403] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851: Time spent bootstrapping tablet: real 0.172s	user 0.022s	sys 0.058s
I20260709 12:18:49.743870 23032 tablet_bootstrap.cc:654] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.745604 23029 raft_consensus.cc:359] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:49.746659 23029 raft_consensus.cc:385] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.746958 23029 raft_consensus.cc:740] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.747982 23030 tablet_bootstrap.cc:492] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f: No bootstrap required, opened a new log
I20260709 12:18:49.748682 23030 ts_tablet_manager.cc:1403] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.011s
I20260709 12:18:49.747952 23029 consensus_queue.cc:260] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:49.753983 22861 heartbeater.cc:499] Master 127.22.43.126:34023 was elected leader, sending a full tablet report...
I20260709 12:18:49.754321 23032 tablet_bootstrap.cc:492] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e: No bootstrap required, opened a new log
I20260709 12:18:49.754501 23029 ts_tablet_manager.cc:1434] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.007s
I20260709 12:18:49.754791 23032 ts_tablet_manager.cc:1403] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.009s
I20260709 12:18:49.755643 23029 tablet_bootstrap.cc:492] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851: Bootstrap starting.
I20260709 12:18:49.757603 23032 raft_consensus.cc:359] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.758343 23032 raft_consensus.cc:385] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.758627 23032 raft_consensus.cc:740] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.759361 23032 consensus_queue.cc:260] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.762312 23029 tablet_bootstrap.cc:654] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.753364 23030 raft_consensus.cc:359] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.771230 22937 heartbeater.cc:499] Master 127.22.43.126:34023 was elected leader, sending a full tablet report...
W20260709 12:18:49.771257 22862 tablet.cc:2406] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:18:49.771735 23032 ts_tablet_manager.cc:1434] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e: Time spent starting tablet: real 0.017s	user 0.014s	sys 0.003s
I20260709 12:18:49.773557 23032 tablet_bootstrap.cc:492] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e: Bootstrap starting.
I20260709 12:18:49.777760 23030 raft_consensus.cc:385] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.778370 23030 raft_consensus.cc:740] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c626837b190a4555a179db184c87451f, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.780129 23032 tablet_bootstrap.cc:654] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.781454 23030 consensus_queue.cc:260] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.792671 23011 heartbeater.cc:499] Master 127.22.43.126:34023 was elected leader, sending a full tablet report...
I20260709 12:18:49.794855 23030 ts_tablet_manager.cc:1434] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f: Time spent starting tablet: real 0.046s	user 0.013s	sys 0.003s
I20260709 12:18:49.795470 23035 raft_consensus.cc:493] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.796294 23030 tablet_bootstrap.cc:492] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f: Bootstrap starting.
I20260709 12:18:49.795979 23035 raft_consensus.cc:515] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:49.797066 23029 tablet_bootstrap.cc:492] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851: No bootstrap required, opened a new log
I20260709 12:18:49.799396 23035 leader_election.cc:290] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c626837b190a4555a179db184c87451f (127.22.43.67:32807), 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561)
I20260709 12:18:49.806394 23029 ts_tablet_manager.cc:1403] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851: Time spent bootstrapping tablet: real 0.051s	user 0.027s	sys 0.002s
I20260709 12:18:49.809787 23032 tablet_bootstrap.cc:492] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e: No bootstrap required, opened a new log
I20260709 12:18:49.810413 23032 ts_tablet_manager.cc:1403] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.013s
I20260709 12:18:49.811810 23029 raft_consensus.cc:359] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.812562 23029 raft_consensus.cc:385] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.812863 23029 raft_consensus.cc:740] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.813628 23029 consensus_queue.cc:260] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.815814 23029 ts_tablet_manager.cc:1434] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:49.817730 23029 tablet_bootstrap.cc:492] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851: Bootstrap starting.
I20260709 12:18:49.824339 23030 tablet_bootstrap.cc:654] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.840123 23032 raft_consensus.cc:359] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.840921 23032 raft_consensus.cc:385] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.841235 23032 raft_consensus.cc:740] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.844316 23032 consensus_queue.cc:260] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.846372 23032 ts_tablet_manager.cc:1434] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:18:49.847234 23032 tablet_bootstrap.cc:492] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e: Bootstrap starting.
I20260709 12:18:49.847349 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
I20260709 12:18:49.850504 23029 tablet_bootstrap.cc:654] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:49.851963 22802 leader_election.cc:343] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c626837b190a4555a179db184c87451f (127.22.43.67:32807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:49.883482 23032 tablet_bootstrap.cc:654] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.884225 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e" is_pre_election: true
W20260709 12:18:49.885915 22801 leader_election.cc:343] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:49.886447 22801 leader_election.cc:304] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89017b6621424a6696e49f037d524851; no voters: 50e7eefc7699487eaa0f1b500916f17e, c626837b190a4555a179db184c87451f
I20260709 12:18:49.887380 23035 raft_consensus.cc:2749] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:49.888062 23029 tablet_bootstrap.cc:492] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851: No bootstrap required, opened a new log
I20260709 12:18:49.888414 23029 ts_tablet_manager.cc:1403] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.002s
I20260709 12:18:49.892103 23030 tablet_bootstrap.cc:492] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f: No bootstrap required, opened a new log
I20260709 12:18:49.891861 23029 raft_consensus.cc:359] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.892668 23030 ts_tablet_manager.cc:1403] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f: Time spent bootstrapping tablet: real 0.097s	user 0.019s	sys 0.006s
I20260709 12:18:49.892872 23029 raft_consensus.cc:385] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.893293 23029 raft_consensus.cc:740] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.894325 23029 consensus_queue.cc:260] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.896908 23029 ts_tablet_manager.cc:1434] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:18:49.897253 23032 tablet_bootstrap.cc:492] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e: No bootstrap required, opened a new log
I20260709 12:18:49.897706 23032 ts_tablet_manager.cc:1403] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.006s
I20260709 12:18:49.897905 23029 tablet_bootstrap.cc:492] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851: Bootstrap starting.
I20260709 12:18:49.900588 23032 raft_consensus.cc:359] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.901374 23032 raft_consensus.cc:385] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.901715 23032 raft_consensus.cc:740] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.902660 23032 consensus_queue.cc:260] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.905483 23029 tablet_bootstrap.cc:654] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.907505 23032 ts_tablet_manager.cc:1434] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:18:49.908502 23032 tablet_bootstrap.cc:492] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e: Bootstrap starting.
I20260709 12:18:49.908437 23030 raft_consensus.cc:359] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.909519 23030 raft_consensus.cc:385] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.909862 23030 raft_consensus.cc:740] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c626837b190a4555a179db184c87451f, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.911581 23030 consensus_queue.cc:260] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.919584 23032 tablet_bootstrap.cc:654] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.920302 23030 ts_tablet_manager.cc:1434] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:18:49.927562 23030 tablet_bootstrap.cc:492] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f: Bootstrap starting.
I20260709 12:18:49.934661 23030 tablet_bootstrap.cc:654] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.936064 23032 tablet_bootstrap.cc:492] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e: No bootstrap required, opened a new log
I20260709 12:18:49.936321 23029 tablet_bootstrap.cc:492] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851: No bootstrap required, opened a new log
I20260709 12:18:49.936573 23032 ts_tablet_manager.cc:1403] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.012s
I20260709 12:18:49.936748 23029 ts_tablet_manager.cc:1403] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.018s
I20260709 12:18:49.939625 23029 raft_consensus.cc:359] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.939898 23032 raft_consensus.cc:359] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.940393 23029 raft_consensus.cc:385] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.940558 23032 raft_consensus.cc:385] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.940732 23029 raft_consensus.cc:740] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.940881 23032 raft_consensus.cc:740] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.941519 23029 consensus_queue.cc:260] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.941696 23032 consensus_queue.cc:260] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.944075 23029 ts_tablet_manager.cc:1434] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:18:49.945043 23029 tablet_bootstrap.cc:492] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851: Bootstrap starting.
I20260709 12:18:49.951570 23029 tablet_bootstrap.cc:654] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.952203 23032 ts_tablet_manager.cc:1434] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:18:49.953263 23032 tablet_bootstrap.cc:492] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e: Bootstrap starting.
I20260709 12:18:49.956972 23035 raft_consensus.cc:493] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.957455 23035 raft_consensus.cc:515] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.959652 23035 leader_election.cc:290] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:49.960695 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a150d4ebdd44949aa163f29355354a8" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e" is_pre_election: true
I20260709 12:18:49.961382 22911 raft_consensus.cc:2468] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 0.
I20260709 12:18:49.962924 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a150d4ebdd44949aa163f29355354a8" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
I20260709 12:18:49.963542 22986 raft_consensus.cc:2468] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 0.
I20260709 12:18:49.965219 22802 leader_election.cc:304] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:18:49.965821 23032 tablet_bootstrap.cc:654] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.966019 23035 raft_consensus.cc:2804] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:49.966364 23035 raft_consensus.cc:493] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.966738 23035 raft_consensus.cc:3060] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:49.967537 23030 tablet_bootstrap.cc:492] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f: No bootstrap required, opened a new log
I20260709 12:18:49.968039 23030 ts_tablet_manager.cc:1403] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.011s
I20260709 12:18:49.971297 23030 raft_consensus.cc:359] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.972054 23030 raft_consensus.cc:385] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.972431 23030 raft_consensus.cc:740] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c626837b190a4555a179db184c87451f, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.973397 23030 consensus_queue.cc:260] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.979341 23029 tablet_bootstrap.cc:492] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851: No bootstrap required, opened a new log
I20260709 12:18:49.980052 23029 ts_tablet_manager.cc:1403] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.008s
I20260709 12:18:49.982642 23030 ts_tablet_manager.cc:1434] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:18:49.984131 23029 raft_consensus.cc:359] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.985191 23029 raft_consensus.cc:385] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.986682 23035 raft_consensus.cc:515] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.985579 23029 raft_consensus.cc:740] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.990219 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a150d4ebdd44949aa163f29355354a8" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:18:49.990129 23029 consensus_queue.cc:260] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:49.990900 22911 raft_consensus.cc:3060] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:49.992645 23035 leader_election.cc:290] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Requested vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:49.997721 23030 tablet_bootstrap.cc:492] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f: Bootstrap starting.
I20260709 12:18:49.997071 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a150d4ebdd44949aa163f29355354a8" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:18:49.999269 22986 raft_consensus.cc:3060] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.001856 23029 ts_tablet_manager.cc:1434] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851: Time spent starting tablet: real 0.021s	user 0.015s	sys 0.001s
I20260709 12:18:50.002907 23029 tablet_bootstrap.cc:492] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851: Bootstrap starting.
I20260709 12:18:50.003656 23036 raft_consensus.cc:493] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.004141 23036 raft_consensus.cc:515] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.008368 23036 leader_election.cc:290] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.010689 23032 tablet_bootstrap.cc:492] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e: No bootstrap required, opened a new log
I20260709 12:18:50.014844 23032 ts_tablet_manager.cc:1403] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.033s
I20260709 12:18:50.026026 23030 tablet_bootstrap.cc:654] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.028522 22911 raft_consensus.cc:2468] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 1.
I20260709 12:18:50.027055 22986 raft_consensus.cc:2468] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 1.
I20260709 12:18:50.035606 23032 raft_consensus.cc:359] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.036757 23032 raft_consensus.cc:385] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.037312 22802 leader_election.cc:304] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:18:50.038445 23050 raft_consensus.cc:2804] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.038992 23050 raft_consensus.cc:697] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Leader. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:18:50.039844 23050 consensus_queue.cc:237] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.037451 23032 raft_consensus.cc:740] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.041481 23032 consensus_queue.cc:260] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.045136 23029 tablet_bootstrap.cc:654] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.046810 23036 raft_consensus.cc:493] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.047348 23036 raft_consensus.cc:515] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.049643 23036 leader_election.cc:290] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.052249 23032 ts_tablet_manager.cc:1434] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.004s
I20260709 12:18:50.061388 23032 tablet_bootstrap.cc:492] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e: Bootstrap starting.
I20260709 12:18:50.063871 22985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb5b9c40c9184e9d93dba40346d04fa0" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
I20260709 12:18:50.065027 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
W20260709 12:18:50.067044 22877 leader_election.cc:343] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c626837b190a4555a179db184c87451f (127.22.43.67:32807): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:50.067781 22877 leader_election.cc:343] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c626837b190a4555a179db184c87451f (127.22.43.67:32807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.069954 23030 tablet_bootstrap.cc:492] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f: No bootstrap required, opened a new log
I20260709 12:18:50.069800 22835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb5b9c40c9184e9d93dba40346d04fa0" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89017b6621424a6696e49f037d524851" is_pre_election: true
I20260709 12:18:50.071159 23030 ts_tablet_manager.cc:1403] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.003s
I20260709 12:18:50.071614 22835 raft_consensus.cc:2468] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 0.
I20260709 12:18:50.071506 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89017b6621424a6696e49f037d524851" is_pre_election: true
I20260709 12:18:50.079708 22875 leader_election.cc:304] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: c626837b190a4555a179db184c87451f
I20260709 12:18:50.081271 23036 raft_consensus.cc:2804] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:18:50.081347 22875 leader_election.cc:343] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89017b6621424a6696e49f037d524851 (127.22.43.65:45213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.081821 23036 raft_consensus.cc:493] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.081538 23030 raft_consensus.cc:359] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.081919 22875 leader_election.cc:304] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e; no voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f
I20260709 12:18:50.082392 23030 raft_consensus.cc:385] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.082347 23036 raft_consensus.cc:3060] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.082834 23030 raft_consensus.cc:740] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c626837b190a4555a179db184c87451f, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.087617 22730 catalog_manager.cc:5697] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89017b6621424a6696e49f037d524851 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "89017b6621424a6696e49f037d524851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.086750 23030 consensus_queue.cc:260] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.092247 23036 raft_consensus.cc:515] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.094103 23030 ts_tablet_manager.cc:1434] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:18:50.094537 23029 tablet_bootstrap.cc:492] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851: No bootstrap required, opened a new log
I20260709 12:18:50.095098 23029 ts_tablet_manager.cc:1403] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.011s
I20260709 12:18:50.098109 23032 tablet_bootstrap.cc:654] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.098640 23029 raft_consensus.cc:359] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.099521 23029 raft_consensus.cc:385] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.099916 23029 raft_consensus.cc:740] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.100765 23029 consensus_queue.cc:260] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.102700 23057 raft_consensus.cc:2749] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:50.105023 23036 leader_election.cc:290] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.106437 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb5b9c40c9184e9d93dba40346d04fa0" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f"
W20260709 12:18:50.108011 22877 leader_election.cc:343] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c626837b190a4555a179db184c87451f (127.22.43.67:32807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.108563 23029 ts_tablet_manager.cc:1434] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:18:50.109225 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb5b9c40c9184e9d93dba40346d04fa0" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:18:50.109730 23029 tablet_bootstrap.cc:492] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851: Bootstrap starting.
I20260709 12:18:50.109807 22836 raft_consensus.cc:3060] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.112277 23032 tablet_bootstrap.cc:492] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e: No bootstrap required, opened a new log
I20260709 12:18:50.112783 23032 ts_tablet_manager.cc:1403] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.004s
I20260709 12:18:50.116328 23032 raft_consensus.cc:359] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:50.117147 23032 raft_consensus.cc:385] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.117182 22836 raft_consensus.cc:2468] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 1.
I20260709 12:18:50.117556 23032 raft_consensus.cc:740] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.118876 23032 consensus_queue.cc:260] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:50.119326 22875 leader_election.cc:304] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: c626837b190a4555a179db184c87451f
I20260709 12:18:50.122007 23032 ts_tablet_manager.cc:1434] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 12:18:50.123284 23032 tablet_bootstrap.cc:492] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e: Bootstrap starting.
I20260709 12:18:50.124119 23036 raft_consensus.cc:2804] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.124692 23036 raft_consensus.cc:697] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Becoming Leader. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:18:50.125602 23036 consensus_queue.cc:237] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.130900 23030 tablet_bootstrap.cc:492] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f: Bootstrap starting.
I20260709 12:18:50.131664 23032 tablet_bootstrap.cc:654] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.117540 23029 tablet_bootstrap.cc:654] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.142338 23050 raft_consensus.cc:493] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.143193 23050 raft_consensus.cc:515] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.145099 23030 tablet_bootstrap.cc:654] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.146831 23050 leader_election.cc:290] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.151302 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
I20260709 12:18:50.152279 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e" is_pre_election: true
I20260709 12:18:50.152989 22911 raft_consensus.cc:2468] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 0.
I20260709 12:18:50.154264 22801 leader_election.cc:304] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: 
I20260709 12:18:50.155066 23050 raft_consensus.cc:2804] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.155550 23050 raft_consensus.cc:493] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:50.155570 22802 leader_election.cc:343] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c626837b190a4555a179db184c87451f (127.22.43.67:32807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.156132 23050 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.164673 23029 tablet_bootstrap.cc:492] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851: No bootstrap required, opened a new log
I20260709 12:18:50.165202 23029 ts_tablet_manager.cc:1403] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851: Time spent bootstrapping tablet: real 0.056s	user 0.006s	sys 0.008s
I20260709 12:18:50.166456 23032 tablet_bootstrap.cc:492] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e: No bootstrap required, opened a new log
I20260709 12:18:50.166924 23032 ts_tablet_manager.cc:1403] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.018s
I20260709 12:18:50.168305 23029 raft_consensus.cc:359] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.169034 23029 raft_consensus.cc:385] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.169351 23029 raft_consensus.cc:740] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.169778 23032 raft_consensus.cc:359] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.170521 23032 raft_consensus.cc:385] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.170126 23029 consensus_queue.cc:260] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.170859 23032 raft_consensus.cc:740] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.172569 23029 ts_tablet_manager.cc:1434] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:50.173571 23029 tablet_bootstrap.cc:492] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851: Bootstrap starting.
I20260709 12:18:50.177148 23050 raft_consensus.cc:515] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.179993 23036 raft_consensus.cc:493] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.180282 23029 tablet_bootstrap.cc:654] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.180439 23036 raft_consensus.cc:515] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.181041 22731 catalog_manager.cc:5697] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e reported cstate change: term changed from 0 to 1, leader changed from <none> to 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66). New cstate: current_term: 1 leader_uuid: "50e7eefc7699487eaa0f1b500916f17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.182565 23036 leader_election.cc:290] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.183794 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d85030295c4eb59727de692f2e140a" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
I20260709 12:18:50.184368 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d85030295c4eb59727de692f2e140a" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89017b6621424a6696e49f037d524851" is_pre_election: true
I20260709 12:18:50.184430 22986 raft_consensus.cc:2468] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 0.
I20260709 12:18:50.185070 22836 raft_consensus.cc:2468] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 0.
I20260709 12:18:50.185840 22877 leader_election.cc:304] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:18:50.185992 23035 raft_consensus.cc:493] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.186635 23035 raft_consensus.cc:515] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.188565 23035 leader_election.cc:290] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.190055 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
I20260709 12:18:50.190667 22986 raft_consensus.cc:2468] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 0.
I20260709 12:18:50.191586 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e" is_pre_election: true
I20260709 12:18:50.191861 22802 leader_election.cc:304] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:18:50.192406 23036 raft_consensus.cc:2804] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.192768 23036 raft_consensus.cc:493] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.193104 23036 raft_consensus.cc:3060] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.195953 23050 leader_election.cc:290] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Requested vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.196542 23050 raft_consensus.cc:2804] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.196902 23050 raft_consensus.cc:493] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.197175 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:18:50.198489 22910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:18:50.199156 22910 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:50.203033 22802 leader_election.cc:343] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c626837b190a4555a179db184c87451f (127.22.43.67:32807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.197239 23050 raft_consensus.cc:3060] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.171590 23032 consensus_queue.cc:260] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.205251 22911 raft_consensus.cc:2468] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 0.
I20260709 12:18:50.209654 22910 raft_consensus.cc:2468] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 1.
I20260709 12:18:50.214959 22801 leader_election.cc:304] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: c626837b190a4555a179db184c87451f
I20260709 12:18:50.204202 23036 raft_consensus.cc:515] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.215953 23035 raft_consensus.cc:2804] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.221078 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d85030295c4eb59727de692f2e140a" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:18:50.221670 22836 raft_consensus.cc:3060] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.222276 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d85030295c4eb59727de692f2e140a" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:18:50.222904 23032 ts_tablet_manager.cc:1434] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 12:18:50.222833 22986 raft_consensus.cc:3060] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.223958 23032 tablet_bootstrap.cc:492] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e: Bootstrap starting.
I20260709 12:18:50.216207 23050 raft_consensus.cc:515] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.226661 23057 raft_consensus.cc:493] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.227285 23057 raft_consensus.cc:515] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:50.225996 23036 leader_election.cc:290] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.231750 22910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:18:50.232359 22910 raft_consensus.cc:3060] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.232472 23050 leader_election.cc:290] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Requested vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.230866 23035 raft_consensus.cc:697] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Leader. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:18:50.235975 22984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
I20260709 12:18:50.237289 22985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:18:50.238297 22985 raft_consensus.cc:3060] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.242249 23030 tablet_bootstrap.cc:492] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f: No bootstrap required, opened a new log
I20260709 12:18:50.242815 23030 ts_tablet_manager.cc:1403] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.003s
W20260709 12:18:50.238972 22877 leader_election.cc:343] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c626837b190a4555a179db184c87451f (127.22.43.67:32807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.242676 22835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89017b6621424a6696e49f037d524851" is_pre_election: true
I20260709 12:18:50.234579 23035 consensus_queue.cc:237] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.243456 22836 raft_consensus.cc:2468] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 1.
I20260709 12:18:50.243804 22835 raft_consensus.cc:2468] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 0.
I20260709 12:18:50.234922 23057 leader_election.cc:290] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.246559 22875 leader_election.cc:304] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: 
I20260709 12:18:50.246871 23029 tablet_bootstrap.cc:492] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851: No bootstrap required, opened a new log
I20260709 12:18:50.247401 23029 ts_tablet_manager.cc:1403] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.008s
I20260709 12:18:50.247496 22875 leader_election.cc:304] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: c626837b190a4555a179db184c87451f
I20260709 12:18:50.248639 23036 raft_consensus.cc:2804] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.249063 23057 raft_consensus.cc:2804] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.249614 23057 raft_consensus.cc:493] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.250042 23057 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.250192 22985 raft_consensus.cc:2468] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 1.
I20260709 12:18:50.254042 22802 leader_election.cc:304] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:18:50.250198 22910 raft_consensus.cc:2468] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 1.
I20260709 12:18:50.256721 23029 raft_consensus.cc:359] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.257864 23029 raft_consensus.cc:385] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.258353 23029 raft_consensus.cc:740] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.256042 23067 raft_consensus.cc:2804] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.259500 23067 raft_consensus.cc:697] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Leader. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:18:50.267606 22986 raft_consensus.cc:2468] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 1.
I20260709 12:18:50.260666 23067 consensus_queue.cc:237] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.277397 23032 tablet_bootstrap.cc:654] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.265652 23030 raft_consensus.cc:359] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.278446 23036 raft_consensus.cc:697] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Becoming Leader. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:18:50.278149 23030 raft_consensus.cc:385] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.279215 23030 raft_consensus.cc:740] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c626837b190a4555a179db184c87451f, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.280107 23030 consensus_queue.cc:260] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.279340 23036 consensus_queue.cc:237] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.278103 23029 consensus_queue.cc:260] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.284910 23029 ts_tablet_manager.cc:1434] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:18:50.285643 23029 tablet_bootstrap.cc:492] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851: Bootstrap starting.
I20260709 12:18:50.290015 23068 raft_consensus.cc:493] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.293203 23057 raft_consensus.cc:515] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:50.292434 23068 raft_consensus.cc:515] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.295138 23030 ts_tablet_manager.cc:1434] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f: Time spent starting tablet: real 0.052s	user 0.003s	sys 0.005s
I20260709 12:18:50.298951 23057 leader_election.cc:290] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.299755 22835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:18:50.300143 23030 tablet_bootstrap.cc:492] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f: Bootstrap starting.
I20260709 12:18:50.300323 22835 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.297175 22731 catalog_manager.cc:5697] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89017b6621424a6696e49f037d524851 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "89017b6621424a6696e49f037d524851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.311522 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:18:50.311643 23068 leader_election.cc:290] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.312341 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fba284ca09c49e9b8c37b50ffb2eca5" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89017b6621424a6696e49f037d524851" is_pre_election: true
I20260709 12:18:50.312997 22985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fba284ca09c49e9b8c37b50ffb2eca5" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
W20260709 12:18:50.314105 22877 leader_election.cc:343] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c626837b190a4555a179db184c87451f (127.22.43.67:32807): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:50.316282 22877 leader_election.cc:343] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c626837b190a4555a179db184c87451f (127.22.43.67:32807): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:50.316773 22875 leader_election.cc:343] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89017b6621424a6696e49f037d524851 (127.22.43.65:45213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.317227 22875 leader_election.cc:304] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e; no voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f
I20260709 12:18:50.318009 23068 raft_consensus.cc:2749] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:50.318264 22730 catalog_manager.cc:5697] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e reported cstate change: term changed from 0 to 1, leader changed from <none> to 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66). New cstate: current_term: 1 leader_uuid: "50e7eefc7699487eaa0f1b500916f17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.320386 23030 tablet_bootstrap.cc:654] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.325145 23029 tablet_bootstrap.cc:654] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.328159 22835 raft_consensus.cc:2468] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 1.
I20260709 12:18:50.330305 22875 leader_election.cc:304] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: c626837b190a4555a179db184c87451f
I20260709 12:18:50.332561 23068 raft_consensus.cc:2804] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.337620 23068 raft_consensus.cc:697] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Becoming Leader. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:18:50.338524 23068 consensus_queue.cc:237] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:50.341358 23035 raft_consensus.cc:493] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.343497 23035 raft_consensus.cc:515] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.345575 23035 leader_election.cc:290] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.348035 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
I20260709 12:18:50.348879 22986 raft_consensus.cc:2468] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 0.
I20260709 12:18:50.350528 22910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e" is_pre_election: true
I20260709 12:18:50.353715 22802 leader_election.cc:304] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:18:50.354667 23029 tablet_bootstrap.cc:492] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851: No bootstrap required, opened a new log
W20260709 12:18:50.354728 22801 leader_election.cc:343] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.355178 23029 ts_tablet_manager.cc:1403] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.000s
I20260709 12:18:50.355765 23035 raft_consensus.cc:2804] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.356211 23035 raft_consensus.cc:493] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.356658 23035 raft_consensus.cc:3060] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.363289 23035 raft_consensus.cc:515] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.366251 22910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:18:50.365938 22729 catalog_manager.cc:5697] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89017b6621424a6696e49f037d524851 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "89017b6621424a6696e49f037d524851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:50.367865 22801 leader_election.cc:343] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.369143 23035 leader_election.cc:290] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Requested vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.371943 23029 raft_consensus.cc:359] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.373982 23029 raft_consensus.cc:385] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.374321 23029 raft_consensus.cc:740] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.375197 23029 consensus_queue.cc:260] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.372803 23032 tablet_bootstrap.cc:492] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e: No bootstrap required, opened a new log
I20260709 12:18:50.373328 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:18:50.376519 23032 ts_tablet_manager.cc:1403] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e: Time spent bootstrapping tablet: real 0.153s	user 0.011s	sys 0.032s
I20260709 12:18:50.376523 22986 raft_consensus.cc:3060] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.379787 23030 tablet_bootstrap.cc:492] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f: No bootstrap required, opened a new log
I20260709 12:18:50.380281 23030 ts_tablet_manager.cc:1403] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.004s
I20260709 12:18:50.380570 23032 raft_consensus.cc:359] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.381240 23032 raft_consensus.cc:385] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.381507 23032 raft_consensus.cc:740] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.382349 23032 consensus_queue.cc:260] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.383569 23030 raft_consensus.cc:359] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:50.384341 23030 raft_consensus.cc:385] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.384672 23032 ts_tablet_manager.cc:1434] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:50.384693 23030 raft_consensus.cc:740] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c626837b190a4555a179db184c87451f, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.385684 23032 tablet_bootstrap.cc:492] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e: Bootstrap starting.
I20260709 12:18:50.385704 23030 consensus_queue.cc:260] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:50.388262 23030 ts_tablet_manager.cc:1434] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:50.389248 23030 tablet_bootstrap.cc:492] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f: Bootstrap starting.
I20260709 12:18:50.394240 22986 raft_consensus.cc:2468] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 1.
I20260709 12:18:50.377547 23029 ts_tablet_manager.cc:1434] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:18:50.376015 22731 catalog_manager.cc:5697] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e reported cstate change: term changed from 0 to 1, leader changed from <none> to 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66). New cstate: current_term: 1 leader_uuid: "50e7eefc7699487eaa0f1b500916f17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.396114 23030 tablet_bootstrap.cc:654] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.396520 23032 tablet_bootstrap.cc:654] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.398984 22802 leader_election.cc:304] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 50e7eefc7699487eaa0f1b500916f17e
I20260709 12:18:50.399984 23035 raft_consensus.cc:2804] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.400441 23035 raft_consensus.cc:697] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Leader. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:18:50.401216 23035 consensus_queue.cc:237] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.406881 23067 raft_consensus.cc:493] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.407447 23038 raft_consensus.cc:493] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.407364 23067 raft_consensus.cc:515] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.407908 23038 raft_consensus.cc:515] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.409484 23067 leader_election.cc:290] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.410328 23038 leader_election.cc:290] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561)
I20260709 12:18:50.410238 22910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e" is_pre_election: true
I20260709 12:18:50.410941 22910 raft_consensus.cc:2468] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 0.
I20260709 12:18:50.431775 22730 catalog_manager.cc:5697] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89017b6621424a6696e49f037d524851 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "89017b6621424a6696e49f037d524851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.437264 23030 tablet_bootstrap.cc:492] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f: No bootstrap required, opened a new log
I20260709 12:18:50.437768 23030 ts_tablet_manager.cc:1403] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.000s
I20260709 12:18:50.440544 23030 raft_consensus.cc:359] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.441293 23030 raft_consensus.cc:385] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.442193 22801 leader_election.cc:304] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: 
I20260709 12:18:50.443071 23035 raft_consensus.cc:2804] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.443426 23035 raft_consensus.cc:493] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.443778 23035 raft_consensus.cc:3060] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.447494 23032 tablet_bootstrap.cc:492] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e: No bootstrap required, opened a new log
I20260709 12:18:50.447979 23032 ts_tablet_manager.cc:1403] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.011s
I20260709 12:18:50.441604 23030 raft_consensus.cc:740] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c626837b190a4555a179db184c87451f, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.451215 23032 raft_consensus.cc:359] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.452219 23032 raft_consensus.cc:385] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.452591 23032 raft_consensus.cc:740] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.453560 23032 consensus_queue.cc:260] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.456120 23032 ts_tablet_manager.cc:1434] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:18:50.457001 23068 raft_consensus.cc:493] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.452618 23035 raft_consensus.cc:515] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.457430 23068 raft_consensus.cc:515] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.460021 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
I20260709 12:18:50.460654 22986 raft_consensus.cc:2468] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 0.
I20260709 12:18:50.461383 22835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89017b6621424a6696e49f037d524851" is_pre_election: true
I20260709 12:18:50.460793 23068 leader_election.cc:290] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.449383 23030 consensus_queue.cc:260] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.465045 23035 leader_election.cc:290] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Requested vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.465974 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
I20260709 12:18:50.466405 22910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:18:50.467453 22910 raft_consensus.cc:3060] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.467562 22986 raft_consensus.cc:2393] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50e7eefc7699487eaa0f1b500916f17e in current term 1: Already voted for candidate 89017b6621424a6696e49f037d524851 in this term.
I20260709 12:18:50.470191 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:18:50.469825 22877 leader_election.cc:304] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e; no voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f
I20260709 12:18:50.471239 22986 raft_consensus.cc:3060] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.471276 22835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89017b6621424a6696e49f037d524851" is_pre_election: true
I20260709 12:18:50.472127 22835 raft_consensus.cc:2393] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c626837b190a4555a179db184c87451f in current term 1: Already voted for candidate 89017b6621424a6696e49f037d524851 in this term.
I20260709 12:18:50.473160 23068 raft_consensus.cc:3060] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.474368 23030 ts_tablet_manager.cc:1434] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.004s
I20260709 12:18:50.475801 23030 tablet_bootstrap.cc:492] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f: Bootstrap starting.
I20260709 12:18:50.478732 22910 raft_consensus.cc:2468] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 1.
I20260709 12:18:50.480969 22801 leader_election.cc:304] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: 
I20260709 12:18:50.482205 23035 raft_consensus.cc:2804] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.482785 23035 raft_consensus.cc:697] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Leader. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:18:50.483911 23035 consensus_queue.cc:237] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.486009 23030 tablet_bootstrap.cc:654] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.485795 23068 raft_consensus.cc:2749] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:50.486722 22986 raft_consensus.cc:2468] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 1.
I20260709 12:18:50.491922 23038 raft_consensus.cc:493] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.492559 23038 raft_consensus.cc:515] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:50.497066 22835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89017b6621424a6696e49f037d524851" is_pre_election: true
I20260709 12:18:50.497870 22835 raft_consensus.cc:2393] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c626837b190a4555a179db184c87451f in current term 1: Already voted for candidate 50e7eefc7699487eaa0f1b500916f17e in this term.
I20260709 12:18:50.499256 23038 leader_election.cc:290] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561)
I20260709 12:18:50.503772 22731 catalog_manager.cc:5697] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89017b6621424a6696e49f037d524851 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "89017b6621424a6696e49f037d524851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.506633 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e" is_pre_election: true
I20260709 12:18:50.506786 22910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e" is_pre_election: true
I20260709 12:18:50.507519 22910 raft_consensus.cc:2393] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c626837b190a4555a179db184c87451f in current term 1: Already voted for candidate 89017b6621424a6696e49f037d524851 in this term.
I20260709 12:18:50.509485 22951 leader_election.cc:304] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c626837b190a4555a179db184c87451f; no voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851
I20260709 12:18:50.511214 22951 leader_election.cc:304] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c626837b190a4555a179db184c87451f; no voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851
I20260709 12:18:50.512190 23035 raft_consensus.cc:493] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.512710 23035 raft_consensus.cc:515] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.513098 23085 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.514878 23035 leader_election.cc:290] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.520138 23085 raft_consensus.cc:2749] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:50.520747 23085 raft_consensus.cc:2749] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:50.521670 22910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fba284ca09c49e9b8c37b50ffb2eca5" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e" is_pre_election: true
I20260709 12:18:50.522650 22910 raft_consensus.cc:2468] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 0.
I20260709 12:18:50.524178 22801 leader_election.cc:304] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: 
I20260709 12:18:50.524999 23035 raft_consensus.cc:2804] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.525352 23035 raft_consensus.cc:493] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.525662 23035 raft_consensus.cc:3060] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.530203 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fba284ca09c49e9b8c37b50ffb2eca5" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f" is_pre_election: true
W20260709 12:18:50.531540 22802 leader_election.cc:343] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c626837b190a4555a179db184c87451f (127.22.43.67:32807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.532897 23035 raft_consensus.cc:515] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.535291 23035 leader_election.cc:290] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Requested vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:50.535763 23030 tablet_bootstrap.cc:492] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f: No bootstrap required, opened a new log
I20260709 12:18:50.536386 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fba284ca09c49e9b8c37b50ffb2eca5" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:18:50.536689 23030 ts_tablet_manager.cc:1403] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f: Time spent bootstrapping tablet: real 0.061s	user 0.031s	sys 0.012s
I20260709 12:18:50.536872 22910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fba284ca09c49e9b8c37b50ffb2eca5" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:18:50.537422 22910 raft_consensus.cc:3060] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:50.537906 22802 leader_election.cc:343] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c626837b190a4555a179db184c87451f (127.22.43.67:32807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.539464 23030 raft_consensus.cc:359] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.540150 23030 raft_consensus.cc:385] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.540412 23030 raft_consensus.cc:740] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c626837b190a4555a179db184c87451f, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.541100 23030 consensus_queue.cc:260] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
W20260709 12:18:50.542119 22781 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:50.543181 23030 ts_tablet_manager.cc:1434] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:18:50.544078 23030 tablet_bootstrap.cc:492] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f: Bootstrap starting.
I20260709 12:18:50.546872 22910 raft_consensus.cc:2468] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 1.
I20260709 12:18:50.548151 22801 leader_election.cc:304] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: c626837b190a4555a179db184c87451f
I20260709 12:18:50.550181 23030 tablet_bootstrap.cc:654] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.548956 23035 raft_consensus.cc:2804] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.553776 23035 raft_consensus.cc:697] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Leader. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:18:50.554931 23035 consensus_queue.cc:237] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.559474 23067 consensus_queue.cc:1048] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:50.566334 23030 tablet_bootstrap.cc:492] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f: No bootstrap required, opened a new log
I20260709 12:18:50.566820 23030 ts_tablet_manager.cc:1403] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.012s
I20260709 12:18:50.567917 22731 catalog_manager.cc:5697] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89017b6621424a6696e49f037d524851 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "89017b6621424a6696e49f037d524851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.569468 23030 raft_consensus.cc:359] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.570142 23030 raft_consensus.cc:385] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.570466 23030 raft_consensus.cc:740] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c626837b190a4555a179db184c87451f, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.571211 23030 consensus_queue.cc:260] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:50.572657 23030 ts_tablet_manager.cc:1434] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:18:50.590154 23035 consensus_queue.cc:1048] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:50.684707 23035 consensus_queue.cc:1048] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:50.687620 22986 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.689697 22984 raft_consensus.cc:3060] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.699479 23068 consensus_queue.cc:1048] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:50.699561 23035 consensus_queue.cc:1048] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:50.707552 23035 consensus_queue.cc:1048] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:50.739321 23036 consensus_queue.cc:1048] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:50.748510 23036 consensus_queue.cc:1048] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:50.750912 23068 consensus_queue.cc:1048] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:50.759886 23067 consensus_queue.cc:1048] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:50.787995 23070 consensus_queue.cc:1048] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:50.820956 22910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
mode: GRACEFUL
new_leader_uuid: "89017b6621424a6696e49f037d524851"
 from {username='slave'} at 127.0.0.1:43846
I20260709 12:18:50.821669 22910 raft_consensus.cc:606] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Received request to transfer leadership to TS 89017b6621424a6696e49f037d524851
I20260709 12:18:50.829463 23036 raft_consensus.cc:993] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e: : Instructing follower 89017b6621424a6696e49f037d524851 to start an election
I20260709 12:18:50.829931 23036 raft_consensus.cc:1081] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Signalling peer 89017b6621424a6696e49f037d524851 to start an election
I20260709 12:18:50.840775 22836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab"
dest_uuid: "89017b6621424a6696e49f037d524851"
 from {username='slave'} at 127.0.0.1:54808
I20260709 12:18:50.841499 22836 raft_consensus.cc:493] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:50.841933 22836 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:50.849071 22836 raft_consensus.cc:515] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:50.853973 23057 consensus_queue.cc:1048] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:50.856510 23067 consensus_queue.cc:1048] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:50.859136 22985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:18:50.859731 22985 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:50.869925 22985 raft_consensus.cc:2468] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 2.
I20260709 12:18:50.871340 22802 leader_election.cc:304] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:18:50.873276 23067 raft_consensus.cc:2804] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:50.875420 22910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:18:50.875991 22910 raft_consensus.cc:3055] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:50.876317 22910 raft_consensus.cc:740] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:18:50.877156 22910 consensus_queue.cc:260] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:50.874302 23067 raft_consensus.cc:697] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 2 LEADER]: Becoming Leader. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:18:50.878476 22910 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:50.879235 23067 consensus_queue.cc:237] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:18:50.873301 22836 leader_election.cc:290] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 2 election: Requested vote from peers c626837b190a4555a179db184c87451f (127.22.43.67:32807), 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561)
I20260709 12:18:50.889067 22910 raft_consensus.cc:2468] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 2.
I20260709 12:18:50.890887 23067 consensus_queue.cc:1048] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:50.894934 22836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521"
dest_uuid: "89017b6621424a6696e49f037d524851"
mode: GRACEFUL
new_leader_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:18:50.895560 22836 raft_consensus.cc:606] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Received request to transfer leadership to TS 50e7eefc7699487eaa0f1b500916f17e
I20260709 12:18:50.905817 22836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2"
dest_uuid: "89017b6621424a6696e49f037d524851"
mode: GRACEFUL
new_leader_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:18:50.906504 22836 raft_consensus.cc:606] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Received request to transfer leadership to TS 50e7eefc7699487eaa0f1b500916f17e
I20260709 12:18:50.908602 22732 catalog_manager.cc:5697] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 reported cstate change: term changed from 1 to 2, leader changed from 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66) to 89017b6621424a6696e49f037d524851 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "89017b6621424a6696e49f037d524851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.920141 22836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fba284ca09c49e9b8c37b50ffb2eca5"
dest_uuid: "89017b6621424a6696e49f037d524851"
mode: GRACEFUL
new_leader_uuid: "c626837b190a4555a179db184c87451f"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:18:50.920791 22836 raft_consensus.cc:606] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Received request to transfer leadership to TS c626837b190a4555a179db184c87451f
I20260709 12:18:50.989092 22985 raft_consensus.cc:3060] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.995266 23067 consensus_queue.cc:1048] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.002297 23035 raft_consensus.cc:993] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851: : Instructing follower c626837b190a4555a179db184c87451f to start an election
I20260709 12:18:51.002799 23035 raft_consensus.cc:1081] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Signalling peer c626837b190a4555a179db184c87451f to start an election
I20260709 12:18:51.005241 22986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fba284ca09c49e9b8c37b50ffb2eca5"
dest_uuid: "c626837b190a4555a179db184c87451f"
 from {username='slave'} at 127.0.0.1:52200
I20260709 12:18:51.005913 22986 raft_consensus.cc:493] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.006372 22986 raft_consensus.cc:3060] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.009027 23035 consensus_queue.cc:1048] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.015317 22986 raft_consensus.cc:515] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:51.018380 22985 raft_consensus.cc:1240] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Rejecting Update request from peer 89017b6621424a6696e49f037d524851 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:51.018678 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fba284ca09c49e9b8c37b50ffb2eca5" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:18:51.018807 22910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fba284ca09c49e9b8c37b50ffb2eca5" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:18:51.019490 22836 raft_consensus.cc:3055] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:51.019928 22836 raft_consensus.cc:740] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:18:51.020864 22836 consensus_queue.cc:260] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:51.022547 22986 leader_election.cc:290] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 2 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561)
I20260709 12:18:51.024298 22836 raft_consensus.cc:3060] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.032721 23035 consensus_queue.cc:1048] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.038771 22836 raft_consensus.cc:2468] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c626837b190a4555a179db184c87451f in term 2.
I20260709 12:18:51.040130 22950 leader_election.cc:304] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 50e7eefc7699487eaa0f1b500916f17e
I20260709 12:18:51.041384 23038 raft_consensus.cc:2804] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:51.042956 23038 raft_consensus.cc:697] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 2 LEADER]: Becoming Leader. State: Replica: c626837b190a4555a179db184c87451f, State: Running, Role: LEADER
I20260709 12:18:51.043912 23038 consensus_queue.cc:237] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:51.053609 23035 consensus_queue.cc:1048] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:51.053812 22732 catalog_manager.cc:5697] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f reported cstate change: term changed from 1 to 2, leader changed from 89017b6621424a6696e49f037d524851 (127.22.43.65) to c626837b190a4555a179db184c87451f (127.22.43.67). New cstate: current_term: 2 leader_uuid: "c626837b190a4555a179db184c87451f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.055449 23067 raft_consensus.cc:993] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851: : Instructing follower 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:18:51.056216 23050 raft_consensus.cc:1081] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Signalling peer 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:18:51.058974 22911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:43832
I20260709 12:18:51.059545 22911 raft_consensus.cc:493] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.059963 22911 raft_consensus.cc:3060] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.068583 22911 raft_consensus.cc:515] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:51.069830 22910 raft_consensus.cc:1240] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Rejecting Update request from peer 89017b6621424a6696e49f037d524851 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:51.072198 23110 consensus_queue.cc:1059] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.073101 23110 raft_consensus.cc:3055] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:51.073454 23110 raft_consensus.cc:740] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:18:51.074520 23110 consensus_queue.cc:260] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:51.076128 23110 raft_consensus.cc:3060] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:51.079413 23067 consensus_queue.cc:1175] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c626837b190a4555a179db184c87451f" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:18:51.082846 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:18:51.083115 22985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:18:51.083781 22985 raft_consensus.cc:3060] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.088948 22911 leader_election.cc:290] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 2 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:51.093200 22985 raft_consensus.cc:2468] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 2.
I20260709 12:18:51.094863 22877 leader_election.cc:304] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:18:51.095619 23057 raft_consensus.cc:2804] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:51.095631 22836 raft_consensus.cc:2468] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 2.
I20260709 12:18:51.096215 23057 raft_consensus.cc:697] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Becoming Leader. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:18:51.097203 23057 consensus_queue.cc:237] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:51.105324 22731 catalog_manager.cc:5697] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e reported cstate change: term changed from 1 to 2, leader changed from 89017b6621424a6696e49f037d524851 (127.22.43.65) to 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66). New cstate: current_term: 2 leader_uuid: "50e7eefc7699487eaa0f1b500916f17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.304075 23067 raft_consensus.cc:993] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851: : Instructing follower 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:18:51.304593 23110 raft_consensus.cc:1081] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Signalling peer 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:18:51.306447 22911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:43832
I20260709 12:18:51.307252 22911 raft_consensus.cc:493] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.307650 22911 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.314361 22911 raft_consensus.cc:515] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:51.316459 22911 leader_election.cc:290] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 2 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:18:51.317410 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:18:51.317442 22985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:18:51.318081 22836 raft_consensus.cc:3055] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:51.318204 22985 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.318483 22836 raft_consensus.cc:740] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:18:51.319310 22836 consensus_queue.cc:260] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:51.320501 22836 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.324826 22836 raft_consensus.cc:2468] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 2.
I20260709 12:18:51.324947 22985 raft_consensus.cc:2468] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 2.
I20260709 12:18:51.326143 22877 leader_election.cc:304] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:18:51.326929 23057 raft_consensus.cc:2804] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:51.327365 23057 raft_consensus.cc:697] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Becoming Leader. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:18:51.328194 23057 consensus_queue.cc:237] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:51.334666 22731 catalog_manager.cc:5697] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e reported cstate change: term changed from 1 to 2, leader changed from 89017b6621424a6696e49f037d524851 (127.22.43.65) to 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66). New cstate: current_term: 2 leader_uuid: "50e7eefc7699487eaa0f1b500916f17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.374555 22985 raft_consensus.cc:1275] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Refusing update from remote peer 89017b6621424a6696e49f037d524851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:51.375955 23110 consensus_queue.cc:1048] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:51.384217 22911 raft_consensus.cc:1275] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Refusing update from remote peer 89017b6621424a6696e49f037d524851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:51.386615 23050 consensus_queue.cc:1048] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:51.472237 22911 raft_consensus.cc:3060] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.478279 22911 raft_consensus.cc:1275] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Refusing update from remote peer c626837b190a4555a179db184c87451f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:51.479701 23038 consensus_queue.cc:1048] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:51.497567 22836 raft_consensus.cc:1275] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Refusing update from remote peer c626837b190a4555a179db184c87451f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:51.499166 23038 consensus_queue.cc:1048] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:51.527617 22985 raft_consensus.cc:1275] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:51.529141 23057 consensus_queue.cc:1048] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.539322 22836 raft_consensus.cc:1275] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:51.541189 23057 consensus_queue.cc:1048] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:51.736836 22836 raft_consensus.cc:1275] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:51.738389 23057 consensus_queue.cc:1048] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:51.748345 22985 raft_consensus.cc:1275] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:51.749810 23036 consensus_queue.cc:1048] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.952905 22701 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:18:53.953991 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:53.979344 22836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e"
dest_uuid: "89017b6621424a6696e49f037d524851"
mode: GRACEFUL
new_leader_uuid: "c626837b190a4555a179db184c87451f"
 from {username='slave'} at 127.0.0.1:54834
I20260709 12:18:53.979934 22836 raft_consensus.cc:606] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Received request to transfer leadership to TS c626837b190a4555a179db184c87451f
I20260709 12:18:53.991097 22911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
mode: GRACEFUL
new_leader_uuid: "c626837b190a4555a179db184c87451f"
 from {username='slave'} at 127.0.0.1:43862
I20260709 12:18:53.991650 22911 raft_consensus.cc:606] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Received request to transfer leadership to TS c626837b190a4555a179db184c87451f
I20260709 12:18:53.992960 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:53.993508 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:54.091382 23057 raft_consensus.cc:993] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e: : Instructing follower c626837b190a4555a179db184c87451f to start an election
I20260709 12:18:54.091921 23123 raft_consensus.cc:1081] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Signalling peer c626837b190a4555a179db184c87451f to start an election
I20260709 12:18:54.093746 22986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521"
dest_uuid: "c626837b190a4555a179db184c87451f"
 from {username='slave'} at 127.0.0.1:52212
I20260709 12:18:54.094340 22986 raft_consensus.cc:493] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.094707 22986 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:54.099181 22986 raft_consensus.cc:515] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:54.100737 22986 leader_election.cc:290] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 3 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561)
I20260709 12:18:54.101697 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:18:54.101845 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:18:54.102268 22836 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:54.102421 22911 raft_consensus.cc:3055] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:54.102793 22911 raft_consensus.cc:740] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:18:54.103464 22911 consensus_queue.cc:260] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:54.104360 22911 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:54.107425 22836 raft_consensus.cc:2468] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c626837b190a4555a179db184c87451f in term 3.
I20260709 12:18:54.108512 22950 leader_election.cc:304] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:18:54.109294 23118 raft_consensus.cc:2804] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:54.109606 22911 raft_consensus.cc:2468] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c626837b190a4555a179db184c87451f in term 3.
I20260709 12:18:54.110651 23118 raft_consensus.cc:697] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 3 LEADER]: Becoming Leader. State: Replica: c626837b190a4555a179db184c87451f, State: Running, Role: LEADER
I20260709 12:18:54.111435 23118 consensus_queue.cc:237] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:54.118279 22732 catalog_manager.cc:5697] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f reported cstate change: term changed from 2 to 3, leader changed from 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66) to c626837b190a4555a179db184c87451f (127.22.43.67). New cstate: current_term: 3 leader_uuid: "c626837b190a4555a179db184c87451f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.411164 23116 raft_consensus.cc:993] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851: : Instructing follower c626837b190a4555a179db184c87451f to start an election
I20260709 12:18:54.411598 23130 raft_consensus.cc:1081] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Signalling peer c626837b190a4555a179db184c87451f to start an election
I20260709 12:18:54.413130 22986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e"
dest_uuid: "c626837b190a4555a179db184c87451f"
 from {username='slave'} at 127.0.0.1:52200
I20260709 12:18:54.413551 22986 raft_consensus.cc:493] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.413816 22986 raft_consensus.cc:3060] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.418210 22986 raft_consensus.cc:515] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:54.419876 22986 leader_election.cc:290] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 2 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561)
I20260709 12:18:54.420801 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:18:54.420828 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:18:54.421416 22836 raft_consensus.cc:3055] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:54.421617 22911 raft_consensus.cc:3060] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.421761 22836 raft_consensus.cc:740] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:18:54.422580 22836 consensus_queue.cc:260] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:54.423539 22836 raft_consensus.cc:3060] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.427615 22911 raft_consensus.cc:2468] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c626837b190a4555a179db184c87451f in term 2.
I20260709 12:18:54.428668 22836 raft_consensus.cc:2468] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c626837b190a4555a179db184c87451f in term 2.
I20260709 12:18:54.428865 22951 leader_election.cc:304] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:18:54.429811 23118 raft_consensus.cc:2804] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:54.430308 23118 raft_consensus.cc:697] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 2 LEADER]: Becoming Leader. State: Replica: c626837b190a4555a179db184c87451f, State: Running, Role: LEADER
I20260709 12:18:54.431109 23118 consensus_queue.cc:237] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:18:54.441455 22732 catalog_manager.cc:5697] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f reported cstate change: term changed from 1 to 2, leader changed from 89017b6621424a6696e49f037d524851 (127.22.43.65) to c626837b190a4555a179db184c87451f (127.22.43.67). New cstate: current_term: 2 leader_uuid: "c626837b190a4555a179db184c87451f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.622563 22911 raft_consensus.cc:1275] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Refusing update from remote peer c626837b190a4555a179db184c87451f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:54.623958 23118 consensus_queue.cc:1048] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:54.633605 22836 raft_consensus.cc:1275] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Refusing update from remote peer c626837b190a4555a179db184c87451f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:54.635510 23134 consensus_queue.cc:1048] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:54.816016 22911 raft_consensus.cc:1275] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Refusing update from remote peer c626837b190a4555a179db184c87451f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:54.817318 23134 consensus_queue.cc:1048] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:54.827791 22836 raft_consensus.cc:1275] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Refusing update from remote peer c626837b190a4555a179db184c87451f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:54.829416 23134 consensus_queue.cc:1048] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:54.994617 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:55.000015 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:55.000456 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:56.001396 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:56.007539 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:56.007937 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:57.033802 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:57.050853 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:57.051227 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:58.052197 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:58.056978 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:58.057335 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:59.058293 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:59.064446 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:59.064982 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:00.066217 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:00.073498 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:00.074028 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:01.075001 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:01.080286 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:01.080772 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:02.081797 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:02.086725 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:02.087184 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:03.088184 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:03.093675 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:03.094179 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:04.123914 22701 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:19:04.128719 22836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab"
dest_uuid: "89017b6621424a6696e49f037d524851"
mode: GRACEFUL
new_leader_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:19:04.129429 22836 raft_consensus.cc:606] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 2 LEADER]: Received request to transfer leadership to TS 50e7eefc7699487eaa0f1b500916f17e
I20260709 12:19:04.134598 22836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a150d4ebdd44949aa163f29355354a8"
dest_uuid: "89017b6621424a6696e49f037d524851"
mode: GRACEFUL
new_leader_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:19:04.135063 22836 raft_consensus.cc:606] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Received request to transfer leadership to TS 50e7eefc7699487eaa0f1b500916f17e
I20260709 12:19:04.154201 22986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e"
dest_uuid: "c626837b190a4555a179db184c87451f"
mode: GRACEFUL
new_leader_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:39886
I20260709 12:19:04.154753 22986 raft_consensus.cc:606] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 2 LEADER]: Received request to transfer leadership to TS 50e7eefc7699487eaa0f1b500916f17e
I20260709 12:19:04.160054 22836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23"
dest_uuid: "89017b6621424a6696e49f037d524851"
mode: GRACEFUL
new_leader_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:19:04.160567 22836 raft_consensus.cc:606] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Received request to transfer leadership to TS 50e7eefc7699487eaa0f1b500916f17e
I20260709 12:19:04.165941 22986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521"
dest_uuid: "c626837b190a4555a179db184c87451f"
mode: GRACEFUL
new_leader_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:39886
I20260709 12:19:04.166504 22986 raft_consensus.cc:606] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 3 LEADER]: Received request to transfer leadership to TS 50e7eefc7699487eaa0f1b500916f17e
I20260709 12:19:04.173923 23153 raft_consensus.cc:993] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851: : Instructing follower 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:19:04.174501 23148 raft_consensus.cc:1081] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 2 LEADER]: Signalling peer 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:19:04.176098 22911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:43832
I20260709 12:19:04.176616 22911 raft_consensus.cc:493] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.177069 22911 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:04.181959 22911 raft_consensus.cc:515] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:19:04.183715 22911 leader_election.cc:290] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 3 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:19:04.184722 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:19:04.184535 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:19:04.185284 22986 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:04.185379 22836 raft_consensus.cc:3055] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:04.185688 22836 raft_consensus.cc:740] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:19:04.186473 22836 consensus_queue.cc:260] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:19:04.187355 22836 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:04.189775 22986 raft_consensus.cc:2468] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 3.
I20260709 12:19:04.190997 22877 leader_election.cc:304] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:19:04.191886 23147 raft_consensus.cc:2804] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:04.192178 22836 raft_consensus.cc:2468] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 3.
I20260709 12:19:04.192974 23147 raft_consensus.cc:697] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 3 LEADER]: Becoming Leader. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:19:04.193964 23147 consensus_queue.cc:237] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:19:04.201769 22732 catalog_manager.cc:5697] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e reported cstate change: term changed from 2 to 3, leader changed from 89017b6621424a6696e49f037d524851 (127.22.43.65) to 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66). New cstate: current_term: 3 leader_uuid: "50e7eefc7699487eaa0f1b500916f17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:04.338266 23153 raft_consensus.cc:993] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851: : Instructing follower 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:19:04.338698 23148 raft_consensus.cc:1081] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Signalling peer 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:19:04.340016 22911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a150d4ebdd44949aa163f29355354a8"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:43832
I20260709 12:19:04.340404 22911 raft_consensus.cc:493] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.340629 22911 raft_consensus.cc:3060] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.344506 22911 raft_consensus.cc:515] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.345863 22911 leader_election.cc:290] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 2 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:19:04.346603 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a150d4ebdd44949aa163f29355354a8" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:19:04.346967 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a150d4ebdd44949aa163f29355354a8" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:19:04.347138 22836 raft_consensus.cc:3055] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:04.347451 22986 raft_consensus.cc:3060] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.347450 22836 raft_consensus.cc:740] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:19:04.348248 22836 consensus_queue.cc:260] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.349107 22836 raft_consensus.cc:3060] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.351686 22986 raft_consensus.cc:2468] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 2.
I20260709 12:19:04.352643 22877 leader_election.cc:304] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:19:04.353379 23147 raft_consensus.cc:2804] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:04.353379 22836 raft_consensus.cc:2468] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 2.
I20260709 12:19:04.354128 23147 raft_consensus.cc:697] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Becoming Leader. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:19:04.354988 23147 consensus_queue.cc:237] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.361146 22732 catalog_manager.cc:5697] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e reported cstate change: term changed from 1 to 2, leader changed from 89017b6621424a6696e49f037d524851 (127.22.43.65) to 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66). New cstate: current_term: 2 leader_uuid: "50e7eefc7699487eaa0f1b500916f17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.454667 23153 raft_consensus.cc:993] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851: : Instructing follower 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:19:04.455121 23148 raft_consensus.cc:1081] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Signalling peer 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:19:04.456380 22911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:43832
I20260709 12:19:04.456774 22911 raft_consensus.cc:493] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.457005 22911 raft_consensus.cc:3060] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.460863 22911 raft_consensus.cc:515] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.462350 22911 leader_election.cc:290] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 2 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:19:04.463155 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:19:04.463356 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:19:04.463711 22836 raft_consensus.cc:3055] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:04.463814 22986 raft_consensus.cc:3060] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.464047 22836 raft_consensus.cc:740] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:19:04.464725 22836 consensus_queue.cc:260] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.465811 22836 raft_consensus.cc:3060] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:04.469799 22986 raft_consensus.cc:2468] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 2.
I20260709 12:19:04.470836 22877 leader_election.cc:304] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:19:04.471465 22836 raft_consensus.cc:2468] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 2.
I20260709 12:19:04.471536 23147 raft_consensus.cc:2804] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:04.472072 23147 raft_consensus.cc:697] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Becoming Leader. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:19:04.472818 23147 consensus_queue.cc:237] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.479045 22732 catalog_manager.cc:5697] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e reported cstate change: term changed from 1 to 2, leader changed from 89017b6621424a6696e49f037d524851 (127.22.43.65) to 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66). New cstate: current_term: 2 leader_uuid: "50e7eefc7699487eaa0f1b500916f17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.486722 23163 raft_consensus.cc:993] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f: : Instructing follower 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:19:04.487201 23163 raft_consensus.cc:1081] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 3 LEADER]: Signalling peer 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:19:04.488547 22911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:43844
I20260709 12:19:04.488919 22911 raft_consensus.cc:493] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.489140 22911 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:04.493013 22911 raft_consensus.cc:515] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.494410 22911 leader_election.cc:290] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 4 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:19:04.495158 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:19:04.495462 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf1fd0b3bc5473bbe2dcf0b125be521" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:19:04.495728 22836 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:04.495966 22986 raft_consensus.cc:3055] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:04.496234 22986 raft_consensus.cc:740] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c626837b190a4555a179db184c87451f, State: Running, Role: LEADER
I20260709 12:19:04.496927 22986 consensus_queue.cc:260] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.498023 22986 raft_consensus.cc:3060] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:04.501523 22836 raft_consensus.cc:2468] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 4.
I20260709 12:19:04.502687 22875 leader_election.cc:304] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: 
I20260709 12:19:04.503374 23147 raft_consensus.cc:2804] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:04.503758 23147 raft_consensus.cc:697] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 4 LEADER]: Becoming Leader. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:19:04.503856 22986 raft_consensus.cc:2468] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 4.
I20260709 12:19:04.504581 23147 consensus_queue.cc:237] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.511380 22732 catalog_manager.cc:5697] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e reported cstate change: term changed from 3 to 4, leader changed from c626837b190a4555a179db184c87451f (127.22.43.67) to 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66). New cstate: current_term: 4 leader_uuid: "50e7eefc7699487eaa0f1b500916f17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.528721 23144 raft_consensus.cc:993] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f: : Instructing follower 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:19:04.529119 23163 raft_consensus.cc:1081] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 2 LEADER]: Signalling peer 50e7eefc7699487eaa0f1b500916f17e to start an election
I20260709 12:19:04.530488 22911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
 from {username='slave'} at 127.0.0.1:43844
I20260709 12:19:04.531028 22911 raft_consensus.cc:493] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.531301 22911 raft_consensus.cc:3060] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:04.535336 22911 raft_consensus.cc:515] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.536733 22911 leader_election.cc:290] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 3 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:19:04.537648 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:19:04.537676 22986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bf1a2da1c84d1f82a3c33736f0a79e" candidate_uuid: "50e7eefc7699487eaa0f1b500916f17e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:19:04.538463 22986 raft_consensus.cc:3055] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:04.538453 22836 raft_consensus.cc:3060] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:04.538983 22986 raft_consensus.cc:740] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c626837b190a4555a179db184c87451f, State: Running, Role: LEADER
I20260709 12:19:04.539816 22986 consensus_queue.cc:260] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.540979 22986 raft_consensus.cc:3060] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:04.545266 22836 raft_consensus.cc:2468] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 3.
I20260709 12:19:04.546381 22875 leader_election.cc:304] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e7eefc7699487eaa0f1b500916f17e, 89017b6621424a6696e49f037d524851; no voters: 
I20260709 12:19:04.547068 23147 raft_consensus.cc:2804] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:04.547155 22986 raft_consensus.cc:2468] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e7eefc7699487eaa0f1b500916f17e in term 3.
I20260709 12:19:04.547636 23147 raft_consensus.cc:697] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 3 LEADER]: Becoming Leader. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:19:04.548733 23147 consensus_queue.cc:237] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:04.556869 22732 catalog_manager.cc:5697] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e reported cstate change: term changed from 2 to 3, leader changed from c626837b190a4555a179db184c87451f (127.22.43.67) to 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66). New cstate: current_term: 3 leader_uuid: "50e7eefc7699487eaa0f1b500916f17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.670537 22836 raft_consensus.cc:1275] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:04.671868 23147 consensus_queue.cc:1048] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:04.682282 22986 raft_consensus.cc:1275] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:04.684080 23147 consensus_queue.cc:1048] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:04.779951 22836 raft_consensus.cc:1275] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:04.781363 23155 consensus_queue.cc:1048] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:04.790545 22986 raft_consensus.cc:1275] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:04.792127 23154 consensus_queue.cc:1048] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:04.912343 22836 raft_consensus.cc:1275] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:04.913756 23154 consensus_queue.cc:1048] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:04.929056 22986 raft_consensus.cc:1275] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:04.930505 23154 consensus_queue.cc:1048] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:04.980405 22986 raft_consensus.cc:1275] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:04.981842 23154 consensus_queue.cc:1048] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:04.991715 22836 raft_consensus.cc:1275] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:04.993064 23147 consensus_queue.cc:1048] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:05.080075 22986 raft_consensus.cc:1275] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 4 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:05.081378 23147 consensus_queue.cc:1048] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:05.090041 22836 raft_consensus.cc:1275] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 4 FOLLOWER]: Refusing update from remote peer 50e7eefc7699487eaa0f1b500916f17e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:05.091548 23147 consensus_queue.cc:1048] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:07.210896 22701 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:19:07.211807 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.219012 22911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77d85030295c4eb59727de692f2e140a"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
mode: GRACEFUL
new_leader_uuid: "c626837b190a4555a179db184c87451f"
 from {username='slave'} at 127.0.0.1:43862
I20260709 12:19:07.219828 22911 raft_consensus.cc:606] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Received request to transfer leadership to TS c626837b190a4555a179db184c87451f
I20260709 12:19:07.222822 22911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
mode: GRACEFUL
new_leader_uuid: "89017b6621424a6696e49f037d524851"
 from {username='slave'} at 127.0.0.1:43862
I20260709 12:19:07.223346 22911 raft_consensus.cc:606] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Received request to transfer leadership to TS 89017b6621424a6696e49f037d524851
I20260709 12:19:07.225945 22911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
mode: GRACEFUL
new_leader_uuid: "89017b6621424a6696e49f037d524851"
 from {username='slave'} at 127.0.0.1:43862
I20260709 12:19:07.226456 22911 raft_consensus.cc:606] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Received request to transfer leadership to TS 89017b6621424a6696e49f037d524851
I20260709 12:19:07.228844 22911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
mode: GRACEFUL
new_leader_uuid: "89017b6621424a6696e49f037d524851"
 from {username='slave'} at 127.0.0.1:43862
I20260709 12:19:07.229270 22911 raft_consensus.cc:606] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 3 LEADER]: Received request to transfer leadership to TS 89017b6621424a6696e49f037d524851
I20260709 12:19:07.231442 22911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb5b9c40c9184e9d93dba40346d04fa0"
dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
mode: GRACEFUL
new_leader_uuid: "c626837b190a4555a179db184c87451f"
 from {username='slave'} at 127.0.0.1:43862
I20260709 12:19:07.231973 22911 raft_consensus.cc:606] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Received request to transfer leadership to TS c626837b190a4555a179db184c87451f
I20260709 12:19:07.233067 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:07.233558 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:07.325009 23178 raft_consensus.cc:993] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e: : Instructing follower c626837b190a4555a179db184c87451f to start an election
I20260709 12:19:07.325562 23181 raft_consensus.cc:1081] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Signalling peer c626837b190a4555a179db184c87451f to start an election
I20260709 12:19:07.327328 22985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb5b9c40c9184e9d93dba40346d04fa0"
dest_uuid: "c626837b190a4555a179db184c87451f"
 from {username='slave'} at 127.0.0.1:52212
I20260709 12:19:07.327875 22985 raft_consensus.cc:493] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:07.328282 22985 raft_consensus.cc:3060] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:07.334574 22985 raft_consensus.cc:515] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.337106 22985 leader_election.cc:290] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 2 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561)
I20260709 12:19:07.338306 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb5b9c40c9184e9d93dba40346d04fa0" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:19:07.338158 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb5b9c40c9184e9d93dba40346d04fa0" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:19:07.338994 22836 raft_consensus.cc:3060] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:07.338966 22911 raft_consensus.cc:3055] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:07.339473 22911 raft_consensus.cc:740] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:19:07.340324 22911 consensus_queue.cc:260] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.341621 22911 raft_consensus.cc:3060] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:07.346257 22836 raft_consensus.cc:2468] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c626837b190a4555a179db184c87451f in term 2.
I20260709 12:19:07.347612 22950 leader_election.cc:304] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:19:07.347934 22911 raft_consensus.cc:2468] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c626837b190a4555a179db184c87451f in term 2.
I20260709 12:19:07.348503 23163 raft_consensus.cc:2804] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:07.349676 23163 raft_consensus.cc:697] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [term 2 LEADER]: Becoming Leader. State: Replica: c626837b190a4555a179db184c87451f, State: Running, Role: LEADER
I20260709 12:19:07.350526 23163 consensus_queue.cc:237] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.357290 22732 catalog_manager.cc:5697] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f reported cstate change: term changed from 1 to 2, leader changed from 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66) to c626837b190a4555a179db184c87451f (127.22.43.67). New cstate: current_term: 2 leader_uuid: "c626837b190a4555a179db184c87451f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.360363 23178 raft_consensus.cc:993] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e: : Instructing follower c626837b190a4555a179db184c87451f to start an election
I20260709 12:19:07.360874 23181 raft_consensus.cc:1081] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Signalling peer c626837b190a4555a179db184c87451f to start an election
I20260709 12:19:07.362659 22985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77d85030295c4eb59727de692f2e140a"
dest_uuid: "c626837b190a4555a179db184c87451f"
 from {username='slave'} at 127.0.0.1:52212
I20260709 12:19:07.363157 22985 raft_consensus.cc:493] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:07.363443 22985 raft_consensus.cc:3060] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:07.369942 22985 raft_consensus.cc:515] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.372026 22985 leader_election.cc:290] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 2 election: Requested vote from peers 89017b6621424a6696e49f037d524851 (127.22.43.65:45213), 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561)
I20260709 12:19:07.372920 22836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d85030295c4eb59727de692f2e140a" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89017b6621424a6696e49f037d524851"
I20260709 12:19:07.373261 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d85030295c4eb59727de692f2e140a" candidate_uuid: "c626837b190a4555a179db184c87451f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:19:07.373503 22836 raft_consensus.cc:3060] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:07.373803 22911 raft_consensus.cc:3055] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:07.374106 22911 raft_consensus.cc:740] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:19:07.374759 22911 consensus_queue.cc:260] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.375579 22911 raft_consensus.cc:3060] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:07.378140 22836 raft_consensus.cc:2468] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c626837b190a4555a179db184c87451f in term 2.
I20260709 12:19:07.379155 22950 leader_election.cc:304] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:19:07.379591 22911 raft_consensus.cc:2468] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c626837b190a4555a179db184c87451f in term 2.
I20260709 12:19:07.379948 23163 raft_consensus.cc:2804] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:07.380398 23163 raft_consensus.cc:697] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 2 LEADER]: Becoming Leader. State: Replica: c626837b190a4555a179db184c87451f, State: Running, Role: LEADER
I20260709 12:19:07.381266 23163 consensus_queue.cc:237] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.387856 22732 catalog_manager.cc:5697] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f reported cstate change: term changed from 1 to 2, leader changed from 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66) to c626837b190a4555a179db184c87451f (127.22.43.67). New cstate: current_term: 2 leader_uuid: "c626837b190a4555a179db184c87451f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.482277 23178 raft_consensus.cc:993] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e: : Instructing follower 89017b6621424a6696e49f037d524851 to start an election
I20260709 12:19:07.482645 23178 raft_consensus.cc:1081] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Signalling peer 89017b6621424a6696e49f037d524851 to start an election
I20260709 12:19:07.484154 22836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2"
dest_uuid: "89017b6621424a6696e49f037d524851"
 from {username='slave'} at 127.0.0.1:54808
I20260709 12:19:07.484647 22836 raft_consensus.cc:493] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:07.484946 22836 raft_consensus.cc:3060] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:07.489720 22836 raft_consensus.cc:515] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.491783 22836 leader_election.cc:290] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 3 election: Requested vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:19:07.492601 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:19:07.492950 22985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8676a96c9094f15a144b8b5ab2ba9e2" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:19:07.493180 22911 raft_consensus.cc:3055] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:07.493467 22911 raft_consensus.cc:740] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:19:07.493575 22985 raft_consensus.cc:3060] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:07.494309 22911 consensus_queue.cc:260] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.495479 22911 raft_consensus.cc:3060] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:07.499707 22985 raft_consensus.cc:2468] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 3.
I20260709 12:19:07.501015 22802 leader_election.cc:304] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:19:07.501199 22911 raft_consensus.cc:2468] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 3.
I20260709 12:19:07.502871 23189 raft_consensus.cc:2804] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:07.503856 23189 raft_consensus.cc:697] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 3 LEADER]: Becoming Leader. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:19:07.504551 23189 consensus_queue.cc:237] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.511967 22732 catalog_manager.cc:5697] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 reported cstate change: term changed from 2 to 3, leader changed from 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66) to 89017b6621424a6696e49f037d524851 (127.22.43.65). New cstate: current_term: 3 leader_uuid: "89017b6621424a6696e49f037d524851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.531498 23181 raft_consensus.cc:993] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e: : Instructing follower 89017b6621424a6696e49f037d524851 to start an election
I20260709 12:19:07.531944 23178 raft_consensus.cc:1081] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 3 LEADER]: Signalling peer 89017b6621424a6696e49f037d524851 to start an election
I20260709 12:19:07.533684 22836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab"
dest_uuid: "89017b6621424a6696e49f037d524851"
 from {username='slave'} at 127.0.0.1:54808
I20260709 12:19:07.534197 22836 raft_consensus.cc:493] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:07.534428 22836 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:07.538355 22836 raft_consensus.cc:515] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:19:07.539635 22836 leader_election.cc:290] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 4 election: Requested vote from peers c626837b190a4555a179db184c87451f (127.22.43.67:32807), 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561)
I20260709 12:19:07.540534 22985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:19:07.540654 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3b6df7fa7143b6bf42bcbaf55046ab" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:19:07.541113 22985 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:07.541168 22911 raft_consensus.cc:3055] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:07.541538 22911 raft_consensus.cc:740] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:19:07.542346 22911 consensus_queue.cc:260] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:19:07.543434 22911 raft_consensus.cc:3060] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:07.547231 22985 raft_consensus.cc:2468] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 4.
I20260709 12:19:07.548352 22802 leader_election.cc:304] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:19:07.549077 23189 raft_consensus.cc:2804] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:07.549103 22911 raft_consensus.cc:2468] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 4.
I20260709 12:19:07.549717 23189 raft_consensus.cc:697] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 4 LEADER]: Becoming Leader. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:19:07.550614 23189 consensus_queue.cc:237] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } }
I20260709 12:19:07.556824 22732 catalog_manager.cc:5697] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 reported cstate change: term changed from 3 to 4, leader changed from 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66) to 89017b6621424a6696e49f037d524851 (127.22.43.65). New cstate: current_term: 4 leader_uuid: "89017b6621424a6696e49f037d524851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.637405 23181 raft_consensus.cc:993] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e: : Instructing follower 89017b6621424a6696e49f037d524851 to start an election
I20260709 12:19:07.637868 23178 raft_consensus.cc:1081] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Signalling peer 89017b6621424a6696e49f037d524851 to start an election
I20260709 12:19:07.639161 22836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23"
dest_uuid: "89017b6621424a6696e49f037d524851"
 from {username='slave'} at 127.0.0.1:54808
I20260709 12:19:07.639660 22836 raft_consensus.cc:493] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:07.639972 22836 raft_consensus.cc:3060] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:07.644338 22836 raft_consensus.cc:515] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.645939 22836 leader_election.cc:290] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 3 election: Requested vote from peers 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66:36561), c626837b190a4555a179db184c87451f (127.22.43.67:32807)
I20260709 12:19:07.646795 22911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50e7eefc7699487eaa0f1b500916f17e"
I20260709 12:19:07.646903 22985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce773d57686424eb6c5b9fedc276c23" candidate_uuid: "89017b6621424a6696e49f037d524851" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c626837b190a4555a179db184c87451f"
I20260709 12:19:07.647353 22911 raft_consensus.cc:3055] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:07.647392 22985 raft_consensus.cc:3060] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:07.647720 22911 raft_consensus.cc:740] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50e7eefc7699487eaa0f1b500916f17e, State: Running, Role: LEADER
I20260709 12:19:07.648474 22911 consensus_queue.cc:260] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.649374 22911 raft_consensus.cc:3060] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:07.652446 22985 raft_consensus.cc:2468] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 3.
I20260709 12:19:07.653761 22802 leader_election.cc:304] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89017b6621424a6696e49f037d524851, c626837b190a4555a179db184c87451f; no voters: 
I20260709 12:19:07.654536 23189 raft_consensus.cc:2804] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:07.654882 22911 raft_consensus.cc:2468] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89017b6621424a6696e49f037d524851 in term 3.
I20260709 12:19:07.654958 23189 raft_consensus.cc:697] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 3 LEADER]: Becoming Leader. State: Replica: 89017b6621424a6696e49f037d524851, State: Running, Role: LEADER
I20260709 12:19:07.655895 23189 consensus_queue.cc:237] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } }
I20260709 12:19:07.662304 22732 catalog_manager.cc:5697] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 reported cstate change: term changed from 2 to 3, leader changed from 50e7eefc7699487eaa0f1b500916f17e (127.22.43.66) to 89017b6621424a6696e49f037d524851 (127.22.43.65). New cstate: current_term: 3 leader_uuid: "89017b6621424a6696e49f037d524851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.854307 22836 raft_consensus.cc:1275] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Refusing update from remote peer c626837b190a4555a179db184c87451f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:07.855517 23163 consensus_queue.cc:1048] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:07.865731 22911 raft_consensus.cc:1275] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Refusing update from remote peer c626837b190a4555a179db184c87451f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:07.867126 23163 consensus_queue.cc:1048] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:07.899369 22911 raft_consensus.cc:1275] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Refusing update from remote peer 89017b6621424a6696e49f037d524851: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:07.900614 23189 consensus_queue.cc:1048] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:07.910511 22985 raft_consensus.cc:1275] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Refusing update from remote peer 89017b6621424a6696e49f037d524851: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:07.912307 23200 consensus_queue.cc:1048] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:07.929409 22985 raft_consensus.cc:1275] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 4 FOLLOWER]: Refusing update from remote peer 89017b6621424a6696e49f037d524851: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:07.930552 23200 consensus_queue.cc:1048] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:07.942356 22911 raft_consensus.cc:1275] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 4 FOLLOWER]: Refusing update from remote peer 89017b6621424a6696e49f037d524851: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:07.945042 23189 consensus_queue.cc:1048] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:07.958582 22836 raft_consensus.cc:1275] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Refusing update from remote peer c626837b190a4555a179db184c87451f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:07.960039 23163 consensus_queue.cc:1048] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [LEADER]: Connected to new peer: Peer: permanent_uuid: "89017b6621424a6696e49f037d524851" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 45213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:07.969696 22911 raft_consensus.cc:1275] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Refusing update from remote peer c626837b190a4555a179db184c87451f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:07.971095 23182 consensus_queue.cc:1048] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:08.099141 22985 raft_consensus.cc:1275] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Refusing update from remote peer 89017b6621424a6696e49f037d524851: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:08.100507 23189 consensus_queue.cc:1048] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c626837b190a4555a179db184c87451f" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 32807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:08.109579 22911 raft_consensus.cc:1275] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Refusing update from remote peer 89017b6621424a6696e49f037d524851: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:08.111552 23208 consensus_queue.cc:1048] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50e7eefc7699487eaa0f1b500916f17e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 36561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:08.234728 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:08.240206 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:08.240609 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:09.241673 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:09.246809 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:09.247259 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:10.248463 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:10.253470 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:10.253867 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:11.255115 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:11.260164 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:11.260643 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:12.261785 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:12.267277 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:12.267803 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:13.268846 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:13.273916 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:13.274384 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:14.275549 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:14.280814 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:14.281268 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:15.282420 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:15.287940 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:15.288447 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:16.289634 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:16.294842 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:16.295300 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:17.323884 22701 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:19:17.324455 22701 tablet_server.cc:179] TabletServer@127.22.43.65:0 shutting down...
I20260709 12:19:17.353010 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:17.353807 22701 tablet_replica.cc:333] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851: stopping tablet replica
I20260709 12:19:17.354569 22701 raft_consensus.cc:2243] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.355212 22701 raft_consensus.cc:2272] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 89017b6621424a6696e49f037d524851 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:17.358273 22875 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:17.358383 22701 tablet_replica.cc:333] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851: stopping tablet replica
I20260709 12:19:17.359081 22701 raft_consensus.cc:2243] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.359834 22701 raft_consensus.cc:2272] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:17.361805 22875 consensus_peers.cc:597] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e -> Peer 89017b6621424a6696e49f037d524851 (127.22.43.65:45213): Couldn't send request to peer 89017b6621424a6696e49f037d524851. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:17.362365 22701 tablet_replica.cc:333] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851: stopping tablet replica
I20260709 12:19:17.362921 22701 raft_consensus.cc:2243] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.363750 22701 raft_consensus.cc:2272] T 9ce773d57686424eb6c5b9fedc276c23 P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.366144 22701 tablet_replica.cc:333] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851: stopping tablet replica
I20260709 12:19:17.366815 22701 raft_consensus.cc:2243] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.367415 22701 raft_consensus.cc:2272] T b4bf1a2da1c84d1f82a3c33736f0a79e P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.369444 22701 tablet_replica.cc:333] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851: stopping tablet replica
I20260709 12:19:17.369997 22701 raft_consensus.cc:2243] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.370450 22701 raft_consensus.cc:2272] T fb5b9c40c9184e9d93dba40346d04fa0 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.372220 22701 tablet_replica.cc:333] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851: stopping tablet replica
I20260709 12:19:17.372687 22701 raft_consensus.cc:2243] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.373440 22701 raft_consensus.cc:2272] T a8676a96c9094f15a144b8b5ab2ba9e2 P 89017b6621424a6696e49f037d524851 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.375174 22701 tablet_replica.cc:333] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851: stopping tablet replica
I20260709 12:19:17.375629 22701 raft_consensus.cc:2243] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.376081 22701 raft_consensus.cc:2272] T 77d85030295c4eb59727de692f2e140a P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.378096 22701 tablet_replica.cc:333] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851: stopping tablet replica
I20260709 12:19:17.378629 22701 raft_consensus.cc:2243] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.379154 22701 raft_consensus.cc:2272] T 8a150d4ebdd44949aa163f29355354a8 P 89017b6621424a6696e49f037d524851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.380920 22701 tablet_replica.cc:333] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851: stopping tablet replica
I20260709 12:19:17.381297 22701 raft_consensus.cc:2243] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.382215 22701 raft_consensus.cc:2272] T af3b6df7fa7143b6bf42bcbaf55046ab P 89017b6621424a6696e49f037d524851 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.479377 22701 tablet_server.cc:196] TabletServer@127.22.43.65:0 shutdown complete.
W20260709 12:19:17.480664 22950 consensus_peers.cc:597] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f -> Peer 89017b6621424a6696e49f037d524851 (127.22.43.65:45213): Couldn't send request to peer 89017b6621424a6696e49f037d524851. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:45213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:17.491777 22875 consensus_peers.cc:597] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e -> Peer 89017b6621424a6696e49f037d524851 (127.22.43.65:45213): Couldn't send request to peer 89017b6621424a6696e49f037d524851. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:45213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:17.501840 22701 tablet_server.cc:179] TabletServer@127.22.43.66:0 shutting down...
I20260709 12:19:17.535368 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:17.536131 22701 tablet_replica.cc:333] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e: stopping tablet replica
W20260709 12:19:17.536516 22950 consensus_peers.cc:597] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f -> Peer 89017b6621424a6696e49f037d524851 (127.22.43.65:45213): Couldn't send request to peer 89017b6621424a6696e49f037d524851. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:45213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:17.536983 22701 raft_consensus.cc:2243] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.537551 22701 raft_consensus.cc:2272] T af3b6df7fa7143b6bf42bcbaf55046ab P 50e7eefc7699487eaa0f1b500916f17e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.539855 22701 tablet_replica.cc:333] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e: stopping tablet replica
I20260709 12:19:17.540459 22701 raft_consensus.cc:2243] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.541443 22701 raft_consensus.cc:2272] T 8a150d4ebdd44949aa163f29355354a8 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:17.542443 22875 consensus_peers.cc:597] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e -> Peer 89017b6621424a6696e49f037d524851 (127.22.43.65:45213): Couldn't send request to peer 89017b6621424a6696e49f037d524851. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:45213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:17.543457 22701 tablet_replica.cc:333] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e: stopping tablet replica
I20260709 12:19:17.544047 22701 raft_consensus.cc:2243] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.544816 22701 raft_consensus.cc:2272] T b4bf1a2da1c84d1f82a3c33736f0a79e P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.546438 22701 tablet_replica.cc:333] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e: stopping tablet replica
I20260709 12:19:17.546922 22701 raft_consensus.cc:2243] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.547367 22701 raft_consensus.cc:2272] T fb5b9c40c9184e9d93dba40346d04fa0 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.549046 22701 tablet_replica.cc:333] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e: stopping tablet replica
I20260709 12:19:17.549525 22701 raft_consensus.cc:2243] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.549991 22701 raft_consensus.cc:2272] T a8676a96c9094f15a144b8b5ab2ba9e2 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.551539 22701 tablet_replica.cc:333] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e: stopping tablet replica
I20260709 12:19:17.552037 22701 raft_consensus.cc:2243] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.552446 22701 raft_consensus.cc:2272] T 77d85030295c4eb59727de692f2e140a P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.554107 22701 tablet_replica.cc:333] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e: stopping tablet replica
I20260709 12:19:17.554584 22701 raft_consensus.cc:2243] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.554993 22701 raft_consensus.cc:2272] T 9ce773d57686424eb6c5b9fedc276c23 P 50e7eefc7699487eaa0f1b500916f17e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.556627 22701 tablet_replica.cc:333] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e: stopping tablet replica
I20260709 12:19:17.557070 22701 raft_consensus.cc:2243] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.557471 22701 raft_consensus.cc:2272] T 0fba284ca09c49e9b8c37b50ffb2eca5 P 50e7eefc7699487eaa0f1b500916f17e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.559111 22701 tablet_replica.cc:333] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e: stopping tablet replica
I20260709 12:19:17.559542 22701 raft_consensus.cc:2243] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.560343 22701 raft_consensus.cc:2272] T bbf1fd0b3bc5473bbe2dcf0b125be521 P 50e7eefc7699487eaa0f1b500916f17e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.588620 22701 tablet_server.cc:196] TabletServer@127.22.43.66:0 shutdown complete.
W20260709 12:19:17.595422 22950 consensus_peers.cc:597] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f -> Peer 89017b6621424a6696e49f037d524851 (127.22.43.65:45213): Couldn't send request to peer 89017b6621424a6696e49f037d524851. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:45213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:17.607936 22701 tablet_server.cc:179] TabletServer@127.22.43.67:0 shutting down...
I20260709 12:19:17.637430 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:17.638248 22701 tablet_replica.cc:333] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f: stopping tablet replica
I20260709 12:19:17.638885 22701 raft_consensus.cc:2243] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.639380 22701 raft_consensus.cc:2272] T bbf1fd0b3bc5473bbe2dcf0b125be521 P c626837b190a4555a179db184c87451f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.641177 22701 tablet_replica.cc:333] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f: stopping tablet replica
I20260709 12:19:17.641731 22701 raft_consensus.cc:2243] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.642203 22701 raft_consensus.cc:2272] T af3b6df7fa7143b6bf42bcbaf55046ab P c626837b190a4555a179db184c87451f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.643790 22701 tablet_replica.cc:333] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f: stopping tablet replica
I20260709 12:19:17.644317 22701 raft_consensus.cc:2243] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.645128 22701 raft_consensus.cc:2272] T fb5b9c40c9184e9d93dba40346d04fa0 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.646911 22701 tablet_replica.cc:333] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f: stopping tablet replica
I20260709 12:19:17.647414 22701 raft_consensus.cc:2243] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.647821 22701 raft_consensus.cc:2272] T b4bf1a2da1c84d1f82a3c33736f0a79e P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.649363 22701 tablet_replica.cc:333] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f: stopping tablet replica
I20260709 12:19:17.649837 22701 raft_consensus.cc:2243] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.650640 22701 raft_consensus.cc:2272] T 0fba284ca09c49e9b8c37b50ffb2eca5 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.652297 22701 tablet_replica.cc:333] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f: stopping tablet replica
I20260709 12:19:17.652784 22701 raft_consensus.cc:2243] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.653257 22701 raft_consensus.cc:2272] T 9ce773d57686424eb6c5b9fedc276c23 P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.655067 22701 tablet_replica.cc:333] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f: stopping tablet replica
I20260709 12:19:17.655606 22701 raft_consensus.cc:2243] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.656466 22701 raft_consensus.cc:2272] T 77d85030295c4eb59727de692f2e140a P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.658417 22701 tablet_replica.cc:333] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f: stopping tablet replica
I20260709 12:19:17.658865 22701 raft_consensus.cc:2243] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.659286 22701 raft_consensus.cc:2272] T a8676a96c9094f15a144b8b5ab2ba9e2 P c626837b190a4555a179db184c87451f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.660818 22701 tablet_replica.cc:333] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f: stopping tablet replica
I20260709 12:19:17.661226 22701 raft_consensus.cc:2243] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.661705 22701 raft_consensus.cc:2272] T 8a150d4ebdd44949aa163f29355354a8 P c626837b190a4555a179db184c87451f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.689689 22701 tablet_server.cc:196] TabletServer@127.22.43.67:0 shutdown complete.
I20260709 12:19:17.707513 22701 master.cc:562] Master@127.22.43.126:34023 shutting down...
I20260709 12:19:17.832701 22701 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.833297 22701 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.833596 22701 tablet_replica.cc:333] T 00000000000000000000000000000000 P 986a4d1a52b946e0b663a9ca5e60717d: stopping tablet replica
I20260709 12:19:17.853737 22701 master.cc:584] Master@127.22.43.126:34023 shutdown complete.
50e7eefc7699487eaa0f1b500916f17e  4
89017b6621424a6696e49f037d524851  4
c626837b190a4555a179db184c87451f  1
50e7eefc7699487eaa0f1b500916f17e  3
89017b6621424a6696e49f037d524851  3
c626837b190a4555a179db184c87451f  3
50e7eefc7699487eaa0f1b500916f17e  8
89017b6621424a6696e49f037d524851  0
c626837b190a4555a179db184c87451f  1
50e7eefc7699487eaa0f1b500916f17e  3
89017b6621424a6696e49f037d524851  3
c626837b190a4555a179db184c87451f  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30906 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:19:17.895009 22701 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.43.126:42241
I20260709 12:19:17.896118 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:17.901425 23219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:17.902671 23220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:17.903224 23222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:17.904209 22701 server_base.cc:1061] running on GCE node
I20260709 12:19:17.905117 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:17.905361 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:17.905519 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599557905496 us; error 0 us; skew 500 ppm
I20260709 12:19:17.906064 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:17.908406 22701 webserver.cc:533] Webserver started at http://127.22.43.126:39171/ using document root <none> and password file <none>
I20260709 12:19:17.909049 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:17.909264 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:17.909559 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:17.910813 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/master-0-root/instance:
uuid: "b46e82d0d9374600bfdd1247b5981ede"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-0768"
I20260709 12:19:17.915218 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:17.918546 23227 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:17.919277 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:19:17.919556 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/master-0-root
uuid: "b46e82d0d9374600bfdd1247b5981ede"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-0768"
I20260709 12:19:17.919824 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:17.929633 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:17.930935 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:17.968791 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.126:42241
I20260709 12:19:17.968881 23278 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.126:42241 every 8 connection(s)
I20260709 12:19:17.973927 23279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:17.984135 23279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede: Bootstrap starting.
I20260709 12:19:17.988798 23279 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:17.993359 23279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede: No bootstrap required, opened a new log
I20260709 12:19:17.995574 23279 raft_consensus.cc:359] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46e82d0d9374600bfdd1247b5981ede" member_type: VOTER }
I20260709 12:19:17.996024 23279 raft_consensus.cc:385] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:17.996269 23279 raft_consensus.cc:740] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46e82d0d9374600bfdd1247b5981ede, State: Initialized, Role: FOLLOWER
I20260709 12:19:17.996814 23279 consensus_queue.cc:260] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46e82d0d9374600bfdd1247b5981ede" member_type: VOTER }
I20260709 12:19:17.997275 23279 raft_consensus.cc:399] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:17.997502 23279 raft_consensus.cc:493] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:17.997767 23279 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:18.001749 23279 raft_consensus.cc:515] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46e82d0d9374600bfdd1247b5981ede" member_type: VOTER }
I20260709 12:19:18.002408 23279 leader_election.cc:304] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b46e82d0d9374600bfdd1247b5981ede; no voters: 
I20260709 12:19:18.003575 23279 leader_election.cc:290] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:18.003964 23282 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:18.005332 23282 raft_consensus.cc:697] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [term 1 LEADER]: Becoming Leader. State: Replica: b46e82d0d9374600bfdd1247b5981ede, State: Running, Role: LEADER
I20260709 12:19:18.006126 23282 consensus_queue.cc:237] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46e82d0d9374600bfdd1247b5981ede" member_type: VOTER }
I20260709 12:19:18.006632 23279 sys_catalog.cc:565] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:18.011148 23284 sys_catalog.cc:455] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [sys.catalog]: SysCatalogTable state changed. Reason: New leader b46e82d0d9374600bfdd1247b5981ede. Latest consensus state: current_term: 1 leader_uuid: "b46e82d0d9374600bfdd1247b5981ede" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46e82d0d9374600bfdd1247b5981ede" member_type: VOTER } }
I20260709 12:19:18.011148 23283 sys_catalog.cc:455] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b46e82d0d9374600bfdd1247b5981ede" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46e82d0d9374600bfdd1247b5981ede" member_type: VOTER } }
I20260709 12:19:18.011914 23283 sys_catalog.cc:458] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:18.011888 23284 sys_catalog.cc:458] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:18.015754 23289 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:18.024009 23289 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:18.025069 22701 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:18.033041 23289 catalog_manager.cc:1383] Generated new cluster ID: 45fc16e131d24d9f92e2ce18bd4af0c2
I20260709 12:19:18.033360 23289 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:18.049376 23289 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:18.050649 23289 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:18.061075 23289 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede: Generated new TSK 0
I20260709 12:19:18.061666 23289 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:18.092429 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:18.098511 23300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:18.099639 23301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:18.101059 23303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:18.101382 22701 server_base.cc:1061] running on GCE node
I20260709 12:19:18.102365 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:18.102591 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:18.102769 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599558102755 us; error 0 us; skew 500 ppm
I20260709 12:19:18.103281 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:18.105818 22701 webserver.cc:533] Webserver started at http://127.22.43.65:41425/ using document root <none> and password file <none>
I20260709 12:19:18.106499 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:18.106707 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:18.106987 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:18.108165 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-0-root/instance:
uuid: "a8beeb14299b447fa8bd913de1aab377"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-0768"
I20260709 12:19:18.113040 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:19:18.116412 23308 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.117308 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:19:18.117704 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-0-root
uuid: "a8beeb14299b447fa8bd913de1aab377"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-0768"
I20260709 12:19:18.118125 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:18.131628 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:18.132889 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:18.134467 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:18.136739 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:18.136961 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.137208 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:18.137405 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.176488 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.65:41391
I20260709 12:19:18.176581 23370 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.65:41391 every 8 connection(s)
I20260709 12:19:18.181373 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:18.189596 23375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:18.191582 23376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:18.194885 22701 server_base.cc:1061] running on GCE node
W20260709 12:19:18.195641 23378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:18.196595 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:18.196799 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:18.197043 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599558197021 us; error 0 us; skew 500 ppm
I20260709 12:19:18.197758 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:18.199576 23371 heartbeater.cc:344] Connected to a master server at 127.22.43.126:42241
I20260709 12:19:18.199939 23371 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:18.200698 22701 webserver.cc:533] Webserver started at http://127.22.43.66:33353/ using document root <none> and password file <none>
I20260709 12:19:18.200881 23371 heartbeater.cc:507] Master 127.22.43.126:42241 requested a full tablet report, sending...
I20260709 12:19:18.201386 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:18.201633 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:18.202014 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:18.203231 23244 ts_manager.cc:194] Registered new tserver with Master: a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391)
I20260709 12:19:18.203281 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-1-root/instance:
uuid: "4335df7771044244810c947ea8190bc6"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-0768"
I20260709 12:19:18.205072 23244 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59404
I20260709 12:19:18.208353 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:18.211719 23383 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.212466 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:19:18.212759 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-1-root
uuid: "4335df7771044244810c947ea8190bc6"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-0768"
I20260709 12:19:18.213050 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:18.241127 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:18.242457 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:18.243947 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:18.246136 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:18.246368 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.246604 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:18.246773 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.288714 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.66:43801
I20260709 12:19:18.288806 23445 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.66:43801 every 8 connection(s)
I20260709 12:19:18.294071 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:18.301537 23449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:18.302789 23450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:18.305835 23452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:18.306465 23446 heartbeater.cc:344] Connected to a master server at 127.22.43.126:42241
I20260709 12:19:18.306530 22701 server_base.cc:1061] running on GCE node
I20260709 12:19:18.307022 23446 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:18.307650 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:18.307906 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:18.307814 23446 heartbeater.cc:507] Master 127.22.43.126:42241 requested a full tablet report, sending...
I20260709 12:19:18.308182 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599558308164 us; error 0 us; skew 500 ppm
I20260709 12:19:18.308832 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:18.310303 23244 ts_manager.cc:194] Registered new tserver with Master: 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:18.311661 22701 webserver.cc:533] Webserver started at http://127.22.43.67:33759/ using document root <none> and password file <none>
I20260709 12:19:18.311910 23244 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59406
I20260709 12:19:18.312192 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:18.312417 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:18.312688 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:18.313862 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-2-root/instance:
uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-0768"
I20260709 12:19:18.318789 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:19:18.322106 23457 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.322856 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:19:18.323144 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-2-root
uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-0768"
I20260709 12:19:18.323446 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599526815862-22701-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:18.336333 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:18.337548 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:18.339068 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:18.341311 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:18.341531 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.341776 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:18.341992 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:19:18.380604 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.67:37999
I20260709 12:19:18.380726 23519 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.67:37999 every 8 connection(s)
I20260709 12:19:18.394318 23520 heartbeater.cc:344] Connected to a master server at 127.22.43.126:42241
I20260709 12:19:18.394713 23520 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:18.395434 23520 heartbeater.cc:507] Master 127.22.43.126:42241 requested a full tablet report, sending...
I20260709 12:19:18.397315 23244 ts_manager.cc:194] Registered new tserver with Master: c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:18.398172 22701 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014374167s
I20260709 12:19:18.398877 23244 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59414
I20260709 12:19:18.423867 23244 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59430:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:18.426869 23244 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:18.502552 23485 tablet_service.cc:1511] Processing CreateTablet for tablet 60a8430668284bc39fe0f2e1eb6249b1 (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:18.504195 23485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a8430668284bc39fe0f2e1eb6249b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.513041 23484 tablet_service.cc:1511] Processing CreateTablet for tablet f31d07e28e2e4460a7c5261c1feef77e (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:18.514544 23484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31d07e28e2e4460a7c5261c1feef77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.521358 23331 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc0231ce2d5467ea3d745f7fd16fd9e (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:18.522441 23336 tablet_service.cc:1511] Processing CreateTablet for tablet 60a8430668284bc39fe0f2e1eb6249b1 (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:18.522966 23331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc0231ce2d5467ea3d745f7fd16fd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.523705 23336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a8430668284bc39fe0f2e1eb6249b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.525671 23330 tablet_service.cc:1511] Processing CreateTablet for tablet b0e2372c5fa8402cbd8947aca495e0da (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:18.525964 23335 tablet_service.cc:1511] Processing CreateTablet for tablet f31d07e28e2e4460a7c5261c1feef77e (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:18.527894 23329 tablet_service.cc:1511] Processing CreateTablet for tablet 837f4b67331f47d3aba4b8357ce8c57f (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:18.528126 23328 tablet_service.cc:1511] Processing CreateTablet for tablet 96039210dcd54f0ab7724baf3442247e (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:18.530260 23332 tablet_service.cc:1511] Processing CreateTablet for tablet 50c6e67147e141d082abdc273ef229cf (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:18.530803 23327 tablet_service.cc:1511] Processing CreateTablet for tablet 62c52881c12e41ad939e025d13f69921 (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:18.531201 23535 tablet_bootstrap.cc:492] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a: Bootstrap starting.
I20260709 12:19:18.532634 23333 tablet_service.cc:1511] Processing CreateTablet for tablet d478ea946acb4e97aa84e3450247751c (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:18.533149 23334 tablet_service.cc:1511] Processing CreateTablet for tablet b654d14a5a7e4911a2adce199f0bae49 (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:18.534015 23333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d478ea946acb4e97aa84e3450247751c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.534785 23335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31d07e28e2e4460a7c5261c1feef77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.535552 23329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837f4b67331f47d3aba4b8357ce8c57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.536563 23328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96039210dcd54f0ab7724baf3442247e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.537228 23332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c6e67147e141d082abdc273ef229cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.538566 23535 tablet_bootstrap.cc:654] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.539438 23327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c52881c12e41ad939e025d13f69921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.542204 23330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e2372c5fa8402cbd8947aca495e0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.546218 23334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b654d14a5a7e4911a2adce199f0bae49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.551198 23535 tablet_bootstrap.cc:492] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a: No bootstrap required, opened a new log
I20260709 12:19:18.551767 23535 ts_tablet_manager.cc:1403] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:19:18.555505 23535 raft_consensus.cc:359] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:18.557825 23535 raft_consensus.cc:385] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.561262 23535 raft_consensus.cc:740] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.559648 23537 tablet_bootstrap.cc:492] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377: Bootstrap starting.
I20260709 12:19:18.562294 23535 consensus_queue.cc:260] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:18.571159 23537 tablet_bootstrap.cc:654] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.575045 23520 heartbeater.cc:499] Master 127.22.43.126:42241 was elected leader, sending a full tablet report...
I20260709 12:19:18.575718 23535 ts_tablet_manager.cc:1434] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.009s
I20260709 12:19:18.592017 23485 tablet_service.cc:1511] Processing CreateTablet for tablet b654d14a5a7e4911a2adce199f0bae49 (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:18.593309 23485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b654d14a5a7e4911a2adce199f0bae49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.594691 23535 tablet_bootstrap.cc:492] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a: Bootstrap starting.
I20260709 12:19:18.599617 23484 tablet_service.cc:1511] Processing CreateTablet for tablet d478ea946acb4e97aa84e3450247751c (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:18.600960 23484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d478ea946acb4e97aa84e3450247751c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.604506 23483 tablet_service.cc:1511] Processing CreateTablet for tablet 50c6e67147e141d082abdc273ef229cf (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:18.607546 23482 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc0231ce2d5467ea3d745f7fd16fd9e (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:18.610700 23481 tablet_service.cc:1511] Processing CreateTablet for tablet b0e2372c5fa8402cbd8947aca495e0da (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:18.612514 23481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e2372c5fa8402cbd8947aca495e0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.615373 23480 tablet_service.cc:1511] Processing CreateTablet for tablet 837f4b67331f47d3aba4b8357ce8c57f (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:18.617251 23480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837f4b67331f47d3aba4b8357ce8c57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.619450 23479 tablet_service.cc:1511] Processing CreateTablet for tablet 96039210dcd54f0ab7724baf3442247e (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:18.622877 23478 tablet_service.cc:1511] Processing CreateTablet for tablet 62c52881c12e41ad939e025d13f69921 (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:18.627483 23409 tablet_service.cc:1511] Processing CreateTablet for tablet b654d14a5a7e4911a2adce199f0bae49 (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:18.628947 23409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b654d14a5a7e4911a2adce199f0bae49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.630106 23411 tablet_service.cc:1511] Processing CreateTablet for tablet 60a8430668284bc39fe0f2e1eb6249b1 (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:18.631072 23408 tablet_service.cc:1511] Processing CreateTablet for tablet d478ea946acb4e97aa84e3450247751c (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:18.632469 23410 tablet_service.cc:1511] Processing CreateTablet for tablet f31d07e28e2e4460a7c5261c1feef77e (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:18.633400 23407 tablet_service.cc:1511] Processing CreateTablet for tablet 50c6e67147e141d082abdc273ef229cf (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:18.634934 23402 tablet_service.cc:1511] Processing CreateTablet for tablet 62c52881c12e41ad939e025d13f69921 (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:18.636152 23406 tablet_service.cc:1511] Processing CreateTablet for tablet 1dc0231ce2d5467ea3d745f7fd16fd9e (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:18.636740 23411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a8430668284bc39fe0f2e1eb6249b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.637485 23408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d478ea946acb4e97aa84e3450247751c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.639524 23479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96039210dcd54f0ab7724baf3442247e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.639989 23405 tablet_service.cc:1511] Processing CreateTablet for tablet b0e2372c5fa8402cbd8947aca495e0da (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:18.642853 23404 tablet_service.cc:1511] Processing CreateTablet for tablet 837f4b67331f47d3aba4b8357ce8c57f (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:18.644786 23406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc0231ce2d5467ea3d745f7fd16fd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.650249 23407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c6e67147e141d082abdc273ef229cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.651108 23403 tablet_service.cc:1511] Processing CreateTablet for tablet 96039210dcd54f0ab7724baf3442247e (DEFAULT_TABLE table=test-workload [id=c6b1a8fae76b4d8cb73288015deb99f5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:18.653062 23403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96039210dcd54f0ab7724baf3442247e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.654270 23410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31d07e28e2e4460a7c5261c1feef77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.654946 23405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e2372c5fa8402cbd8947aca495e0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.658381 23538 raft_consensus.cc:493] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.658483 23404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837f4b67331f47d3aba4b8357ce8c57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.658933 23538 raft_consensus.cc:515] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:18.669046 23478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c52881c12e41ad939e025d13f69921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.669199 23402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c52881c12e41ad939e025d13f69921. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:18.678277 23459 leader_election.cc:343] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801): Not found: Tablet not found: 60a8430668284bc39fe0f2e1eb6249b1
I20260709 12:19:18.678996 23538 leader_election.cc:290] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:18.678280 23483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c6e67147e141d082abdc273ef229cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.683429 23482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc0231ce2d5467ea3d745f7fd16fd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.719779 23535 tablet_bootstrap.cc:654] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.742522 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:18.742915 23541 tablet_bootstrap.cc:492] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6: Bootstrap starting.
W20260709 12:19:18.744295 23460 leader_election.cc:343] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:18.744794 23460 leader_election.cc:304] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3c01853e9ea4f74b345c3fc10cc454a; no voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:18.745868 23538 raft_consensus.cc:2749] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:18.755885 23537 tablet_bootstrap.cc:492] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377: No bootstrap required, opened a new log
I20260709 12:19:18.756373 23537 ts_tablet_manager.cc:1403] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377: Time spent bootstrapping tablet: real 0.197s	user 0.044s	sys 0.081s
I20260709 12:19:18.759760 23537 raft_consensus.cc:359] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:18.760699 23537 raft_consensus.cc:385] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.761072 23537 raft_consensus.cc:740] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.766235 23537 consensus_queue.cc:260] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:18.769562 23541 tablet_bootstrap.cc:654] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.779548 23535 tablet_bootstrap.cc:492] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a: No bootstrap required, opened a new log
I20260709 12:19:18.780694 23535 ts_tablet_manager.cc:1403] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a: Time spent bootstrapping tablet: real 0.186s	user 0.012s	sys 0.021s
I20260709 12:19:18.782716 23537 ts_tablet_manager.cc:1434] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.009s
I20260709 12:19:18.783455 23371 heartbeater.cc:499] Master 127.22.43.126:42241 was elected leader, sending a full tablet report...
I20260709 12:19:18.783735 23537 tablet_bootstrap.cc:492] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377: Bootstrap starting.
I20260709 12:19:18.789418 23541 tablet_bootstrap.cc:492] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6: No bootstrap required, opened a new log
I20260709 12:19:18.789867 23541 ts_tablet_manager.cc:1403] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 12:19:18.790921 23535 raft_consensus.cc:359] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.791693 23535 raft_consensus.cc:385] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.791997 23535 raft_consensus.cc:740] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.792779 23535 consensus_queue.cc:260] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.792935 23541 raft_consensus.cc:359] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.794114 23537 tablet_bootstrap.cc:654] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.795092 23535 ts_tablet_manager.cc:1434] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:19:18.793697 23541 raft_consensus.cc:385] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.795800 23541 raft_consensus.cc:740] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.796074 23535 tablet_bootstrap.cc:492] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a: Bootstrap starting.
I20260709 12:19:18.796718 23541 consensus_queue.cc:260] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.802950 23535 tablet_bootstrap.cc:654] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.807147 23541 ts_tablet_manager.cc:1434] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.003s
I20260709 12:19:18.807518 23446 heartbeater.cc:499] Master 127.22.43.126:42241 was elected leader, sending a full tablet report...
I20260709 12:19:18.808182 23541 tablet_bootstrap.cc:492] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6: Bootstrap starting.
I20260709 12:19:18.808893 23537 tablet_bootstrap.cc:492] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377: No bootstrap required, opened a new log
I20260709 12:19:18.809448 23537 ts_tablet_manager.cc:1403] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377: Time spent bootstrapping tablet: real 0.026s	user 0.004s	sys 0.014s
I20260709 12:19:18.812435 23537 raft_consensus.cc:359] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.813336 23537 raft_consensus.cc:385] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.813688 23537 raft_consensus.cc:740] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.814617 23541 tablet_bootstrap.cc:654] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.814690 23537 consensus_queue.cc:260] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.817344 23537 ts_tablet_manager.cc:1434] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:19:18.818616 23537 tablet_bootstrap.cc:492] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377: Bootstrap starting.
I20260709 12:19:18.827030 23537 tablet_bootstrap.cc:654] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.835997 23541 tablet_bootstrap.cc:492] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6: No bootstrap required, opened a new log
I20260709 12:19:18.836666 23541 ts_tablet_manager.cc:1403] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.008s
I20260709 12:19:18.837750 23543 raft_consensus.cc:493] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.838642 23543 raft_consensus.cc:515] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:18.840960 23541 raft_consensus.cc:359] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.841811 23541 raft_consensus.cc:385] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.842133 23537 tablet_bootstrap.cc:492] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377: No bootstrap required, opened a new log
I20260709 12:19:18.842248 23541 raft_consensus.cc:740] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.842759 23537 ts_tablet_manager.cc:1403] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 12:19:18.843417 23541 consensus_queue.cc:260] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.844375 23543 leader_election.cc:290] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:18.845937 23541 ts_tablet_manager.cc:1434] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:19:18.846081 23537 raft_consensus.cc:359] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.846920 23541 tablet_bootstrap.cc:492] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6: Bootstrap starting.
I20260709 12:19:18.847051 23537 raft_consensus.cc:385] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.847536 23537 raft_consensus.cc:740] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.848660 23545 raft_consensus.cc:493] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.848554 23537 consensus_queue.cc:260] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.849208 23545 raft_consensus.cc:515] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.851049 23537 ts_tablet_manager.cc:1434] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:19:18.851238 23535 tablet_bootstrap.cc:492] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a: No bootstrap required, opened a new log
I20260709 12:19:18.851660 23535 ts_tablet_manager.cc:1403] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.016s
I20260709 12:19:18.852006 23537 tablet_bootstrap.cc:492] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377: Bootstrap starting.
I20260709 12:19:18.854532 23535 raft_consensus.cc:359] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.855266 23535 raft_consensus.cc:385] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.855579 23535 raft_consensus.cc:740] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.856653 23535 consensus_queue.cc:260] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.858664 23537 tablet_bootstrap.cc:654] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.861143 23535 ts_tablet_manager.cc:1434] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:19:18.862483 23535 tablet_bootstrap.cc:492] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a: Bootstrap starting.
I20260709 12:19:18.863909 23545 leader_election.cc:290] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:18.876031 23535 tablet_bootstrap.cc:654] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.889040 23541 tablet_bootstrap.cc:654] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.900753 23538 raft_consensus.cc:493] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.912011 23538 raft_consensus.cc:515] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.914438 23538 leader_election.cc:290] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:18.916616 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b654d14a5a7e4911a2adce199f0bae49" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:18.917160 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b654d14a5a7e4911a2adce199f0bae49" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6" is_pre_election: true
I20260709 12:19:18.917801 23421 raft_consensus.cc:2468] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 0.
I20260709 12:19:18.917697 23346 raft_consensus.cc:2468] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 0.
I20260709 12:19:18.919560 23459 leader_election.cc:304] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:18.920272 23538 raft_consensus.cc:2804] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:18.920706 23538 raft_consensus.cc:493] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.921263 23538 raft_consensus.cc:3060] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:18.919874 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
W20260709 12:19:18.923019 23386 leader_election.cc:343] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:18.929198 23535 tablet_bootstrap.cc:492] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a: No bootstrap required, opened a new log
I20260709 12:19:18.929409 23495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:18.929141 23538 raft_consensus.cc:515] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
W20260709 12:19:18.930945 23385 leader_election.cc:343] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:18.931392 23385 leader_election.cc:304] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4335df7771044244810c947ea8190bc6; no voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a
I20260709 12:19:18.932119 23545 raft_consensus.cc:2749] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:18.932003 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6" is_pre_election: true
I20260709 12:19:18.933146 23538 leader_election.cc:290] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:18.934638 23535 ts_tablet_manager.cc:1403] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a: Time spent bootstrapping tablet: real 0.072s	user 0.019s	sys 0.008s
W20260709 12:19:18.934492 23310 leader_election.cc:343] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:18.934499 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b654d14a5a7e4911a2adce199f0bae49" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:18.935420 23421 raft_consensus.cc:3060] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:18.936419 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b654d14a5a7e4911a2adce199f0bae49" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:18.936522 23495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:18.937011 23346 raft_consensus.cc:3060] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:18.937070 23495 raft_consensus.cc:2468] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 0.
I20260709 12:19:18.939447 23537 tablet_bootstrap.cc:492] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377: No bootstrap required, opened a new log
I20260709 12:19:18.939937 23537 ts_tablet_manager.cc:1403] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377: Time spent bootstrapping tablet: real 0.088s	user 0.048s	sys 0.035s
I20260709 12:19:18.940987 23541 tablet_bootstrap.cc:492] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6: No bootstrap required, opened a new log
I20260709 12:19:18.941568 23541 ts_tablet_manager.cc:1403] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6: Time spent bootstrapping tablet: real 0.095s	user 0.004s	sys 0.010s
I20260709 12:19:18.942806 23537 raft_consensus.cc:359] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.943514 23537 raft_consensus.cc:385] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.943874 23421 raft_consensus.cc:2468] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 1.
I20260709 12:19:18.944393 23310 leader_election.cc:304] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 4335df7771044244810c947ea8190bc6
I20260709 12:19:18.945142 23459 leader_election.cc:304] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:18.945391 23543 raft_consensus.cc:2804] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:18.945912 23543 raft_consensus.cc:493] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.946111 23538 raft_consensus.cc:2804] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:18.943876 23537 raft_consensus.cc:740] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.946331 23543 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:18.947250 23537 consensus_queue.cc:260] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.945273 23541 raft_consensus.cc:359] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.951578 23541 raft_consensus.cc:385] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.952629 23541 raft_consensus.cc:740] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.953977 23346 raft_consensus.cc:2468] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 1.
I20260709 12:19:18.954353 23543 raft_consensus.cc:515] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:18.957427 23535 raft_consensus.cc:359] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.958139 23535 raft_consensus.cc:385] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.958221 23495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:18.958504 23535 raft_consensus.cc:740] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.958827 23495 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:18.961655 23535 consensus_queue.cc:260] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.963539 23538 raft_consensus.cc:697] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Becoming Leader. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Running, Role: LEADER
I20260709 12:19:18.964890 23538 consensus_queue.cc:237] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.968609 23495 raft_consensus.cc:2468] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 1.
I20260709 12:19:18.969102 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:18.955089 23541 consensus_queue.cc:260] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:18.970198 23310 leader_election.cc:304] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:18.970054 23543 leader_election.cc:290] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 election: Requested vote from peers c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:18.972530 23543 raft_consensus.cc:2804] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:18.972875 23535 ts_tablet_manager.cc:1434] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.004s
I20260709 12:19:18.973014 23543 raft_consensus.cc:697] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Becoming Leader. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:18.973973 23535 tablet_bootstrap.cc:492] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a: Bootstrap starting.
I20260709 12:19:18.973945 23543 consensus_queue.cc:237] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:18.978614 23541 ts_tablet_manager.cc:1434] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 12:19:18.979698 23541 tablet_bootstrap.cc:492] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6: Bootstrap starting.
I20260709 12:19:18.987389 23535 tablet_bootstrap.cc:654] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:18.988667 23310 leader_election.cc:343] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.002702 23241 catalog_manager.cc:5697] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8beeb14299b447fa8bd913de1aab377 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "a8beeb14299b447fa8bd913de1aab377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.004436 23541 tablet_bootstrap.cc:654] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.016805 23535 tablet_bootstrap.cc:492] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a: No bootstrap required, opened a new log
I20260709 12:19:19.017393 23535 ts_tablet_manager.cc:1403] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.015s
I20260709 12:19:19.020849 23537 ts_tablet_manager.cc:1434] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377: Time spent starting tablet: real 0.081s	user 0.026s	sys 0.046s
I20260709 12:19:19.021124 23535 raft_consensus.cc:359] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.022483 23535 raft_consensus.cc:385] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.022881 23537 tablet_bootstrap.cc:492] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377: Bootstrap starting.
I20260709 12:19:19.022943 23535 raft_consensus.cc:740] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.024507 23535 consensus_queue.cc:260] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.027565 23535 ts_tablet_manager.cc:1434] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 12:19:19.028561 23535 tablet_bootstrap.cc:492] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a: Bootstrap starting.
I20260709 12:19:19.030514 23244 catalog_manager.cc:5697] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a reported cstate change: term changed from 0 to 1, leader changed from <none> to c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67). New cstate: current_term: 1 leader_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:19.034149 23292 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:19.035696 23541 tablet_bootstrap.cc:492] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6: No bootstrap required, opened a new log
I20260709 12:19:19.036266 23537 tablet_bootstrap.cc:654] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.036262 23541 ts_tablet_manager.cc:1403] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.009s
I20260709 12:19:19.037436 23535 tablet_bootstrap.cc:654] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.039921 23541 raft_consensus.cc:359] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.041046 23541 raft_consensus.cc:385] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.041553 23541 raft_consensus.cc:740] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.042815 23541 consensus_queue.cc:260] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.050559 23541 ts_tablet_manager.cc:1434] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:19:19.051184 23537 tablet_bootstrap.cc:492] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377: No bootstrap required, opened a new log
I20260709 12:19:19.054030 23535 tablet_bootstrap.cc:492] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a: No bootstrap required, opened a new log
I20260709 12:19:19.054307 23537 ts_tablet_manager.cc:1403] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.009s
I20260709 12:19:19.054518 23535 ts_tablet_manager.cc:1403] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.012s
I20260709 12:19:19.057338 23541 tablet_bootstrap.cc:492] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6: Bootstrap starting.
I20260709 12:19:19.057860 23537 raft_consensus.cc:359] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.058671 23537 raft_consensus.cc:385] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.059073 23537 raft_consensus.cc:740] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.060000 23537 consensus_queue.cc:260] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.060506 23535 raft_consensus.cc:359] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.061265 23535 raft_consensus.cc:385] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.061429 23559 raft_consensus.cc:493] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.061594 23535 raft_consensus.cc:740] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.061969 23559 raft_consensus.cc:515] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.062613 23543 raft_consensus.cc:493] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.063076 23543 raft_consensus.cc:515] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.064071 23559 leader_election.cc:290] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.064622 23541 tablet_bootstrap.cc:654] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.065060 23543 leader_election.cc:290] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.065682 23535 consensus_queue.cc:260] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.066848 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96039210dcd54f0ab7724baf3442247e" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6" is_pre_election: true
I20260709 12:19:19.067150 23538 raft_consensus.cc:493] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.067759 23538 raft_consensus.cc:515] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.068156 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6" is_pre_election: true
I20260709 12:19:19.069674 23495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96039210dcd54f0ab7724baf3442247e" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:19.070282 23495 raft_consensus.cc:2468] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 0.
I20260709 12:19:19.071298 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:19.071724 23538 leader_election.cc:290] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:19.074180 23535 ts_tablet_manager.cc:1434] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 12:19:19.074087 23310 leader_election.cc:304] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
W20260709 12:19:19.075269 23310 leader_election.cc:343] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.076095 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6" is_pre_election: true
W20260709 12:19:19.076218 23310 leader_election.cc:343] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.077284 23543 raft_consensus.cc:2804] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:19.077487 23459 leader_election.cc:343] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.075345 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:19.077822 23543 raft_consensus.cc:493] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.078351 23543 raft_consensus.cc:3060] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:19.079624 23460 leader_election.cc:343] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.080049 23460 leader_election.cc:304] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3c01853e9ea4f74b345c3fc10cc454a; no voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:19.081106 23538 raft_consensus.cc:2749] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:19.083289 23310 leader_election.cc:343] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.083719 23310 leader_election.cc:304] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377; no voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a
I20260709 12:19:19.084456 23559 raft_consensus.cc:2749] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.084977 23562 raft_consensus.cc:493] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.085448 23562 raft_consensus.cc:515] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.086090 23541 tablet_bootstrap.cc:492] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6: No bootstrap required, opened a new log
I20260709 12:19:19.086611 23541 ts_tablet_manager.cc:1403] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.018s
I20260709 12:19:19.086846 23543 raft_consensus.cc:515] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.087574 23562 leader_election.cc:290] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.088862 23543 leader_election.cc:290] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 election: Requested vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.089210 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6" is_pre_election: true
I20260709 12:19:19.089785 23420 raft_consensus.cc:2468] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 0.
I20260709 12:19:19.089586 23541 raft_consensus.cc:359] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.090389 23541 raft_consensus.cc:385] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.090699 23541 raft_consensus.cc:740] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.090911 23537 ts_tablet_manager.cc:1434] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.002s
I20260709 12:19:19.091125 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:19.091604 23541 consensus_queue.cc:260] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.093499 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96039210dcd54f0ab7724baf3442247e" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:19.094013 23541 ts_tablet_manager.cc:1434] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:19.095002 23541 tablet_bootstrap.cc:492] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6: Bootstrap starting.
I20260709 12:19:19.095693 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96039210dcd54f0ab7724baf3442247e" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:19.096289 23494 raft_consensus.cc:3060] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.097259 23535 tablet_bootstrap.cc:492] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a: Bootstrap starting.
I20260709 12:19:19.101557 23541 tablet_bootstrap.cc:654] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:19.102846 23310 leader_election.cc:343] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.105293 23535 tablet_bootstrap.cc:654] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.105823 23310 leader_election.cc:304] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377; no voters: c3c01853e9ea4f74b345c3fc10cc454a
I20260709 12:19:19.108956 23543 raft_consensus.cc:2804] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.109390 23543 raft_consensus.cc:493] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.109843 23543 raft_consensus.cc:3060] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:19.110245 23310 leader_election.cc:343] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.115473 23537 tablet_bootstrap.cc:492] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377: Bootstrap starting.
I20260709 12:19:19.107208 23494 raft_consensus.cc:2468] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 1.
I20260709 12:19:19.119956 23310 leader_election.cc:304] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 4335df7771044244810c947ea8190bc6
I20260709 12:19:19.122092 23562 raft_consensus.cc:2804] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.122913 23562 raft_consensus.cc:697] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Becoming Leader. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:19.128062 23562 consensus_queue.cc:237] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.129254 23537 tablet_bootstrap.cc:654] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.145181 23243 catalog_manager.cc:5697] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8beeb14299b447fa8bd913de1aab377 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "a8beeb14299b447fa8bd913de1aab377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.148430 23543 raft_consensus.cc:515] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.151134 23535 tablet_bootstrap.cc:492] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a: No bootstrap required, opened a new log
I20260709 12:19:19.152374 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:19.152714 23538 raft_consensus.cc:493] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.152987 23420 raft_consensus.cc:3060] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.153258 23538 raft_consensus.cc:515] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.156829 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:19.158311 23538 leader_election.cc:290] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
W20260709 12:19:19.159178 23310 leader_election.cc:343] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.159277 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e2372c5fa8402cbd8947aca495e0da" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:19.160094 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e2372c5fa8402cbd8947aca495e0da" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6" is_pre_election: true
W20260709 12:19:19.161487 23459 leader_election.cc:343] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:19.164125 23460 leader_election.cc:343] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.164532 23460 leader_election.cc:304] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3c01853e9ea4f74b345c3fc10cc454a; no voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:19.164469 23420 raft_consensus.cc:2468] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 1.
I20260709 12:19:19.165500 23535 ts_tablet_manager.cc:1403] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a: Time spent bootstrapping tablet: real 0.068s	user 0.023s	sys 0.023s
I20260709 12:19:19.156963 23543 leader_election.cc:290] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 election: Requested vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.165799 23310 leader_election.cc:304] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377; no voters: c3c01853e9ea4f74b345c3fc10cc454a
I20260709 12:19:19.166150 23538 raft_consensus.cc:2749] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.166656 23543 raft_consensus.cc:2804] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.167173 23543 raft_consensus.cc:697] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Becoming Leader. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:19.168049 23543 consensus_queue.cc:237] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.168542 23537 tablet_bootstrap.cc:492] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377: No bootstrap required, opened a new log
I20260709 12:19:19.169101 23537 ts_tablet_manager.cc:1403] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.002s
I20260709 12:19:19.168855 23535 raft_consensus.cc:359] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.169582 23535 raft_consensus.cc:385] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.169919 23535 raft_consensus.cc:740] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.170646 23535 consensus_queue.cc:260] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.172595 23541 tablet_bootstrap.cc:492] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6: No bootstrap required, opened a new log
I20260709 12:19:19.173043 23535 ts_tablet_manager.cc:1434] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:19:19.173091 23541 ts_tablet_manager.cc:1403] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.031s
I20260709 12:19:19.172909 23537 raft_consensus.cc:359] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.173969 23537 raft_consensus.cc:385] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.174119 23535 tablet_bootstrap.cc:492] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a: Bootstrap starting.
I20260709 12:19:19.174389 23537 raft_consensus.cc:740] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.175333 23537 consensus_queue.cc:260] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.176348 23541 raft_consensus.cc:359] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:19.177114 23541 raft_consensus.cc:385] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.177407 23541 raft_consensus.cc:740] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.178290 23541 consensus_queue.cc:260] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:19.181422 23535 tablet_bootstrap.cc:654] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.185279 23541 ts_tablet_manager.cc:1434] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:19:19.186367 23541 tablet_bootstrap.cc:492] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6: Bootstrap starting.
I20260709 12:19:19.186510 23244 catalog_manager.cc:5697] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8beeb14299b447fa8bd913de1aab377 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "a8beeb14299b447fa8bd913de1aab377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.190060 23537 ts_tablet_manager.cc:1434] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:19:19.191056 23537 tablet_bootstrap.cc:492] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377: Bootstrap starting.
I20260709 12:19:19.198649 23537 tablet_bootstrap.cc:654] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.201377 23535 tablet_bootstrap.cc:492] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a: No bootstrap required, opened a new log
I20260709 12:19:19.205313 23535 ts_tablet_manager.cc:1403] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.005s
I20260709 12:19:19.206174 23541 tablet_bootstrap.cc:654] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.207913 23545 raft_consensus.cc:493] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.207913 23535 raft_consensus.cc:359] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.208775 23535 raft_consensus.cc:385] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.208544 23545 raft_consensus.cc:515] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.209046 23535 raft_consensus.cc:740] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.209774 23535 consensus_queue.cc:260] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.210948 23545 leader_election.cc:290] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.212538 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:19.213142 23494 raft_consensus.cc:2468] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 0.
I20260709 12:19:19.213842 23535 ts_tablet_manager.cc:1434] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:19:19.214815 23385 leader_election.cc:304] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:19.214972 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:19.215534 23346 raft_consensus.cc:2468] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 0.
I20260709 12:19:19.216470 23535 tablet_bootstrap.cc:492] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a: Bootstrap starting.
I20260709 12:19:19.217622 23545 raft_consensus.cc:2804] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.218199 23545 raft_consensus.cc:493] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.218586 23545 raft_consensus.cc:3060] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.224033 23535 tablet_bootstrap.cc:654] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.227336 23537 tablet_bootstrap.cc:492] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377: No bootstrap required, opened a new log
I20260709 12:19:19.227872 23537 ts_tablet_manager.cc:1403] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.009s
I20260709 12:19:19.229991 23545 raft_consensus.cc:515] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.232291 23537 raft_consensus.cc:359] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.233583 23537 raft_consensus.cc:385] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.235967 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:19.236295 23537 raft_consensus.cc:740] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.236665 23346 raft_consensus.cc:3060] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.237834 23537 consensus_queue.cc:260] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.241321 23537 ts_tablet_manager.cc:1434] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:19:19.242784 23537 tablet_bootstrap.cc:492] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377: Bootstrap starting.
I20260709 12:19:19.247880 23346 raft_consensus.cc:2468] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 1.
I20260709 12:19:19.249091 23386 leader_election.cc:304] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377; no voters: 
I20260709 12:19:19.251454 23537 tablet_bootstrap.cc:654] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.254457 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:19.255146 23494 raft_consensus.cc:3060] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.258064 23535 tablet_bootstrap.cc:492] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a: No bootstrap required, opened a new log
I20260709 12:19:19.258617 23535 ts_tablet_manager.cc:1403] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.018s
I20260709 12:19:19.258651 23545 leader_election.cc:290] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.259315 23545 raft_consensus.cc:2804] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.259678 23537 tablet_bootstrap.cc:492] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377: No bootstrap required, opened a new log
I20260709 12:19:19.259752 23545 raft_consensus.cc:697] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:19.260278 23537 ts_tablet_manager.cc:1403] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:19:19.260663 23545 consensus_queue.cc:237] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.261262 23535 raft_consensus.cc:359] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.261966 23535 raft_consensus.cc:385] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.262238 23535 raft_consensus.cc:740] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.262537 23538 raft_consensus.cc:493] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.262872 23535 consensus_queue.cc:260] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.263126 23537 raft_consensus.cc:359] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.263163 23538 raft_consensus.cc:515] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.264004 23537 raft_consensus.cc:385] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.264663 23537 raft_consensus.cc:740] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.265486 23537 consensus_queue.cc:260] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.267062 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c52881c12e41ad939e025d13f69921" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6" is_pre_election: true
I20260709 12:19:19.235991 23541 tablet_bootstrap.cc:492] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6: No bootstrap required, opened a new log
I20260709 12:19:19.267884 23541 ts_tablet_manager.cc:1403] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.008s
I20260709 12:19:19.269912 23537 ts_tablet_manager.cc:1434] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:19:19.270864 23537 tablet_bootstrap.cc:492] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377: Bootstrap starting.
I20260709 12:19:19.272768 23535 ts_tablet_manager.cc:1434] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
W20260709 12:19:19.273399 23459 leader_election.cc:343] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.274570 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c52881c12e41ad939e025d13f69921" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:19.272189 23541 raft_consensus.cc:359] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.275347 23541 raft_consensus.cc:385] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.275406 23346 raft_consensus.cc:2468] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 0.
I20260709 12:19:19.277063 23582 raft_consensus.cc:493] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.276962 23460 leader_election.cc:304] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 4335df7771044244810c947ea8190bc6
I20260709 12:19:19.277705 23582 raft_consensus.cc:515] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.278381 23560 raft_consensus.cc:2804] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.278878 23560 raft_consensus.cc:493] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.279314 23560 raft_consensus.cc:3060] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.280498 23582 leader_election.cc:290] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.282181 23535 tablet_bootstrap.cc:492] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a: Bootstrap starting.
I20260709 12:19:19.283694 23495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:19.284328 23495 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 0.
I20260709 12:19:19.281566 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:19.285617 23385 leader_election.cc:304] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:19.285751 23345 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 0.
I20260709 12:19:19.282125 23538 leader_election.cc:290] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:19.286118 23537 tablet_bootstrap.cc:654] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.286726 23494 raft_consensus.cc:2468] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 1.
I20260709 12:19:19.275777 23541 raft_consensus.cc:740] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.288615 23242 catalog_manager.cc:5697] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4335df7771044244810c947ea8190bc6 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "4335df7771044244810c947ea8190bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.290618 23541 consensus_queue.cc:260] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.291746 23545 raft_consensus.cc:2804] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.292121 23545 raft_consensus.cc:493] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.292474 23545 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.294258 23541 ts_tablet_manager.cc:1434] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 12:19:19.295490 23541 tablet_bootstrap.cc:492] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6: Bootstrap starting.
I20260709 12:19:19.296231 23560 raft_consensus.cc:515] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.303429 23541 tablet_bootstrap.cc:654] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.305184 23545 raft_consensus.cc:515] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.308130 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:19.308698 23345 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.316334 23345 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 1.
I20260709 12:19:19.317595 23386 leader_election.cc:304] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377; no voters: 
I20260709 12:19:19.318527 23582 raft_consensus.cc:2804] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.319161 23535 tablet_bootstrap.cc:654] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.321187 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c52881c12e41ad939e025d13f69921" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:19.321509 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c52881c12e41ad939e025d13f69921" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:19.321808 23346 raft_consensus.cc:3060] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:19.323014 23459 leader_election.cc:343] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.323536 23560 leader_election.cc:290] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:19.329592 23541 tablet_bootstrap.cc:492] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6: No bootstrap required, opened a new log
I20260709 12:19:19.330183 23541 ts_tablet_manager.cc:1403] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.014s
I20260709 12:19:19.333107 23535 tablet_bootstrap.cc:492] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a: No bootstrap required, opened a new log
I20260709 12:19:19.333768 23535 ts_tablet_manager.cc:1403] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.000s
I20260709 12:19:19.334133 23346 raft_consensus.cc:2468] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 1.
I20260709 12:19:19.335398 23460 leader_election.cc:304] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 4335df7771044244810c947ea8190bc6
I20260709 12:19:19.336161 23560 raft_consensus.cc:2804] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.336712 23560 raft_consensus.cc:697] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Becoming Leader. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Running, Role: LEADER
I20260709 12:19:19.337538 23560 consensus_queue.cc:237] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.344007 23535 raft_consensus.cc:359] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.348569 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:19.349181 23535 raft_consensus.cc:385] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.349449 23494 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.349572 23535 raft_consensus.cc:740] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.350663 23535 consensus_queue.cc:260] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.353286 23535 ts_tablet_manager.cc:1434] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:19:19.347154 23545 leader_election.cc:290] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.354423 23545 raft_consensus.cc:493] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.355005 23545 raft_consensus.cc:515] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.358928 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc0231ce2d5467ea3d745f7fd16fd9e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
W20260709 12:19:19.360908 23386 leader_election.cc:343] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.358729 23541 raft_consensus.cc:359] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.363497 23541 raft_consensus.cc:385] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.363965 23541 raft_consensus.cc:740] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.365269 23582 raft_consensus.cc:697] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:19.366585 23582 consensus_queue.cc:237] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.367394 23494 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 1.
I20260709 12:19:19.371810 23545 leader_election.cc:290] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.372097 23495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc0231ce2d5467ea3d745f7fd16fd9e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:19.373027 23495 raft_consensus.cc:2468] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 0.
I20260709 12:19:19.374846 23385 leader_election.cc:304] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:19.375739 23545 raft_consensus.cc:2804] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.376168 23545 raft_consensus.cc:493] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.376504 23545 raft_consensus.cc:3060] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.364897 23541 consensus_queue.cc:260] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.378842 23242 catalog_manager.cc:5697] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a reported cstate change: term changed from 0 to 1, leader changed from <none> to c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67). New cstate: current_term: 1 leader_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:19.381820 23541 ts_tablet_manager.cc:1434] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.002s
I20260709 12:19:19.381455 23244 catalog_manager.cc:5697] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4335df7771044244810c947ea8190bc6 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "4335df7771044244810c947ea8190bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.382761 23541 tablet_bootstrap.cc:492] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6: Bootstrap starting.
I20260709 12:19:19.383646 23545 raft_consensus.cc:515] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.386720 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc0231ce2d5467ea3d745f7fd16fd9e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:19.387111 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc0231ce2d5467ea3d745f7fd16fd9e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:19.387701 23494 raft_consensus.cc:3060] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.387894 23537 tablet_bootstrap.cc:492] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377: No bootstrap required, opened a new log
W20260709 12:19:19.388003 23386 leader_election.cc:343] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.388388 23537 ts_tablet_manager.cc:1403] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377: Time spent bootstrapping tablet: real 0.118s	user 0.028s	sys 0.061s
I20260709 12:19:19.392223 23537 raft_consensus.cc:359] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.392875 23537 raft_consensus.cc:385] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.393128 23537 raft_consensus.cc:740] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.393744 23537 consensus_queue.cc:260] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.395957 23545 leader_election.cc:290] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.397862 23537 ts_tablet_manager.cc:1434] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:19:19.398841 23537 tablet_bootstrap.cc:492] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377: Bootstrap starting.
I20260709 12:19:19.404143 23494 raft_consensus.cc:2468] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 1.
I20260709 12:19:19.405330 23541 tablet_bootstrap.cc:654] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.405519 23385 leader_election.cc:304] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:19.411304 23537 tablet_bootstrap.cc:654] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.411382 23545 raft_consensus.cc:2804] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.414644 23582 raft_consensus.cc:493] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.415565 23582 raft_consensus.cc:515] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.415025 23545 raft_consensus.cc:697] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:19.417131 23545 consensus_queue.cc:237] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.417644 23582 leader_election.cc:290] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.422369 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e2372c5fa8402cbd8947aca495e0da" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:19.423239 23346 raft_consensus.cc:2468] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 0.
I20260709 12:19:19.425707 23386 leader_election.cc:304] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377; no voters: 
I20260709 12:19:19.427498 23541 tablet_bootstrap.cc:492] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6: No bootstrap required, opened a new log
I20260709 12:19:19.427977 23541 ts_tablet_manager.cc:1403] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.003s
I20260709 12:19:19.429695 23589 raft_consensus.cc:2804] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.430123 23589 raft_consensus.cc:493] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.430459 23589 raft_consensus.cc:3060] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.431118 23537 tablet_bootstrap.cc:492] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377: No bootstrap required, opened a new log
I20260709 12:19:19.431015 23541 raft_consensus.cc:359] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.431567 23537 ts_tablet_manager.cc:1403] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.007s
I20260709 12:19:19.431785 23541 raft_consensus.cc:385] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.432057 23541 raft_consensus.cc:740] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.432787 23541 consensus_queue.cc:260] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.434175 23537 raft_consensus.cc:359] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.434851 23537 raft_consensus.cc:385] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.435047 23541 ts_tablet_manager.cc:1434] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:19.435101 23537 raft_consensus.cc:740] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.436170 23541 tablet_bootstrap.cc:492] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6: Bootstrap starting.
I20260709 12:19:19.437994 23537 consensus_queue.cc:260] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.438274 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e2372c5fa8402cbd8947aca495e0da" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:19.438930 23494 raft_consensus.cc:2468] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 0.
I20260709 12:19:19.440038 23537 ts_tablet_manager.cc:1434] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:19.441347 23589 raft_consensus.cc:515] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.442746 23541 tablet_bootstrap.cc:654] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.444229 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e2372c5fa8402cbd8947aca495e0da" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:19.444794 23346 raft_consensus.cc:3060] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.447522 23589 leader_election.cc:290] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.448658 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e2372c5fa8402cbd8947aca495e0da" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:19.449255 23494 raft_consensus.cc:3060] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.453984 23494 raft_consensus.cc:2468] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 1.
I20260709 12:19:19.455119 23385 leader_election.cc:304] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:19.458153 23346 raft_consensus.cc:2468] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 1.
I20260709 12:19:19.459517 23589 raft_consensus.cc:2804] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.460079 23589 raft_consensus.cc:697] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:19.459227 23242 catalog_manager.cc:5697] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4335df7771044244810c947ea8190bc6 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "4335df7771044244810c947ea8190bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.460947 23589 consensus_queue.cc:237] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.462046 23541 tablet_bootstrap.cc:492] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6: No bootstrap required, opened a new log
I20260709 12:19:19.462487 23541 ts_tablet_manager.cc:1403] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.007s
I20260709 12:19:19.465379 23541 raft_consensus.cc:359] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.465896 23541 raft_consensus.cc:385] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.466168 23541 raft_consensus.cc:740] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.466810 23541 consensus_queue.cc:260] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.468577 23541 ts_tablet_manager.cc:1434] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:19.470358 23560 consensus_queue.cc:1048] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.476140 23242 catalog_manager.cc:5697] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4335df7771044244810c947ea8190bc6 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "4335df7771044244810c947ea8190bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.477545 23589 raft_consensus.cc:493] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.478219 23589 raft_consensus.cc:515] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.481766 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96039210dcd54f0ab7724baf3442247e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:19.482215 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96039210dcd54f0ab7724baf3442247e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:19.482566 23494 raft_consensus.cc:2393] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4335df7771044244810c947ea8190bc6 in current term 1: Already voted for candidate a8beeb14299b447fa8bd913de1aab377 in this term.
I20260709 12:19:19.483820 23589 leader_election.cc:290] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.484481 23386 leader_election.cc:304] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4335df7771044244810c947ea8190bc6; no voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a
I20260709 12:19:19.485641 23589 raft_consensus.cc:3060] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.495134 23545 raft_consensus.cc:493] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.495618 23589 raft_consensus.cc:2749] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.495709 23545 raft_consensus.cc:515] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:19.498291 23545 leader_election.cc:290] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999), a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391)
I20260709 12:19:19.499900 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:19.499902 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:19.501051 23494 raft_consensus.cc:2393] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4335df7771044244810c947ea8190bc6 in current term 1: Already voted for candidate a8beeb14299b447fa8bd913de1aab377 in this term.
I20260709 12:19:19.503093 23385 leader_election.cc:304] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4335df7771044244810c947ea8190bc6; no voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a
I20260709 12:19:19.505125 23545 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.511224 23538 consensus_queue.cc:1048] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.516305 23545 raft_consensus.cc:2749] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.530844 23560 raft_consensus.cc:493] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.531411 23560 raft_consensus.cc:515] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.533553 23560 leader_election.cc:290] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:19.534281 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:19.534695 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6" is_pre_election: true
I20260709 12:19:19.535427 23420 raft_consensus.cc:2393] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3c01853e9ea4f74b345c3fc10cc454a in current term 1: Already voted for candidate a8beeb14299b447fa8bd913de1aab377 in this term.
I20260709 12:19:19.536284 23459 leader_election.cc:304] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3c01853e9ea4f74b345c3fc10cc454a; no voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:19.536953 23560 raft_consensus.cc:3060] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.541606 23560 raft_consensus.cc:2749] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.560915 23543 consensus_queue.cc:1048] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.571703 23562 consensus_queue.cc:1048] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.604843 23562 consensus_queue.cc:1048] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.618475 23606 consensus_queue.cc:1048] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:19.658214 23560 raft_consensus.cc:493] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.658737 23560 raft_consensus.cc:515] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.660504 23560 leader_election.cc:290] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:19.661288 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:19.661500 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6" is_pre_election: true
I20260709 12:19:19.661823 23346 raft_consensus.cc:2468] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 0.
I20260709 12:19:19.662086 23420 raft_consensus.cc:2468] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 0.
I20260709 12:19:19.662873 23460 leader_election.cc:304] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:19.663530 23560 raft_consensus.cc:2804] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.663875 23560 raft_consensus.cc:493] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.664098 23560 raft_consensus.cc:3060] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.668629 23560 raft_consensus.cc:515] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.670187 23560 leader_election.cc:290] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:19.670929 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:19.671159 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:19.671409 23346 raft_consensus.cc:3060] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.671758 23420 raft_consensus.cc:3060] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.676102 23346 raft_consensus.cc:2468] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 1.
I20260709 12:19:19.676124 23420 raft_consensus.cc:2468] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 1.
I20260709 12:19:19.677232 23460 leader_election.cc:304] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:19.677942 23560 raft_consensus.cc:2804] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.678472 23560 raft_consensus.cc:697] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Becoming Leader. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Running, Role: LEADER
I20260709 12:19:19.679208 23560 consensus_queue.cc:237] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.686591 23242 catalog_manager.cc:5697] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a reported cstate change: term changed from 0 to 1, leader changed from <none> to c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67). New cstate: current_term: 1 leader_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:19.702499 23606 consensus_queue.cc:1048] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.711560 23543 consensus_queue.cc:1048] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.735713 23420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e"
dest_uuid: "4335df7771044244810c947ea8190bc6"
mode: GRACEFUL
new_leader_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:36522
I20260709 12:19:19.736274 23420 raft_consensus.cc:606] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Received request to transfer leadership to TS a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:19.748984 23494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b654d14a5a7e4911a2adce199f0bae49"
dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
mode: GRACEFUL
new_leader_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:49990
I20260709 12:19:19.749563 23494 raft_consensus.cc:606] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Received request to transfer leadership to TS a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:19.754653 23420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c"
dest_uuid: "4335df7771044244810c947ea8190bc6"
mode: GRACEFUL
new_leader_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:36522
I20260709 12:19:19.755162 23420 raft_consensus.cc:606] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Received request to transfer leadership to TS a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:19.760504 23545 consensus_queue.cc:1048] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.768165 23587 raft_consensus.cc:993] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6: : Instructing follower a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:19.768651 23587 raft_consensus.cc:1081] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Signalling peer a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:19.770246 23494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f"
dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
mode: GRACEFUL
new_leader_uuid: "4335df7771044244810c947ea8190bc6"
 from {username='slave'} at 127.0.0.1:49990
I20260709 12:19:19.770872 23494 raft_consensus.cc:606] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Received request to transfer leadership to TS 4335df7771044244810c947ea8190bc6
I20260709 12:19:19.771113 23345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:44332
I20260709 12:19:19.771807 23345 raft_consensus.cc:493] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:19.772161 23345 raft_consensus.cc:3060] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.778286 23545 consensus_queue.cc:1048] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.780700 23345 raft_consensus.cc:515] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.787839 23345 leader_election.cc:290] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 2 election: Requested vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.790623 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:19.791241 23420 raft_consensus.cc:3055] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.791600 23420 raft_consensus.cc:740] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:19.792135 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:19.792692 23494 raft_consensus.cc:3060] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.792397 23420 consensus_queue.cc:260] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.793663 23420 raft_consensus.cc:3060] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.798241 23545 raft_consensus.cc:493] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.798800 23545 raft_consensus.cc:515] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.800827 23494 raft_consensus.cc:2468] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 2.
I20260709 12:19:19.800827 23420 raft_consensus.cc:2468] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 2.
I20260709 12:19:19.801998 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c52881c12e41ad939e025d13f69921" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8beeb14299b447fa8bd913de1aab377" is_pre_election: true
I20260709 12:19:19.802217 23310 leader_election.cc:304] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377; no voters: 
I20260709 12:19:19.802883 23345 raft_consensus.cc:2393] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4335df7771044244810c947ea8190bc6 in current term 1: Already voted for candidate c3c01853e9ea4f74b345c3fc10cc454a in this term.
I20260709 12:19:19.803210 23543 raft_consensus.cc:2804] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:19.803679 23543 raft_consensus.cc:697] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Becoming Leader. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:19.804543 23543 consensus_queue.cc:237] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:19.808305 23545 leader_election.cc:290] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:19.808135 23345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96039210dcd54f0ab7724baf3442247e"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
mode: GRACEFUL
new_leader_uuid: "4335df7771044244810c947ea8190bc6"
 from {username='slave'} at 127.0.0.1:44336
I20260709 12:19:19.808972 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c52881c12e41ad939e025d13f69921" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" is_pre_election: true
I20260709 12:19:19.809257 23345 raft_consensus.cc:606] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Received request to transfer leadership to TS 4335df7771044244810c947ea8190bc6
I20260709 12:19:19.810436 23385 leader_election.cc:304] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4335df7771044244810c947ea8190bc6; no voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a
I20260709 12:19:19.811218 23545 raft_consensus.cc:3060] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.814221 23242 catalog_manager.cc:5697] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 reported cstate change: term changed from 1 to 2, leader changed from 4335df7771044244810c947ea8190bc6 (127.22.43.66) to a8beeb14299b447fa8bd913de1aab377 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "a8beeb14299b447fa8bd913de1aab377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.818920 23545 raft_consensus.cc:2749] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.829320 23560 consensus_queue.cc:1048] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.839183 23538 consensus_queue.cc:1048] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.870609 23545 consensus_queue.cc:1048] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.880003 23345 raft_consensus.cc:3060] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.886780 23589 consensus_queue.cc:1048] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.970722 23589 consensus_queue.cc:1048] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.977612 23545 consensus_queue.cc:1048] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.982882 23587 consensus_queue.cc:1048] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.994251 23587 raft_consensus.cc:993] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6: : Instructing follower a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:19.994683 23587 raft_consensus.cc:1081] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Signalling peer a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:19.997495 23346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:44332
I20260709 12:19:19.998090 23346 raft_consensus.cc:493] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:19.998509 23346 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.004616 23582 consensus_queue.cc:1048] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.006851 23600 raft_consensus.cc:993] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a: : Instructing follower a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:20.007302 23600 raft_consensus.cc:1081] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Signalling peer a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:20.007822 23346 raft_consensus.cc:515] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.010089 23346 leader_election.cc:290] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 2 election: Requested vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:20.011472 23345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b654d14a5a7e4911a2adce199f0bae49"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:44328
I20260709 12:19:20.012032 23345 raft_consensus.cc:493] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.012363 23345 raft_consensus.cc:3060] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.014689 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:20.015506 23420 raft_consensus.cc:3055] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.015921 23420 raft_consensus.cc:740] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:20.016965 23420 consensus_queue.cc:260] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.019767 23495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:20.020040 23420 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.020388 23495 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.017982 23345 raft_consensus.cc:515] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.028168 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b654d14a5a7e4911a2adce199f0bae49" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:20.028744 23420 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 2.
I20260709 12:19:20.028784 23421 raft_consensus.cc:3060] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.030835 23345 leader_election.cc:290] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 2 election: Requested vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:20.031067 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b654d14a5a7e4911a2adce199f0bae49" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:20.031788 23494 raft_consensus.cc:3055] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.032150 23494 raft_consensus.cc:740] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Running, Role: LEADER
I20260709 12:19:20.033118 23494 consensus_queue.cc:260] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.034149 23495 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 2.
I20260709 12:19:20.035357 23310 leader_election.cc:304] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:20.035705 23421 raft_consensus.cc:2468] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 2.
I20260709 12:19:20.034435 23494 raft_consensus.cc:3060] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.036118 23543 raft_consensus.cc:2804] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:20.036718 23543 raft_consensus.cc:697] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Becoming Leader. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:20.036993 23310 leader_election.cc:304] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377; no voters: 
I20260709 12:19:20.037871 23562 raft_consensus.cc:2804] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:20.037576 23543 consensus_queue.cc:237] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.038552 23562 raft_consensus.cc:697] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Becoming Leader. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:20.039398 23562 consensus_queue.cc:237] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.042686 23494 raft_consensus.cc:2468] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 2.
I20260709 12:19:20.048731 23243 catalog_manager.cc:5697] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 reported cstate change: term changed from 1 to 2, leader changed from 4335df7771044244810c947ea8190bc6 (127.22.43.66) to a8beeb14299b447fa8bd913de1aab377 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "a8beeb14299b447fa8bd913de1aab377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.050062 23243 catalog_manager.cc:5697] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 reported cstate change: term changed from 1 to 2, leader changed from c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67) to a8beeb14299b447fa8bd913de1aab377 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "a8beeb14299b447fa8bd913de1aab377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.142831 23538 consensus_queue.cc:1048] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.149273 23560 raft_consensus.cc:993] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a: : Instructing follower 4335df7771044244810c947ea8190bc6 to start an election
I20260709 12:19:20.149732 23600 raft_consensus.cc:1081] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Signalling peer 4335df7771044244810c947ea8190bc6 to start an election
I20260709 12:19:20.153314 23421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f"
dest_uuid: "4335df7771044244810c947ea8190bc6"
 from {username='slave'} at 127.0.0.1:36502
I20260709 12:19:20.154491 23600 consensus_queue.cc:1048] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.155220 23421 raft_consensus.cc:493] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.155652 23421 raft_consensus.cc:3060] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.162781 23421 raft_consensus.cc:515] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.166747 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:20.167002 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:20.167403 23345 raft_consensus.cc:3060] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.167552 23494 raft_consensus.cc:3055] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.167909 23494 raft_consensus.cc:740] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Running, Role: LEADER
I20260709 12:19:20.168705 23494 consensus_queue.cc:260] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.169817 23494 raft_consensus.cc:3060] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.170010 23421 leader_election.cc:290] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 2 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:20.174508 23345 raft_consensus.cc:2468] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 2.
I20260709 12:19:20.175717 23386 leader_election.cc:304] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377; no voters: 
I20260709 12:19:20.176540 23582 raft_consensus.cc:2804] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:20.177016 23582 raft_consensus.cc:697] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 2 LEADER]: Becoming Leader. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:20.177143 23494 raft_consensus.cc:2468] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 2.
I20260709 12:19:20.177922 23582 consensus_queue.cc:237] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.178697 23606 raft_consensus.cc:993] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377: : Instructing follower 4335df7771044244810c947ea8190bc6 to start an election
I20260709 12:19:20.179128 23606 raft_consensus.cc:1081] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Signalling peer 4335df7771044244810c947ea8190bc6 to start an election
I20260709 12:19:20.181558 23420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96039210dcd54f0ab7724baf3442247e"
dest_uuid: "4335df7771044244810c947ea8190bc6"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:19:20.182134 23420 raft_consensus.cc:493] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.182423 23420 raft_consensus.cc:3060] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.186820 23243 catalog_manager.cc:5697] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 reported cstate change: term changed from 1 to 2, leader changed from c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67) to 4335df7771044244810c947ea8190bc6 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "4335df7771044244810c947ea8190bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.189065 23420 raft_consensus.cc:515] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.190965 23420 leader_election.cc:290] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 2 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:20.192135 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96039210dcd54f0ab7724baf3442247e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:20.192727 23494 raft_consensus.cc:3060] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.193228 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96039210dcd54f0ab7724baf3442247e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:20.193810 23345 raft_consensus.cc:3055] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.194150 23345 raft_consensus.cc:740] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:20.195495 23345 consensus_queue.cc:260] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.197719 23345 raft_consensus.cc:3060] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.200073 23494 raft_consensus.cc:2468] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 2.
I20260709 12:19:20.201503 23385 leader_election.cc:304] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:20.202425 23582 raft_consensus.cc:2804] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:20.202921 23582 raft_consensus.cc:697] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 2 LEADER]: Becoming Leader. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:20.203763 23582 consensus_queue.cc:237] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:20.204675 23345 raft_consensus.cc:2468] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 2.
I20260709 12:19:20.210675 23243 catalog_manager.cc:5697] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 reported cstate change: term changed from 1 to 2, leader changed from a8beeb14299b447fa8bd913de1aab377 (127.22.43.65) to 4335df7771044244810c947ea8190bc6 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "4335df7771044244810c947ea8190bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.261269 23420 raft_consensus.cc:1275] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.262748 23543 consensus_queue.cc:1048] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:20.271687 23494 raft_consensus.cc:1275] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.273257 23543 consensus_queue.cc:1048] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:20.553231 23420 raft_consensus.cc:1275] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.554587 23543 consensus_queue.cc:1048] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:20.557981 23494 raft_consensus.cc:1275] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.559291 23543 consensus_queue.cc:1048] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:20.563045 23495 raft_consensus.cc:1275] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.564934 23562 consensus_queue.cc:1048] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:20.575251 23420 raft_consensus.cc:1275] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.578387 23495 raft_consensus.cc:1275] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Refusing update from remote peer 4335df7771044244810c947ea8190bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.578199 23543 consensus_queue.cc:1048] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:20.579988 23582 consensus_queue.cc:1048] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:20.588617 23345 raft_consensus.cc:1275] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Refusing update from remote peer 4335df7771044244810c947ea8190bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.590806 23545 consensus_queue.cc:1048] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:20.675251 23495 raft_consensus.cc:1275] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Refusing update from remote peer 4335df7771044244810c947ea8190bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.676545 23545 consensus_queue.cc:1048] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:20.683714 23345 raft_consensus.cc:1275] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Refusing update from remote peer 4335df7771044244810c947ea8190bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.685397 23545 consensus_queue.cc:1048] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:22.088670 23516 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4a80 after lost signal to thread 22704
W20260709 12:19:22.089574 23516 debug-util.cc:398] Leaking SignalData structure 0x7b08001d8160 after lost signal to thread 23278
W20260709 12:19:22.090565 23516 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8680 after lost signal to thread 23370
W20260709 12:19:22.091380 23516 debug-util.cc:398] Leaking SignalData structure 0x7b0800195c60 after lost signal to thread 23445
W20260709 12:19:22.092168 23516 debug-util.cc:398] Leaking SignalData structure 0x7b08001d60e0 after lost signal to thread 23519
I20260709 12:19:22.918427 22701 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:19:22.919159 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:22.943781 23345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
mode: GRACEFUL
new_leader_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
 from {username='slave'} at 127.0.0.1:44344
I20260709 12:19:22.944486 23345 raft_consensus.cc:606] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Received request to transfer leadership to TS c3c01853e9ea4f74b345c3fc10cc454a
I20260709 12:19:22.950496 23345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
mode: GRACEFUL
new_leader_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
 from {username='slave'} at 127.0.0.1:44344
I20260709 12:19:22.951195 23345 raft_consensus.cc:606] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Received request to transfer leadership to TS c3c01853e9ea4f74b345c3fc10cc454a
I20260709 12:19:22.952628 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:22.953245 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:23.129953 23634 raft_consensus.cc:993] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377: : Instructing follower c3c01853e9ea4f74b345c3fc10cc454a to start an election
I20260709 12:19:23.130493 23630 raft_consensus.cc:1081] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Signalling peer c3c01853e9ea4f74b345c3fc10cc454a to start an election
I20260709 12:19:23.132246 23494 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c"
dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
 from {username='slave'} at 127.0.0.1:49968
I20260709 12:19:23.132714 23494 raft_consensus.cc:493] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.133005 23494 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.137502 23494 raft_consensus.cc:515] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:23.139088 23494 leader_election.cc:290] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 3 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:23.139860 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:23.140298 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:23.140450 23345 raft_consensus.cc:3055] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:23.140885 23421 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.141134 23345 raft_consensus.cc:740] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:23.142000 23345 consensus_queue.cc:260] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:23.143230 23345 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.147920 23421 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 3.
I20260709 12:19:23.150099 23459 leader_election.cc:304] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:23.150954 23600 raft_consensus.cc:2804] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:23.150072 23345 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 3.
I20260709 12:19:23.156919 23600 raft_consensus.cc:697] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 3 LEADER]: Becoming Leader. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Running, Role: LEADER
I20260709 12:19:23.158414 23600 consensus_queue.cc:237] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:23.172993 23244 catalog_manager.cc:5697] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a reported cstate change: term changed from 2 to 3, leader changed from a8beeb14299b447fa8bd913de1aab377 (127.22.43.65) to c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67). New cstate: current_term: 3 leader_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.209738 23634 raft_consensus.cc:993] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377: : Instructing follower c3c01853e9ea4f74b345c3fc10cc454a to start an election
I20260709 12:19:23.210273 23630 raft_consensus.cc:1081] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Signalling peer c3c01853e9ea4f74b345c3fc10cc454a to start an election
I20260709 12:19:23.211789 23494 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1"
dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
 from {username='slave'} at 127.0.0.1:49968
I20260709 12:19:23.212325 23494 raft_consensus.cc:493] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.212654 23494 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.218266 23494 raft_consensus.cc:515] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:23.220785 23494 leader_election.cc:290] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 2 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:23.221220 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:23.221952 23345 raft_consensus.cc:3055] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:23.222329 23345 raft_consensus.cc:740] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:23.223476 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:23.223224 23345 consensus_queue.cc:260] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:23.224061 23421 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.224637 23345 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.231994 23421 raft_consensus.cc:2468] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 2.
I20260709 12:19:23.232096 23345 raft_consensus.cc:2468] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 2.
I20260709 12:19:23.233572 23460 leader_election.cc:304] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:23.234474 23600 raft_consensus.cc:2804] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:23.234949 23600 raft_consensus.cc:697] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 LEADER]: Becoming Leader. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Running, Role: LEADER
I20260709 12:19:23.235790 23600 consensus_queue.cc:237] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:23.243865 23244 catalog_manager.cc:5697] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a reported cstate change: term changed from 1 to 2, leader changed from a8beeb14299b447fa8bd913de1aab377 (127.22.43.65) to c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67). New cstate: current_term: 2 leader_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.652446 23345 raft_consensus.cc:1275] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Refusing update from remote peer c3c01853e9ea4f74b345c3fc10cc454a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:23.653890 23600 consensus_queue.cc:1048] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:23.665609 23421 raft_consensus.cc:1275] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Refusing update from remote peer c3c01853e9ea4f74b345c3fc10cc454a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:23.674453 23635 consensus_queue.cc:1048] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:23.801716 23345 raft_consensus.cc:1275] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Refusing update from remote peer c3c01853e9ea4f74b345c3fc10cc454a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.803602 23635 consensus_queue.cc:1048] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.804847 23421 raft_consensus.cc:1275] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Refusing update from remote peer c3c01853e9ea4f74b345c3fc10cc454a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.806350 23635 consensus_queue.cc:1048] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.954495 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:23.960988 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:23.961598 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:24.962632 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:24.968580 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:24.969041 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:25.970095 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:25.975467 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:25.975929 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:26.976915 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:26.982956 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:26.983424 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:27.984664 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:27.990932 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:27.991379 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:28.992692 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:28.998638 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:28.999065 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:30.000056 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:30.006068 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:30.006582 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:31.007714 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:31.013420 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:31.013940 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:32.015087 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:32.022042 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:32.022504 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:33.057947 22701 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:19:33.062952 23495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1"
dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
mode: GRACEFUL
new_leader_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:49990
I20260709 12:19:33.063953 23495 raft_consensus.cc:606] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 LEADER]: Received request to transfer leadership to TS a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:33.074891 23495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c"
dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
mode: GRACEFUL
new_leader_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:49990
I20260709 12:19:33.075436 23495 raft_consensus.cc:606] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 3 LEADER]: Received request to transfer leadership to TS a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:33.083987 23421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dc0231ce2d5467ea3d745f7fd16fd9e"
dest_uuid: "4335df7771044244810c947ea8190bc6"
mode: GRACEFUL
new_leader_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:36522
I20260709 12:19:33.084498 23421 raft_consensus.cc:606] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Received request to transfer leadership to TS a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:33.089831 23421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0e2372c5fa8402cbd8947aca495e0da"
dest_uuid: "4335df7771044244810c947ea8190bc6"
mode: GRACEFUL
new_leader_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:36522
I20260709 12:19:33.090353 23421 raft_consensus.cc:606] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Received request to transfer leadership to TS a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:33.095252 23421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f"
dest_uuid: "4335df7771044244810c947ea8190bc6"
mode: GRACEFUL
new_leader_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:36522
I20260709 12:19:33.095819 23421 raft_consensus.cc:606] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 2 LEADER]: Received request to transfer leadership to TS a8beeb14299b447fa8bd913de1aab377
I20260709 12:19:33.124221 23654 raft_consensus.cc:993] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6: : Instructing follower a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:33.124717 23661 raft_consensus.cc:1081] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Signalling peer a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:33.126477 23346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0e2372c5fa8402cbd8947aca495e0da"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:44332
I20260709 12:19:33.126943 23346 raft_consensus.cc:493] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.127236 23346 raft_consensus.cc:3060] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.132972 23346 raft_consensus.cc:515] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.135097 23346 leader_election.cc:290] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 2 election: Requested vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:33.136142 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e2372c5fa8402cbd8947aca495e0da" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:33.136708 23495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e2372c5fa8402cbd8947aca495e0da" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:33.136828 23421 raft_consensus.cc:3055] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:33.137223 23495 raft_consensus.cc:3060] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.137234 23421 raft_consensus.cc:740] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:33.138361 23421 consensus_queue.cc:260] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.139420 23421 raft_consensus.cc:3060] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.142819 23495 raft_consensus.cc:2468] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 2.
I20260709 12:19:33.144207 23310 leader_election.cc:304] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:33.145328 23652 raft_consensus.cc:2804] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:33.145769 23421 raft_consensus.cc:2468] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 2.
I20260709 12:19:33.146435 23652 raft_consensus.cc:697] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Becoming Leader. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:33.147410 23652 consensus_queue.cc:237] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.154676 23244 catalog_manager.cc:5697] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 reported cstate change: term changed from 1 to 2, leader changed from 4335df7771044244810c947ea8190bc6 (127.22.43.66) to a8beeb14299b447fa8bd913de1aab377 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "a8beeb14299b447fa8bd913de1aab377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.204166 23661 raft_consensus.cc:993] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6: : Instructing follower a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:33.204566 23635 raft_consensus.cc:993] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a: : Instructing follower a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:33.204691 23661 raft_consensus.cc:1081] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Signalling peer a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:33.205164 23635 raft_consensus.cc:1081] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 LEADER]: Signalling peer a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:33.206414 23346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dc0231ce2d5467ea3d745f7fd16fd9e"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:44332
I20260709 12:19:33.206986 23346 raft_consensus.cc:493] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.206985 23345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:44328
I20260709 12:19:33.207522 23346 raft_consensus.cc:3060] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.207682 23345 raft_consensus.cc:493] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.208097 23345 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.215057 23346 raft_consensus.cc:515] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.215070 23345 raft_consensus.cc:515] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:33.217175 23345 leader_election.cc:290] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 3 election: Requested vote from peers c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:33.217165 23346 leader_election.cc:290] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 2 election: Requested vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:33.218102 23495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:33.218729 23495 raft_consensus.cc:3055] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:33.218874 23494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc0231ce2d5467ea3d745f7fd16fd9e" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:33.219091 23495 raft_consensus.cc:740] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Running, Role: LEADER
I20260709 12:19:33.219327 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dc0231ce2d5467ea3d745f7fd16fd9e" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:33.219486 23494 raft_consensus.cc:3060] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.219413 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:33.219866 23421 raft_consensus.cc:3055] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:33.220006 23420 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.220326 23421 raft_consensus.cc:740] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:33.219920 23495 consensus_queue.cc:260] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:33.221247 23421 consensus_queue.cc:260] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.221689 23495 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.223083 23421 raft_consensus.cc:3060] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.227537 23494 raft_consensus.cc:2468] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 2.
I20260709 12:19:33.228647 23310 leader_election.cc:304] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:33.229367 23652 raft_consensus.cc:2804] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:33.229827 23652 raft_consensus.cc:697] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Becoming Leader. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:33.229846 23420 raft_consensus.cc:2468] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 3.
I20260709 12:19:33.231048 23310 leader_election.cc:304] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377; no voters: 
I20260709 12:19:33.231243 23421 raft_consensus.cc:2468] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 2.
I20260709 12:19:33.230952 23652 consensus_queue.cc:237] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.231961 23662 raft_consensus.cc:2804] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:33.232411 23495 raft_consensus.cc:2468] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 3.
I20260709 12:19:33.234938 23662 raft_consensus.cc:697] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 3 LEADER]: Becoming Leader. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:33.236048 23662 consensus_queue.cc:237] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:33.239166 23244 catalog_manager.cc:5697] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 reported cstate change: term changed from 1 to 2, leader changed from 4335df7771044244810c947ea8190bc6 (127.22.43.66) to a8beeb14299b447fa8bd913de1aab377 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "a8beeb14299b447fa8bd913de1aab377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.250773 23244 catalog_manager.cc:5697] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 reported cstate change: term changed from 2 to 3, leader changed from c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67) to a8beeb14299b447fa8bd913de1aab377 (127.22.43.65). New cstate: current_term: 3 leader_uuid: "a8beeb14299b447fa8bd913de1aab377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.295799 23668 raft_consensus.cc:993] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a: : Instructing follower a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:33.296231 23635 raft_consensus.cc:1081] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 3 LEADER]: Signalling peer a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:33.297484 23345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:44328
I20260709 12:19:33.298015 23345 raft_consensus.cc:493] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.298306 23345 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:33.302665 23345 raft_consensus.cc:515] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.304183 23345 leader_election.cc:290] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 4 election: Requested vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:33.304955 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:33.305176 23495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:33.305562 23421 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:33.305727 23495 raft_consensus.cc:3055] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:33.306099 23495 raft_consensus.cc:740] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Running, Role: LEADER
I20260709 12:19:33.307127 23495 consensus_queue.cc:260] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.308254 23495 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:33.310598 23421 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 4.
I20260709 12:19:33.311977 23310 leader_election.cc:304] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, a8beeb14299b447fa8bd913de1aab377; no voters: 
I20260709 12:19:33.312654 23662 raft_consensus.cc:2804] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:33.313166 23662 raft_consensus.cc:697] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 4 LEADER]: Becoming Leader. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:33.313833 23495 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 4.
I20260709 12:19:33.314218 23662 consensus_queue.cc:237] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.321857 23244 catalog_manager.cc:5697] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 reported cstate change: term changed from 3 to 4, leader changed from c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67) to a8beeb14299b447fa8bd913de1aab377 (127.22.43.65). New cstate: current_term: 4 leader_uuid: "a8beeb14299b447fa8bd913de1aab377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.382619 23654 raft_consensus.cc:993] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6: : Instructing follower a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:33.383069 23661 raft_consensus.cc:1081] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 2 LEADER]: Signalling peer a8beeb14299b447fa8bd913de1aab377 to start an election
I20260709 12:19:33.384588 23345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
 from {username='slave'} at 127.0.0.1:44332
I20260709 12:19:33.385058 23345 raft_consensus.cc:493] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.385344 23345 raft_consensus.cc:3060] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.390316 23345 raft_consensus.cc:515] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.391732 23345 leader_election.cc:290] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 3 election: Requested vote from peers 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:33.392525 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:33.392755 23495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837f4b67331f47d3aba4b8357ce8c57f" candidate_uuid: "a8beeb14299b447fa8bd913de1aab377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:33.393103 23421 raft_consensus.cc:3055] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:33.393282 23495 raft_consensus.cc:3060] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.393419 23421 raft_consensus.cc:740] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:33.394287 23421 consensus_queue.cc:260] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.395437 23421 raft_consensus.cc:3060] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.400063 23495 raft_consensus.cc:2468] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 3.
I20260709 12:19:33.401134 23310 leader_election.cc:304] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8beeb14299b447fa8bd913de1aab377, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:33.401481 23421 raft_consensus.cc:2468] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8beeb14299b447fa8bd913de1aab377 in term 3.
I20260709 12:19:33.401827 23662 raft_consensus.cc:2804] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:33.402350 23662 raft_consensus.cc:697] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 3 LEADER]: Becoming Leader. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:33.403151 23662 consensus_queue.cc:237] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:33.410341 23244 catalog_manager.cc:5697] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 reported cstate change: term changed from 2 to 3, leader changed from 4335df7771044244810c947ea8190bc6 (127.22.43.66) to a8beeb14299b447fa8bd913de1aab377 (127.22.43.65). New cstate: current_term: 3 leader_uuid: "a8beeb14299b447fa8bd913de1aab377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.617982 23421 raft_consensus.cc:1275] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:33.619448 23662 consensus_queue.cc:1048] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:33.628147 23421 raft_consensus.cc:1275] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:33.629901 23669 consensus_queue.cc:1048] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:33.635977 23495 raft_consensus.cc:1275] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:33.637570 23652 consensus_queue.cc:1048] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:33.649034 23494 raft_consensus.cc:1275] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:33.651180 23669 consensus_queue.cc:1048] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:33.656615 23494 raft_consensus.cc:1275] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:33.658582 23669 consensus_queue.cc:1048] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:33.669239 23421 raft_consensus.cc:1275] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:33.670527 23652 consensus_queue.cc:1048] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:33.760460 23494 raft_consensus.cc:1275] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 4 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:33.761814 23652 consensus_queue.cc:1048] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:33.770844 23421 raft_consensus.cc:1275] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 4 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:33.772280 23652 consensus_queue.cc:1048] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:33.832823 23494 raft_consensus.cc:1275] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:33.834043 23652 consensus_queue.cc:1048] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:33.842854 23421 raft_consensus.cc:1275] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Refusing update from remote peer a8beeb14299b447fa8bd913de1aab377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:33.844331 23662 consensus_queue.cc:1048] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:36.134795 22701 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:19:36.135542 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:36.143548 23345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
mode: GRACEFUL
new_leader_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
 from {username='slave'} at 127.0.0.1:44344
I20260709 12:19:36.144138 23345 raft_consensus.cc:606] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Received request to transfer leadership to TS c3c01853e9ea4f74b345c3fc10cc454a
I20260709 12:19:36.146838 23345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
mode: GRACEFUL
new_leader_uuid: "4335df7771044244810c947ea8190bc6"
 from {username='slave'} at 127.0.0.1:44344
I20260709 12:19:36.147333 23345 raft_consensus.cc:606] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 3 LEADER]: Received request to transfer leadership to TS 4335df7771044244810c947ea8190bc6
I20260709 12:19:36.149755 23345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
mode: GRACEFUL
new_leader_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
 from {username='slave'} at 127.0.0.1:44344
I20260709 12:19:36.150305 23345 raft_consensus.cc:606] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 4 LEADER]: Received request to transfer leadership to TS c3c01853e9ea4f74b345c3fc10cc454a
I20260709 12:19:36.152740 23345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e"
dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
mode: GRACEFUL
new_leader_uuid: "4335df7771044244810c947ea8190bc6"
 from {username='slave'} at 127.0.0.1:44344
I20260709 12:19:36.153173 23345 raft_consensus.cc:606] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Received request to transfer leadership to TS 4335df7771044244810c947ea8190bc6
I20260709 12:19:36.154171 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:36.154672 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:36.194824 23688 raft_consensus.cc:993] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377: : Instructing follower c3c01853e9ea4f74b345c3fc10cc454a to start an election
I20260709 12:19:36.195318 23688 raft_consensus.cc:1081] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Signalling peer c3c01853e9ea4f74b345c3fc10cc454a to start an election
I20260709 12:19:36.196674 23493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf"
dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
 from {username='slave'} at 127.0.0.1:49968
I20260709 12:19:36.197168 23493 raft_consensus.cc:493] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.197453 23493 raft_consensus.cc:3060] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.202770 23493 raft_consensus.cc:515] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:36.205009 23493 leader_election.cc:290] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 2 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:36.205857 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:36.206069 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c6e67147e141d082abdc273ef229cf" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:36.206406 23345 raft_consensus.cc:3055] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:36.206593 23420 raft_consensus.cc:3060] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.206727 23345 raft_consensus.cc:740] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:36.207345 23345 consensus_queue.cc:260] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:36.208232 23345 raft_consensus.cc:3060] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.211141 23420 raft_consensus.cc:2468] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 2.
I20260709 12:19:36.212327 23459 leader_election.cc:304] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:36.212692 23345 raft_consensus.cc:2468] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 2.
I20260709 12:19:36.213274 23687 raft_consensus.cc:2804] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:36.214506 23687 raft_consensus.cc:697] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 2 LEADER]: Becoming Leader. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Running, Role: LEADER
I20260709 12:19:36.215446 23687 consensus_queue.cc:237] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:36.222632 23244 catalog_manager.cc:5697] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a reported cstate change: term changed from 1 to 2, leader changed from a8beeb14299b447fa8bd913de1aab377 (127.22.43.65) to c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67). New cstate: current_term: 2 leader_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.289597 23652 raft_consensus.cc:993] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377: : Instructing follower 4335df7771044244810c947ea8190bc6 to start an election
I20260709 12:19:36.290082 23688 raft_consensus.cc:1081] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 3 LEADER]: Signalling peer 4335df7771044244810c947ea8190bc6 to start an election
I20260709 12:19:36.291522 23420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1"
dest_uuid: "4335df7771044244810c947ea8190bc6"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:19:36.291963 23420 raft_consensus.cc:493] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.292210 23420 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.296331 23420 raft_consensus.cc:515] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:36.299027 23420 leader_election.cc:290] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 4 election: Requested vote from peers c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999), a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391)
I20260709 12:19:36.299299 23493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:36.299619 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8430668284bc39fe0f2e1eb6249b1" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:36.299979 23493 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.300163 23345 raft_consensus.cc:3055] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:36.300508 23345 raft_consensus.cc:740] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:36.301293 23345 consensus_queue.cc:260] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:36.302690 23345 raft_consensus.cc:3060] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.307792 23493 raft_consensus.cc:2468] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 4.
I20260709 12:19:36.309401 23385 leader_election.cc:304] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:36.309756 23345 raft_consensus.cc:2468] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 4.
I20260709 12:19:36.310268 23661 raft_consensus.cc:2804] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:36.312076 23661 raft_consensus.cc:697] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:36.312978 23661 consensus_queue.cc:237] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } }
I20260709 12:19:36.321544 23244 catalog_manager.cc:5697] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 reported cstate change: term changed from 3 to 4, leader changed from a8beeb14299b447fa8bd913de1aab377 (127.22.43.65) to 4335df7771044244810c947ea8190bc6 (127.22.43.66). New cstate: current_term: 4 leader_uuid: "4335df7771044244810c947ea8190bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.454438 23652 raft_consensus.cc:993] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377: : Instructing follower 4335df7771044244810c947ea8190bc6 to start an election
I20260709 12:19:36.454854 23688 raft_consensus.cc:1081] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Signalling peer 4335df7771044244810c947ea8190bc6 to start an election
I20260709 12:19:36.456481 23420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e"
dest_uuid: "4335df7771044244810c947ea8190bc6"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:19:36.457039 23420 raft_consensus.cc:493] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.457337 23420 raft_consensus.cc:3060] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.461796 23420 raft_consensus.cc:515] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:36.463244 23420 leader_election.cc:290] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 3 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67:37999)
I20260709 12:19:36.464120 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:36.464269 23493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31d07e28e2e4460a7c5261c1feef77e" candidate_uuid: "4335df7771044244810c947ea8190bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
I20260709 12:19:36.464617 23345 raft_consensus.cc:3055] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:36.464838 23493 raft_consensus.cc:3060] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.464915 23345 raft_consensus.cc:740] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:36.465840 23345 consensus_queue.cc:260] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:36.466691 23345 raft_consensus.cc:3060] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.470031 23493 raft_consensus.cc:2468] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 3.
I20260709 12:19:36.470779 23345 raft_consensus.cc:2468] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4335df7771044244810c947ea8190bc6 in term 3.
I20260709 12:19:36.471105 23385 leader_election.cc:304] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:36.471880 23661 raft_consensus.cc:2804] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:36.472288 23661 raft_consensus.cc:697] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 4335df7771044244810c947ea8190bc6, State: Running, Role: LEADER
I20260709 12:19:36.473055 23661 consensus_queue.cc:237] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:36.480454 23244 catalog_manager.cc:5697] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 reported cstate change: term changed from 2 to 3, leader changed from a8beeb14299b447fa8bd913de1aab377 (127.22.43.65) to 4335df7771044244810c947ea8190bc6 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "4335df7771044244810c947ea8190bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.489151 23652 raft_consensus.cc:993] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377: : Instructing follower c3c01853e9ea4f74b345c3fc10cc454a to start an election
I20260709 12:19:36.489548 23652 raft_consensus.cc:1081] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 4 LEADER]: Signalling peer c3c01853e9ea4f74b345c3fc10cc454a to start an election
I20260709 12:19:36.490829 23493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c"
dest_uuid: "c3c01853e9ea4f74b345c3fc10cc454a"
 from {username='slave'} at 127.0.0.1:49968
I20260709 12:19:36.491336 23493 raft_consensus.cc:493] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.491626 23493 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:36.496313 23493 raft_consensus.cc:515] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:36.497951 23493 leader_election.cc:290] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 5 election: Requested vote from peers a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391), 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801)
I20260709 12:19:36.498797 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a8beeb14299b447fa8bd913de1aab377"
I20260709 12:19:36.498941 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d478ea946acb4e97aa84e3450247751c" candidate_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4335df7771044244810c947ea8190bc6"
I20260709 12:19:36.499382 23345 raft_consensus.cc:3055] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:36.499430 23420 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:36.499665 23345 raft_consensus.cc:740] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8beeb14299b447fa8bd913de1aab377, State: Running, Role: LEADER
I20260709 12:19:36.500406 23345 consensus_queue.cc:260] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:36.501264 23345 raft_consensus.cc:3060] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:36.503785 23420 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 5.
I20260709 12:19:36.504729 23459 leader_election.cc:304] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4335df7771044244810c947ea8190bc6, c3c01853e9ea4f74b345c3fc10cc454a; no voters: 
I20260709 12:19:36.505446 23687 raft_consensus.cc:2804] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:36.505834 23345 raft_consensus.cc:2468] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c01853e9ea4f74b345c3fc10cc454a in term 5.
I20260709 12:19:36.505833 23687 raft_consensus.cc:697] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 5 LEADER]: Becoming Leader. State: Replica: c3c01853e9ea4f74b345c3fc10cc454a, State: Running, Role: LEADER
I20260709 12:19:36.506910 23687 consensus_queue.cc:237] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } }
I20260709 12:19:36.513337 23244 catalog_manager.cc:5697] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a reported cstate change: term changed from 4 to 5, leader changed from a8beeb14299b447fa8bd913de1aab377 (127.22.43.65) to c3c01853e9ea4f74b345c3fc10cc454a (127.22.43.67). New cstate: current_term: 5 leader_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.614460 23345 raft_consensus.cc:1275] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Refusing update from remote peer c3c01853e9ea4f74b345c3fc10cc454a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:36.615943 23687 consensus_queue.cc:1048] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:36.628293 23420 raft_consensus.cc:1275] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Refusing update from remote peer c3c01853e9ea4f74b345c3fc10cc454a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:36.631834 23701 consensus_queue.cc:1048] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:36.770407 23493 raft_consensus.cc:1275] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 4 FOLLOWER]: Refusing update from remote peer 4335df7771044244810c947ea8190bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:36.771739 23661 consensus_queue.cc:1048] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:36.781379 23345 raft_consensus.cc:1275] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 4 FOLLOWER]: Refusing update from remote peer 4335df7771044244810c947ea8190bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:36.783798 23706 consensus_queue.cc:1048] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:36.886930 23420 raft_consensus.cc:1275] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 5 FOLLOWER]: Refusing update from remote peer c3c01853e9ea4f74b345c3fc10cc454a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:36.888010 23701 consensus_queue.cc:1048] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4335df7771044244810c947ea8190bc6" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:36.896909 23345 raft_consensus.cc:1275] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 5 FOLLOWER]: Refusing update from remote peer c3c01853e9ea4f74b345c3fc10cc454a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:36.898557 23689 consensus_queue.cc:1048] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:36.904063 23346 raft_consensus.cc:1275] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Refusing update from remote peer 4335df7771044244810c947ea8190bc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:36.905555 23706 consensus_queue.cc:1048] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8beeb14299b447fa8bd913de1aab377" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:36.915514 23493 raft_consensus.cc:1275] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Refusing update from remote peer 4335df7771044244810c947ea8190bc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:36.918486 23695 consensus_queue.cc:1048] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3c01853e9ea4f74b345c3fc10cc454a" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:37.155748 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:37.161135 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:37.161592 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:38.162724 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:38.168848 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:38.169322 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:39.170599 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:39.176761 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:39.177302 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:40.178344 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:40.183626 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:40.184122 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:41.185015 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:41.190459 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:41.190929 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:42.191864 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:42.197108 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:42.197598 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:43.198643 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:43.204366 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:43.204877 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:44.205861 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:44.211843 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:44.212373 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:45.213276 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:45.218853 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:45.219312 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:46.252442 22701 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:19:46.253021 22701 tablet_server.cc:179] TabletServer@127.22.43.65:0 shutting down...
I20260709 12:19:46.283636 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:46.284442 22701 tablet_replica.cc:333] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377: stopping tablet replica
I20260709 12:19:46.285099 22701 raft_consensus.cc:2243] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.286095 22701 raft_consensus.cc:2272] T 1dc0231ce2d5467ea3d745f7fd16fd9e P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.288205 22701 tablet_replica.cc:333] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377: stopping tablet replica
I20260709 12:19:46.288828 22701 raft_consensus.cc:2243] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.289211 22701 raft_consensus.cc:2272] T 62c52881c12e41ad939e025d13f69921 P a8beeb14299b447fa8bd913de1aab377 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.291113 22701 tablet_replica.cc:333] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377: stopping tablet replica
I20260709 12:19:46.291643 22701 raft_consensus.cc:2243] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.292128 22701 raft_consensus.cc:2272] T f31d07e28e2e4460a7c5261c1feef77e P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.293838 22701 tablet_replica.cc:333] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377: stopping tablet replica
I20260709 12:19:46.294435 22701 raft_consensus.cc:2243] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.295186 22701 raft_consensus.cc:2272] T b654d14a5a7e4911a2adce199f0bae49 P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.297041 22701 tablet_replica.cc:333] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377: stopping tablet replica
I20260709 12:19:46.297565 22701 raft_consensus.cc:2243] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.298453 22701 raft_consensus.cc:2272] T 837f4b67331f47d3aba4b8357ce8c57f P a8beeb14299b447fa8bd913de1aab377 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.300194 22701 tablet_replica.cc:333] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377: stopping tablet replica
I20260709 12:19:46.300685 22701 raft_consensus.cc:2243] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.301115 22701 raft_consensus.cc:2272] T 50c6e67147e141d082abdc273ef229cf P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.303191 22701 tablet_replica.cc:333] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377: stopping tablet replica
I20260709 12:19:46.304034 22701 raft_consensus.cc:2243] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.304502 22701 raft_consensus.cc:2272] T d478ea946acb4e97aa84e3450247751c P a8beeb14299b447fa8bd913de1aab377 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.306222 22701 tablet_replica.cc:333] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377: stopping tablet replica
I20260709 12:19:46.306689 22701 raft_consensus.cc:2243] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.307130 22701 raft_consensus.cc:2272] T 96039210dcd54f0ab7724baf3442247e P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.308952 22701 tablet_replica.cc:333] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377: stopping tablet replica
I20260709 12:19:46.309414 22701 raft_consensus.cc:2243] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.310242 22701 raft_consensus.cc:2272] T b0e2372c5fa8402cbd8947aca495e0da P a8beeb14299b447fa8bd913de1aab377 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.311861 22701 tablet_replica.cc:333] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377: stopping tablet replica
I20260709 12:19:46.312325 22701 raft_consensus.cc:2243] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.312747 22701 raft_consensus.cc:2272] T 60a8430668284bc39fe0f2e1eb6249b1 P a8beeb14299b447fa8bd913de1aab377 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:46.331895 23312 connection.cc:466] server connection from 127.0.0.1:44332 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44332 (request call id 201) could send its response
W20260709 12:19:46.333086 23386 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.43.65:41391 (error 108) [suppressed 5 similar messages]
W20260709 12:19:46.337512 23386 consensus_peers.cc:597] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 -> Peer a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391): Couldn't send request to peer a8beeb14299b447fa8bd913de1aab377. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:46.347440 22701 tablet_server.cc:196] TabletServer@127.22.43.65:0 shutdown complete.
W20260709 12:19:46.350735 23460 consensus_peers.cc:597] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a -> Peer a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391): Couldn't send request to peer a8beeb14299b447fa8bd913de1aab377. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:46.368462 22701 tablet_server.cc:179] TabletServer@127.22.43.66:0 shutting down...
W20260709 12:19:46.393764 23386 consensus_peers.cc:597] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 -> Peer a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391): Couldn't send request to peer a8beeb14299b447fa8bd913de1aab377. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:46.401464 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:46.402416 22701 tablet_replica.cc:333] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6: stopping tablet replica
I20260709 12:19:46.403116 22701 raft_consensus.cc:2243] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.403628 22701 raft_consensus.cc:2272] T 62c52881c12e41ad939e025d13f69921 P 4335df7771044244810c947ea8190bc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.405638 22701 tablet_replica.cc:333] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6: stopping tablet replica
I20260709 12:19:46.406263 22701 raft_consensus.cc:2243] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.406790 22701 raft_consensus.cc:2272] T b0e2372c5fa8402cbd8947aca495e0da P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.408809 22701 tablet_replica.cc:333] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6: stopping tablet replica
I20260709 12:19:46.409430 22701 raft_consensus.cc:2243] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.410346 22701 raft_consensus.cc:2272] T 60a8430668284bc39fe0f2e1eb6249b1 P 4335df7771044244810c947ea8190bc6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.412341 22701 tablet_replica.cc:333] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6: stopping tablet replica
I20260709 12:19:46.412966 22701 raft_consensus.cc:2243] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.413846 22701 raft_consensus.cc:2272] T 96039210dcd54f0ab7724baf3442247e P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.416000 22701 tablet_replica.cc:333] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6: stopping tablet replica
I20260709 12:19:46.416594 22701 raft_consensus.cc:2243] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.417115 22701 raft_consensus.cc:2272] T d478ea946acb4e97aa84e3450247751c P 4335df7771044244810c947ea8190bc6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.419414 22701 tablet_replica.cc:333] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6: stopping tablet replica
I20260709 12:19:46.419986 22701 raft_consensus.cc:2243] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.420787 22701 raft_consensus.cc:2272] T f31d07e28e2e4460a7c5261c1feef77e P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.422753 22701 tablet_replica.cc:333] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6: stopping tablet replica
I20260709 12:19:46.423283 22701 raft_consensus.cc:2243] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.423733 22701 raft_consensus.cc:2272] T 1dc0231ce2d5467ea3d745f7fd16fd9e P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.425771 22701 tablet_replica.cc:333] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6: stopping tablet replica
I20260709 12:19:46.426334 22701 raft_consensus.cc:2243] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.426828 22701 raft_consensus.cc:2272] T 50c6e67147e141d082abdc273ef229cf P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.429368 22701 tablet_replica.cc:333] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6: stopping tablet replica
I20260709 12:19:46.430141 22701 raft_consensus.cc:2243] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.430608 22701 raft_consensus.cc:2272] T 837f4b67331f47d3aba4b8357ce8c57f P 4335df7771044244810c947ea8190bc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.432394 22701 tablet_replica.cc:333] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6: stopping tablet replica
I20260709 12:19:46.432837 22701 raft_consensus.cc:2243] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.433235 22701 raft_consensus.cc:2272] T b654d14a5a7e4911a2adce199f0bae49 P 4335df7771044244810c947ea8190bc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.467584 22701 tablet_server.cc:196] TabletServer@127.22.43.66:0 shutdown complete.
W20260709 12:19:46.470729 23459 consensus_peers.cc:597] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a -> Peer 4335df7771044244810c947ea8190bc6 (127.22.43.66:43801): Couldn't send request to peer 4335df7771044244810c947ea8190bc6. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:46.474640 23460 consensus_peers.cc:597] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a -> Peer a8beeb14299b447fa8bd913de1aab377 (127.22.43.65:41391): Couldn't send request to peer a8beeb14299b447fa8bd913de1aab377. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:46.490911 22701 tablet_server.cc:179] TabletServer@127.22.43.67:0 shutting down...
I20260709 12:19:46.515612 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:46.516216 22701 tablet_replica.cc:333] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a: stopping tablet replica
I20260709 12:19:46.516845 22701 raft_consensus.cc:2243] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.517390 22701 raft_consensus.cc:2272] T 1dc0231ce2d5467ea3d745f7fd16fd9e P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.519397 22701 tablet_replica.cc:333] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a: stopping tablet replica
I20260709 12:19:46.519940 22701 raft_consensus.cc:2243] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.520709 22701 raft_consensus.cc:2272] T 62c52881c12e41ad939e025d13f69921 P c3c01853e9ea4f74b345c3fc10cc454a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.522751 22701 tablet_replica.cc:333] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a: stopping tablet replica
I20260709 12:19:46.523249 22701 raft_consensus.cc:2243] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.524025 22701 raft_consensus.cc:2272] T 50c6e67147e141d082abdc273ef229cf P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.525794 22701 tablet_replica.cc:333] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a: stopping tablet replica
I20260709 12:19:46.526352 22701 raft_consensus.cc:2243] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.526791 22701 raft_consensus.cc:2272] T 60a8430668284bc39fe0f2e1eb6249b1 P c3c01853e9ea4f74b345c3fc10cc454a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.528811 22701 tablet_replica.cc:333] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a: stopping tablet replica
I20260709 12:19:46.529378 22701 raft_consensus.cc:2243] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.529804 22701 raft_consensus.cc:2272] T b0e2372c5fa8402cbd8947aca495e0da P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.531550 22701 tablet_replica.cc:333] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a: stopping tablet replica
I20260709 12:19:46.532048 22701 raft_consensus.cc:2243] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.532466 22701 raft_consensus.cc:2272] T 96039210dcd54f0ab7724baf3442247e P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.534262 22701 tablet_replica.cc:333] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a: stopping tablet replica
I20260709 12:19:46.534747 22701 raft_consensus.cc:2243] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.535458 22701 raft_consensus.cc:2272] T d478ea946acb4e97aa84e3450247751c P c3c01853e9ea4f74b345c3fc10cc454a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.537076 22701 tablet_replica.cc:333] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a: stopping tablet replica
I20260709 12:19:46.537544 22701 raft_consensus.cc:2243] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.538045 22701 raft_consensus.cc:2272] T f31d07e28e2e4460a7c5261c1feef77e P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.539791 22701 tablet_replica.cc:333] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a: stopping tablet replica
I20260709 12:19:46.540252 22701 raft_consensus.cc:2243] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.540676 22701 raft_consensus.cc:2272] T 837f4b67331f47d3aba4b8357ce8c57f P c3c01853e9ea4f74b345c3fc10cc454a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.542243 22701 tablet_replica.cc:333] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a: stopping tablet replica
I20260709 12:19:46.542671 22701 raft_consensus.cc:2243] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.543063 22701 raft_consensus.cc:2272] T b654d14a5a7e4911a2adce199f0bae49 P c3c01853e9ea4f74b345c3fc10cc454a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.592458 22701 tablet_server.cc:196] TabletServer@127.22.43.67:0 shutdown complete.
I20260709 12:19:46.613958 22701 master.cc:562] Master@127.22.43.126:42241 shutting down...
I20260709 12:19:46.637509 22701 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.638154 22701 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.638494 22701 tablet_replica.cc:333] T 00000000000000000000000000000000 P b46e82d0d9374600bfdd1247b5981ede: stopping tablet replica
I20260709 12:19:46.658154 22701 master.cc:584] Master@127.22.43.126:42241 shutdown complete.
4335df7771044244810c947ea8190bc6  4
a8beeb14299b447fa8bd913de1aab377  5
c3c01853e9ea4f74b345c3fc10cc454a  1
4335df7771044244810c947ea8190bc6  4
a8beeb14299b447fa8bd913de1aab377  3
c3c01853e9ea4f74b345c3fc10cc454a  3
4335df7771044244810c947ea8190bc6  1
a8beeb14299b447fa8bd913de1aab377  8
c3c01853e9ea4f74b345c3fc10cc454a  1
4335df7771044244810c947ea8190bc6  3
a8beeb14299b447fa8bd913de1aab377  4
c3c01853e9ea4f74b345c3fc10cc454a  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28805 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:19:46.700690 22701 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.43.126:38021
I20260709 12:19:46.701875 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:46.708173 23727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:46.708328 23728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:46.709208 23730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:46.709522 22701 server_base.cc:1061] running on GCE node
I20260709 12:19:46.710691 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:46.710877 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:46.711071 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599586711036 us; error 0 us; skew 500 ppm
I20260709 12:19:46.711613 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:46.714067 22701 webserver.cc:533] Webserver started at http://127.22.43.126:41759/ using document root <none> and password file <none>
I20260709 12:19:46.714546 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:46.714736 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:46.715030 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:46.716179 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/master-0-root/instance:
uuid: "8f9c39c095e54c96a7a90888b94785f5"
format_stamp: "Formatted at 2026-07-09 12:19:46 on dist-test-slave-0768"
I20260709 12:19:46.720769 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:19:46.724639 23735 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:46.725490 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:19:46.725802 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/master-0-root
uuid: "8f9c39c095e54c96a7a90888b94785f5"
format_stamp: "Formatted at 2026-07-09 12:19:46 on dist-test-slave-0768"
I20260709 12:19:46.726156 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:46.757445 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:46.758810 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:46.798691 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.126:38021
I20260709 12:19:46.798792 23786 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.126:38021 every 8 connection(s)
I20260709 12:19:46.803023 23787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:46.813735 23787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Bootstrap starting.
I20260709 12:19:46.818980 23787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.823597 23787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: No bootstrap required, opened a new log
I20260709 12:19:46.826268 23787 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f9c39c095e54c96a7a90888b94785f5" member_type: VOTER }
I20260709 12:19:46.826821 23787 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.827097 23787 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9c39c095e54c96a7a90888b94785f5, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.828091 23787 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f9c39c095e54c96a7a90888b94785f5" member_type: VOTER }
I20260709 12:19:46.828696 23787 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:46.828927 23787 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:46.829170 23787 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.833729 23787 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f9c39c095e54c96a7a90888b94785f5" member_type: VOTER }
I20260709 12:19:46.834405 23787 leader_election.cc:304] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f9c39c095e54c96a7a90888b94785f5; no voters: 
I20260709 12:19:46.835566 23787 leader_election.cc:290] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:46.836020 23790 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:46.837455 23790 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9c39c095e54c96a7a90888b94785f5, State: Running, Role: LEADER
I20260709 12:19:46.838267 23790 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f9c39c095e54c96a7a90888b94785f5" member_type: VOTER }
I20260709 12:19:46.838779 23787 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:46.843475 23791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f9c39c095e54c96a7a90888b94785f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f9c39c095e54c96a7a90888b94785f5" member_type: VOTER } }
I20260709 12:19:46.844250 23791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:46.844058 23792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f9c39c095e54c96a7a90888b94785f5. Latest consensus state: current_term: 1 leader_uuid: "8f9c39c095e54c96a7a90888b94785f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f9c39c095e54c96a7a90888b94785f5" member_type: VOTER } }
I20260709 12:19:46.845762 23792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:46.846588 23797 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:46.854745 23797 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:46.855682 22701 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:46.863524 23797 catalog_manager.cc:1383] Generated new cluster ID: c4f4af3fe0ae483e9d5d875fb63d7357
I20260709 12:19:46.863835 23797 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:46.900559 23797 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:46.901785 23797 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:46.921073 23797 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Generated new TSK 0
I20260709 12:19:46.921689 23797 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:46.986752 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:46.993148 23808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:46.993707 23809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:46.995499 23811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:46.996316 22701 server_base.cc:1061] running on GCE node
I20260709 12:19:46.997313 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:46.997491 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:46.997622 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599586997610 us; error 0 us; skew 500 ppm
I20260709 12:19:46.998202 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:47.000594 22701 webserver.cc:533] Webserver started at http://127.22.43.65:39919/ using document root <none> and password file <none>
I20260709 12:19:47.001029 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:47.001195 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:47.001417 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:47.002722 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/instance:
uuid: "22996f888daf435398b693481171c18c"
format_stamp: "Formatted at 2026-07-09 12:19:46 on dist-test-slave-0768"
I20260709 12:19:47.007340 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:47.010942 23816 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.011835 22701 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:19:47.012202 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root
uuid: "22996f888daf435398b693481171c18c"
format_stamp: "Formatted at 2026-07-09 12:19:46 on dist-test-slave-0768"
I20260709 12:19:47.012576 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:47.022352 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:47.023617 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:47.025064 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:47.027379 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:47.027613 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.027871 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:47.028064 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.069942 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.65:34895
I20260709 12:19:47.070225 23878 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.65:34895 every 8 connection(s)
I20260709 12:19:47.075431 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:47.082690 23883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:47.084303 23884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:47.088007 23886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:47.088546 22701 server_base.cc:1061] running on GCE node
I20260709 12:19:47.090021 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:47.090340 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:47.090549 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599587090530 us; error 0 us; skew 500 ppm
I20260709 12:19:47.091329 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:47.093626 23879 heartbeater.cc:344] Connected to a master server at 127.22.43.126:38021
I20260709 12:19:47.094043 23879 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:47.094630 22701 webserver.cc:533] Webserver started at http://127.22.43.66:43335/ using document root <none> and password file <none>
I20260709 12:19:47.094966 23879 heartbeater.cc:507] Master 127.22.43.126:38021 requested a full tablet report, sending...
I20260709 12:19:47.095156 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:47.095461 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:47.095775 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:47.097167 23752 ts_manager.cc:194] Registered new tserver with Master: 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:19:47.097289 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/instance:
uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-0768"
I20260709 12:19:47.099654 23752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43178
I20260709 12:19:47.103057 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:19:47.106595 23891 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.107396 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:19:47.107695 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root
uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-0768"
I20260709 12:19:47.107972 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:47.117698 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:47.119019 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:47.120497 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:47.122723 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:47.122954 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.123214 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:47.123394 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.163345 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.66:33453
I20260709 12:19:47.163461 23953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.66:33453 every 8 connection(s)
I20260709 12:19:47.167989 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:47.175719 23957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:47.176896 23958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:47.180362 23960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:47.180970 22701 server_base.cc:1061] running on GCE node
I20260709 12:19:47.181979 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:19:47.182041 23954 heartbeater.cc:344] Connected to a master server at 127.22.43.126:38021
W20260709 12:19:47.182237 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:47.182461 23954 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:47.182485 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599587182464 us; error 0 us; skew 500 ppm
I20260709 12:19:47.183286 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:47.183364 23954 heartbeater.cc:507] Master 127.22.43.126:38021 requested a full tablet report, sending...
I20260709 12:19:47.185554 23752 ts_manager.cc:194] Registered new tserver with Master: e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:47.186015 22701 webserver.cc:533] Webserver started at http://127.22.43.67:42465/ using document root <none> and password file <none>
I20260709 12:19:47.186537 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:47.186764 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:47.187039 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:47.187091 23752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43184
I20260709 12:19:47.188630 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/instance:
uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-0768"
I20260709 12:19:47.193300 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:19:47.196667 23965 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.197444 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:19:47.197749 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root
uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-0768"
I20260709 12:19:47.198104 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:47.235762 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:47.237543 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:47.239120 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:47.241807 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:47.242116 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:19:47.242404 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:47.242595 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.285952 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.67:40331
I20260709 12:19:47.286163 24028 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.67:40331 every 8 connection(s)
I20260709 12:19:47.302551 24029 heartbeater.cc:344] Connected to a master server at 127.22.43.126:38021
I20260709 12:19:47.302980 24029 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:47.303772 24029 heartbeater.cc:507] Master 127.22.43.126:38021 requested a full tablet report, sending...
I20260709 12:19:47.306174 23752 ts_manager.cc:194] Registered new tserver with Master: 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:47.307062 22701 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017236161s
I20260709 12:19:47.307828 23752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43186
I20260709 12:19:47.335194 23752 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43192:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:47.341980 23752 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:47.569198 23993 tablet_service.cc:1511] Processing CreateTablet for tablet fadf34409dda41739b8f46dcf0a526b2 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:47.569675 23992 tablet_service.cc:1511] Processing CreateTablet for tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:47.571087 23993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadf34409dda41739b8f46dcf0a526b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.572180 23991 tablet_service.cc:1511] Processing CreateTablet for tablet 8d880a30519445959394501b6616f15f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:47.573621 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d880a30519445959394501b6616f15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.575158 23994 tablet_service.cc:1511] Processing CreateTablet for tablet 092a962747db4e3b9c0bb6d7fdb831d5 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:47.576524 23994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092a962747db4e3b9c0bb6d7fdb831d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.578229 23992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.582585 23990 tablet_service.cc:1511] Processing CreateTablet for tablet d78ef4be778a4d7fa19baf9815bd1d96 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:47.584254 23990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78ef4be778a4d7fa19baf9815bd1d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.587189 23989 tablet_service.cc:1511] Processing CreateTablet for tablet 23e8987a07704ea192b04366772512e7 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:47.588860 23989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e8987a07704ea192b04366772512e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.588980 23986 tablet_service.cc:1511] Processing CreateTablet for tablet 9f65f9b948cd4a8d88db397a8232dace (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:47.590553 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f65f9b948cd4a8d88db397a8232dace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.591234 23988 tablet_service.cc:1511] Processing CreateTablet for tablet fdd49025134246c8a0245389cc43db77 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:47.592969 23988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd49025134246c8a0245389cc43db77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.595047 23985 tablet_service.cc:1511] Processing CreateTablet for tablet d53a1203874c465cbc2d50279fc76c4b (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:47.596671 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53a1203874c465cbc2d50279fc76c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.598459 23987 tablet_service.cc:1511] Processing CreateTablet for tablet 05a83cc012d5420494cfd8c624a09767 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:47.600080 23987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a83cc012d5420494cfd8c624a09767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.639019 23992 tablet_service.cc:1511] Processing CreateTablet for tablet 66100c48e39a42c7be31fa60db7a0d23 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:47.640793 23992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66100c48e39a42c7be31fa60db7a0d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.650028 23919 tablet_service.cc:1511] Processing CreateTablet for tablet 092a962747db4e3b9c0bb6d7fdb831d5 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:47.651755 23919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092a962747db4e3b9c0bb6d7fdb831d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.659910 24044 tablet_bootstrap.cc:492] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:47.660406 23991 tablet_service.cc:1511] Processing CreateTablet for tablet 0ade9323ef4a49b3b60c68243facc406 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:47.661968 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ade9323ef4a49b3b60c68243facc406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.664866 23918 tablet_service.cc:1511] Processing CreateTablet for tablet fadf34409dda41739b8f46dcf0a526b2 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:47.670450 23917 tablet_service.cc:1511] Processing CreateTablet for tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:47.671087 23987 tablet_service.cc:1511] Processing CreateTablet for tablet bed4315a53504a7a84ffb2b5e251ea08 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:47.672470 23987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed4315a53504a7a84ffb2b5e251ea08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.672751 23916 tablet_service.cc:1511] Processing CreateTablet for tablet 8d880a30519445959394501b6616f15f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:47.675166 23914 tablet_service.cc:1511] Processing CreateTablet for tablet 23e8987a07704ea192b04366772512e7 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:47.677268 23844 tablet_service.cc:1511] Processing CreateTablet for tablet 092a962747db4e3b9c0bb6d7fdb831d5 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:47.678732 23844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092a962747db4e3b9c0bb6d7fdb831d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.678771 23991 tablet_service.cc:1511] Processing CreateTablet for tablet d0df961accdf4f35a6f59fd126751e8a (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:47.680140 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0df961accdf4f35a6f59fd126751e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.678915 23993 tablet_service.cc:1511] Processing CreateTablet for tablet f478cef7044d4597b6db8ead4067f592 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:47.682757 23915 tablet_service.cc:1511] Processing CreateTablet for tablet d78ef4be778a4d7fa19baf9815bd1d96 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:47.683035 23839 tablet_service.cc:1511] Processing CreateTablet for tablet 23e8987a07704ea192b04366772512e7 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:47.683195 23838 tablet_service.cc:1511] Processing CreateTablet for tablet fdd49025134246c8a0245389cc43db77 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:47.684511 23839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e8987a07704ea192b04366772512e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.685295 23843 tablet_service.cc:1511] Processing CreateTablet for tablet fadf34409dda41739b8f46dcf0a526b2 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:47.686353 23838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd49025134246c8a0245389cc43db77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.688014 23842 tablet_service.cc:1511] Processing CreateTablet for tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:47.689481 23842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.691174 23840 tablet_service.cc:1511] Processing CreateTablet for tablet d78ef4be778a4d7fa19baf9815bd1d96 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:47.691725 23916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d880a30519445959394501b6616f15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.692494 23840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78ef4be778a4d7fa19baf9815bd1d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.695200 23915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78ef4be778a4d7fa19baf9815bd1d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.694954 23841 tablet_service.cc:1511] Processing CreateTablet for tablet 8d880a30519445959394501b6616f15f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:47.703672 23843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadf34409dda41739b8f46dcf0a526b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.702728 23913 tablet_service.cc:1511] Processing CreateTablet for tablet fdd49025134246c8a0245389cc43db77 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:47.703863 23837 tablet_service.cc:1511] Processing CreateTablet for tablet 05a83cc012d5420494cfd8c624a09767 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:47.705179 23837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a83cc012d5420494cfd8c624a09767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.705780 23841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d880a30519445959394501b6616f15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.706225 23918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadf34409dda41739b8f46dcf0a526b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.707551 23836 tablet_service.cc:1511] Processing CreateTablet for tablet 9f65f9b948cd4a8d88db397a8232dace (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:47.708849 23836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f65f9b948cd4a8d88db397a8232dace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.710268 23914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e8987a07704ea192b04366772512e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.711725 23913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd49025134246c8a0245389cc43db77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.711588 23835 tablet_service.cc:1511] Processing CreateTablet for tablet d53a1203874c465cbc2d50279fc76c4b (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:47.712888 23835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53a1203874c465cbc2d50279fc76c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.714174 23917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.723691 23912 tablet_service.cc:1511] Processing CreateTablet for tablet 05a83cc012d5420494cfd8c624a09767 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:47.723953 23911 tablet_service.cc:1511] Processing CreateTablet for tablet 9f65f9b948cd4a8d88db397a8232dace (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:47.725232 23912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a83cc012d5420494cfd8c624a09767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.727752 23910 tablet_service.cc:1511] Processing CreateTablet for tablet d53a1203874c465cbc2d50279fc76c4b (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:47.733503 23993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f478cef7044d4597b6db8ead4067f592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.734242 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f65f9b948cd4a8d88db397a8232dace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.738269 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53a1203874c465cbc2d50279fc76c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.740180 23994 tablet_service.cc:1511] Processing CreateTablet for tablet c68dea7a8ca44705b1d5fe7b0748519d (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:47.742278 23990 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0c3eeb21514ee1a8f1324ff166cb7f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:47.748611 23990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0c3eeb21514ee1a8f1324ff166cb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.744180 23991 tablet_service.cc:1511] Processing CreateTablet for tablet 83e1955dc5e84b5080e7ea8d739baff4 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:47.754704 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e1955dc5e84b5080e7ea8d739baff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.775427 23994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68dea7a8ca44705b1d5fe7b0748519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.746762 23988 tablet_service.cc:1511] Processing CreateTablet for tablet 5a4c451e990244d7a5701e875fa03f62 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:47.810365 23988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a4c451e990244d7a5701e875fa03f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.816241 23989 tablet_service.cc:1511] Processing CreateTablet for tablet 4a72394010d8464f87107625dbd58b7d (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:47.817592 23989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a72394010d8464f87107625dbd58b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.820983 23986 tablet_service.cc:1511] Processing CreateTablet for tablet fe9ef9f9e0c249d5bdb5743853fa3308 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:47.845302 24044 tablet_bootstrap.cc:654] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:47.850914 23800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:47.854841 23843 tablet_service.cc:1511] Processing CreateTablet for tablet d0df961accdf4f35a6f59fd126751e8a (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:47.863309 23918 tablet_service.cc:1511] Processing CreateTablet for tablet 66100c48e39a42c7be31fa60db7a0d23 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:47.864728 23918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66100c48e39a42c7be31fa60db7a0d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.867295 23841 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0c3eeb21514ee1a8f1324ff166cb7f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:47.868222 23917 tablet_service.cc:1511] Processing CreateTablet for tablet 0ade9323ef4a49b3b60c68243facc406 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:47.869323 23917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ade9323ef4a49b3b60c68243facc406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.876119 23911 tablet_service.cc:1511] Processing CreateTablet for tablet 38d6b859dc2949aeaefe73fefd5829bb (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:47.856173 23843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0df961accdf4f35a6f59fd126751e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.877471 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d6b859dc2949aeaefe73fefd5829bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.879774 23914 tablet_service.cc:1511] Processing CreateTablet for tablet f478cef7044d4597b6db8ead4067f592 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:47.881011 23914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f478cef7044d4597b6db8ead4067f592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.863529 23844 tablet_service.cc:1511] Processing CreateTablet for tablet 0ade9323ef4a49b3b60c68243facc406 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:47.886873 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9ef9f9e0c249d5bdb5743853fa3308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.919510 23991 tablet_service.cc:1511] Processing CreateTablet for tablet e24af680f7e54ded89a0d5eff1320c6c (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:47.920849 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24af680f7e54ded89a0d5eff1320c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.926055 23912 tablet_service.cc:1511] Processing CreateTablet for tablet 83e1955dc5e84b5080e7ea8d739baff4 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:47.934767 23987 tablet_service.cc:1511] Processing CreateTablet for tablet d80eac81f44441f49acb9eba858e3637 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:47.935662 23993 tablet_service.cc:1511] Processing CreateTablet for tablet 9527aa74b6e94801a45ae653023f6793 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:47.936262 23987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80eac81f44441f49acb9eba858e3637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.937063 23993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9527aa74b6e94801a45ae653023f6793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.876597 23910 tablet_service.cc:1511] Processing CreateTablet for tablet d0df961accdf4f35a6f59fd126751e8a (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:47.893260 23842 tablet_service.cc:1511] Processing CreateTablet for tablet c68dea7a8ca44705b1d5fe7b0748519d (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:47.898062 23837 tablet_service.cc:1511] Processing CreateTablet for tablet 66100c48e39a42c7be31fa60db7a0d23 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:47.898542 23913 tablet_service.cc:1511] Processing CreateTablet for tablet bed4315a53504a7a84ffb2b5e251ea08 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:47.938454 23912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e1955dc5e84b5080e7ea8d739baff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.938520 23994 tablet_service.cc:1511] Processing CreateTablet for tablet 7b845c11f69f485889b01a0a648dc3bc (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:47.939226 23913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed4315a53504a7a84ffb2b5e251ea08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.939949 23994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b845c11f69f485889b01a0a648dc3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.942451 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0df961accdf4f35a6f59fd126751e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.889525 23841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0c3eeb21514ee1a8f1324ff166cb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.900635 24044 tablet_bootstrap.cc:492] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:47.901490 23992 tablet_service.cc:1511] Processing CreateTablet for tablet cf7ddeeeb6384431bc2cc3bcf50c2a16 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:47.904310 23843 tablet_service.cc:1511] Processing CreateTablet for tablet fe9ef9f9e0c249d5bdb5743853fa3308 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:47.944060 23837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66100c48e39a42c7be31fa60db7a0d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.944908 23843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9ef9f9e0c249d5bdb5743853fa3308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.950170 23842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68dea7a8ca44705b1d5fe7b0748519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.906796 24045 tablet_bootstrap.cc:492] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:47.907847 24046 tablet_bootstrap.cc:492] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:47.910555 23915 tablet_service.cc:1511] Processing CreateTablet for tablet c68dea7a8ca44705b1d5fe7b0748519d (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:47.958802 23915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68dea7a8ca44705b1d5fe7b0748519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.910898 23985 tablet_service.cc:1511] Processing CreateTablet for tablet 38d6b859dc2949aeaefe73fefd5829bb (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:47.911302 23919 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0c3eeb21514ee1a8f1324ff166cb7f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:47.963009 23919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0c3eeb21514ee1a8f1324ff166cb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.963512 24044 ts_tablet_manager.cc:1403] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.304s	user 0.010s	sys 0.005s
I20260709 12:19:47.963655 23844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ade9323ef4a49b3b60c68243facc406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.912508 23835 tablet_service.cc:1511] Processing CreateTablet for tablet f478cef7044d4597b6db8ead4067f592 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:47.965639 23835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f478cef7044d4597b6db8ead4067f592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.914430 23840 tablet_service.cc:1511] Processing CreateTablet for tablet bed4315a53504a7a84ffb2b5e251ea08 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:47.914530 23916 tablet_service.cc:1511] Processing CreateTablet for tablet 5a4c451e990244d7a5701e875fa03f62 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:47.967854 23840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed4315a53504a7a84ffb2b5e251ea08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.967854 23916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a4c451e990244d7a5701e875fa03f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.979728 23836 tablet_service.cc:1511] Processing CreateTablet for tablet 83e1955dc5e84b5080e7ea8d739baff4 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:47.980345 23991 tablet_service.cc:1511] Processing CreateTablet for tablet 945f6253667d4ed18d5bf1c3fd3cc9e9 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:47.982036 23992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7ddeeeb6384431bc2cc3bcf50c2a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.983734 23990 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2bef15f0a6452999bc8b6f4e360c3e (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:47.985606 23990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2bef15f0a6452999bc8b6f4e360c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.989140 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d6b859dc2949aeaefe73fefd5829bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.993263 23836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e1955dc5e84b5080e7ea8d739baff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.011864 23988 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6aae08bca4478b92abb367635b948e (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:48.028925 24046 tablet_bootstrap.cc:654] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:48.032845 23736 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 66290.9us
I20260709 12:19:48.035807 23913 tablet_service.cc:1511] Processing CreateTablet for tablet fe9ef9f9e0c249d5bdb5743853fa3308 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:48.039862 23913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9ef9f9e0c249d5bdb5743853fa3308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.046231 24044 raft_consensus.cc:359] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.047293 24044 raft_consensus.cc:385] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.047652 24044 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
W20260709 12:19:48.050233 23737 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 71150.3us
I20260709 12:19:48.052865 23988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6aae08bca4478b92abb367635b948e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.058521 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945f6253667d4ed18d5bf1c3fd3cc9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.036883 24045 tablet_bootstrap.cc:654] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.093238 23839 tablet_service.cc:1511] Processing CreateTablet for tablet 7b845c11f69f485889b01a0a648dc3bc (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:48.077518 24044 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.096143 23839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b845c11f69f485889b01a0a648dc3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.102653 23879 heartbeater.cc:499] Master 127.22.43.126:38021 was elected leader, sending a full tablet report...
I20260709 12:19:48.102494 23915 tablet_service.cc:1511] Processing CreateTablet for tablet e24af680f7e54ded89a0d5eff1320c6c (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:48.106891 23915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24af680f7e54ded89a0d5eff1320c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.116475 23991 tablet_service.cc:1511] Processing CreateTablet for tablet 45f9750732564b8ebf9a7d205547b35c (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:48.117923 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f9750732564b8ebf9a7d205547b35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.128897 23912 tablet_service.cc:1511] Processing CreateTablet for tablet 9527aa74b6e94801a45ae653023f6793 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:48.130285 23912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9527aa74b6e94801a45ae653023f6793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.130853 23914 tablet_service.cc:1511] Processing CreateTablet for tablet d80eac81f44441f49acb9eba858e3637 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:48.132370 23914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80eac81f44441f49acb9eba858e3637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.112125 23918 tablet_service.cc:1511] Processing CreateTablet for tablet 4a72394010d8464f87107625dbd58b7d (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:48.135166 23918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a72394010d8464f87107625dbd58b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.142179 23911 tablet_service.cc:1511] Processing CreateTablet for tablet 7b845c11f69f485889b01a0a648dc3bc (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:48.143601 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b845c11f69f485889b01a0a648dc3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.156662 23842 tablet_service.cc:1511] Processing CreateTablet for tablet 4a72394010d8464f87107625dbd58b7d (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:48.160917 23838 tablet_service.cc:1511] Processing CreateTablet for tablet cf7ddeeeb6384431bc2cc3bcf50c2a16 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:48.161371 23915 tablet_service.cc:1511] Processing CreateTablet for tablet 945f6253667d4ed18d5bf1c3fd3cc9e9 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:48.164466 23915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945f6253667d4ed18d5bf1c3fd3cc9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.164901 23917 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2bef15f0a6452999bc8b6f4e360c3e (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:48.167243 23989 tablet_service.cc:1511] Processing CreateTablet for tablet 769e238f62804be6900a5660ed34e431 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:48.168696 23989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769e238f62804be6900a5660ed34e431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.170303 23992 tablet_service.cc:1511] Processing CreateTablet for tablet 41807c0564934d23b20ac6f983e233d6 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:48.172118 23994 tablet_service.cc:1511] Processing CreateTablet for tablet aa7130e46e524c588b99e0dfff2518c4 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:48.174499 23910 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6aae08bca4478b92abb367635b948e (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:48.176051 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6aae08bca4478b92abb367635b948e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.178992 23919 tablet_service.cc:1511] Processing CreateTablet for tablet 45f9750732564b8ebf9a7d205547b35c (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:48.180280 23919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f9750732564b8ebf9a7d205547b35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.184494 23917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2bef15f0a6452999bc8b6f4e360c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.189395 23916 tablet_service.cc:1511] Processing CreateTablet for tablet cf7ddeeeb6384431bc2cc3bcf50c2a16 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:48.190142 23954 heartbeater.cc:499] Master 127.22.43.126:38021 was elected leader, sending a full tablet report...
I20260709 12:19:48.190860 23916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7ddeeeb6384431bc2cc3bcf50c2a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.192973 23992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41807c0564934d23b20ac6f983e233d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.194242 23837 tablet_service.cc:1511] Processing CreateTablet for tablet 5a4c451e990244d7a5701e875fa03f62 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:48.198264 23986 tablet_service.cc:1511] Processing CreateTablet for tablet d55123f416ba4e9a930f3a24bb6c88f3 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:48.201547 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55123f416ba4e9a930f3a24bb6c88f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.206218 23994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7130e46e524c588b99e0dfff2518c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.207008 23993 tablet_service.cc:1511] Processing CreateTablet for tablet 729f7490c64342bebf0188dd2f975e39 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:48.210201 24045 tablet_bootstrap.cc:492] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:48.210670 24045 ts_tablet_manager.cc:1403] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.304s	user 0.023s	sys 0.008s
I20260709 12:19:48.211205 23844 tablet_service.cc:1511] Processing CreateTablet for tablet e24af680f7e54ded89a0d5eff1320c6c (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:48.210683 23993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729f7490c64342bebf0188dd2f975e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.211968 23842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a72394010d8464f87107625dbd58b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.212579 23844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24af680f7e54ded89a0d5eff1320c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.213155 23838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7ddeeeb6384431bc2cc3bcf50c2a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.213500 24045 raft_consensus.cc:359] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.220410 24051 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.221065 24029 heartbeater.cc:499] Master 127.22.43.126:38021 was elected leader, sending a full tablet report...
I20260709 12:19:48.228804 23841 tablet_service.cc:1511] Processing CreateTablet for tablet 38d6b859dc2949aeaefe73fefd5829bb (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:48.235229 23990 tablet_service.cc:1511] Processing CreateTablet for tablet d12092e2a1294da4acc0a5f0261bfe94 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:48.238920 23912 tablet_service.cc:1511] Processing CreateTablet for tablet 41807c0564934d23b20ac6f983e233d6 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:48.244141 23913 tablet_service.cc:1511] Processing CreateTablet for tablet 769e238f62804be6900a5660ed34e431 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:48.250455 23837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a4c451e990244d7a5701e875fa03f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.252231 23835 tablet_service.cc:1511] Processing CreateTablet for tablet d80eac81f44441f49acb9eba858e3637 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:48.268296 23840 tablet_service.cc:1511] Processing CreateTablet for tablet 9527aa74b6e94801a45ae653023f6793 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:48.270548 23841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d6b859dc2949aeaefe73fefd5829bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.272071 23917 tablet_service.cc:1511] Processing CreateTablet for tablet aa7130e46e524c588b99e0dfff2518c4 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:48.252005 24044 ts_tablet_manager.cc:1434] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.288s	user 0.032s	sys 0.011s
I20260709 12:19:48.282907 24044 tablet_bootstrap.cc:492] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:48.282781 24051 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.272841 24045 raft_consensus.cc:385] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.273042 23835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80eac81f44441f49acb9eba858e3637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.274562 23913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769e238f62804be6900a5660ed34e431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.251091 23987 tablet_service.cc:1511] Processing CreateTablet for tablet f82c4b60fcc242eda3a32f8f32d6d163 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:48.275249 23991 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5d779cbe414b879d3a8be40d0428fa (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:19:48.295219 24030 tablet.cc:2406] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:48.291075 24045 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.303861 24046 tablet_bootstrap.cc:492] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:48.304473 24046 ts_tablet_manager.cc:1403] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.397s	user 0.016s	sys 0.009s
I20260709 12:19:48.303952 24045 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.314667 24045 ts_tablet_manager.cc:1434] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.104s	user 0.009s	sys 0.000s
I20260709 12:19:48.316308 23915 tablet_service.cc:1511] Processing CreateTablet for tablet d55123f416ba4e9a930f3a24bb6c88f3 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:48.318475 23990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12092e2a1294da4acc0a5f0261bfe94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.319146 23987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82c4b60fcc242eda3a32f8f32d6d163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.319514 24045 tablet_bootstrap.cc:492] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:48.319517 24046 raft_consensus.cc:359] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.320480 24046 raft_consensus.cc:385] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.320807 24046 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.321276 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5d779cbe414b879d3a8be40d0428fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.321873 24046 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.332760 23985 tablet_service.cc:1511] Processing CreateTablet for tablet f07a76a5d75e47acaff6a5ca2f03dcc5 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:48.305594 24044 tablet_bootstrap.cc:654] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.351749 23912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41807c0564934d23b20ac6f983e233d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.366421 23917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7130e46e524c588b99e0dfff2518c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.373210 23840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9527aa74b6e94801a45ae653023f6793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.406320 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07a76a5d75e47acaff6a5ca2f03dcc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.412732 23915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55123f416ba4e9a930f3a24bb6c88f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.415565 24045 tablet_bootstrap.cc:654] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.419085 23838 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2bef15f0a6452999bc8b6f4e360c3e (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:48.431152 23838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2bef15f0a6452999bc8b6f4e360c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.417469 23839 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6aae08bca4478b92abb367635b948e (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:48.434820 23839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6aae08bca4478b92abb367635b948e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.373245 24051 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:48.457216 23836 tablet_service.cc:1511] Processing CreateTablet for tablet 45f9750732564b8ebf9a7d205547b35c (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:48.458441 23843 tablet_service.cc:1511] Processing CreateTablet for tablet 945f6253667d4ed18d5bf1c3fd3cc9e9 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:48.458907 24046 ts_tablet_manager.cc:1434] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.154s	user 0.019s	sys 0.028s
I20260709 12:19:48.462394 23989 tablet_service.cc:1511] Processing CreateTablet for tablet 375316edc4f14c939e96f8ce70294c81 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:48.464048 24055 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.474908 23989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375316edc4f14c939e96f8ce70294c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.478247 24055 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.484864 24046 tablet_bootstrap.cc:492] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:48.487514 23916 tablet_service.cc:1511] Processing CreateTablet for tablet d12092e2a1294da4acc0a5f0261bfe94 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:48.489389 23916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12092e2a1294da4acc0a5f0261bfe94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.490517 23914 tablet_service.cc:1511] Processing CreateTablet for tablet f82c4b60fcc242eda3a32f8f32d6d163 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:48.485728 23919 tablet_service.cc:1511] Processing CreateTablet for tablet 729f7490c64342bebf0188dd2f975e39 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:48.491792 23914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82c4b60fcc242eda3a32f8f32d6d163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.547647 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:48.547394 23991 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9e6b2e7add490280e05d9b2bfdda17 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:48.548944 23919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729f7490c64342bebf0188dd2f975e39. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:48.549497 23966 leader_election.cc:343] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.549960 23988 tablet_service.cc:1511] Processing CreateTablet for tablet 29a434c2919b4912a056d435a8992ff0 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:48.558796 24055 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:48.560525 23836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f9750732564b8ebf9a7d205547b35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.566217 23843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945f6253667d4ed18d5bf1c3fd3cc9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.567761 23988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a434c2919b4912a056d435a8992ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.569619 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9e6b2e7add490280e05d9b2bfdda17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.574360 23993 tablet_service.cc:1511] Processing CreateTablet for tablet 362d811dc320452d8daaca5fda5cd52a (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:48.575340 24045 tablet_bootstrap.cc:492] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:48.575865 24045 ts_tablet_manager.cc:1403] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.257s	user 0.003s	sys 0.018s
I20260709 12:19:48.590342 23987 tablet_service.cc:1511] Processing CreateTablet for tablet 4a79eabff38b4edebe70e32ff0d72afc (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:48.538542 23918 tablet_service.cc:1511] Processing CreateTablet for tablet f07a76a5d75e47acaff6a5ca2f03dcc5 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:48.595908 23842 tablet_service.cc:1511] Processing CreateTablet for tablet 41807c0564934d23b20ac6f983e233d6 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:48.615506 23842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41807c0564934d23b20ac6f983e233d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.616398 24044 tablet_bootstrap.cc:492] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:48.616914 24044 ts_tablet_manager.cc:1403] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.334s	user 0.018s	sys 0.036s
I20260709 12:19:48.622804 23986 tablet_service.cc:1511] Processing CreateTablet for tablet 3482cac0ee5745259004349e6078cf03 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:48.622927 24045 raft_consensus.cc:359] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.623769 24045 raft_consensus.cc:385] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.624171 24045 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.625016 24045 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.625936 23990 tablet_service.cc:1511] Processing CreateTablet for tablet c4a453d774d845e59416b4429315c41f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:48.627228 23918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07a76a5d75e47acaff6a5ca2f03dcc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.627038 24044 raft_consensus.cc:359] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.627861 24044 raft_consensus.cc:385] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.628192 24044 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.629032 24044 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.553270 23994 tablet_service.cc:1511] Processing CreateTablet for tablet 73d2fbc1f30749eba64903d7e79de8a7 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:48.634718 23991 tablet_service.cc:1511] Processing CreateTablet for tablet 01f15f801cf34333ad12954d0b614109 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:48.637019 23917 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5d779cbe414b879d3a8be40d0428fa (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:48.638958 24046 tablet_bootstrap.cc:654] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.639274 23917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5d779cbe414b879d3a8be40d0428fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.642546 23841 tablet_service.cc:1511] Processing CreateTablet for tablet f07a76a5d75e47acaff6a5ca2f03dcc5 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:48.626228 23910 tablet_service.cc:1511] Processing CreateTablet for tablet 375316edc4f14c939e96f8ce70294c81 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:48.636526 23911 tablet_service.cc:1511] Processing CreateTablet for tablet 29a434c2919b4912a056d435a8992ff0 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:48.611495 23993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362d811dc320452d8daaca5fda5cd52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.644744 23841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07a76a5d75e47acaff6a5ca2f03dcc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.654088 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3482cac0ee5745259004349e6078cf03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.666357 23990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a453d774d845e59416b4429315c41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.667622 23994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d2fbc1f30749eba64903d7e79de8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.647874 23838 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9e6b2e7add490280e05d9b2bfdda17 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:48.675400 23838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9e6b2e7add490280e05d9b2bfdda17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.676664 24045 ts_tablet_manager.cc:1434] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.001s
I20260709 12:19:48.671818 23989 tablet_service.cc:1511] Processing CreateTablet for tablet 5d00e1a3cc444623bdf4910b98044d66 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:48.680713 23987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a79eabff38b4edebe70e32ff0d72afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.687302 24044 ts_tablet_manager.cc:1434] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:19:48.687052 23985 tablet_service.cc:1511] Processing CreateTablet for tablet 8630b76482c543a2a08e289b32b13ab6 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:48.693572 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:48.694365 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a434c2919b4912a056d435a8992ff0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:48.699833 23966 leader_election.cc:343] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.700335 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:48.701128 24051 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.726517 24054 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.727156 24054 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.727496 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:48.728170 24044 tablet_bootstrap.cc:492] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
W20260709 12:19:48.729313 23893 leader_election.cc:343] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.731863 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:48.708557 23989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d00e1a3cc444623bdf4910b98044d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.733807 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8630b76482c543a2a08e289b32b13ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.734436 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f15f801cf34333ad12954d0b614109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.734807 23912 tablet_service.cc:1511] Processing CreateTablet for tablet 73d2fbc1f30749eba64903d7e79de8a7 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:48.736321 23912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d2fbc1f30749eba64903d7e79de8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.739743 24054 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:19:48.742442 23892 leader_election.cc:343] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.742913 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:48.743664 24055 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.744674 23844 tablet_service.cc:1511] Processing CreateTablet for tablet aa7130e46e524c588b99e0dfff2518c4 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:48.746563 23844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7130e46e524c588b99e0dfff2518c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.747287 24046 tablet_bootstrap.cc:492] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:48.754364 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375316edc4f14c939e96f8ce70294c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.788252 24046 ts_tablet_manager.cc:1403] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.304s	user 0.014s	sys 0.029s
I20260709 12:19:48.788702 23991 tablet_service.cc:1511] Processing CreateTablet for tablet 536d25b8a1934dfd8c9ecb2fa2068928 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:48.789845 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 536d25b8a1934dfd8c9ecb2fa2068928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.755249 23913 tablet_service.cc:1511] Processing CreateTablet for tablet 3482cac0ee5745259004349e6078cf03 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:48.757131 23835 tablet_service.cc:1511] Processing CreateTablet for tablet 769e238f62804be6900a5660ed34e431 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:48.760041 23914 tablet_service.cc:1511] Processing CreateTablet for tablet 362d811dc320452d8daaca5fda5cd52a (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:48.763134 23992 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0499f663114741880a025070e7b81f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:48.791452 24046 raft_consensus.cc:359] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.793972 24046 raft_consensus.cc:385] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.794301 24046 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.794480 23992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0499f663114741880a025070e7b81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.766755 23839 tablet_service.cc:1511] Processing CreateTablet for tablet d55123f416ba4e9a930f3a24bb6c88f3 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:48.767453 24045 tablet_bootstrap.cc:492] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:48.771162 23836 tablet_service.cc:1511] Processing CreateTablet for tablet 729f7490c64342bebf0188dd2f975e39 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:48.775681 23840 tablet_service.cc:1511] Processing CreateTablet for tablet d12092e2a1294da4acc0a5f0261bfe94 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:48.780186 23993 tablet_service.cc:1511] Processing CreateTablet for tablet 573b7fecf80d4359b0e9f045d989ed09 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:48.780637 24044 tablet_bootstrap.cc:654] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.726478 23915 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9e6b2e7add490280e05d9b2bfdda17 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:48.786175 23841 tablet_service.cc:1511] Processing CreateTablet for tablet 375316edc4f14c939e96f8ce70294c81 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:48.836989 23993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573b7fecf80d4359b0e9f045d989ed09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.794682 23835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769e238f62804be6900a5660ed34e431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.763856 23837 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 18) took 1047 ms. Trace:
I20260709 12:19:48.837709 23837 rpcz_store.cc:276] 0709 12:19:47.716878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.082305 (+365427us) service_pool.cc:224] Handling call
0709 12:19:48.215263 (+132958us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.249866 (+ 34603us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.624615 (+374749us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.763291 (+138676us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:48.763765 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:48.840040 23840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12092e2a1294da4acc0a5f0261bfe94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.840739 23836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729f7490c64342bebf0188dd2f975e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.842236 23841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375316edc4f14c939e96f8ce70294c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.843261 23839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55123f416ba4e9a930f3a24bb6c88f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.843986 23911 tablet_service.cc:1511] Processing CreateTablet for tablet 01f15f801cf34333ad12954d0b614109 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:48.847864 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:48.853546 23800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:48.842331 23837 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5d779cbe414b879d3a8be40d0428fa (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:48.820636 23991 tablet_service.cc:1511] Processing CreateTablet for tablet d78d41f27ddd4a3fa2fe292b189ba372 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:48.822507 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:48.810992 23842 tablet_service.cc:1511] Processing CreateTablet for tablet 29a434c2919b4912a056d435a8992ff0 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:48.814081 23987 tablet_service.cc:1511] Processing CreateTablet for tablet 9458291d6d4d499f9c4b21cbe9170c33 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:48.806712 23913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3482cac0ee5745259004349e6078cf03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.862330 23837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5d779cbe414b879d3a8be40d0428fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.862128 23838 tablet_service.cc:1511] Processing CreateTablet for tablet c4a453d774d845e59416b4429315c41f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:48.863700 23915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9e6b2e7add490280e05d9b2bfdda17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.799995 23918 tablet_service.cc:1511] Processing CreateTablet for tablet c4a453d774d845e59416b4429315c41f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:48.866743 23918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a453d774d845e59416b4429315c41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.870820 23916 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35544 (request call id 36) took 1083 ms. Trace:
I20260709 12:19:48.871299 23916 rpcz_store.cc:276] 0709 12:19:47.787893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.486394 (+698501us) service_pool.cc:224] Handling call
0709 12:19:48.488581 (+  2187us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.488720 (+   139us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.718084 (+229364us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.870299 (+152215us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:48.870760 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:48.795569 23843 tablet_service.cc:1511] Processing CreateTablet for tablet f82c4b60fcc242eda3a32f8f32d6d163 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 12:19:48.874243 23817 leader_election.cc:343] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.874661 23919 tablet_service.cc:1511] Processing CreateTablet for tablet 4a79eabff38b4edebe70e32ff0d72afc (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:48.876019 23919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a79eabff38b4edebe70e32ff0d72afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.876715 24045 tablet_bootstrap.cc:654] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.859403 23991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78d41f27ddd4a3fa2fe292b189ba372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.835858 24046 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.879014 23914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362d811dc320452d8daaca5fda5cd52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.880715 23987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9458291d6d4d499f9c4b21cbe9170c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.889840 24054 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.890548 24054 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:48.891358 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f15f801cf34333ad12954d0b614109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.894050 24004 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:48.896013 23838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a453d774d845e59416b4429315c41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.895939 23818 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:48.896862 23843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82c4b60fcc242eda3a32f8f32d6d163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.898144 23842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a434c2919b4912a056d435a8992ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.873427 23916 tablet_service.cc:1511] Processing CreateTablet for tablet 5d00e1a3cc444623bdf4910b98044d66 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:48.905100 23916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d00e1a3cc444623bdf4910b98044d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.907917 23917 tablet_service.cc:1511] Processing CreateTablet for tablet 8630b76482c543a2a08e289b32b13ab6 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:48.917906 24054 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:48.918567 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:48.942420 23929 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:48.942929 23917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8630b76482c543a2a08e289b32b13ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.943773 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:48.943938 24054 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:48.944121 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 48491.3us
I20260709 12:19:48.944478 24054 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.945037 24054 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.946327 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:48.948208 23818 leader_election.cc:343] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.927031 24046 ts_tablet_manager.cc:1434] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.138s	user 0.009s	sys 0.000s
I20260709 12:19:48.949620 24068 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.950188 24068 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.950584 24068 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.951025 23986 tablet_service.cc:1511] Processing CreateTablet for tablet a9308162d63f49c4aa8dfccb14c1cf8a (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:48.955261 24044 tablet_bootstrap.cc:492] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:48.955847 24044 ts_tablet_manager.cc:1403] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.228s	user 0.020s	sys 0.000s
I20260709 12:19:48.957427 23910 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35544 (request call id 39) took 1060 ms. Trace:
I20260709 12:19:48.925410 23990 tablet_service.cc:1511] Processing CreateTablet for tablet d728437e541d463594bcfe1155df3a32 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:48.969413 23840 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 36) took 1052 ms. Trace:
I20260709 12:19:48.969866 23840 rpcz_store.cc:276] 0709 12:19:47.917146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.774268 (+857122us) service_pool.cc:224] Handling call
0709 12:19:48.836471 (+ 62203us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.836567 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.867651 (+ 31084us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.968896 (+101245us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:48.969343 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:48.960146 24046 tablet_bootstrap.cc:492] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:48.975196 23841 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 39) took 1057 ms. Trace:
I20260709 12:19:48.975703 23841 rpcz_store.cc:276] 0709 12:19:47.918063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.785184 (+867121us) service_pool.cc:224] Handling call
0709 12:19:48.837261 (+ 52077us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.837351 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.884969 (+ 47618us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.974576 (+ 89607us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:48.975126 (+   550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:48.930904 23989 tablet_service.cc:1511] Processing CreateTablet for tablet 880fc0774867427e9e9a605bad2bd375 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:48.979698 23844 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 33) took 1063 ms. Trace:
I20260709 12:19:48.980099 23844 rpcz_store.cc:276] 0709 12:19:47.916176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.743110 (+826934us) service_pool.cc:224] Handling call
0709 12:19:48.745919 (+  2809us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.746048 (+   129us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.914631 (+168583us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.977038 (+ 62407us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:48.979637 (+  2599us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:48.980727 23841 tablet_service.cc:1511] Processing CreateTablet for tablet 73d2fbc1f30749eba64903d7e79de8a7 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:48.978199 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9308162d63f49c4aa8dfccb14c1cf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.977285 23910 rpcz_store.cc:276] 0709 12:19:47.897148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.625195 (+728047us) service_pool.cc:224] Handling call
0709 12:19:48.693537 (+ 68342us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327eee 000000000036eb39 00007fa28c39b1e0 00007fa28c48084c 00007fa28c45dac3 00007fa28c40c400 00007fa285891af4 00007fa285891a82 00007fa2858919b1
0709 12:19:48.706455 (+ 12918us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.709248 (+  2793us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.833529 (+124281us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.956942 (+123413us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:48.957366 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42926336}
I20260709 12:19:48.986917 23988 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52308 (request call id 40) took 1071 ms. Trace:
I20260709 12:19:48.988557 24046 tablet_bootstrap.cc:654] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.003302 23841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d2fbc1f30749eba64903d7e79de8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.004531 23910 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0499f663114741880a025070e7b81f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:48.989565 23913 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35544 (request call id 44) took 1056 ms. Trace:
I20260709 12:19:48.990113 23844 tablet_service.cc:1511] Processing CreateTablet for tablet 362d811dc320452d8daaca5fda5cd52a (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:49.005977 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0499f663114741880a025070e7b81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.006498 23844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362d811dc320452d8daaca5fda5cd52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.007162 24045 tablet_bootstrap.cc:492] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:49.007653 24045 ts_tablet_manager.cc:1403] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.286s	user 0.008s	sys 0.007s
I20260709 12:19:49.010885 23916 tablet_service.cc:1511] Processing CreateTablet for tablet 573b7fecf80d4359b0e9f045d989ed09 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:48.992208 23919 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35544 (request call id 46) took 1036 ms. Trace:
I20260709 12:19:48.999174 23840 tablet_service.cc:1511] Processing CreateTablet for tablet 3482cac0ee5745259004349e6078cf03 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:49.011124 23839 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 34) took 1094 ms. Trace:
I20260709 12:19:48.999771 23835 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 32) took 1084 ms. Trace:
I20260709 12:19:49.002089 23837 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 41) took 1083 ms. Trace:
I20260709 12:19:49.002122 23988 rpcz_store.cc:276] 0709 12:19:47.915028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.468964 (+553936us) service_pool.cc:224] Handling call
0709 12:19:48.567031 (+ 98067us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.567185 (+   154us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.918967 (+351782us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.981002 (+ 62035us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:48.986848 (+  5846us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.012717 23840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3482cac0ee5745259004349e6078cf03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.013062 23837 rpcz_store.cc:276] 0709 12:19:47.918694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.841309 (+922615us) service_pool.cc:224] Handling call
0709 12:19:48.859979 (+ 18670us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.861970 (+  1991us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.956880 (+ 94910us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.996619 (+ 39739us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.001367 (+  4748us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.012624 23919 rpcz_store.cc:276] 0709 12:19:47.955965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.783722 (+827757us) service_pool.cc:224] Handling call
0709 12:19:48.875543 (+ 91821us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.875639 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.965057 (+ 89418us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.991690 (+ 26633us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:48.992143 (+   453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.011642 23913 rpcz_store.cc:276] 0709 12:19:47.933084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.754249 (+821165us) service_pool.cc:224] Handling call
0709 12:19:48.806018 (+ 51769us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.806172 (+   154us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.915648 (+109476us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.988986 (+ 73338us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:48.989494 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.016772 24044 raft_consensus.cc:359] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.017928 23837 tablet_service.cc:1511] Processing CreateTablet for tablet 4a79eabff38b4edebe70e32ff0d72afc (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:49.019272 23837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a79eabff38b4edebe70e32ff0d72afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.013499 23835 rpcz_store.cc:276] 0709 12:19:47.915789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.756091 (+840302us) service_pool.cc:224] Handling call
0709 12:19:48.793407 (+ 37316us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.793554 (+   147us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.921803 (+128249us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.995400 (+ 73597us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:48.999701 (+  4301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.022013 23836 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 35) took 1105 ms. Trace:
I20260709 12:19:48.976127 23912 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35544 (request call id 43) took 1047 ms. Trace:
I20260709 12:19:49.023123 23913 tablet_service.cc:1511] Processing CreateTablet for tablet 536d25b8a1934dfd8c9ecb2fa2068928 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:49.022719 23836 rpcz_store.cc:276] 0709 12:19:47.916828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.770137 (+853309us) service_pool.cc:224] Handling call
0709 12:19:48.839990 (+ 69853us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.840091 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.877558 (+ 37467us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.965725 (+ 88167us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.001639 (+ 35914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.023788 23835 tablet_service.cc:1511] Processing CreateTablet for tablet 01f15f801cf34333ad12954d0b614109 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:49.025949 23835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f15f801cf34333ad12954d0b614109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.026326 23989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880fc0774867427e9e9a605bad2bd375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.026181 23836 tablet_service.cc:1511] Processing CreateTablet for tablet 5d00e1a3cc444623bdf4910b98044d66 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:49.024327 23916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573b7fecf80d4359b0e9f045d989ed09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.028610 23990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d728437e541d463594bcfe1155df3a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.030877 23919 tablet_service.cc:1511] Processing CreateTablet for tablet 9458291d6d4d499f9c4b21cbe9170c33 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:49.033716 23919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9458291d6d4d499f9c4b21cbe9170c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.013995 23914 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35544 (request call id 45) took 1075 ms. Trace:
I20260709 12:19:49.034278 23914 rpcz_store.cc:276] 0709 12:19:47.937968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.759102 (+821134us) service_pool.cc:224] Handling call
0709 12:19:48.878240 (+119138us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c480831 00007fa28c45dac3 00007fa28c40c400 00007fa285891af4 00007fa285891a82 00007fa2858919b1
0709 12:19:48.878400 (+   160us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.878622 (+   222us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.973142 (+ 94520us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.005226 (+ 32084us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.013745 (+  8519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80570112}
I20260709 12:19:49.037539 23914 tablet_service.cc:1511] Processing CreateTablet for tablet d78d41f27ddd4a3fa2fe292b189ba372 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:49.038851 23913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 536d25b8a1934dfd8c9ecb2fa2068928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.039212 24045 raft_consensus.cc:359] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.040073 24045 raft_consensus.cc:385] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.039978 23836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d00e1a3cc444623bdf4910b98044d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.040459 24045 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.012399 23839 rpcz_store.cc:276] 0709 12:19:47.916513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.763586 (+847073us) service_pool.cc:224] Handling call
0709 12:19:48.818298 (+ 54712us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.818452 (+   154us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.880000 (+ 61548us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.983617 (+103617us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.010979 (+ 27362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.017617 24044 raft_consensus.cc:385] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.042089 24044 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.043131 24044 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.049706 24054 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.054960 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:49.055647 24004 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.023396 23912 rpcz_store.cc:276] 0709 12:19:47.928430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.733571 (+805141us) service_pool.cc:224] Handling call
0709 12:19:48.735756 (+  2185us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.735902 (+   146us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.938776 (+202874us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:48.975625 (+ 36849us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:48.976065 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.064953 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:49.058651 23914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78d41f27ddd4a3fa2fe292b189ba372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.074496 24045 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.077770 23836 tablet_service.cc:1511] Processing CreateTablet for tablet 8630b76482c543a2a08e289b32b13ab6 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:49.079100 23836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8630b76482c543a2a08e289b32b13ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.060973 24068 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.079350 23917 tablet_service.cc:1511] Processing CreateTablet for tablet 880fc0774867427e9e9a605bad2bd375 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:49.087652 23915 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35544 (request call id 42) took 1164 ms. Trace:
I20260709 12:19:49.088086 23915 rpcz_store.cc:276] 0709 12:19:47.923211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.725395 (+802184us) service_pool.cc:224] Handling call
0709 12:19:48.836658 (+111263us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.836786 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.918556 (+ 81770us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.077647 (+159091us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.087276 (+  9629us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa2843281a2 00007fa28d269889 00007fa28c39ad88 00007fa28c461973 00007fa28c45d70f 00007fa28c45decd 00007fa28c40c400 00007fa285891af4 00007fa285891a82
0709 12:19:49.087593 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8897,"spinlock_wait_cycles":4696832}
I20260709 12:19:49.080474 23911 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35544 (request call id 48) took 1020 ms. Trace:
I20260709 12:19:49.081584 24046 tablet_bootstrap.cc:492] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:49.090927 24046 ts_tablet_manager.cc:1403] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.131s	user 0.016s	sys 0.011s
I20260709 12:19:49.092113 23918 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35544 (request call id 47) took 1036 ms. Trace:
I20260709 12:19:49.092532 23918 rpcz_store.cc:276] 0709 12:19:48.055490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.791933 (+736443us) service_pool.cc:224] Handling call
0709 12:19:48.866250 (+ 74317us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.866354 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.935059 (+ 68705us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.046754 (+111695us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.091738 (+ 44984us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa2843281a2 00007fa28d269889 00007fa28c39ad88 00007fa28c461973 00007fa28c45d70f 00007fa28c45decd 00007fa28c40c400 00007fa285891af4 00007fa285891a82
0709 12:19:49.092049 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29409152}
I20260709 12:19:49.086143 23910 tablet_service.cc:1511] Processing CreateTablet for tablet a9308162d63f49c4aa8dfccb14c1cf8a (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 12:19:49.086758 23817 leader_election.cc:343] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.056454 23839 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0499f663114741880a025070e7b81f (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:49.089530 23843 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 37) took 1172 ms. Trace:
I20260709 12:19:49.076462 23912 tablet_service.cc:1511] Processing CreateTablet for tablet d728437e541d463594bcfe1155df3a32 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:49.096133 23839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0499f663114741880a025070e7b81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.100495 23836 tablet_service.cc:1511] Processing CreateTablet for tablet 573b7fecf80d4359b0e9f045d989ed09 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:49.102042 23836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573b7fecf80d4359b0e9f045d989ed09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.103632 23835 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 48) took 1028 ms. Trace:
I20260709 12:19:49.094487 24046 raft_consensus.cc:359] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.104072 23835 rpcz_store.cc:276] 0709 12:19:48.079851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.022853 (+943002us) service_pool.cc:224] Handling call
0709 12:19:49.025396 (+  2543us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:49.025504 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:49.052535 (+ 27031us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.103067 (+ 50532us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.103569 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.110608 23844 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 45) took 1078 ms. Trace:
I20260709 12:19:49.098672 23911 rpcz_store.cc:276] 0709 12:19:48.059722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.834122 (+774400us) service_pool.cc:224] Handling call
0709 12:19:48.844850 (+ 10728us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.844964 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.984010 (+139046us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.076165 (+ 92155us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.080415 (+  4250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.096552 24004 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:49.116396 23818 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:49.111018 23844 rpcz_store.cc:276] 0709 12:19:48.032178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.988986 (+956808us) service_pool.cc:224] Handling call
0709 12:19:49.006012 (+ 17026us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:49.006103 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:49.051483 (+ 45380us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.110036 (+ 58553us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.110544 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.111768 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:49.112277 24046 raft_consensus.cc:385] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.057803 24054 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.113015 23917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880fc0774867427e9e9a605bad2bd375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.098989 24044 ts_tablet_manager.cc:1434] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.143s	user 0.000s	sys 0.008s
I20260709 12:19:49.120245 23929 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.123638 24072 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.124157 24072 raft_consensus.cc:697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:49.124209 24068 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.125087 24072 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.118387 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:49.084672 23838 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 47) took 1028 ms. Trace:
I20260709 12:19:49.119427 24046 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.142983 23842 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 40) took 1224 ms. Trace:
I20260709 12:19:49.142666 24046 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.143386 23842 rpcz_store.cc:276] 0709 12:19:47.918382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.809956 (+891574us) service_pool.cc:224] Handling call
0709 12:19:48.870083 (+ 60127us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.870168 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:49.040129 (+169961us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.142501 (+102372us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.142911 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.132052 23838 rpcz_store.cc:276] 0709 12:19:48.055911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.861010 (+805099us) service_pool.cc:224] Handling call
0709 12:19:48.863094 (+  2084us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.863195 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.936820 (+ 73625us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.084080 (+147260us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.084604 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.096119 23843 rpcz_store.cc:276] 0709 12:19:47.917429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.782384 (+864955us) service_pool.cc:224] Handling call
0709 12:19:48.874257 (+ 91873us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:48.874366 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:48.982684 (+108318us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.089013 (+106329us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.089472 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.147783 23838 tablet_service.cc:1511] Processing CreateTablet for tablet d728437e541d463594bcfe1155df3a32 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:49.148483 23843 tablet_service.cc:1511] Processing CreateTablet for tablet 880fc0774867427e9e9a605bad2bd375 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:49.149946 24044 tablet_bootstrap.cc:492] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
W20260709 12:19:49.150203 23818 leader_election.cc:343] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.149099 23838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d728437e541d463594bcfe1155df3a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.131873 23835 tablet_service.cc:1511] Processing CreateTablet for tablet 536d25b8a1934dfd8c9ecb2fa2068928 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:49.154774 23835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 536d25b8a1934dfd8c9ecb2fa2068928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.136392 23912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d728437e541d463594bcfe1155df3a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.155910 23843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880fc0774867427e9e9a605bad2bd375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.138854 23844 tablet_service.cc:1511] Processing CreateTablet for tablet 9458291d6d4d499f9c4b21cbe9170c33 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:49.140156 23751 catalog_manager.cc:5697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.158116 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9308162d63f49c4aa8dfccb14c1cf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.145393 23842 tablet_service.cc:1511] Processing CreateTablet for tablet d78d41f27ddd4a3fa2fe292b189ba372 (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:49.170583 23844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9458291d6d4d499f9c4b21cbe9170c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.179414 24045 ts_tablet_manager.cc:1434] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.171s	user 0.030s	sys 0.014s
I20260709 12:19:49.180454 23929 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:49.160629 24046 ts_tablet_manager.cc:1434] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.069s	user 0.003s	sys 0.007s
I20260709 12:19:49.181954 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:49.182853 24046 tablet_bootstrap.cc:492] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:49.183319 24068 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.183856 24068 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:49.183646 23836 tablet_service.cc:1511] Processing CreateTablet for tablet a9308162d63f49c4aa8dfccb14c1cf8a (DEFAULT_TABLE table=test-workload [id=c0d74a83531a4662b07debf30a362e9a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:49.184816 24068 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.191159 23841 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 43) took 1159 ms. Trace:
I20260709 12:19:49.191660 23841 rpcz_store.cc:276] 0709 12:19:48.031509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.979568 (+948059us) service_pool.cc:224] Handling call
0709 12:19:49.001357 (+ 21789us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:49.002924 (+  1567us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:49.100185 (+ 97261us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.168436 (+ 68251us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.191086 (+ 22650us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356032}
I20260709 12:19:49.192430 23840 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 44) took 1160 ms. Trace:
I20260709 12:19:49.193001 23840 rpcz_store.cc:276] 0709 12:19:48.031863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.998040 (+966177us) service_pool.cc:224] Handling call
0709 12:19:49.012238 (+ 14198us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:49.012329 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:49.065997 (+ 53668us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.191846 (+125849us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.192364 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.193761 24045 tablet_bootstrap.cc:492] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:49.196990 24044 tablet_bootstrap.cc:654] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.201364 24046 tablet_bootstrap.cc:654] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.210139 23842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78d41f27ddd4a3fa2fe292b189ba372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.217495 23836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9308162d63f49c4aa8dfccb14c1cf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.210884 23837 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 46) took 1178 ms. Trace:
I20260709 12:19:49.222859 23837 rpcz_store.cc:276] 0709 12:19:48.032502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.016871 (+984369us) service_pool.cc:224] Handling call
0709 12:19:49.018799 (+  1928us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:49.018897 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:49.132291 (+113394us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.210060 (+ 77769us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.210817 (+   757us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.235371 24068 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.236531 24068 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.241972 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:49.243583 24045 tablet_bootstrap.cc:654] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:49.243921 23817 leader_election.cc:343] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.245370 24068 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.254128 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:49.255856 23818 leader_election.cc:343] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.256352 23818 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:49.261123 24046 tablet_bootstrap.cc:492] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:49.261662 24046 ts_tablet_manager.cc:1403] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.013s
I20260709 12:19:49.258004 24068 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.266778 24044 tablet_bootstrap.cc:492] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:49.267333 24044 ts_tablet_manager.cc:1403] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.118s	user 0.013s	sys 0.000s
I20260709 12:19:49.270347 24044 raft_consensus.cc:359] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.271127 24044 raft_consensus.cc:385] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.271440 24044 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.272240 24044 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.264787 24046 raft_consensus.cc:359] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.275776 24044 ts_tablet_manager.cc:1434] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:49.274034 24046 raft_consensus.cc:385] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.276365 24046 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.276520 23839 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60686 (request call id 51) took 1050 ms. Trace:
I20260709 12:19:49.277249 23839 rpcz_store.cc:276] 0709 12:19:48.226309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.043018 (+816709us) service_pool.cc:224] Handling call
0709 12:19:49.095623 (+ 52605us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:49.095732 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:49.212368 (+116636us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:49.273852 (+ 61484us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:49.276437 (+  2585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:49.278093 24044 tablet_bootstrap.cc:492] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:49.278954 24045 tablet_bootstrap.cc:492] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:49.279489 24045 ts_tablet_manager.cc:1403] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.007s
I20260709 12:19:49.277251 24046 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.281792 24046 ts_tablet_manager.cc:1434] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 12:19:49.282927 24046 tablet_bootstrap.cc:492] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:49.282783 24045 raft_consensus.cc:359] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.283631 24045 raft_consensus.cc:385] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.284003 24045 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.285810 24044 tablet_bootstrap.cc:654] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.290989 24046 tablet_bootstrap.cc:654] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.291590 24045 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.296559 24045 ts_tablet_manager.cc:1434] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:19:49.298110 24045 tablet_bootstrap.cc:492] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:49.309301 24044 tablet_bootstrap.cc:492] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:49.310004 24044 ts_tablet_manager.cc:1403] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.010s
I20260709 12:19:49.311324 24046 tablet_bootstrap.cc:492] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:49.311868 24045 tablet_bootstrap.cc:654] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.311868 24046 ts_tablet_manager.cc:1403] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260709 12:19:49.313650 24044 raft_consensus.cc:359] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.314570 24044 raft_consensus.cc:385] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.314970 24044 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.315887 24044 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.315866 24046 raft_consensus.cc:359] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.317279 24046 raft_consensus.cc:385] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.317720 24046 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.319024 24046 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.324373 24046 ts_tablet_manager.cc:1434] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 12:19:49.324816 24045 tablet_bootstrap.cc:492] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:49.325321 24045 ts_tablet_manager.cc:1403] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.008s
I20260709 12:19:49.325500 24046 tablet_bootstrap.cc:492] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:49.327234 24044 ts_tablet_manager.cc:1434] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 12:19:49.328531 24044 tablet_bootstrap.cc:492] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:49.328804 24045 raft_consensus.cc:359] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.329736 24045 raft_consensus.cc:385] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.330147 24045 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.331131 24051 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.331090 24045 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.331701 24051 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.333957 24051 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:49.334149 24045 ts_tablet_manager.cc:1434] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:19:49.335240 24045 tablet_bootstrap.cc:492] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:49.336817 24046 tablet_bootstrap.cc:654] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.337219 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:49.340792 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:49.341640 24045 tablet_bootstrap.cc:654] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:49.342692 23966 leader_election.cc:343] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:49.345081 23966 leader_election.cc:343] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.349612 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:49.329541 23750 catalog_manager.cc:5697] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.346325 24051 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.353756 24087 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.354347 24046 tablet_bootstrap.cc:492] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:49.356423 24046 ts_tablet_manager.cc:1403] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.013s
I20260709 12:19:49.356024 24051 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.358325 24051 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:49.359061 24051 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.359525 24051 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.359758 24046 raft_consensus.cc:359] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.360498 24046 raft_consensus.cc:385] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.360832 24046 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.346369 24044 tablet_bootstrap.cc:654] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.361788 24051 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:49.362658 24046 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.365800 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:49.366019 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:49.366822 23853 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:49.369555 24045 tablet_bootstrap.cc:492] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:49.370205 24045 ts_tablet_manager.cc:1403] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.008s
I20260709 12:19:49.370362 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:49.371538 23929 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 1: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:19:49.373344 24045 raft_consensus.cc:359] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.365165 24046 ts_tablet_manager.cc:1434] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:19:49.374229 24045 raft_consensus.cc:385] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.374586 24045 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.373229 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:49.375337 24045 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.375324 24046 tablet_bootstrap.cc:492] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:49.378480 24045 ts_tablet_manager.cc:1434] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:49.379607 24045 tablet_bootstrap.cc:492] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:49.384696 24046 tablet_bootstrap.cc:654] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.386797 24045 tablet_bootstrap.cc:654] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:49.386950 23966 leader_election.cc:343] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.387778 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:49.388634 24051 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.389032 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:49.396952 24087 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.397650 24045 tablet_bootstrap.cc:492] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:49.398048 24051 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.398244 24045 ts_tablet_manager.cc:1403] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.002s
I20260709 12:19:49.397471 24087 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.399960 24087 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.402170 24044 tablet_bootstrap.cc:492] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:49.402729 24044 ts_tablet_manager.cc:1403] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.010s
I20260709 12:19:49.403970 24055 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.404373 24045 raft_consensus.cc:359] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.404484 24055 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.405229 24045 raft_consensus.cc:385] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.405550 24045 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.406373 24044 raft_consensus.cc:359] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.407260 24044 raft_consensus.cc:385] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.407565 24044 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.407655 24055 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.408298 24046 tablet_bootstrap.cc:492] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:49.408810 24046 ts_tablet_manager.cc:1403] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.003s
I20260709 12:19:49.408558 24044 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.408730 24087 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.410501 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:49.411191 23853 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:49.406337 24045 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.412230 24044 ts_tablet_manager.cc:1434] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:19:49.412333 24046 raft_consensus.cc:359] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.413204 24046 raft_consensus.cc:385] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.413520 24046 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.414562 24046 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.417188 24046 ts_tablet_manager.cc:1434] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:49.417130 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:49.418213 24045 ts_tablet_manager.cc:1434] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 12:19:49.412388 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:49.419512 24045 tablet_bootstrap.cc:492] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Bootstrap starting.
W20260709 12:19:49.420467 23893 leader_election.cc:343] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.421169 24046 tablet_bootstrap.cc:492] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:49.422236 23892 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:49.411114 24087 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:19:49.426105 23966 leader_election.cc:343] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.427352 24044 tablet_bootstrap.cc:492] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:49.428189 24045 tablet_bootstrap.cc:654] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.429342 24091 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.429421 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:49.429894 24091 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.430308 24091 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.440860 24046 tablet_bootstrap.cc:654] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.440855 24045 tablet_bootstrap.cc:492] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:49.441686 24045 ts_tablet_manager.cc:1403] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.001s
I20260709 12:19:49.430159 23853 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.448149 24045 raft_consensus.cc:359] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.449057 24045 raft_consensus.cc:385] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.449425 24045 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.450312 24045 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.455209 24045 ts_tablet_manager.cc:1434] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:19:49.456341 24045 tablet_bootstrap.cc:492] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:49.457908 24046 tablet_bootstrap.cc:492] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:49.459621 24046 ts_tablet_manager.cc:1403] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.004s
I20260709 12:19:49.459934 24044 tablet_bootstrap.cc:654] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.462256 24091 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.465402 24045 tablet_bootstrap.cc:654] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.465806 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:49.465721 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:49.466862 23854 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:49.467558 23893 leader_election.cc:343] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.457803 23853 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:49.468489 24046 raft_consensus.cc:359] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.469237 24046 raft_consensus.cc:385] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.469517 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:49.471071 24051 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.471710 24051 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:49.472837 24051 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.469530 24046 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.475142 24091 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.476186 23854 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:49.476053 24046 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.477783 23892 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:49.478613 24046 ts_tablet_manager.cc:1434] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:19:49.479354 24091 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.481901 24044 tablet_bootstrap.cc:492] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:49.482246 24046 tablet_bootstrap.cc:492] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:49.482430 24044 ts_tablet_manager.cc:1403] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.009s
I20260709 12:19:49.485597 24044 raft_consensus.cc:359] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.491973 24044 raft_consensus.cc:385] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.492313 24044 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.493080 24044 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.493846 24046 tablet_bootstrap.cc:654] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.495656 24044 ts_tablet_manager.cc:1434] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:19:49.496042 24045 tablet_bootstrap.cc:492] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:49.496495 24045 ts_tablet_manager.cc:1403] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.001s
I20260709 12:19:49.496834 24044 tablet_bootstrap.cc:492] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:49.496784 24091 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:49.497838 24091 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.497656 23750 catalog_manager.cc:5697] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.499081 24045 raft_consensus.cc:359] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.499704 24045 raft_consensus.cc:385] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.499974 24045 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.500592 24045 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.503631 24045 ts_tablet_manager.cc:1434] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:49.504655 24045 tablet_bootstrap.cc:492] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:49.505158 24044 tablet_bootstrap.cc:654] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.511242 24045 tablet_bootstrap.cc:654] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.514283 24046 tablet_bootstrap.cc:492] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:49.514817 24046 ts_tablet_manager.cc:1403] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.006s
I20260709 12:19:49.516602 24044 tablet_bootstrap.cc:492] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:49.517124 24044 ts_tablet_manager.cc:1403] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:19:49.518384 24046 raft_consensus.cc:359] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.519168 24046 raft_consensus.cc:385] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.519501 24046 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.519850 24044 raft_consensus.cc:359] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.520582 24044 raft_consensus.cc:385] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.520360 24046 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.520941 24044 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.521009 24045 tablet_bootstrap.cc:492] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:49.521782 24045 ts_tablet_manager.cc:1403] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:19:49.521811 24044 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.522930 24046 ts_tablet_manager.cc:1434] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:19:49.523942 24046 tablet_bootstrap.cc:492] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:49.524394 24044 ts_tablet_manager.cc:1434] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:49.524667 24045 raft_consensus.cc:359] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.525389 24044 tablet_bootstrap.cc:492] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:49.525374 24045 raft_consensus.cc:385] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.525960 24045 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.526804 24045 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.529295 24045 ts_tablet_manager.cc:1434] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:49.530211 24045 tablet_bootstrap.cc:492] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:49.530417 24046 tablet_bootstrap.cc:654] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.536698 24091 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.537647 24045 tablet_bootstrap.cc:654] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.537226 24091 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.538707 24044 tablet_bootstrap.cc:654] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.539629 24091 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.540140 24091 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.543566 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:49.545670 23853 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:49.544049 24055 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.547068 24045 tablet_bootstrap.cc:492] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:49.546705 24055 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.547565 24045 ts_tablet_manager.cc:1403] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:19:49.549093 24055 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.550635 24045 raft_consensus.cc:359] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.551414 24045 raft_consensus.cc:385] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.551508 24044 tablet_bootstrap.cc:492] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:49.551744 24045 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.552163 24044 ts_tablet_manager.cc:1403] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.010s
I20260709 12:19:49.552431 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:49.552811 24045 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.553409 24003 raft_consensus.cc:2393] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 1: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:19:49.544859 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:49.554971 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:49.555423 24045 ts_tablet_manager.cc:1434] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:19:49.555203 24044 raft_consensus.cc:359] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.556170 24044 raft_consensus.cc:385] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.556510 24044 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.557054 24045 tablet_bootstrap.cc:492] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c: Bootstrap starting.
W20260709 12:19:49.557152 23893 leader_election.cc:343] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.557431 24044 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.558060 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:49.558508 23750 catalog_manager.cc:5697] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.559376 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:49.560506 24055 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.560931 24055 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.564049 24044 ts_tablet_manager.cc:1434] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:19:49.567435 24045 tablet_bootstrap.cc:654] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.569039 24091 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.561352 24055 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.573292 24044 tablet_bootstrap.cc:492] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:49.577627 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:49.577966 24097 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.578270 24068 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.579022 24004 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:49.578895 24068 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.580137 24044 tablet_bootstrap.cc:654] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.580615 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:49.582144 23893 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:49.583676 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:49.583946 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:49.584460 23928 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:49.584568 24004 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:49.585964 24068 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.585898 23818 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:49.588479 24071 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.588991 24071 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.589397 24071 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.592958 24044 tablet_bootstrap.cc:492] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
W20260709 12:19:49.592803 23892 leader_election.cc:343] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.593595 24044 ts_tablet_manager.cc:1403] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:19:49.594153 24091 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.594759 24091 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.595139 24091 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.595504 24091 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.596755 24044 raft_consensus.cc:359] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.597630 24044 raft_consensus.cc:385] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.599906 24046 tablet_bootstrap.cc:492] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:49.602201 24044 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.602605 24046 ts_tablet_manager.cc:1403] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.004s
I20260709 12:19:49.603319 24044 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.600342 24071 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.606874 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:49.607482 23929 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.608521 24046 raft_consensus.cc:359] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.609165 24044 ts_tablet_manager.cc:1434] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:19:49.609549 24071 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.610299 24044 tablet_bootstrap.cc:492] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:49.610432 24097 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.612197 24046 raft_consensus.cc:385] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.612591 24046 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.611089 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:49.613449 24046 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.614151 24051 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.616382 24051 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.617805 24044 tablet_bootstrap.cc:654] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.620255 24046 ts_tablet_manager.cc:1434] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 12:19:49.621265 24046 tablet_bootstrap.cc:492] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:49.622774 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:49.623438 23853 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:49.625377 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:49.621286 24051 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:49.625022 24071 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:19:49.619906 24004 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.630537 24051 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.630967 24051 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.631400 24051 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.636772 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:49.638506 23966 leader_election.cc:343] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.630208 24055 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.642549 23929 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:49.643795 23817 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:49.644654 24068 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.645143 24068 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.646739 24046 tablet_bootstrap.cc:654] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.648923 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:49.649718 24003 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:49.651230 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:49.652231 24054 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.652635 24054 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.653013 24054 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.653507 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:49.654256 23929 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:49.655565 24046 tablet_bootstrap.cc:492] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:49.656029 24046 ts_tablet_manager.cc:1403] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 12:19:49.656723 24068 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.651224 24071 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.658557 24051 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.658978 24046 raft_consensus.cc:359] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.659598 24046 raft_consensus.cc:385] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.659885 24046 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.661659 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:49.662372 23853 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.663578 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:49.663843 24051 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:49.663940 24045 tablet_bootstrap.cc:492] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:49.664604 24045 ts_tablet_manager.cc:1403] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.108s	user 0.024s	sys 0.005s
W20260709 12:19:49.665177 23966 leader_election.cc:343] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.669659 24045 raft_consensus.cc:359] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.674157 24045 raft_consensus.cc:385] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.678083 24055 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.678280 24045 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.660650 24046 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.680076 24045 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.676209 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:49.681394 24046 ts_tablet_manager.cc:1434] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:19:49.686069 24046 tablet_bootstrap.cc:492] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
W20260709 12:19:49.686646 23893 leader_election.cc:343] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.683111 24054 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.692018 24054 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.694069 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:49.675973 23853 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:49.695004 24002 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.698199 24045 ts_tablet_manager.cc:1434] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:19:49.699302 24045 tablet_bootstrap.cc:492] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:49.704991 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:49.705736 23929 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.706679 24002 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:49.708323 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:49.709987 24044 tablet_bootstrap.cc:492] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:49.710294 24112 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.722295 24044 ts_tablet_manager.cc:1403] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.041s
I20260709 12:19:49.715071 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:49.709435 24111 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:49.721238 24045 tablet_bootstrap.cc:654] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.710772 24071 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:49.727568 24051 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.728060 24051 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.728127 24071 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.729372 23929 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:49.730337 24051 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:49.724952 24004 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:49.726022 23853 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.725535 24115 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:19:49.714017 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:49.722470 24112 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:49.711097 24091 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.734489 24044 raft_consensus.cc:359] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.737684 24044 raft_consensus.cc:385] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.738521 24044 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.739446 24051 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.739500 24044 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.741999 24091 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.742430 24044 ts_tablet_manager.cc:1434] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:19:49.745448 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:49.746089 24002 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.746628 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:49.747049 24046 tablet_bootstrap.cc:654] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.745746 24044 tablet_bootstrap.cc:492] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:49.740043 24051 raft_consensus.cc:697] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:49.747828 23853 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:49.749760 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:49.750422 23928 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:49.751369 24068 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:49.751840 23892 leader_election.cc:343] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.752566 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:49.753356 24091 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.753846 24091 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:49.749343 24051 consensus_queue.cc:237] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.754769 24091 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.758783 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:49.759433 23853 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:49.754006 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:49.750346 24112 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.764350 24087 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.767593 24087 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.768105 24087 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.772938 24044 tablet_bootstrap.cc:654] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.790093 24002 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:49.799237 23893 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:49.802802 24055 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.803380 24055 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:49.804183 24055 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.807833 24051 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.808472 24051 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.822003 24091 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.796964 24087 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.822721 24091 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.824471 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:49.825259 23853 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:49.825963 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:49.826432 24051 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:49.835979 23854 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:49.840875 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:49.849638 23928 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:49.845801 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:49.846632 24071 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.854488 24071 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.856747 24071 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.847071 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:49.862172 23853 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.865142 24087 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:49.865375 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:49.868495 24051 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.869036 24051 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.869504 24051 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.870846 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:49.874024 24071 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.874786 24071 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.874068 23928 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.883888 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:49.886775 23817 leader_election.cc:343] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:49.891965 23818 leader_election.cc:343] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.889226 24071 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:19:49.899144 23800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:49.902513 23750 catalog_manager.cc:5697] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.894258 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:49.907689 23817 leader_election.cc:343] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.908140 23817 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:49.908480 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:49.890904 24091 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:49.894857 23752 catalog_manager.cc:5697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.911518 24071 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.920758 23853 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:49.922330 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:49.923635 24087 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.923915 24122 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 12:19:49.925019 24118 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:19:49.926420 24044 tablet_bootstrap.cc:492] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:49.928982 24044 ts_tablet_manager.cc:1403] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.183s	user 0.041s	sys 0.027s
I20260709 12:19:49.897207 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:49.932507 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:49.936654 24051 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.940485 24051 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:49.940936 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:49.941569 23929 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.944393 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:49.945053 23854 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.945290 23928 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:49.948805 24044 raft_consensus.cc:359] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.949601 24044 raft_consensus.cc:385] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.949996 24044 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.951071 24044 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.953517 24044 ts_tablet_manager.cc:1434] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:19:49.954806 24044 tablet_bootstrap.cc:492] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:49.959014 24087 raft_consensus.cc:697] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:19:49.961301 23818 leader_election.cc:343] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.963184 23818 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:49.963224 24087 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.959605 24091 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.964675 23929 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:49.965977 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:49.967321 24129 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.968008 24129 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:49.971314 24046 tablet_bootstrap.cc:492] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:49.970588 23751 catalog_manager.cc:5697] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.971855 24046 ts_tablet_manager.cc:1403] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.286s	user 0.026s	sys 0.014s
I20260709 12:19:49.972663 23751 catalog_manager.cc:5697] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.969199 24129 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.974679 24046 raft_consensus.cc:359] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.975360 24046 raft_consensus.cc:385] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.975652 24046 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.976430 24046 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.961807 23854 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:49.977238 24111 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.980028 24046 ts_tablet_manager.cc:1434] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:49.981051 24046 tablet_bootstrap.cc:492] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:49.985325 24045 tablet_bootstrap.cc:492] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:49.985752 24045 ts_tablet_manager.cc:1403] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.287s	user 0.052s	sys 0.049s
W20260709 12:19:49.988287 24123 log.cc:927] Time spent T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:19:49.977439 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 46743.4us
I20260709 12:19:49.992408 24045 raft_consensus.cc:359] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:49.994093 24045 raft_consensus.cc:385] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.994393 24045 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.995610 24045 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:50.001348 23893 consensus_peers.cc:597] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:50.003316 24091 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.006198 24045 ts_tablet_manager.cc:1434] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.007s
I20260709 12:19:50.009393 24045 tablet_bootstrap.cc:492] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:50.018505 24044 tablet_bootstrap.cc:654] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.025632 24051 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.026460 24051 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.023849 24129 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:19:50.028631 24051 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:50.032233 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:50.033030 23854 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 1: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:19:50.033437 24044 tablet_bootstrap.cc:492] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:50.037321 24044 ts_tablet_manager.cc:1403] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.004s
I20260709 12:19:50.031782 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:50.041790 24045 tablet_bootstrap.cc:654] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.042551 23966 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:50.043493 23751 catalog_manager.cc:5697] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:50.046345 24046 tablet_bootstrap.cc:654] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.045696 24129 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.045634 23751 catalog_manager.cc:5697] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:50.085292 24044 raft_consensus.cc:359] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.087881 24044 raft_consensus.cc:385] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.088166 24044 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.088610 24046 tablet_bootstrap.cc:492] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:50.089176 24046 ts_tablet_manager.cc:1403] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.030s
I20260709 12:19:50.090651 24045 tablet_bootstrap.cc:492] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:50.091105 24045 ts_tablet_manager.cc:1403] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.000s
I20260709 12:19:50.090845 23752 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.091842 24046 raft_consensus.cc:359] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.092504 24046 raft_consensus.cc:385] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.092744 24046 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.093283 24046 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.095271 24046 ts_tablet_manager.cc:1434] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:19:50.096138 24046 tablet_bootstrap.cc:492] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:50.099066 24091 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.103013 24046 tablet_bootstrap.cc:654] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.098291 24044 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.105113 24044 ts_tablet_manager.cc:1434] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.002s
I20260709 12:19:50.093600 24045 raft_consensus.cc:359] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.095988 24129 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.106215 24045 raft_consensus.cc:385] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.106804 24045 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.107765 24045 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.109009 24044 tablet_bootstrap.cc:492] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:50.113476 24045 ts_tablet_manager.cc:1434] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:19:50.118455 24044 tablet_bootstrap.cc:654] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.119459 24045 tablet_bootstrap.cc:492] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:50.125483 24045 tablet_bootstrap.cc:654] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.131060 24046 tablet_bootstrap.cc:492] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:50.131629 24046 ts_tablet_manager.cc:1403] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.007s
I20260709 12:19:50.133356 24055 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.133869 24055 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.135188 24046 raft_consensus.cc:359] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.136013 24046 raft_consensus.cc:385] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.136312 24046 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.136868 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:50.137346 24046 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:50.138634 23892 leader_election.cc:343] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.141075 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:50.142722 23893 leader_election.cc:343] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.143122 23893 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:50.143659 24055 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.145586 24097 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.148020 24045 tablet_bootstrap.cc:492] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:50.148491 24045 ts_tablet_manager.cc:1403] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 12:19:50.148540 24046 ts_tablet_manager.cc:1434] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:19:50.150032 24046 tablet_bootstrap.cc:492] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:50.151386 24045 raft_consensus.cc:359] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.152232 24045 raft_consensus.cc:385] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.152540 24045 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.154371 24045 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.155989 24044 tablet_bootstrap.cc:492] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:50.156642 24044 ts_tablet_manager.cc:1403] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.015s
I20260709 12:19:50.156733 24045 ts_tablet_manager.cc:1434] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:19:50.158191 24045 tablet_bootstrap.cc:492] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:50.159235 24046 tablet_bootstrap.cc:654] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.159821 24044 raft_consensus.cc:359] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.160537 24044 raft_consensus.cc:385] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.160799 24044 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.161479 24044 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.164290 24044 ts_tablet_manager.cc:1434] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:50.165496 24044 tablet_bootstrap.cc:492] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:50.172374 24045 tablet_bootstrap.cc:654] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.177520 24129 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.178083 24129 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.178555 24046 tablet_bootstrap.cc:492] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:50.179015 24046 ts_tablet_manager.cc:1403] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.010s
I20260709 12:19:50.180300 24129 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:50.181824 24045 tablet_bootstrap.cc:492] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:50.182111 24046 raft_consensus.cc:359] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.182837 24046 raft_consensus.cc:385] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.182402 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:50.183225 24046 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.183518 23854 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:50.184196 24044 tablet_bootstrap.cc:654] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.184551 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:50.186429 23966 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:50.187309 24122 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:50.187664 24122 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.188000 24122 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.188373 24046 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.188019 24055 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:19:50.192239 23966 leader_election.cc:343] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.194062 24111 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.199097 24046 ts_tablet_manager.cc:1434] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:19:50.201179 24046 tablet_bootstrap.cc:492] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:50.182739 24129 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.203531 24129 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.206445 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:50.182385 24045 ts_tablet_manager.cc:1403] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 12:19:50.218200 24129 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:19:50.219790 23966 leader_election.cc:343] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.221624 23854 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.222273 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:50.230604 24071 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.233163 24045 raft_consensus.cc:359] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:50.234413 23966 leader_election.cc:343] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.235797 24045 raft_consensus.cc:385] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.236128 24045 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.237798 24071 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.238587 24045 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.240461 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:50.241237 24045 ts_tablet_manager.cc:1434] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 12:19:50.241355 24087 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.247645 24091 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.252820 24046 tablet_bootstrap.cc:654] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.256976 24045 tablet_bootstrap.cc:492] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:50.267163 24122 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.269726 24122 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:50.272450 24055 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:19:50.265769 24091 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.278643 24044 tablet_bootstrap.cc:492] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:50.279189 24044 ts_tablet_manager.cc:1403] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.052s
I20260709 12:19:50.283742 24044 raft_consensus.cc:359] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.284530 24044 raft_consensus.cc:385] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.284847 24044 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.285346 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:50.285640 24044 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.290315 24044 ts_tablet_manager.cc:1434] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:19:50.291725 24044 tablet_bootstrap.cc:492] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:50.294075 24068 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:50.292806 23966 leader_election.cc:343] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.300028 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:50.317174 23854 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.326486 24097 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.327104 24097 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.331944 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:50.332513 24068 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.332640 23853 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:50.333032 24068 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.336112 24046 tablet_bootstrap.cc:492] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:50.336555 24046 ts_tablet_manager.cc:1403] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.136s	user 0.005s	sys 0.012s
I20260709 12:19:50.337637 23892 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:50.338241 24068 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.338619 24097 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.346117 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:50.347251 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:50.350282 24091 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:50.361024 23818 leader_election.cc:343] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.357537 24091 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.363721 24091 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:50.363018 23817 leader_election.cc:343] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.357995 24046 raft_consensus.cc:359] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.366721 24046 raft_consensus.cc:385] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.367092 24046 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.369408 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:50.369442 24087 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.371358 24152 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.351313 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:50.372682 24002 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:50.378136 24046 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.386524 24087 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:50.416909 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 79924.5us
I20260709 12:19:50.421428 24091 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.425783 24091 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.408521 24045 tablet_bootstrap.cc:654] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.427078 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:50.427762 24001 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.410820 23854 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:50.423352 24046 ts_tablet_manager.cc:1434] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.087s	user 0.003s	sys 0.005s
I20260709 12:19:50.404752 24044 tablet_bootstrap.cc:654] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.431210 23966 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:50.432777 24046 tablet_bootstrap.cc:492] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:50.437271 24001 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:50.438364 24051 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:50.438903 24051 raft_consensus.cc:697] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:50.439774 24051 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.443051 24152 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.443578 24152 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.446305 23893 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:50.450928 24157 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:50.451579 24157 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:50.452607 24157 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.454520 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:50.457082 23817 leader_election.cc:343] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.459334 24152 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.460898 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:50.462285 23966 consensus_peers.cc:597] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:50.462177 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:19:50.462514 23818 leader_election.cc:343] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.463050 23818 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:50.463400 24122 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.464234 24152 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.465096 24091 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.463069 23854 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.465694 24122 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.464039 24046 tablet_bootstrap.cc:654] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.470654 24129 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.473011 24129 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.475675 24129 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:50.478179 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:50.470826 24091 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.486258 24152 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.486796 24152 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.487600 24091 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.488569 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:50.490135 24152 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:19:50.490621 23893 leader_election.cc:343] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.491586 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:50.491745 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:50.492852 24001 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:50.496970 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:50.498590 24045 tablet_bootstrap.cc:492] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:50.499020 24045 ts_tablet_manager.cc:1403] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.242s	user 0.009s	sys 0.018s
I20260709 12:19:50.499887 24122 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.502995 24045 raft_consensus.cc:359] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.503569 24045 raft_consensus.cc:385] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.503850 24045 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.504683 24045 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.502260 23818 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:50.507843 24068 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:50.507892 23817 leader_election.cc:343] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.508196 23854 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:50.508417 24068 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.508877 24068 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.510983 24045 ts_tablet_manager.cc:1434] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:19:50.514355 24044 tablet_bootstrap.cc:492] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:50.514878 24044 ts_tablet_manager.cc:1403] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.223s	user 0.023s	sys 0.002s
I20260709 12:19:50.516911 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:50.519423 23752 catalog_manager.cc:5697] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:50.523947 24045 tablet_bootstrap.cc:492] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:50.519718 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:50.522575 24051 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.533286 24001 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.544198 24044 raft_consensus.cc:359] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.545271 24044 raft_consensus.cc:385] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.546159 23751 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.545648 24044 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
W20260709 12:19:50.554234 23892 leader_election.cc:343] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.554792 23892 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:50.558315 24156 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.566892 24068 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.573382 24044 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.573832 24156 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.574787 24156 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.582424 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:50.585004 24068 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.586352 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:50.586956 24003 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:50.584353 23892 leader_election.cc:343] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.625327 24157 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.625954 24157 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.630388 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:50.631464 23851 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:50.633313 24045 tablet_bootstrap.cc:654] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.633639 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:50.635950 24156 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.636010 24091 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:50.639088 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:50.641952 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:50.641978 24091 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.641232 24157 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.641189 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:50.643020 24091 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:50.645546 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 68004.9us
I20260709 12:19:50.647445 24003 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:50.648823 23818 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:50.649842 24152 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:50.650386 24152 raft_consensus.cc:697] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:50.651288 24152 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.658154 24046 tablet_bootstrap.cc:492] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:50.658711 24046 ts_tablet_manager.cc:1403] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.226s	user 0.010s	sys 0.028s
I20260709 12:19:50.641090 24044 ts_tablet_manager.cc:1434] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.126s	user 0.016s	sys 0.016s
W20260709 12:19:50.660684 23817 leader_election.cc:343] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.662714 24046 raft_consensus.cc:359] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.663503 24046 raft_consensus.cc:385] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.663807 24046 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.664583 24046 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:50.666733 23893 leader_election.cc:343] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.670539 23893 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:50.669684 24091 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.675848 24091 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.661034 24044 tablet_bootstrap.cc:492] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:50.676664 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:50.677392 23854 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.684557 24157 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:50.686432 23893 leader_election.cc:343] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.687222 23854 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:50.687472 24046 ts_tablet_manager.cc:1434] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 12:19:50.688472 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:50.689332 24156 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:50.690209 24156 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:50.691407 24156 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.692889 24046 tablet_bootstrap.cc:492] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:50.701267 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:50.709189 24046 tablet_bootstrap.cc:654] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:50.710259 23893 leader_election.cc:343] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.718858 24044 tablet_bootstrap.cc:654] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.720778 24045 tablet_bootstrap.cc:492] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:50.721297 24045 ts_tablet_manager.cc:1403] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.198s	user 0.047s	sys 0.043s
I20260709 12:19:50.723904 24045 raft_consensus.cc:359] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.724664 24045 raft_consensus.cc:385] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.724938 24045 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.725629 24045 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.726389 23752 catalog_manager.cc:5697] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.727664 24045 ts_tablet_manager.cc:1434] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:50.728647 24045 tablet_bootstrap.cc:492] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:50.732112 24044 tablet_bootstrap.cc:492] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:50.732620 24044 ts_tablet_manager.cc:1403] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.004s
I20260709 12:19:50.732025 23751 catalog_manager.cc:5697] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.735610 24045 tablet_bootstrap.cc:654] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.738646 24046 tablet_bootstrap.cc:492] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:50.739130 24046 ts_tablet_manager.cc:1403] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 12:19:50.741804 24046 raft_consensus.cc:359] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.742547 24046 raft_consensus.cc:385] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.742870 24046 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.743558 24046 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.745133 24046 ts_tablet_manager.cc:1434] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:50.735302 24044 raft_consensus.cc:359] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.746119 24044 raft_consensus.cc:385] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.746443 24044 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.747269 24044 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.749620 24044 ts_tablet_manager.cc:1434] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:19:50.750885 24044 tablet_bootstrap.cc:492] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:50.745841 24046 tablet_bootstrap.cc:492] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:50.754305 24045 tablet_bootstrap.cc:492] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:50.754808 24045 ts_tablet_manager.cc:1403] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 12:19:50.758036 24046 tablet_bootstrap.cc:654] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.759445 24045 raft_consensus.cc:359] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.760134 24045 raft_consensus.cc:385] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.760381 24045 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.760962 24156 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.761202 24045 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.761437 24156 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.763298 24045 ts_tablet_manager.cc:1434] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:50.764240 24045 tablet_bootstrap.cc:492] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:50.765015 24156 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.766516 24044 tablet_bootstrap.cc:654] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.766877 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:50.767768 23854 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:50.768815 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:50.770249 24045 tablet_bootstrap.cc:654] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.770437 23893 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:50.771428 24156 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.771886 24046 tablet_bootstrap.cc:492] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:50.772475 24046 ts_tablet_manager.cc:1403] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:19:50.776134 24046 raft_consensus.cc:359] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.777022 24046 raft_consensus.cc:385] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.777355 24046 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.778594 24046 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.782137 24046 ts_tablet_manager.cc:1434] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:19:50.783805 24044 tablet_bootstrap.cc:492] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:50.782918 24156 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.784343 24044 ts_tablet_manager.cc:1403] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.008s
I20260709 12:19:50.784355 24046 tablet_bootstrap.cc:492] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:50.786774 24045 tablet_bootstrap.cc:492] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:50.787266 24045 ts_tablet_manager.cc:1403] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 12:19:50.787190 24044 raft_consensus.cc:359] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.788138 24044 raft_consensus.cc:385] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.788473 24044 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.789057 24156 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.789534 24156 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.789358 24044 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.793378 24044 ts_tablet_manager.cc:1434] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:50.794431 24044 tablet_bootstrap.cc:492] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:50.794963 24046 tablet_bootstrap.cc:654] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.796976 24045 raft_consensus.cc:359] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.797816 24045 raft_consensus.cc:385] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.798148 24045 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.798890 24045 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.801069 24045 ts_tablet_manager.cc:1434] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:19:50.803450 24044 tablet_bootstrap.cc:654] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.804142 24045 tablet_bootstrap.cc:492] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:50.810631 24045 tablet_bootstrap.cc:654] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.823333 24045 tablet_bootstrap.cc:492] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:50.823834 24045 ts_tablet_manager.cc:1403] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.009s
I20260709 12:19:50.830933 24156 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.832401 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:50.833114 23854 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:50.835176 23892 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:50.836407 24091 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:50.834160 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:50.836978 24046 tablet_bootstrap.cc:492] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:50.833130 24045 raft_consensus.cc:359] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.836781 24091 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.837499 24046 ts_tablet_manager.cc:1403] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.018s
I20260709 12:19:50.837493 24045 raft_consensus.cc:385] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.837639 24091 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.838024 24045 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
W20260709 12:19:50.838306 23893 leader_election.cc:343] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.838820 24045 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.841450 24046 raft_consensus.cc:359] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.842113 24046 raft_consensus.cc:385] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.842320 24152 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.842427 24046 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.842867 24152 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.843358 24046 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.844306 24045 ts_tablet_manager.cc:1434] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 12:19:50.845830 24045 tablet_bootstrap.cc:492] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:50.846841 24046 ts_tablet_manager.cc:1434] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:50.847347 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:50.848811 23818 leader_election.cc:343] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.849152 24046 tablet_bootstrap.cc:492] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:50.852272 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:50.851769 24152 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.856362 24045 tablet_bootstrap.cc:654] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:50.858577 23817 leader_election.cc:343] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.859181 23817 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:50.860440 24091 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.864167 24046 tablet_bootstrap.cc:654] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.860466 24044 tablet_bootstrap.cc:492] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:50.860638 24111 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.864508 24157 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:19:50.868407 24044 ts_tablet_manager.cc:1403] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.020s
I20260709 12:19:50.871898 24044 raft_consensus.cc:359] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.872571 24044 raft_consensus.cc:385] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.872848 24044 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.873495 24044 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.876219 24044 ts_tablet_manager.cc:1434] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:50.877853 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:50.878481 23854 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.881158 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:50.881979 24003 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.884409 24122 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.886274 24111 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.886895 24111 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.887738 23854 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:50.889370 24044 tablet_bootstrap.cc:492] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:50.891021 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:50.891891 24004 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:50.892831 24111 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.894219 23818 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:50.896973 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:50.897819 23929 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:50.900609 23892 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:50.901628 24157 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:50.902117 24111 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:50.902129 24157 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:50.902850 24111 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.903374 24157 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.910557 24091 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.903403 24111 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.913007 24003 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:50.925060 24046 tablet_bootstrap.cc:492] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:50.925555 24046 ts_tablet_manager.cc:1403] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.077s	user 0.021s	sys 0.040s
I20260709 12:19:50.926550 24044 tablet_bootstrap.cc:654] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.928646 24046 raft_consensus.cc:359] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.929319 24046 raft_consensus.cc:385] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.929553 24046 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.930629 24046 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.932674 24046 ts_tablet_manager.cc:1434] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 12:19:50.934330 23800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:50.939090 24046 tablet_bootstrap.cc:492] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:50.939564 24045 tablet_bootstrap.cc:492] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:50.940006 24045 ts_tablet_manager.cc:1403] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.001s
I20260709 12:19:50.942625 24045 raft_consensus.cc:359] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.943300 24045 raft_consensus.cc:385] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.943576 24045 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.944298 24045 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.950549 24045 ts_tablet_manager.cc:1434] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:19:50.951465 24045 tablet_bootstrap.cc:492] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:50.934731 24111 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.966348 24111 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:50.967989 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:50.968628 24003 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.968853 24157 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.970877 24044 tablet_bootstrap.cc:492] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:50.971431 24044 ts_tablet_manager.cc:1403] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.082s	user 0.022s	sys 0.016s
I20260709 12:19:50.966825 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:50.967104 24046 tablet_bootstrap.cc:654] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.967535 24045 tablet_bootstrap.cc:654] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.974573 24129 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.977854 23928 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.978209 23752 catalog_manager.cc:5697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.977926 24044 raft_consensus.cc:359] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.979983 24044 raft_consensus.cc:385] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.980255 24044 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.980978 24044 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.983681 24044 ts_tablet_manager.cc:1434] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:19:50.984818 24044 tablet_bootstrap.cc:492] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:50.991291 23928 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:50.992622 23817 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:50.993427 24111 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:50.994076 24111 raft_consensus.cc:697] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:50.995196 24111 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:50.998490 24051 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.999166 24051 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.002019 24051 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:51.003679 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:51.005461 23966 leader_election.cc:343] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.007541 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:51.008478 23928 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:51.011510 24045 tablet_bootstrap.cc:492] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:51.012401 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:51.011312 24046 tablet_bootstrap.cc:492] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:51.015172 24111 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.015766 24111 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.016489 24051 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.016855 24051 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.017001 24044 tablet_bootstrap.cc:654] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.017220 24051 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.018779 24111 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.018827 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:51.019407 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.019596 24046 ts_tablet_manager.cc:1403] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.015s
I20260709 12:19:51.019598 23928 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:51.020051 24001 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:51.021091 23817 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:51.022505 24111 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.022667 24046 raft_consensus.cc:359] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.023030 24111 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.023370 24046 raft_consensus.cc:385] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.023715 24046 raft_consensus.cc:740] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.023556 24111 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.024475 24046 consensus_queue.cc:260] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.025508 24051 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.026738 24046 ts_tablet_manager.cc:1434] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:51.027736 24046 tablet_bootstrap.cc:492] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:51.027786 24045 ts_tablet_manager.cc:1403] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.076s	user 0.007s	sys 0.008s
I20260709 12:19:51.033507 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:51.034339 24111 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.034989 24046 tablet_bootstrap.cc:654] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:51.035120 23966 leader_election.cc:343] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.037014 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:51.037590 23928 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.037581 24051 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:51.037587 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:51.042423 23929 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.046278 23928 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:51.046957 24046 tablet_bootstrap.cc:492] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:51.047531 24046 ts_tablet_manager.cc:1403] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:19:51.047741 24044 tablet_bootstrap.cc:492] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:51.047470 23817 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:51.048202 24044 ts_tablet_manager.cc:1403] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.000s
I20260709 12:19:51.048455 24152 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.048959 24152 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:51.049815 24152 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.050443 23929 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:51.050443 24046 raft_consensus.cc:359] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.051367 24046 raft_consensus.cc:385] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.051002 24044 raft_consensus.cc:359] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.051669 24112 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.051826 24044 raft_consensus.cc:385] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.051851 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:51.052304 24044 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.053076 24051 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.053001 24044 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.058598 24051 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:51.059414 24044 ts_tablet_manager.cc:1434] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:19:51.053273 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:51.053781 24111 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.054008 24112 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.059893 24001 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.060362 24044 tablet_bootstrap.cc:492] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:51.060192 24045 raft_consensus.cc:359] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.060873 24045 raft_consensus.cc:385] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.061133 24045 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.061374 24112 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.059303 24051 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.051694 24046 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.042452 24003 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:51.062656 24046 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.064985 24046 ts_tablet_manager.cc:1434] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:19:51.065541 24045 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.068917 24045 ts_tablet_manager.cc:1434] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:19:51.069895 24045 tablet_bootstrap.cc:492] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:51.071533 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:51.066483 24044 tablet_bootstrap.cc:654] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.066392 24046 tablet_bootstrap.cc:492] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
W20260709 12:19:51.075206 23817 leader_election.cc:343] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.077308 24157 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.077906 24157 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.081116 24046 tablet_bootstrap.cc:654] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.081087 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.081920 24004 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 1: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:19:51.085843 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:51.077229 23751 catalog_manager.cc:5697] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.089632 23892 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:51.093907 23750 catalog_manager.cc:5697] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:51.095331 24055 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.094341 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.094823 24157 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.097812 24157 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:51.098242 24129 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.098702 24129 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.100775 24129 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:51.100899 24045 tablet_bootstrap.cc:654] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:51.102748 23818 leader_election.cc:343] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.103224 23818 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:51.105090 24111 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.106107 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:51.106899 24129 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:51.107756 23966 leader_election.cc:343] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.107467 24129 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.109800 24129 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:51.111678 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:51.115113 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:51.116529 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:51.122958 24001 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:51.123713 23929 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
W20260709 12:19:51.125726 23966 leader_election.cc:343] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.126613 24004 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:51.127502 23966 leader_election.cc:343] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.128005 23966 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:51.128777 24129 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.129961 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:51.130854 24129 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.131208 24129 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.131531 24129 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.134833 24055 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.138288 24129 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.140877 24055 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.141419 24055 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.142608 24129 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:51.144356 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:51.144460 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:51.146188 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:51.146755 23929 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:51.148372 23966 leader_election.cc:343] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.151029 24044 tablet_bootstrap.cc:492] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:51.151609 24044 ts_tablet_manager.cc:1403] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.000s
I20260709 12:19:51.157428 24044 raft_consensus.cc:359] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.158203 24044 raft_consensus.cc:385] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.158519 24044 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.159346 24044 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.161399 24044 ts_tablet_manager.cc:1434] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:19:51.164909 24044 tablet_bootstrap.cc:492] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:51.176486 24091 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.161181 23750 catalog_manager.cc:5697] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.174882 24055 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.183283 24112 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.184046 24112 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.190569 24044 tablet_bootstrap.cc:654] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.153687 23929 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:51.175330 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.196791 23893 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:51.198241 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:51.200752 24046 tablet_bootstrap.cc:492] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:51.201311 24046 ts_tablet_manager.cc:1403] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.135s	user 0.042s	sys 0.071s
I20260709 12:19:51.201443 24111 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.203105 24156 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.204393 24046 raft_consensus.cc:359] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.205152 24046 raft_consensus.cc:385] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.205525 24046 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.206254 24046 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.207878 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:51.208591 24046 ts_tablet_manager.cc:1434] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:19:51.209575 24046 tablet_bootstrap.cc:492] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
W20260709 12:19:51.209619 23817 leader_election.cc:343] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.211581 24112 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.213191 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.215721 24051 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.216588 24046 tablet_bootstrap.cc:654] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.219496 24051 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:19:51.222018 23818 leader_election.cc:343] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.222581 23818 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:51.223874 24112 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.220624 24051 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.231245 24046 tablet_bootstrap.cc:492] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:51.231745 24046 ts_tablet_manager.cc:1403] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.005s
I20260709 12:19:51.232263 24045 tablet_bootstrap.cc:492] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:51.232724 24045 ts_tablet_manager.cc:1403] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.163s	user 0.028s	sys 0.012s
I20260709 12:19:51.234551 24046 raft_consensus.cc:359] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.235229 24046 raft_consensus.cc:385] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.235682 24046 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.235219 24045 raft_consensus.cc:359] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.236027 24045 raft_consensus.cc:385] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.236335 24045 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.236415 24046 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.237010 24045 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.240633 24044 tablet_bootstrap.cc:492] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:51.242224 24044 ts_tablet_manager.cc:1403] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.014s
I20260709 12:19:51.244967 24044 raft_consensus.cc:359] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.241758 24045 ts_tablet_manager.cc:1434] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:19:51.246230 24046 ts_tablet_manager.cc:1434] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:19:51.246483 24045 tablet_bootstrap.cc:492] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:51.247139 24046 tablet_bootstrap.cc:492] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:51.248728 24044 raft_consensus.cc:385] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.251683 24044 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.264112 24111 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:51.266239 24044 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.266964 24046 tablet_bootstrap.cc:654] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.269618 24044 ts_tablet_manager.cc:1434] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.004s
I20260709 12:19:51.271039 24044 tablet_bootstrap.cc:492] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:51.274775 24045 tablet_bootstrap.cc:654] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.279378 23751 catalog_manager.cc:5697] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:51.281543 24055 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.282120 24055 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.285719 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.286417 24004 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:51.287444 24044 tablet_bootstrap.cc:654] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.287781 23893 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:51.289486 24157 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.290071 24157 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.290481 24157 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.292265 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:51.295943 24055 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:19:51.306170 23892 leader_election.cc:343] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.324715 24046 tablet_bootstrap.cc:492] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:51.325301 24046 ts_tablet_manager.cc:1403] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.023s
I20260709 12:19:51.329905 24046 raft_consensus.cc:359] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.330734 24046 raft_consensus.cc:385] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.331099 24046 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.331881 24046 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.333964 24044 tablet_bootstrap.cc:492] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:51.334399 24045 tablet_bootstrap.cc:492] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:51.334463 24044 ts_tablet_manager.cc:1403] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.021s
I20260709 12:19:51.334889 24045 ts_tablet_manager.cc:1403] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.089s	user 0.024s	sys 0.004s
I20260709 12:19:51.338004 24046 ts_tablet_manager.cc:1434] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.005s
I20260709 12:19:51.338975 24046 tablet_bootstrap.cc:492] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:51.340216 24044 raft_consensus.cc:359] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.340941 24044 raft_consensus.cc:385] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.340726 24045 raft_consensus.cc:359] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.341279 24044 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.341488 24045 raft_consensus.cc:385] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.341832 24045 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.342799 24044 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.344177 24045 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.345131 24044 ts_tablet_manager.cc:1434] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:19:51.346058 24044 tablet_bootstrap.cc:492] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:51.349647 24045 ts_tablet_manager.cc:1434] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:19:51.350608 24045 tablet_bootstrap.cc:492] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:51.345847 24157 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.359064 24091 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:51.364535 23929 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.365442 24046 tablet_bootstrap.cc:654] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.367066 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:51.370148 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:51.370764 24001 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.368639 24157 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:19:51.374038 23892 leader_election.cc:343] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.378396 24001 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:51.386219 23893 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:51.387183 24091 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.387642 24091 raft_consensus.cc:697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:51.388522 24091 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.389218 24045 tablet_bootstrap.cc:654] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.392210 24044 tablet_bootstrap.cc:654] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.401856 24112 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.402009 24111 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:51.402419 24112 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.404446 24112 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.404765 24055 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:51.407413 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.408187 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:51.408885 23928 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:51.410295 23817 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:51.411440 24112 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.411954 24112 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.412317 24112 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.412412 24051 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.412880 24051 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.415895 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:51.416528 23854 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:51.417737 23966 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:51.418610 24129 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.418968 24129 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.419341 24129 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.419371 24112 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:51.422087 23818 leader_election.cc:343] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.424054 24046 tablet_bootstrap.cc:492] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:51.424497 24046 ts_tablet_manager.cc:1403] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.000s
I20260709 12:19:51.426348 24051 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:51.428696 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:51.429514 23928 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:51.436656 24046 raft_consensus.cc:359] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.437456 24046 raft_consensus.cc:385] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.437942 24046 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.438898 24046 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.440652 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:51.433686 24129 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.441340 23928 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.441488 24046 ts_tablet_manager.cc:1434] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:19:51.442530 24046 tablet_bootstrap.cc:492] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:51.445016 24112 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.448083 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:51.448815 23851 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.450739 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:51.451380 23927 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.452651 24046 tablet_bootstrap.cc:654] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.458427 23851 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:51.465477 24046 tablet_bootstrap.cc:492] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:51.466003 24046 ts_tablet_manager.cc:1403] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:19:51.477064 24051 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.473364 24129 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:51.479060 24055 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.481252 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:51.486641 24071 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.487653 24071 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.481688 24051 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.485194 23927 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:51.490178 24156 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.490666 24156 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.491094 23928 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:51.491542 24051 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:51.479384 23966 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:51.492653 24156 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.492594 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.491189 24071 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.493810 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:51.494494 23854 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:51.495637 24111 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.496285 24046 raft_consensus.cc:359] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.485446 24055 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.497049 24046 raft_consensus.cc:385] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.495631 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:51.497427 24046 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.497825 23928 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:51.498204 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.498502 24055 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.498253 24046 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.498885 24001 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:51.499967 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.500368 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:51.494588 23818 leader_election.cc:343] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.510183 23893 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:19:51.510720 23892 leader_election.cc:343] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.500756 24046 ts_tablet_manager.cc:1434] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:19:51.513648 24044 tablet_bootstrap.cc:492] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:51.514226 24044 ts_tablet_manager.cc:1403] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.168s	user 0.022s	sys 0.036s
W20260709 12:19:51.510823 23818 leader_election.cc:343] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.511380 24051 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.515602 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:51.517257 24046 tablet_bootstrap.cc:492] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:51.517534 24051 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:51.518585 23817 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:51.514920 24091 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.519296 24091 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.520926 24091 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.519855 24071 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.521507 24071 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:51.522997 24071 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.524291 23751 catalog_manager.cc:5697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.512354 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:51.526587 23893 leader_election.cc:343] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.526856 24045 tablet_bootstrap.cc:492] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
W20260709 12:19:51.526968 23966 leader_election.cc:343] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.527060 23893 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:51.527420 24045 ts_tablet_manager.cc:1403] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.177s	user 0.010s	sys 0.015s
I20260709 12:19:51.527989 24129 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.528370 24129 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.528425 24055 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.528781 24129 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.517673 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:51.534880 24046 tablet_bootstrap.cc:654] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.535396 24087 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.531116 23851 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:51.543380 24045 raft_consensus.cc:359] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.544330 24045 raft_consensus.cc:385] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.544688 24045 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.547224 24112 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.520378 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:51.549329 24152 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.549718 24152 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.550194 24152 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.519109 24051 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.556947 24044 raft_consensus.cc:359] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.557821 24044 raft_consensus.cc:385] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.558288 24044 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.562886 24152 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.565193 24152 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.566898 24129 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.569685 24129 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:51.570426 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:51.583930 23851 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.545437 24045 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.592360 24045 ts_tablet_manager.cc:1434] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:19:51.597128 24071 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.572024 24044 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.572399 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:51.578504 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:51.582819 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:51.600373 23928 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:51.600766 23818 leader_election.cc:343] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.601377 24071 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.601621 23751 catalog_manager.cc:5697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:51.601866 24071 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.605844 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.606596 23752 catalog_manager.cc:5697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:51.607470 23818 leader_election.cc:343] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.607487 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:51.607677 23928 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
W20260709 12:19:51.608599 23966 leader_election.cc:343] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.608940 23926 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:51.610347 24071 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.611398 24044 ts_tablet_manager.cc:1434] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.001s
I20260709 12:19:51.612350 24044 tablet_bootstrap.cc:492] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:51.616420 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:51.618228 24045 tablet_bootstrap.cc:492] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:51.618887 24071 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.619729 24071 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:51.620790 24071 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.617801 23817 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:51.627974 24111 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.628357 24111 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.628685 24111 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.635524 24111 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.637712 24111 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.640017 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:51.642917 23851 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
W20260709 12:19:51.645326 23818 leader_election.cc:343] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.645830 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:51.647135 23926 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.647477 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:51.649174 24045 tablet_bootstrap.cc:654] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.648839 24129 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.650550 24129 raft_consensus.cc:697] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:51.656795 24091 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.658846 24044 tablet_bootstrap.cc:654] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.659168 24091 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.651360 24129 consensus_queue.cc:237] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.660617 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:51.661707 23926 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:51.663956 23851 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.665153 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:51.666352 24004 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.668952 24046 tablet_bootstrap.cc:492] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:51.669436 24046 ts_tablet_manager.cc:1403] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.017s
I20260709 12:19:51.680068 24046 raft_consensus.cc:359] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.680792 24046 raft_consensus.cc:385] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.681062 24046 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.683596 23854 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.685103 24046 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.686425 23817 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:51.695254 24152 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.695796 24152 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:51.700645 24152 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.707322 23750 catalog_manager.cc:5697] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.721262 24051 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.723439 24046 ts_tablet_manager.cc:1434] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.005s
I20260709 12:19:51.727967 24046 tablet_bootstrap.cc:492] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:51.727360 24217 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.755184 24004 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:51.756305 23893 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:51.757434 24156 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.757577 24044 tablet_bootstrap.cc:492] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:51.757969 24156 raft_consensus.cc:697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:51.758133 24044 ts_tablet_manager.cc:1403] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.013s
I20260709 12:19:51.760500 24156 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.761960 23851 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:51.750028 24217 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:51.773790 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.778656 24217 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:51.778223 23750 catalog_manager.cc:5697] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:51.781314 24045 tablet_bootstrap.cc:492] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:51.780869 23752 catalog_manager.cc:5697] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.781749 24045 ts_tablet_manager.cc:1403] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.164s	user 0.001s	sys 0.012s
W20260709 12:19:51.782045 23892 consensus_peers.cc:597] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.783950 24045 raft_consensus.cc:359] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.784618 24045 raft_consensus.cc:385] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.784883 24045 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.786500 24045 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.788566 24045 ts_tablet_manager.cc:1434] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:51.789362 24046 tablet_bootstrap.cc:654] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.789456 24045 tablet_bootstrap.cc:492] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:51.792974 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:51.794919 23966 leader_election.cc:343] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.797739 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:51.798454 23852 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:51.801816 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:51.802965 24051 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.803331 24051 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.803664 24051 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.805364 24087 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.809149 24045 tablet_bootstrap.cc:654] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.813927 24044 raft_consensus.cc:359] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.814651 24044 raft_consensus.cc:385] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.814924 24044 raft_consensus.cc:740] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.815572 24044 consensus_queue.cc:260] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.818480 24046 tablet_bootstrap.cc:492] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:51.819062 24046 ts_tablet_manager.cc:1403] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.095s	user 0.005s	sys 0.009s
I20260709 12:19:51.820398 24091 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.821000 24051 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.823719 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:51.824337 23854 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.824841 24046 raft_consensus.cc:359] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.825541 24046 raft_consensus.cc:385] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.825871 24046 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.826668 24046 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.829289 24046 ts_tablet_manager.cc:1434] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 12:19:51.830610 24046 tablet_bootstrap.cc:492] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:51.833527 24051 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:51.833834 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:19:51.835489 23966 leader_election.cc:343] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.838405 24044 ts_tablet_manager.cc:1434] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 12:19:51.839334 24044 tablet_bootstrap.cc:492] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:51.840292 24046 tablet_bootstrap.cc:654] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.843624 23752 catalog_manager.cc:5697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.848623 23854 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:51.849952 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:51.854526 24044 tablet_bootstrap.cc:654] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.854444 24087 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.857412 24087 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:51.858402 24087 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.859543 24045 tablet_bootstrap.cc:492] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:51.870864 24045 ts_tablet_manager.cc:1403] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.082s	user 0.021s	sys 0.015s
I20260709 12:19:51.861264 24046 tablet_bootstrap.cc:492] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:51.871706 24046 ts_tablet_manager.cc:1403] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.008s
I20260709 12:19:51.873623 24045 raft_consensus.cc:359] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.874761 24045 raft_consensus.cc:385] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.875115 24045 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.875797 24045 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.877987 24045 ts_tablet_manager.cc:1434] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:51.879009 24045 tablet_bootstrap.cc:492] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:51.884900 24045 tablet_bootstrap.cc:654] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.888239 24046 raft_consensus.cc:359] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.889247 24046 raft_consensus.cc:385] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.889611 24046 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.890729 24046 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.896520 24045 tablet_bootstrap.cc:492] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:51.897030 24045 ts_tablet_manager.cc:1403] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.012s
I20260709 12:19:51.899683 24045 raft_consensus.cc:359] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.900357 24045 raft_consensus.cc:385] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.900617 24045 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.901448 24045 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.907344 24045 ts_tablet_manager.cc:1434] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:19:51.908288 24045 tablet_bootstrap.cc:492] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:51.908525 24046 ts_tablet_manager.cc:1434] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.004s
I20260709 12:19:51.910053 24046 tablet_bootstrap.cc:492] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:51.913964 24045 tablet_bootstrap.cc:654] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.921211 24046 tablet_bootstrap.cc:654] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.921844 23751 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:51.926453 24044 tablet_bootstrap.cc:492] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:51.926949 24044 ts_tablet_manager.cc:1403] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.088s	user 0.041s	sys 0.033s
I20260709 12:19:51.930385 24044 raft_consensus.cc:359] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.931293 24044 raft_consensus.cc:385] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.931588 24044 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.932569 24044 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.936074 24044 ts_tablet_manager.cc:1434] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:19:51.961468 24044 tablet_bootstrap.cc:492] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:51.965754 24046 tablet_bootstrap.cc:492] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:51.966293 24046 ts_tablet_manager.cc:1403] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.057s	user 0.031s	sys 0.013s
I20260709 12:19:51.969081 24046 raft_consensus.cc:359] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.969736 24046 raft_consensus.cc:385] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.970070 24046 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.970788 24046 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.974958 24046 ts_tablet_manager.cc:1434] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:19:51.976434 24046 tablet_bootstrap.cc:492] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:51.980047 24002 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.981069 24055 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.984076 24055 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.985948 24044 tablet_bootstrap.cc:654] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.986337 24055 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:51.988423 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:51.988870 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:51.989064 24051 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:51.990262 23893 leader_election.cc:343] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:51.990900 23892 leader_election.cc:343] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.991359 23892 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:51.992117 24156 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.993141 24152 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.993606 24152 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:51.996402 24071 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.996623 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:51.997407 23800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:52.000911 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:52.003208 23818 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:52.001586 24044 tablet_bootstrap.cc:492] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:52.004456 24044 ts_tablet_manager.cc:1403] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.005s
I20260709 12:19:52.005088 24071 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.007274 24044 raft_consensus.cc:359] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.008080 24044 raft_consensus.cc:385] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.008385 24044 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.001488 24152 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.009158 24044 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.010856 24044 ts_tablet_manager.cc:1434] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:52.011861 24044 tablet_bootstrap.cc:492] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:52.016414 24046 tablet_bootstrap.cc:654] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.018095 24044 tablet_bootstrap.cc:654] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.020634 24152 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:52.027045 24046 tablet_bootstrap.cc:492] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:52.027549 24046 ts_tablet_manager.cc:1403] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.003s
I20260709 12:19:52.041407 24046 raft_consensus.cc:359] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.042326 24046 raft_consensus.cc:385] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.047446 24156 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.048130 24156 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.051383 24087 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:52.059327 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.060328 23851 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:52.062561 24156 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.064827 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:52.067123 23893 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:52.075713 24055 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.042672 24046 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.086488 24046 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.088402 24224 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.089775 24046 ts_tablet_manager.cc:1434] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 12:19:52.091041 24224 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.091553 24224 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.092944 24046 tablet_bootstrap.cc:492] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:52.094465 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:52.095367 23928 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:52.096678 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:52.097513 24111 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.097390 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:52.097913 24111 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.098328 24111 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:52.102556 23818 leader_election.cc:343] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.105330 24055 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.108919 24111 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.097893 24224 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.116619 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:52.117372 23929 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.117681 24129 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:52.122468 24046 tablet_bootstrap.cc:654] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.124184 24224 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:52.133863 23818 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.137830 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:19:52.139775 23818 leader_election.cc:343] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.140431 24111 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.154142 23929 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:52.155478 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:52.157124 24071 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.157712 24046 tablet_bootstrap.cc:492] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:52.158771 24129 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.157793 24071 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:52.159060 24046 ts_tablet_manager.cc:1403] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.008s
I20260709 12:19:52.159264 24129 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.160066 24071 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:52.161207 23818 consensus_peers.cc:597] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.164018 24045 tablet_bootstrap.cc:492] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:52.164608 24045 ts_tablet_manager.cc:1403] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.257s	user 0.074s	sys 0.106s
I20260709 12:19:52.163287 24129 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:52.166059 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.169216 23851 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.170737 24046 raft_consensus.cc:359] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.171444 24046 raft_consensus.cc:385] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.171762 24046 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.173045 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:52.174000 23926 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:52.175486 23966 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:52.176414 24046 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.176895 24129 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.177779 24129 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.178282 24129 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.180298 24087 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.180426 24217 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.181393 24044 tablet_bootstrap.cc:492] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:52.180975 24087 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.181828 24044 ts_tablet_manager.cc:1403] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.170s	user 0.024s	sys 0.045s
I20260709 12:19:52.190825 24046 ts_tablet_manager.cc:1434] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
W20260709 12:19:52.192072 23966 leader_election.cc:343] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.195487 24156 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.197321 24156 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.199956 24046 tablet_bootstrap.cc:492] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:52.202457 24156 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.203572 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:52.204378 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:52.205121 23893 leader_election.cc:343] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:52.206429 23892 leader_election.cc:343] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.207036 23892 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:52.203523 24087 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:52.205027 24045 raft_consensus.cc:359] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.209342 24045 raft_consensus.cc:385] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.209806 24045 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.208730 24156 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.212677 24045 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.218691 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.219347 24156 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.220026 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:52.219836 24156 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.221057 24045 ts_tablet_manager.cc:1434] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.004s
W20260709 12:19:52.220199 23966 leader_election.cc:343] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.221494 23926 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:52.223330 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:52.224447 24217 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.224802 24217 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.225152 24217 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.229279 24045 tablet_bootstrap.cc:492] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:52.227873 24044 raft_consensus.cc:359] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.230456 24044 raft_consensus.cc:385] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.230755 24044 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.236523 23751 catalog_manager.cc:5697] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.238169 24111 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.240166 24111 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.242118 24111 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.243072 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:52.246297 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:52.249668 24156 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.251389 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:52.252918 23893 leader_election.cc:343] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.253350 24217 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.257350 24217 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:52.259616 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.259810 24129 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.261374 24044 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.274510 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:52.264921 23818 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:52.277031 24111 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:52.277494 23966 leader_election.cc:343] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:52.278072 23892 leader_election.cc:343] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.278503 23892 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:52.279241 24055 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.280903 24044 ts_tablet_manager.cc:1434] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.099s	user 0.004s	sys 0.002s
I20260709 12:19:52.306365 24044 tablet_bootstrap.cc:492] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:52.326519 24129 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:52.335983 24044 tablet_bootstrap.cc:654] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.339459 24071 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.339625 23854 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:52.343338 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 63474.1us
I20260709 12:19:52.344183 24044 tablet_bootstrap.cc:492] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:52.344656 24044 ts_tablet_manager.cc:1403] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.063s	user 0.003s	sys 0.008s
I20260709 12:19:52.346748 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:52.340124 24071 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.351951 23851 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.355432 24044 raft_consensus.cc:359] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.356123 24044 raft_consensus.cc:385] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.356395 24044 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.357159 24044 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.358693 24044 ts_tablet_manager.cc:1434] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:19:52.359572 24044 tablet_bootstrap.cc:492] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:52.359802 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:52.360446 23929 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:52.368384 23817 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:52.366475 24129 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:19:52.371623 24071 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.374156 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:52.374816 24004 raft_consensus.cc:2393] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:52.378963 23851 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:52.379598 24055 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.381603 24111 raft_consensus.cc:2764] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:19:52.388837 23966 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:52.390317 24217 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.390925 24217 raft_consensus.cc:697] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:19:52.337318 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 59281.5us
I20260709 12:19:52.394292 24217 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.397698 24045 tablet_bootstrap.cc:654] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.406595 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:52.409083 24044 tablet_bootstrap.cc:654] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.410220 24046 tablet_bootstrap.cc:654] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.407238 23929 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.412962 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:52.413640 23926 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.414438 23925 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.439857 23750 catalog_manager.cc:5697] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:52.441825 24157 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.442392 24157 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.444758 23929 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:52.445129 24156 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:52.450039 23926 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:52.455166 24045 tablet_bootstrap.cc:492] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:52.455892 24045 ts_tablet_manager.cc:1403] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.227s	user 0.019s	sys 0.019s
I20260709 12:19:52.459887 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:52.460693 24051 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.461239 24051 raft_consensus.cc:697] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:52.462478 24051 consensus_queue.cc:237] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.464156 24157 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.464036 24046 tablet_bootstrap.cc:492] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:52.465621 24046 ts_tablet_manager.cc:1403] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.266s	user 0.023s	sys 0.000s
I20260709 12:19:52.468288 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:52.475030 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.475507 24044 tablet_bootstrap.cc:492] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:52.475982 24044 ts_tablet_manager.cc:1403] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.002s
I20260709 12:19:52.477670 24087 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.478686 24044 raft_consensus.cc:359] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.479365 24044 raft_consensus.cc:385] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.477273 23892 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:52.479632 24044 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.480641 24055 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.480718 24044 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.472328 24045 raft_consensus.cc:359] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.482038 24045 raft_consensus.cc:385] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.482336 24045 raft_consensus.cc:740] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.488893 24044 ts_tablet_manager.cc:1434] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:19:52.490303 24044 tablet_bootstrap.cc:492] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:52.485859 24045 consensus_queue.cc:260] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.496935 24045 ts_tablet_manager.cc:1434] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:19:52.496903 24046 raft_consensus.cc:359] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.497807 24046 raft_consensus.cc:385] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.498114 24045 tablet_bootstrap.cc:492] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:52.498121 24046 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.501463 24046 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.503170 24044 tablet_bootstrap.cc:654] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.507802 24045 tablet_bootstrap.cc:654] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.499888 23750 catalog_manager.cc:5697] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:52.513461 24044 tablet_bootstrap.cc:492] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:52.514045 24044 ts_tablet_manager.cc:1403] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:19:52.513206 24046 ts_tablet_manager.cc:1434] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:19:52.516758 24046 tablet_bootstrap.cc:492] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:52.516691 24044 raft_consensus.cc:359] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.517398 24044 raft_consensus.cc:385] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.517674 24044 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.518429 24044 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.520529 24044 ts_tablet_manager.cc:1434] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:52.521323 24044 tablet_bootstrap.cc:492] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:52.522547 24045 tablet_bootstrap.cc:492] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:52.522953 24045 ts_tablet_manager.cc:1403] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.010s
I20260709 12:19:52.525092 24045 raft_consensus.cc:359] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.525590 24045 raft_consensus.cc:385] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.525846 24045 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.526472 24045 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.527510 24046 tablet_bootstrap.cc:654] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.528532 24045 ts_tablet_manager.cc:1434] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:52.529400 24045 tablet_bootstrap.cc:492] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:52.535161 24045 tablet_bootstrap.cc:654] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.543239 24046 tablet_bootstrap.cc:492] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:52.543771 24046 ts_tablet_manager.cc:1403] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.008s
I20260709 12:19:52.545694 24044 tablet_bootstrap.cc:654] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.546774 24046 raft_consensus.cc:359] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.547552 24046 raft_consensus.cc:385] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.547832 24046 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.548902 24045 tablet_bootstrap.cc:492] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:52.548497 24046 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.550755 24046 ts_tablet_manager.cc:1434] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:52.551189 24045 ts_tablet_manager.cc:1403] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.001s
I20260709 12:19:52.552588 24046 tablet_bootstrap.cc:492] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:52.553912 24045 raft_consensus.cc:359] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.554622 24045 raft_consensus.cc:385] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.554913 24045 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.555732 24045 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.559414 24046 tablet_bootstrap.cc:654] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.562281 24045 ts_tablet_manager.cc:1434] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:19:52.562719 24044 tablet_bootstrap.cc:492] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:52.563185 24044 ts_tablet_manager.cc:1403] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.007s
I20260709 12:19:52.563289 24045 tablet_bootstrap.cc:492] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:52.565747 24004 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.566337 24044 raft_consensus.cc:359] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.567075 24044 raft_consensus.cc:385] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.567337 24044 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.568002 24044 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.573717 24044 ts_tablet_manager.cc:1434] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:19:52.574733 24044 tablet_bootstrap.cc:492] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:52.586670 24071 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.590637 24045 tablet_bootstrap.cc:654] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.595800 24046 tablet_bootstrap.cc:492] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:52.596398 24046 ts_tablet_manager.cc:1403] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.002s
I20260709 12:19:52.600415 24046 raft_consensus.cc:359] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.601478 24046 raft_consensus.cc:385] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.601907 24046 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.602829 24046 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.605283 24046 ts_tablet_manager.cc:1434] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:52.606561 24046 tablet_bootstrap.cc:492] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:52.607246 24044 tablet_bootstrap.cc:654] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.610102 24045 tablet_bootstrap.cc:492] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:52.610571 24045 ts_tablet_manager.cc:1403] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.006s
I20260709 12:19:52.612469 24046 tablet_bootstrap.cc:654] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.617791 24051 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.618252 24051 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.618729 24157 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.619177 24157 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.620046 24051 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:52.621388 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.617092 24045 raft_consensus.cc:359] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.622843 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.623148 24045 raft_consensus.cc:385] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.623456 24045 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
W20260709 12:19:52.624269 23892 leader_election.cc:343] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.624356 24045 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.626555 24045 ts_tablet_manager.cc:1434] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:19:52.634835 24157 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.635632 24045 tablet_bootstrap.cc:492] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:52.636356 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:52.636992 24002 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:52.625898 24152 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:19:52.639501 23893 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:52.642261 24051 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.632179 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:52.642712 24051 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.643918 24157 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.644408 24157 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.644515 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:52.644877 24157 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.645589 24217 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.659938 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:52.661633 24051 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:52.662318 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.663971 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:52.665688 24217 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.680406 24156 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.681154 24156 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.683187 24045 tablet_bootstrap.cc:654] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.687510 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:52.689478 23893 leader_election.cc:343] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.682476 24044 tablet_bootstrap.cc:492] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:52.684064 24157 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.691637 24044 ts_tablet_manager.cc:1403] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.117s	user 0.024s	sys 0.027s
I20260709 12:19:52.693185 24157 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.696044 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:19:52.697971 23892 leader_election.cc:343] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.694438 24044 raft_consensus.cc:359] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.698690 24044 raft_consensus.cc:385] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.699061 24044 raft_consensus.cc:740] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.700199 24046 tablet_bootstrap.cc:492] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:52.700675 24046 ts_tablet_manager.cc:1403] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.094s	user 0.028s	sys 0.026s
I20260709 12:19:52.702348 24044 consensus_queue.cc:260] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.705330 24044 ts_tablet_manager.cc:1434] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:19:52.685214 24156 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.703429 24046 raft_consensus.cc:359] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.690673 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.707466 24046 raft_consensus.cc:385] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.707787 24046 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.707896 23853 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:52.708454 24046 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.712453 24044 tablet_bootstrap.cc:492] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:52.715754 24004 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.717134 24046 ts_tablet_manager.cc:1434] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:19:52.718315 24046 tablet_bootstrap.cc:492] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:52.713573 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:52.721735 24002 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.721947 24044 tablet_bootstrap.cc:654] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.728231 24046 tablet_bootstrap.cc:654] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.728974 24003 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.734094 24044 tablet_bootstrap.cc:492] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:52.735244 24044 ts_tablet_manager.cc:1403] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 12:19:52.714442 23892 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:52.715349 24156 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.738817 24044 raft_consensus.cc:359] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.738608 24156 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.739540 24044 raft_consensus.cc:385] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.740024 24044 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.740397 24045 tablet_bootstrap.cc:492] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:52.740899 24045 ts_tablet_manager.cc:1403] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.105s	user 0.024s	sys 0.010s
I20260709 12:19:52.741520 24156 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.742748 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:52.744328 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.744972 23853 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
W20260709 12:19:52.746119 23893 leader_election.cc:343] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.740798 24044 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.748425 24044 ts_tablet_manager.cc:1434] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:19:52.748894 23892 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:52.749048 24156 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.749310 24044 tablet_bootstrap.cc:492] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:52.749146 24045 raft_consensus.cc:359] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.749450 24156 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.749652 24157 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.752287 24157 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.752729 24157 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.754396 24051 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.754844 24051 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.750768 24156 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.757076 24051 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:52.758569 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:52.760497 23966 leader_election.cc:343] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.760715 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:52.761337 23929 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:52.763859 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:52.764736 24051 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.765079 24051 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.765388 24051 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.750204 24045 raft_consensus.cc:385] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.768895 24045 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.771411 24157 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.781713 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:52.782423 23853 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.782783 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:52.783149 24051 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:52.784355 23893 leader_election.cc:343] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.785218 24157 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.786346 24045 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.788942 24044 tablet_bootstrap.cc:654] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.793556 24002 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:52.794365 23853 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:52.795369 24111 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.795634 24045 ts_tablet_manager.cc:1434] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 12:19:52.803635 24111 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.805160 23893 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:52.807508 24157 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.807961 24157 raft_consensus.cc:697] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:52.804283 24045 tablet_bootstrap.cc:492] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:52.796039 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:52.796931 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:52.808297 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:52.810231 23926 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:52.809734 24157 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.809759 23929 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.805968 24111 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.795971 24051 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:52.814679 23892 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:52.816542 24055 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.819666 23929 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:52.820793 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:52.823726 24051 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:19:52.823804 23966 leader_election.cc:343] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.824235 24051 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:52.825016 24051 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.812968 24156 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.839568 24087 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.839941 24156 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.840332 24087 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.842178 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:52.853117 24044 tablet_bootstrap.cc:492] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:52.852964 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:52.853751 24044 ts_tablet_manager.cc:1403] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.001s
I20260709 12:19:52.853932 23853 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.831388 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:52.856572 24044 raft_consensus.cc:359] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.857607 24044 raft_consensus.cc:385] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.857960 24044 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.858647 24044 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:52.859865 23893 leader_election.cc:343] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.860729 24044 ts_tablet_manager.cc:1434] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:19:52.861667 24044 tablet_bootstrap.cc:492] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:52.871848 24087 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:52.872747 23818 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:52.874272 24045 tablet_bootstrap.cc:654] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.875483 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:52.877317 23966 leader_election.cc:343] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.880275 24051 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:52.879010 24152 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.878566 24055 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:52.885097 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.899812 24044 tablet_bootstrap.cc:654] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.903149 24152 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.907086 23752 catalog_manager.cc:5697] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:52.910588 23966 leader_election.cc:343] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.910992 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:52.913328 24087 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.914002 23853 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:52.916071 24217 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:19:52.918085 23892 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:52.920856 24051 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:52.921765 24291 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.922477 24291 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:52.948308 24152 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.948958 24152 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.949836 24291 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.952853 24046 tablet_bootstrap.cc:492] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:52.953868 24046 ts_tablet_manager.cc:1403] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.236s	user 0.054s	sys 0.051s
I20260709 12:19:52.960119 24129 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.960861 24286 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.960968 24129 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.961357 24286 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.961966 24087 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.963992 24286 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:52.964310 24087 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.965121 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:52.965926 24152 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:19:52.966480 23817 leader_election.cc:343] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.966812 24087 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:52.964004 24129 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:52.973328 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.973637 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:52.960992 24055 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.977619 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:52.979096 23892 leader_election.cc:343] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.982167 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:52.982971 24045 tablet_bootstrap.cc:492] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:52.983469 24045 ts_tablet_manager.cc:1403] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.179s	user 0.019s	sys 0.035s
W20260709 12:19:52.983990 23818 leader_election.cc:343] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:52.985075 23966 leader_election.cc:343] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:52.986456 23966 leader_election.cc:343] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.988575 24046 raft_consensus.cc:359] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:52.990549 24046 raft_consensus.cc:385] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.991359 24046 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.993803 24046 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.009773 24045 raft_consensus.cc:359] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.010565 24045 raft_consensus.cc:385] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.010814 24045 raft_consensus.cc:740] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.011406 24045 consensus_queue.cc:260] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.023255 24046 ts_tablet_manager.cc:1434] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.069s	user 0.002s	sys 0.007s
I20260709 12:19:52.985562 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:53.022701 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:53.032931 23928 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:53.036379 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:53.051882 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:53.038715 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:53.104738 24293 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:19:53.063627 24071 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.069278 24217 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.118229 24045 ts_tablet_manager.cc:1434] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.134s	user 0.009s	sys 0.000s
I20260709 12:19:53.125744 24046 tablet_bootstrap.cc:492] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:53.125840 24045 tablet_bootstrap.cc:492] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:53.128856 24044 tablet_bootstrap.cc:492] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:53.129340 24044 ts_tablet_manager.cc:1403] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.268s	user 0.014s	sys 0.022s
I20260709 12:19:53.116647 24217 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.116266 23925 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:53.134665 24217 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.159258 23966 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:19:53.148087 23893 leader_election.cc:343] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.163699 24087 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.171137 24087 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.172058 24087 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.166123 23893 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:53.177356 24156 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.189131 24044 raft_consensus.cc:359] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.189914 24044 raft_consensus.cc:385] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.190171 24044 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.190810 24044 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.196421 24044 ts_tablet_manager.cc:1434] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 12:19:53.197404 24044 tablet_bootstrap.cc:492] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:53.205623 24045 tablet_bootstrap.cc:654] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:53.208787 24298 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:19:53.208814 24156 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.209570 24156 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.214260 24156 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:53.207456 24087 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.219408 24087 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:53.220418 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:53.221091 23923 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:53.226354 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 242388us
I20260709 12:19:53.229256 24224 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.236508 24087 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:19:53.239091 24296 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
I20260709 12:19:53.251892 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:53.258015 24293 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.112s	user 0.001s	sys 0.003s
W20260709 12:19:53.269703 23893 leader_election.cc:343] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.238076 24224 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.279433 24044 tablet_bootstrap.cc:654] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.281487 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:53.301573 24224 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:19:53.307765 23966 leader_election.cc:343] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.310823 24299 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.311343 24299 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.317654 24046 tablet_bootstrap.cc:654] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.322944 23923 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:53.323411 23749 catalog_manager.cc:5697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.327215 24157 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.332130 24299 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:53.334510 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:53.334326 24217 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.341709 24044 tablet_bootstrap.cc:492] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:53.343773 24045 tablet_bootstrap.cc:492] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:53.345043 24044 ts_tablet_manager.cc:1403] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.015s
I20260709 12:19:53.345579 24045 ts_tablet_manager.cc:1403] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.220s	user 0.034s	sys 0.012s
W20260709 12:19:53.342403 23800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:53.348944 24217 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:19:53.353005 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44580.5us
I20260709 12:19:53.361389 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:53.373234 23892 leader_election.cc:343] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.373848 23892 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:53.379297 24286 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.387789 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:53.387282 23892 consensus_peers.cc:597] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.376495 23749 catalog_manager.cc:5697] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.397974 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:19:53.398313 23817 leader_election.cc:343] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.402096 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:53.402279 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:53.403013 23927 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.417848 23966 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:53.419432 24051 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.419903 24051 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:19:53.420342 23818 leader_election.cc:343] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.420905 23818 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:53.420645 24051 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:53.427580 23817 leader_election.cc:343] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.429032 24305 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:53.429535 23966 leader_election.cc:343] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.432024 24045 raft_consensus.cc:359] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.417248 24044 raft_consensus.cc:359] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.439549 23927 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:53.454241 24051 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
I20260709 12:19:53.468961 24291 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:19:53.506414 24051 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.508478 24051 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.510664 24051 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:19:53.486022 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 54800.3us
W20260709 12:19:53.514533 23966 consensus_peers.cc:597] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.490764 24045 raft_consensus.cc:385] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.502265 24046 tablet_bootstrap.cc:492] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:53.516455 24046 ts_tablet_manager.cc:1403] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.402s	user 0.047s	sys 0.037s
I20260709 12:19:53.441706 23752 catalog_manager.cc:5697] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.492362 24055 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:19:53.491047 24044 raft_consensus.cc:385] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.518841 24044 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
W20260709 12:19:53.502605 24301 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.056s	user 0.005s	sys 0.005s
I20260709 12:19:53.522034 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:53.519901 24044 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.522903 24051 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.523912 24051 raft_consensus.cc:697] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:19:53.501539 24313 log.cc:927] Time spent T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.050s	user 0.012s	sys 0.027s
I20260709 12:19:53.526118 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:53.526058 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:53.528007 24046 raft_consensus.cc:359] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.540099 24046 raft_consensus.cc:385] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.540548 24046 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.540143 24051 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.541639 24046 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.544960 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:53.545495 24046 ts_tablet_manager.cc:1434] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 12:19:53.545423 23927 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:53.515928 24045 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
W20260709 12:19:53.550871 23893 consensus_peers.cc:597] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.556685 24044 ts_tablet_manager.cc:1434] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.211s	user 0.006s	sys 0.001s
I20260709 12:19:53.552289 24045 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.555424 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:53.552551 24046 tablet_bootstrap.cc:492] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:53.562234 24044 tablet_bootstrap.cc:492] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
W20260709 12:19:53.563648 23966 leader_election.cc:343] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.565069 24315 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.565678 24315 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.565986 24045 ts_tablet_manager.cc:1434] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.220s	user 0.008s	sys 0.000s
I20260709 12:19:53.566053 24315 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.567296 24045 tablet_bootstrap.cc:492] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c: Bootstrap starting.
W20260709 12:19:53.560286 23818 leader_election.cc:343] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.569996 23818 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:53.574638 24300 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:53.585721 23893 consensus_peers.cc:597] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.596331 24046 tablet_bootstrap.cc:654] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.588811 24315 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.600984 23750 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.604163 24045 tablet_bootstrap.cc:654] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.603679 23750 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.605818 24044 tablet_bootstrap.cc:654] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.608664 24315 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:53.610826 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:19:53.612212 23966 leader_election.cc:343] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.613812 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:53.614650 23927 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.627481 23927 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:53.628466 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:53.629544 24315 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.630148 24315 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:53.631111 24315 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.638350 24046 tablet_bootstrap.cc:492] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:53.638350 24045 tablet_bootstrap.cc:492] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:53.638908 24046 ts_tablet_manager.cc:1403] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.003s
I20260709 12:19:53.638908 24045 ts_tablet_manager.cc:1403] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.004s
I20260709 12:19:53.641587 24046 raft_consensus.cc:359] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.641736 24045 raft_consensus.cc:359] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.642324 24046 raft_consensus.cc:385] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.642383 24045 raft_consensus.cc:385] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.642959 24045 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.643185 24046 raft_consensus.cc:740] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.643646 24045 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.643899 24046 consensus_queue.cc:260] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.646253 24044 tablet_bootstrap.cc:492] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:53.646685 24044 ts_tablet_manager.cc:1403] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.008s
I20260709 12:19:53.647768 24046 ts_tablet_manager.cc:1434] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:19:53.649219 24044 raft_consensus.cc:359] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.650065 24044 raft_consensus.cc:385] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.650338 24044 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.651060 24046 tablet_bootstrap.cc:492] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:53.657593 24046 tablet_bootstrap.cc:654] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.662356 24046 tablet_bootstrap.cc:492] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:53.651078 24044 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.662787 24046 ts_tablet_manager.cc:1403] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:19:53.664189 24044 ts_tablet_manager.cc:1434] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260709 12:19:53.665084 24044 tablet_bootstrap.cc:492] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:53.665771 24046 raft_consensus.cc:359] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.666483 24046 raft_consensus.cc:385] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.666733 24046 raft_consensus.cc:740] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.667379 24046 consensus_queue.cc:260] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.669031 24046 ts_tablet_manager.cc:1434] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:53.668277 23749 catalog_manager.cc:5697] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.669938 24046 tablet_bootstrap.cc:492] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:53.675369 24045 ts_tablet_manager.cc:1434] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 12:19:53.675873 24046 tablet_bootstrap.cc:654] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.680306 24045 tablet_bootstrap.cc:492] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:53.684588 24157 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.685148 24157 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.687247 24157 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:53.691028 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:53.691850 23854 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:53.692509 24044 tablet_bootstrap.cc:654] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.693252 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:53.693917 24003 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:53.695962 23893 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:53.700838 24157 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.701267 24157 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.701625 24157 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.704845 24302 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.705379 24302 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.718287 24302 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:53.718956 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:53.719374 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:53.719846 23927 raft_consensus.cc:2393] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:53.721230 24045 tablet_bootstrap.cc:654] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.713543 24157 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.723479 23817 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:53.724697 24302 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.725590 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:53.726183 23854 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.730530 24046 tablet_bootstrap.cc:492] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:53.731258 24046 ts_tablet_manager.cc:1403] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.062s	user 0.022s	sys 0.009s
I20260709 12:19:53.732311 23854 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:53.732429 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:53.733014 24003 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.733908 24046 raft_consensus.cc:359] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.734550 24046 raft_consensus.cc:385] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.734568 24157 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:53.734934 24046 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.738402 24046 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.740294 24003 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:53.736320 23892 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:53.742667 24157 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.743664 24157 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:53.740712 24046 ts_tablet_manager.cc:1434] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:53.745645 24046 tablet_bootstrap.cc:492] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:53.744541 24157 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.750695 24046 tablet_bootstrap.cc:654] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.735791 24302 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.737645 24044 tablet_bootstrap.cc:492] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:53.752662 24044 ts_tablet_manager.cc:1403] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.001s
I20260709 12:19:53.755425 24045 tablet_bootstrap.cc:492] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:53.755908 24045 ts_tablet_manager.cc:1403] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.002s
I20260709 12:19:53.755791 24044 raft_consensus.cc:359] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.756670 24044 raft_consensus.cc:385] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.756997 24044 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.757712 24044 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.760391 24044 ts_tablet_manager.cc:1434] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:53.761611 24044 tablet_bootstrap.cc:492] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:53.758559 24045 raft_consensus.cc:359] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.763470 24045 raft_consensus.cc:385] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.763751 24045 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.764432 24045 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.767629 24045 ts_tablet_manager.cc:1434] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:19:53.769186 24045 tablet_bootstrap.cc:492] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:53.786193 24044 tablet_bootstrap.cc:654] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.792006 23749 catalog_manager.cc:5697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.797794 24046 tablet_bootstrap.cc:492] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:53.798384 24046 ts_tablet_manager.cc:1403] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.003s
I20260709 12:19:53.805235 24045 tablet_bootstrap.cc:654] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.807730 24046 raft_consensus.cc:359] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.809576 24046 raft_consensus.cc:385] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.809942 24046 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.812157 24046 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.814939 24046 ts_tablet_manager.cc:1434] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:19:53.816280 24044 tablet_bootstrap.cc:492] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:53.816494 24046 tablet_bootstrap.cc:492] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:53.816735 24044 ts_tablet_manager.cc:1403] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.008s
I20260709 12:19:53.818466 24315 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.824138 24046 tablet_bootstrap.cc:654] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.844245 24044 raft_consensus.cc:359] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.847716 24044 raft_consensus.cc:385] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.848021 24044 raft_consensus.cc:740] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.848627 24044 consensus_queue.cc:260] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.858131 24045 tablet_bootstrap.cc:492] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:53.858633 24045 ts_tablet_manager.cc:1403] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.011s
I20260709 12:19:53.865515 24315 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.871253 24157 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.871945 24157 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.875223 24044 ts_tablet_manager.cc:1434] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.001s
I20260709 12:19:53.876235 24044 tablet_bootstrap.cc:492] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:53.878618 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:53.879518 24157 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:19:53.880035 23892 leader_election.cc:343] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.861341 24045 raft_consensus.cc:359] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.881623 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:53.884981 24000 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:53.898730 23893 leader_election.cc:343] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.899396 23893 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:53.900096 24055 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.902911 24046 tablet_bootstrap.cc:492] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:53.903396 24046 ts_tablet_manager.cc:1403] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.087s	user 0.044s	sys 0.037s
I20260709 12:19:53.904238 24045 raft_consensus.cc:385] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.906118 24046 raft_consensus.cc:359] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.909672 24046 raft_consensus.cc:385] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.909991 24046 raft_consensus.cc:740] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.913085 24044 tablet_bootstrap.cc:654] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.913404 24046 consensus_queue.cc:260] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.914390 24045 raft_consensus.cc:740] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.914999 24045 consensus_queue.cc:260] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.917976 24157 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.919552 24157 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.921634 24157 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:53.922964 24045 ts_tablet_manager.cc:1434] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:19:53.923460 24046 ts_tablet_manager.cc:1434] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:19:53.924386 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:53.925042 23852 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:53.925525 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:53.926855 24003 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:53.927143 23892 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:53.930138 24045 tablet_bootstrap.cc:492] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:53.932297 24046 tablet_bootstrap.cc:492] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:53.932991 24055 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.933424 24055 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.934372 24055 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.965749 24286 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.966341 24286 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.968643 24286 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:53.970824 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:53.972059 23849 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:53.973619 23892 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:53.976475 23854 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.975008 24286 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.977352 24286 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.978534 24286 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.984277 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:53.986564 24044 tablet_bootstrap.cc:492] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:53.987711 24044 ts_tablet_manager.cc:1403] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.029s
I20260709 12:19:53.987617 24003 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:53.992228 24302 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.992961 24302 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.995222 24286 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.988149 24055 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.997220 24044 raft_consensus.cc:359] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.997704 24046 tablet_bootstrap.cc:654] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.997924 24044 raft_consensus.cc:385] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.998250 24044 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.998891 24044 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:53.997742 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:54.000828 24044 ts_tablet_manager.cc:1434] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.007s
I20260709 12:19:54.001081 23927 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:54.001750 24044 tablet_bootstrap.cc:492] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:53.999811 24302 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:54.003899 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:54.005491 23818 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:54.006867 24302 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.007658 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:54.008252 23849 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.008435 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:54.009148 24003 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.010263 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:54.010834 23999 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.012094 24286 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:54.012002 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:54.015381 23850 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.030992 24156 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.031574 24156 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.033735 24156 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:54.012035 24055 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:54.035228 24045 tablet_bootstrap.cc:654] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.038239 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:54.049208 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:54.050716 23892 leader_election.cc:343] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:54.053778 23893 leader_election.cc:343] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.054417 23893 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:54.068203 24286 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:54.084672 23850 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:54.091327 23849 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:54.093726 23999 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:54.089517 24003 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:54.097988 24302 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:54.095614 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:54.091344 23892 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:54.102310 24055 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:54.102941 24055 raft_consensus.cc:697] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:54.103662 24217 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:54.103866 24055 consensus_queue.cc:237] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.107649 24156 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:54.108188 24156 raft_consensus.cc:697] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:54.109084 24156 consensus_queue.cc:237] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.118638 24046 tablet_bootstrap.cc:492] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:54.119177 24046 ts_tablet_manager.cc:1403] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.187s	user 0.031s	sys 0.019s
I20260709 12:19:54.123895 24045 tablet_bootstrap.cc:492] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:54.124461 24045 ts_tablet_manager.cc:1403] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.195s	user 0.007s	sys 0.047s
I20260709 12:19:54.127821 24046 raft_consensus.cc:359] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.133059 24046 raft_consensus.cc:385] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.133303 24046 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.136344 24046 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.138722 24044 tablet_bootstrap.cc:654] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.143142 24315 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.147001 24315 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.148106 24046 ts_tablet_manager.cc:1434] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:19:54.158190 24046 tablet_bootstrap.cc:492] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:54.168570 23999 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.170605 24315 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:54.161929 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:54.181021 24051 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:54.189831 24045 raft_consensus.cc:359] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.190589 24045 raft_consensus.cc:385] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.190850 24045 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.191484 24045 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:54.192687 23966 consensus_peers.cc:597] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.193496 24045 ts_tablet_manager.cc:1434] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.001s
I20260709 12:19:54.193459 24217 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:54.194857 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:54.181366 23850 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:54.199661 24045 tablet_bootstrap.cc:492] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Bootstrap starting.
W20260709 12:19:54.199725 23966 leader_election.cc:343] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.204331 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:54.211210 24315 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:54.211449 23849 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.211766 24315 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.212433 24315 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.222733 24046 tablet_bootstrap.cc:654] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:54.255801 24342 log.cc:927] Time spent T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:19:54.260416 24341 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:54.271051 23750 catalog_manager.cc:5697] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.277580 23750 catalog_manager.cc:5697] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.285326 24044 tablet_bootstrap.cc:492] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:54.285831 24044 ts_tablet_manager.cc:1403] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.284s	user 0.024s	sys 0.036s
I20260709 12:19:54.295782 24341 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.300144 24341 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.325387 24156 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.325999 24156 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.358421 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:54.360198 24044 raft_consensus.cc:359] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.360904 24044 raft_consensus.cc:385] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.361200 24044 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.367276 24046 tablet_bootstrap.cc:492] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:54.368606 24046 ts_tablet_manager.cc:1403] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.211s	user 0.014s	sys 0.011s
I20260709 12:19:54.370136 24044 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.361857 24156 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:54.380472 24044 ts_tablet_manager.cc:1434] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.000s
W20260709 12:19:54.383777 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 45406.4us
I20260709 12:19:54.400220 24045 tablet_bootstrap.cc:654] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.404467 24315 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.405129 24044 tablet_bootstrap.cc:492] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
W20260709 12:19:54.423434 23892 leader_election.cc:343] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:54.434373 24345 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:19:54.426865 24157 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:19:54.429217 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:54.444008 23892 leader_election.cc:343] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.435346 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:54.436232 24341 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:54.455624 24046 raft_consensus.cc:359] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.456288 24046 raft_consensus.cc:385] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.456533 24046 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.457101 24046 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.458127 24315 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:19:54.462621 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 74351.1us
I20260709 12:19:54.464565 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:54.467504 23893 leader_election.cc:343] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.468391 23893 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:54.469693 24044 tablet_bootstrap.cc:654] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.472164 24045 tablet_bootstrap.cc:492] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:54.472602 24045 ts_tablet_manager.cc:1403] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.273s	user 0.012s	sys 0.009s
I20260709 12:19:54.472985 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:54.474243 23849 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.475879 24046 ts_tablet_manager.cc:1434] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.000s
I20260709 12:19:54.477140 24046 tablet_bootstrap.cc:492] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:54.471346 24055 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:54.532827 24046 tablet_bootstrap.cc:654] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.553989 24045 raft_consensus.cc:359] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.554754 24045 raft_consensus.cc:385] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.555018 24045 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.556524 24045 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.557122 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:54.559521 24355 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.560004 24355 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.560899 23849 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:54.562805 24355 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:54.566769 24045 ts_tablet_manager.cc:1434] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.008s
I20260709 12:19:54.571733 24045 tablet_bootstrap.cc:492] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c: Bootstrap starting.
W20260709 12:19:54.538750 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 69230.3us
I20260709 12:19:54.588001 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:54.591912 24352 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:54.592434 24352 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:54.593276 24352 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:54.586771 23893 leader_election.cc:343] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.604390 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:54.608063 23966 leader_election.cc:343] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.609854 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:54.610833 24157 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.614089 24046 tablet_bootstrap.cc:492] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:54.614593 24046 ts_tablet_manager.cc:1403] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.012s
I20260709 12:19:54.613685 24157 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.612157 24341 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:54.618055 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:54.619419 23892 leader_election.cc:343] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:54.619733 23966 leader_election.cc:343] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.617655 24157 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:54.600255 23893 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:54.618050 23928 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:54.621611 24341 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:54.628085 23966 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:54.634747 24355 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:54.635147 24355 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.635496 24355 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.647182 24046 raft_consensus.cc:359] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.651036 24046 raft_consensus.cc:385] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.651460 24046 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.656468 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:54.661325 24360 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:54.652245 24046 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.672009 23750 catalog_manager.cc:5697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:54.673967 24046 ts_tablet_manager.cc:1434] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.002s
I20260709 12:19:54.677384 24044 tablet_bootstrap.cc:492] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:54.677870 24044 ts_tablet_manager.cc:1403] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.273s	user 0.014s	sys 0.020s
I20260709 12:19:54.681242 24046 tablet_bootstrap.cc:492] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:54.684082 24044 raft_consensus.cc:359] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.684790 24044 raft_consensus.cc:385] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.685074 24044 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.685712 24044 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.679517 24351 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:19:54.698357 24045 tablet_bootstrap.cc:654] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:54.718591 23800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:54.720427 24354 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.721078 24354 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.724457 24354 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:54.725466 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:54.727469 23818 leader_election.cc:343] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.741699 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:54.742436 23927 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:54.749890 23817 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:54.751397 24071 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:54.751809 24071 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.752171 24071 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.755594 24157 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:54.759814 24071 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.761696 24044 ts_tablet_manager.cc:1434] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.003s
I20260709 12:19:54.762919 24071 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:54.762764 24044 tablet_bootstrap.cc:492] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:54.764074 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:54.764576 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:54.765152 23927 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:54.765517 23818 leader_election.cc:343] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.769090 24355 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.772025 23927 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:54.773352 23817 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:54.774369 24071 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:54.774837 24071 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:54.775633 24071 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.791044 24002 raft_consensus.cc:2393] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:54.792461 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:19:54.793800 23966 leader_election.cc:343] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.793744 23893 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:54.796320 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:54.796954 23927 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.804342 23927 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:54.804919 24156 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:54.813989 24355 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:54.817281 23966 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:54.818689 24352 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:54.819207 24352 raft_consensus.cc:697] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:54.820078 24352 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.820361 23750 catalog_manager.cc:5697] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.782056 24046 tablet_bootstrap.cc:654] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.838009 24044 tablet_bootstrap.cc:654] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.847355 23751 catalog_manager.cc:5697] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:54.849623 24355 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.850338 24355 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.853669 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:54.853979 24355 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:54.855734 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:54.858115 23966 leader_election.cc:343] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:54.859026 23966 leader_election.cc:343] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.859508 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:54.862900 24045 tablet_bootstrap.cc:492] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:54.863390 24045 ts_tablet_manager.cc:1403] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.292s	user 0.012s	sys 0.004s
I20260709 12:19:54.863533 24355 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:54.866411 24045 raft_consensus.cc:359] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.867156 24045 raft_consensus.cc:385] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.867646 24045 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.868392 24045 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.870736 24045 ts_tablet_manager.cc:1434] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:54.871639 24045 tablet_bootstrap.cc:492] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:54.878134 24046 tablet_bootstrap.cc:492] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:54.878819 24046 ts_tablet_manager.cc:1403] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.198s	user 0.011s	sys 0.010s
I20260709 12:19:54.881829 24045 tablet_bootstrap.cc:654] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.882426 24046 raft_consensus.cc:359] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.883664 24046 raft_consensus.cc:385] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.884037 24046 raft_consensus.cc:740] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.884881 24046 consensus_queue.cc:260] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.888610 24044 tablet_bootstrap.cc:492] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:54.889057 24044 ts_tablet_manager.cc:1403] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.127s	user 0.026s	sys 0.028s
I20260709 12:19:54.891518 24044 raft_consensus.cc:359] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.892153 24044 raft_consensus.cc:385] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.892397 24044 raft_consensus.cc:740] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.893678 24045 tablet_bootstrap.cc:492] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:54.894146 24045 ts_tablet_manager.cc:1403] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.011s
I20260709 12:19:54.894272 24046 ts_tablet_manager.cc:1434] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:19:54.895227 24046 tablet_bootstrap.cc:492] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:54.897099 24045 raft_consensus.cc:359] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.897747 24045 raft_consensus.cc:385] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.898021 24045 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.898639 24045 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.901526 24044 consensus_queue.cc:260] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.903322 24044 ts_tablet_manager.cc:1434] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:19:54.905138 24046 tablet_bootstrap.cc:654] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.905153 24045 ts_tablet_manager.cc:1434] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:19:54.906344 24045 tablet_bootstrap.cc:492] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:54.912694 24044 tablet_bootstrap.cc:492] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:54.922019 24044 tablet_bootstrap.cc:654] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.929618 24045 tablet_bootstrap.cc:654] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.938387 24044 tablet_bootstrap.cc:492] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:54.939272 24044 ts_tablet_manager.cc:1403] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.000s
I20260709 12:19:54.943558 24045 tablet_bootstrap.cc:492] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:54.944058 24045 ts_tablet_manager.cc:1403] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.006s
I20260709 12:19:54.943920 24044 raft_consensus.cc:359] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.945272 24044 raft_consensus.cc:385] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.945716 24044 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.946786 24045 raft_consensus.cc:359] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.947499 24045 raft_consensus.cc:385] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.946990 24044 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.947782 24045 raft_consensus.cc:740] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.949335 24045 consensus_queue.cc:260] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.949951 24044 ts_tablet_manager.cc:1434] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:54.951228 24044 tablet_bootstrap.cc:492] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:54.959971 24044 tablet_bootstrap.cc:654] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.979329 24055 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.979911 24055 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:54.982419 24045 ts_tablet_manager.cc:1434] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.004s
I20260709 12:19:54.985301 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:54.986586 23892 leader_election.cc:343] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.991285 24055 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:54.992749 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:54.996518 24045 tablet_bootstrap.cc:492] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Bootstrap starting.
W20260709 12:19:54.997395 23893 leader_election.cc:343] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.997865 23893 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:54.999001 24055 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:54.995388 24044 tablet_bootstrap.cc:492] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:55.001051 24044 ts_tablet_manager.cc:1403] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.013s
I20260709 12:19:55.003234 24044 raft_consensus.cc:359] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.003769 24044 raft_consensus.cc:385] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.004012 24044 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.004711 24044 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.006784 24046 tablet_bootstrap.cc:492] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:55.007256 24046 ts_tablet_manager.cc:1403] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.112s	user 0.044s	sys 0.040s
I20260709 12:19:55.007969 24045 tablet_bootstrap.cc:654] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.009650 24046 raft_consensus.cc:359] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.010318 24046 raft_consensus.cc:385] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.010583 24046 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.011193 24046 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.013175 24046 ts_tablet_manager.cc:1434] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:55.014109 24046 tablet_bootstrap.cc:492] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:55.015388 24055 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.015882 24055 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.018152 24055 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.018759 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:55.019550 24044 ts_tablet_manager.cc:1434] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:19:55.019807 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:55.020260 23892 leader_election.cc:343] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.020447 24044 tablet_bootstrap.cc:492] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
W20260709 12:19:55.021059 23893 leader_election.cc:343] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.021487 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:55.015242 24045 tablet_bootstrap.cc:492] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:55.022373 24055 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.022837 24045 ts_tablet_manager.cc:1403] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 12:19:55.025072 24045 raft_consensus.cc:359] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.025604 24045 raft_consensus.cc:385] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.025882 24045 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.026471 24044 tablet_bootstrap.cc:654] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.026705 24045 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.031901 24046 tablet_bootstrap.cc:654] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.038897 24044 tablet_bootstrap.cc:492] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:55.039407 24044 ts_tablet_manager.cc:1403] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.006s
I20260709 12:19:55.041839 24044 raft_consensus.cc:359] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.042514 24044 raft_consensus.cc:385] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.042783 24044 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.042793 24045 ts_tablet_manager.cc:1434] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.002s
I20260709 12:19:55.043401 24044 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.044530 24045 tablet_bootstrap.cc:492] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:55.045531 24044 ts_tablet_manager.cc:1434] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
W20260709 12:19:55.046674 23966 consensus_peers.cc:597] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.046898 24044 tablet_bootstrap.cc:492] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:55.051486 24354 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.052372 24045 tablet_bootstrap.cc:654] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.052086 24354 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.052583 24044 tablet_bootstrap.cc:654] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.054304 24354 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.056142 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:55.057679 23818 leader_election.cc:343] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.058951 24046 tablet_bootstrap.cc:492] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:55.059477 24046 ts_tablet_manager.cc:1403] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 12:19:55.059670 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:55.060998 23817 leader_election.cc:343] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.061380 23817 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:55.061944 24046 raft_consensus.cc:359] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.062606 24046 raft_consensus.cc:385] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.062662 24071 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.062943 24046 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.063591 24046 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.072154 24046 ts_tablet_manager.cc:1434] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:19:55.073104 24046 tablet_bootstrap.cc:492] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:55.076611 24045 tablet_bootstrap.cc:492] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:55.077100 24045 ts_tablet_manager.cc:1403] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.001s
I20260709 12:19:55.079752 24045 raft_consensus.cc:359] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.080413 24045 raft_consensus.cc:385] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.080665 24045 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.080928 24044 tablet_bootstrap.cc:492] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:55.081482 24044 ts_tablet_manager.cc:1403] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.021s
I20260709 12:19:55.081264 24045 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.082887 24045 ts_tablet_manager.cc:1434] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:19:55.084408 24044 raft_consensus.cc:359] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.085134 24044 raft_consensus.cc:385] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.085399 24044 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.086099 24044 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.087044 24046 tablet_bootstrap.cc:654] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.088165 24044 ts_tablet_manager.cc:1434] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:19:55.089089 24044 tablet_bootstrap.cc:492] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:55.090163 24045 tablet_bootstrap.cc:492] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:55.095252 24044 tablet_bootstrap.cc:654] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.096766 24045 tablet_bootstrap.cc:654] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.102599 24046 tablet_bootstrap.cc:492] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:55.103221 24046 ts_tablet_manager.cc:1403] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 12:19:55.106745 24046 raft_consensus.cc:359] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.107662 24046 raft_consensus.cc:385] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.107981 24046 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.108757 24046 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.109442 23849 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.110993 24046 ts_tablet_manager.cc:1434] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:55.112201 24046 tablet_bootstrap.cc:492] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:55.129549 24046 tablet_bootstrap.cc:654] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.131345 24045 tablet_bootstrap.cc:492] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:55.131889 24045 ts_tablet_manager.cc:1403] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.011s
I20260709 12:19:55.132858 24044 tablet_bootstrap.cc:492] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:55.133287 24044 ts_tablet_manager.cc:1403] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.020s
I20260709 12:19:55.134456 24045 raft_consensus.cc:359] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.135139 24045 raft_consensus.cc:385] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.135383 24045 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.135991 24044 raft_consensus.cc:359] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.136701 24044 raft_consensus.cc:385] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.136979 24044 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.135993 24045 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.138701 24044 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.140542 24045 ts_tablet_manager.cc:1434] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:19:55.141431 24045 tablet_bootstrap.cc:492] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:55.143781 24044 ts_tablet_manager.cc:1434] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:19:55.144860 24044 tablet_bootstrap.cc:492] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:55.147161 24156 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.147670 24156 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.149613 24046 tablet_bootstrap.cc:492] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:55.149746 24156 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.150159 24046 ts_tablet_manager.cc:1403] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.008s
I20260709 12:19:55.150722 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:55.151391 23999 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:55.152534 23893 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:55.150827 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:55.153580 23854 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:55.152777 24046 raft_consensus.cc:359] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.153990 24046 raft_consensus.cc:385] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.154273 24046 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.154865 24046 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.155710 24156 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.156072 24156 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.156384 24156 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.156824 24044 tablet_bootstrap.cc:654] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.164642 24046 ts_tablet_manager.cc:1434] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:19:55.172367 24046 tablet_bootstrap.cc:492] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:55.173063 24045 tablet_bootstrap.cc:654] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.176091 24355 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:55.178293 24046 tablet_bootstrap.cc:654] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.177613 24156 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.180495 24156 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.182689 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:55.183288 23999 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.184640 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:55.185256 23850 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.190711 24071 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.191284 24071 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.193406 24071 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.195077 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:19:55.196890 23818 leader_election.cc:343] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.198661 23999 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:55.200683 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:55.201418 23927 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:55.204011 24044 tablet_bootstrap.cc:492] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:55.204473 24044 ts_tablet_manager.cc:1403] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.022s
I20260709 12:19:55.207397 24044 raft_consensus.cc:359] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.207671 23893 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:55.208132 24044 raft_consensus.cc:385] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.208416 24044 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.208544 24156 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:55.208985 24156 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:55.209110 24044 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.209709 24156 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.211345 24044 ts_tablet_manager.cc:1434] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:55.212245 24044 tablet_bootstrap.cc:492] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:55.214572 23817 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:55.214769 24305 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:55.215298 24356 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.215626 24354 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.216030 24354 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.215842 24356 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.217907 24157 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.218362 24157 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.218636 24356 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.216423 24354 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.220326 24157 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.221973 24044 tablet_bootstrap.cc:654] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.225328 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:55.226238 23852 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:55.228175 24356 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.228753 23892 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:55.228713 24356 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.229858 24286 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.230247 24286 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.230559 24286 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.233562 24354 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.234381 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:55.234985 24002 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:55.233582 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:55.237145 24286 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.241343 24315 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.241868 24315 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.242760 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:55.243037 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:55.243527 23923 raft_consensus.cc:2393] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:55.243887 24315 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:55.243543 23928 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.246048 24286 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.251070 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:55.253191 23928 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
W20260709 12:19:55.253314 23966 leader_election.cc:343] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.253859 24044 tablet_bootstrap.cc:492] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:55.255275 24044 ts_tablet_manager.cc:1403] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.005s
I20260709 12:19:55.256916 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:19:55.258919 23818 leader_election.cc:343] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.259143 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:55.259739 24003 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.259727 24354 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.258188 24044 raft_consensus.cc:359] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.264281 24044 raft_consensus.cc:385] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.264633 24044 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.266516 24044 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.268340 24044 ts_tablet_manager.cc:1434] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:19:55.270218 24044 tablet_bootstrap.cc:492] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:55.270483 23817 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:55.271790 24355 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.271958 24398 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.272362 24355 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.273514 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:55.274487 24355 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:55.277572 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:55.278975 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:55.279608 23852 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.282918 24044 tablet_bootstrap.cc:654] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:55.284032 23966 leader_election.cc:343] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.284456 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:55.285164 24156 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.271893 23817 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:55.288403 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:55.290935 23966 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:55.291442 24354 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:55.289835 24355 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.292229 24355 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.292929 24354 raft_consensus.cc:697] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:55.293773 24354 consensus_queue.cc:237] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.294792 24398 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.295765 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:55.296891 24356 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.285583 24156 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.299160 23999 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.301108 24156 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.302400 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:55.337836 23752 catalog_manager.cc:5697] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.329980 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:55.355259 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 83425.3us
I20260709 12:19:55.334730 23850 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:55.334370 24003 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:55.396130 23892 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:55.373504 23852 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:55.399580 24286 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.407718 24045 tablet_bootstrap.cc:492] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:55.408293 24045 ts_tablet_manager.cc:1403] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.267s	user 0.048s	sys 0.078s
I20260709 12:19:55.409333 24046 tablet_bootstrap.cc:492] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:55.409832 24046 ts_tablet_manager.cc:1403] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.238s	user 0.026s	sys 0.043s
I20260709 12:19:55.413058 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:55.431021 24044 tablet_bootstrap.cc:492] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:55.414007 23923 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 1: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:19:55.432704 24044 ts_tablet_manager.cc:1403] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.163s	user 0.013s	sys 0.007s
I20260709 12:19:55.441738 24046 raft_consensus.cc:359] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.443159 24046 raft_consensus.cc:385] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.443869 24046 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.444818 24046 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.446713 24046 ts_tablet_manager.cc:1434] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.005s
I20260709 12:19:55.449059 24046 tablet_bootstrap.cc:492] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:55.454903 23893 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:55.457294 24055 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:55.457821 24055 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:55.458701 24055 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.469170 23817 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:55.490548 24157 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.491271 24157 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.505841 24405 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.475319 24352 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.532239 24352 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.528793 24286 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.568758 24286 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.510669 24408 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.570837 24355 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.572827 24355 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.574522 24046 tablet_bootstrap.cc:654] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.531188 24406 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.580788 24157 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.581982 24045 raft_consensus.cc:359] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.601222 24045 raft_consensus.cc:385] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.601593 24045 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.602537 24045 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.610808 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:55.614832 24045 ts_tablet_manager.cc:1434] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.206s	user 0.024s	sys 0.012s
I20260709 12:19:55.582060 24355 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:55.617201 24044 raft_consensus.cc:359] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.618741 24044 raft_consensus.cc:385] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.619134 24044 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.575585 24406 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.565719 24352 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:55.619954 24044 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:55.601504 24033 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.22.43.126:38021, user_credentials={real_user=slave}} blocked reactor thread for 89163.1us
I20260709 12:19:55.577989 24408 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.612138 23926 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:55.633859 24044 ts_tablet_manager.cc:1434] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.198s	user 0.005s	sys 0.003s
I20260709 12:19:55.635937 24044 tablet_bootstrap.cc:492] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:55.630239 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:55.630244 24411 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.642899 24286 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:55.632488 24354 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:19:55.652987 24408 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:55.650691 24411 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.658957 24406 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:55.653736 23925 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:55.664687 23966 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:55.683984 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:55.684787 23849 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:55.686017 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:55.709867 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:55.687209 24408 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.716574 24408 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.717105 24408 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.720890 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:55.727399 24411 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:19:55.727979 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 258955us
I20260709 12:19:55.740464 24408 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.744841 24045 tablet_bootstrap.cc:492] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:55.807509 24046 tablet_bootstrap.cc:492] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:55.814332 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:55.818439 24046 ts_tablet_manager.cc:1403] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.370s	user 0.018s	sys 0.000s
W20260709 12:19:55.818801 23892 leader_election.cc:343] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.841542 24046 raft_consensus.cc:359] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.825700 24420 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.844094 24420 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.844596 24420 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.845253 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:55.845949 24003 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:55.847368 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:55.849490 24046 raft_consensus.cc:385] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.849988 24046 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.850412 24044 tablet_bootstrap.cc:654] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.851572 24046 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.855490 24046 ts_tablet_manager.cc:1434] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 12:19:55.856393 24046 tablet_bootstrap.cc:492] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:55.862016 24055 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.870172 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:55.857484 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:55.862643 24055 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.881752 23929 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
W20260709 12:19:55.886740 23966 leader_election.cc:343] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.887518 24055 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:19:55.888051 23966 leader_election.cc:343] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.888162 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:55.889714 24055 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:55.895120 23893 leader_election.cc:343] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.895717 23893 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:55.896973 24157 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:55.911586 23892 leader_election.cc:343] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.916440 24416 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:19:55.906380 24408 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:55.932890 24420 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:55.940600 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 47332.2us
I20260709 12:19:55.929606 24405 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.938545 23922 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 1: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:19:55.948635 24355 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.949152 24355 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:55.951237 24355 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:55.951140 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:55.951858 23849 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:55.952404 23966 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:55.954955 24045 tablet_bootstrap.cc:654] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.955822 24407 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.956215 24407 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.956542 24407 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.946815 24405 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:55.986835 23800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:55.987636 24395 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:19:55.992174 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:19:55.998029 23818 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.998541 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:56.008224 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:56.010277 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:56.010749 24408 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:56.011332 24408 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.011811 24408 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.014820 24315 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:56.015448 24315 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.016072 24315 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.021404 24426 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:19:56.039544 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:56.040629 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:56.049057 23750 catalog_manager.cc:5697] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.033490 24420 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:56.058959 24405 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:56.060391 24157 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.063362 24157 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.080026 24046 tablet_bootstrap.cc:654] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.084998 24044 tablet_bootstrap.cc:492] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:56.085487 24044 ts_tablet_manager.cc:1403] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.450s	user 0.029s	sys 0.031s
I20260709 12:19:56.089087 24045 tablet_bootstrap.cc:492] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:56.089524 24045 ts_tablet_manager.cc:1403] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.345s	user 0.008s	sys 0.021s
I20260709 12:19:56.090197 24157 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:56.094123 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:56.094851 24000 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:56.095233 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:56.095852 23926 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:56.095873 23818 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:56.097271 24405 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:56.097627 24405 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.098007 24405 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.102411 23929 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.104166 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:56.105188 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:56.105804 24001 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 0.
I20260709 12:19:56.107177 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:56.107796 23851 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.108080 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:56.109781 24421 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:56.110479 23966 leader_election.cc:343] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:56.112404 23966 leader_election.cc:343] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:56.113435 23966 leader_election.cc:343] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.114324 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:56.119246 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:56.120973 24360 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:56.121351 24360 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.121688 24360 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.135572 24045 raft_consensus.cc:359] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.135664 24044 raft_consensus.cc:359] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.140651 24045 raft_consensus.cc:385] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.141369 24045 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.140683 24044 raft_consensus.cc:385] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.142141 24044 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.138867 24421 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:19:56.143716 24044 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.150581 24045 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.153600 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:56.154313 23928 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:56.117072 24407 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.161476 24407 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:56.164228 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:19:56.165915 23966 leader_election.cc:343] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.145848 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:56.171238 24044 ts_tablet_manager.cc:1434] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.085s	user 0.009s	sys 0.000s
I20260709 12:19:56.172777 24044 tablet_bootstrap.cc:492] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:56.174358 24045 ts_tablet_manager.cc:1434] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.003s
I20260709 12:19:56.175793 24045 tablet_bootstrap.cc:492] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:56.168875 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:56.177121 23922 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:56.191310 23892 leader_election.cc:343] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.191792 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:56.195672 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:56.196357 23921 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.200215 24408 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.201788 23999 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:56.204386 24315 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.184634 23923 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:56.190258 23851 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:56.233356 24044 tablet_bootstrap.cc:654] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.233067 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:56.234158 24355 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:56.234565 24355 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.234911 24355 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.237080 24046 tablet_bootstrap.cc:492] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:56.237573 24046 ts_tablet_manager.cc:1403] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.381s	user 0.015s	sys 0.033s
I20260709 12:19:56.212328 24352 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:56.238875 24004 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:56.236898 24360 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.229115 24408 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:56.252256 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:56.253178 24156 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.253618 24156 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:56.236790 24420 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:19:56.243124 24352 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.254271 24156 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.251711 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:56.281180 24315 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:56.264262 24352 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.263218 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:56.285014 23926 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.296303 24360 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:56.289973 23847 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.297241 24046 raft_consensus.cc:359] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.308137 24046 raft_consensus.cc:385] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.308558 24046 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.310675 24046 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.314298 24045 tablet_bootstrap.cc:654] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.297649 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:19:56.322892 23892 leader_election.cc:343] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.328223 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:56.332356 24000 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.350648 24046 ts_tablet_manager.cc:1434] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260709 12:19:56.352667 24046 tablet_bootstrap.cc:492] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
W20260709 12:19:56.360088 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 104994us
I20260709 12:19:56.362421 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:56.362457 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:56.363313 23854 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 1: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:19:56.355581 24355 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.370949 24044 tablet_bootstrap.cc:492] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:56.371428 24044 ts_tablet_manager.cc:1403] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.199s	user 0.021s	sys 0.015s
I20260709 12:19:56.374389 24355 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:56.418550 23926 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:56.420171 24352 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.422624 24352 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:56.361701 23921 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:56.429315 23847 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:56.375366 24405 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.443557 24044 raft_consensus.cc:359] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.444475 24044 raft_consensus.cc:385] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.444725 24046 tablet_bootstrap.cc:654] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.444876 24044 raft_consensus.cc:740] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.446918 24044 consensus_queue.cc:260] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.441767 24000 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:19:56.486025 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:56.487121 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:56.490952 23922 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:56.492635 23850 raft_consensus.cc:2393] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 1: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:19:56.492691 24446 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.065s	user 0.003s	sys 0.004s
I20260709 12:19:56.499809 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:56.506444 24421 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.507026 24421 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:19:56.508028 24421 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.506987 24405 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:56.530085 24044 ts_tablet_manager.cc:1434] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.158s	user 0.009s	sys 0.004s
I20260709 12:19:56.531239 24044 tablet_bootstrap.cc:492] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:56.537004 23751 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:19:56.527169 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:56.543779 23925 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.546656 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:56.541186 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:56.547372 23920 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.547638 24001 raft_consensus.cc:2393] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:56.552141 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:56.554168 23893 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:56.554443 23966 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:56.557300 24410 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.557991 24410 raft_consensus.cc:697] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:19:56.558519 24443 log.cc:927] Time spent T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:19:56.560916 24055 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.561455 24045 tablet_bootstrap.cc:492] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:56.561968 24045 ts_tablet_manager.cc:1403] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.386s	user 0.014s	sys 0.011s
I20260709 12:19:56.563264 23966 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:56.564054 24417 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.566280 24045 raft_consensus.cc:359] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.567270 24045 raft_consensus.cc:385] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.567586 24045 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.567584 24417 raft_consensus.cc:697] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:56.569061 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:56.570770 24045 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.569360 24417 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.570855 24426 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.573469 24426 raft_consensus.cc:697] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:56.576872 24045 ts_tablet_manager.cc:1434] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:19:56.578114 24045 tablet_bootstrap.cc:492] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:56.582624 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:56.558959 24410 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:56.594033 23966 leader_election.cc:343] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.586411 24355 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.574374 24426 consensus_queue.cc:237] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.620258 24403 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.621551 24046 tablet_bootstrap.cc:492] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:56.622109 24046 ts_tablet_manager.cc:1403] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.270s	user 0.014s	sys 0.021s
I20260709 12:19:56.620769 24403 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.640468 24046 raft_consensus.cc:359] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.641108 24403 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:56.641211 24046 raft_consensus.cc:385] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.646070 24046 raft_consensus.cc:740] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.649151 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:56.655289 23925 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:56.656405 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:56.658129 23922 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:56.659214 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:56.660774 24408 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:19:56.660822 23966 leader_election.cc:343] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.661419 24408 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:56.662420 24408 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.664103 23920 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:56.665069 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:56.666210 24352 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:56.666613 24352 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.666983 24352 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.668077 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:56.670120 24046 consensus_queue.cc:260] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.677817 24044 tablet_bootstrap.cc:654] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.674402 24416 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.685851 24046 ts_tablet_manager.cc:1434] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.063s	user 0.003s	sys 0.005s
I20260709 12:19:56.689167 24352 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.690718 24413 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.691311 24413 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.687597 24416 raft_consensus.cc:697] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:56.696276 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:56.706172 24352 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:56.702195 24395 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.706874 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:56.713138 23926 raft_consensus.cc:2393] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:56.712311 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:56.715596 23752 catalog_manager.cc:5697] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.716337 24421 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:19:56.718922 23966 leader_election.cc:343] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.719676 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:56.720293 23920 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.721169 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:56.723134 23818 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:56.727237 24000 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.732671 24046 tablet_bootstrap.cc:492] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:56.721999 24413 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:56.730341 24400 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.713531 24416 consensus_queue.cc:237] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.765920 24400 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.778245 24421 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:56.783547 24452 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:19:56.816269 24045 tablet_bootstrap.cc:654] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.826120 24421 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.828095 24421 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.828470 23920 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:56.829710 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:56.830588 24046 tablet_bootstrap.cc:654] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.832301 24421 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:56.835479 24408 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.835671 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:56.838893 24408 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:56.839689 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:19:56.841174 23892 leader_election.cc:343] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.844187 24045 tablet_bootstrap.cc:492] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:56.844713 24045 ts_tablet_manager.cc:1403] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.267s	user 0.014s	sys 0.002s
I20260709 12:19:56.847414 24045 raft_consensus.cc:359] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.848122 24045 raft_consensus.cc:385] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.848430 24045 raft_consensus.cc:740] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.839728 24408 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.849181 24045 consensus_queue.cc:260] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.851819 24045 ts_tablet_manager.cc:1434] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 12:19:56.852707 23893 leader_election.cc:343] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.853152 23893 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:56.853863 24055 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.866256 23750 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:56.870390 24045 tablet_bootstrap.cc:492] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:56.870814 23750 catalog_manager.cc:5697] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:56.874898 24044 tablet_bootstrap.cc:492] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:56.875424 24044 ts_tablet_manager.cc:1403] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.344s	user 0.021s	sys 0.005s
I20260709 12:19:56.874007 23750 catalog_manager.cc:5697] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:56.881873 23750 catalog_manager.cc:5697] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:56.884491 24046 tablet_bootstrap.cc:492] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:56.884950 24046 ts_tablet_manager.cc:1403] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.153s	user 0.014s	sys 0.006s
I20260709 12:19:56.886392 24045 tablet_bootstrap.cc:654] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.886154 24044 raft_consensus.cc:359] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.889895 24044 raft_consensus.cc:385] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.890341 24044 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.890801 24046 raft_consensus.cc:359] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.891492 24046 raft_consensus.cc:385] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.891788 24046 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.891232 24044 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.893985 24044 ts_tablet_manager.cc:1434] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:19:56.895046 24044 tablet_bootstrap.cc:492] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:56.892488 24046 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.903282 24046 ts_tablet_manager.cc:1434] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:19:56.903755 24045 tablet_bootstrap.cc:492] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:56.904363 24045 ts_tablet_manager.cc:1403] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.001s
I20260709 12:19:56.904507 24046 tablet_bootstrap.cc:492] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Bootstrap starting.
I20260709 12:19:56.907503 24045 raft_consensus.cc:359] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.908411 24045 raft_consensus.cc:385] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.916970 24045 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.911593 23752 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.921676 24044 tablet_bootstrap.cc:654] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.916036 24046 tablet_bootstrap.cc:654] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.918547 24045 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.925499 24045 ts_tablet_manager.cc:1434] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:19:56.925594 24408 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.960937 24408 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:56.939553 23751 catalog_manager.cc:5697] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:56.964125 24045 tablet_bootstrap.cc:492] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:57.043639 24408 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:57.053956 23751 catalog_manager.cc:5697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:57.066514 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:57.067224 23920 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:57.071049 24156 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:57.084785 24408 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:57.086501 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:57.087208 24408 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.087564 24408 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.087883 24408 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.093418 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:57.095106 24408 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.097179 24408 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:57.100296 24045 tablet_bootstrap.cc:654] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.100898 24315 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:57.107577 23846 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.110409 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:19:57.111510 23966 leader_election.cc:343] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.122368 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:57.123036 23922 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.134157 24046 tablet_bootstrap.cc:492] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: No bootstrap required, opened a new log
I20260709 12:19:57.134933 24046 ts_tablet_manager.cc:1403] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent bootstrapping tablet: real 0.231s	user 0.013s	sys 0.009s
I20260709 12:19:57.137862 24046 raft_consensus.cc:359] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.141909 24046 raft_consensus.cc:385] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:19:57.143100 23800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:57.143500 24046 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.144629 24408 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:19:57.144362 24046 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.148654 24044 tablet_bootstrap.cc:492] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:57.159498 24044 ts_tablet_manager.cc:1403] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.265s	user 0.015s	sys 0.004s
I20260709 12:19:57.149346 24046 ts_tablet_manager.cc:1434] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:19:57.168591 24413 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.204053 24441 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.204630 24441 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:57.207091 23892 consensus_peers.cc:597] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:57.185830 24413 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:19:57.211443 23966 leader_election.cc:343] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.213827 24410 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:57.216285 24044 raft_consensus.cc:359] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.216965 24044 raft_consensus.cc:385] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.217202 24044 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.217819 24044 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.224217 24315 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:57.225641 23922 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:57.231155 24044 ts_tablet_manager.cc:1434] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.004s
I20260709 12:19:57.232091 24403 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.232105 24354 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.232713 24403 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.232734 24354 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.234859 24354 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:57.236292 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:57.238198 24044 tablet_bootstrap.cc:492] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:57.239207 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:57.239323 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:57.239812 23999 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
I20260709 12:19:57.239467 24045 tablet_bootstrap.cc:492] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:57.241714 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:19:57.241499 23892 leader_election.cc:343] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.242300 24045 ts_tablet_manager.cc:1403] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.278s	user 0.010s	sys 0.006s
I20260709 12:19:57.242399 23926 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 0.
W20260709 12:19:57.243645 23893 leader_election.cc:343] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.244040 23893 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:19:57.244931 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:57.245628 24360 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.246018 24403 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:57.246536 24356 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.246937 24356 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.247311 24356 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.245662 24045 raft_consensus.cc:359] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.248171 24045 raft_consensus.cc:385] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.248483 24045 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.249094 24045 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.259074 24045 ts_tablet_manager.cc:1434] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:19:57.260195 24416 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:57.237013 24441 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:57.262684 24045 tablet_bootstrap.cc:492] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:57.261678 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:57.263583 23923 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:57.262389 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:57.265043 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:19:57.287318 23966 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:57.285734 24403 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.294878 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:57.307371 24413 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:57.322539 24410 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.308424 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:57.340585 24417 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:57.342300 24044 tablet_bootstrap.cc:654] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.346807 24045 tablet_bootstrap.cc:654] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.335953 24413 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.332355 24403 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:57.334956 24410 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:57.352200 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:57.349553 24410 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.349258 24413 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.355922 24403 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.357499 24413 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:57.352953 24352 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:19:57.355566 24356 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.365996 24410 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.416747 23852 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 1: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:19:57.438686 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:57.495000 23925 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:57.500952 24410 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:57.366714 24356 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:57.502988 24416 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:57.514215 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:57.515388 23929 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.519343 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:57.598574 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:19:57.595239 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 96117.7us
I20260709 12:19:57.615612 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:57.616674 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:19:57.639734 23999 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 1: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:19:57.610240 24408 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:19:57.639971 23818 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:57.623400 24044 tablet_bootstrap.cc:492] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:57.623893 23849 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.627261 23852 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 1: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:19:57.636093 24045 tablet_bootstrap.cc:492] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:57.653548 24044 ts_tablet_manager.cc:1403] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.416s	user 0.021s	sys 0.011s
I20260709 12:19:57.658437 24045 ts_tablet_manager.cc:1403] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.396s	user 0.008s	sys 0.020s
I20260709 12:19:57.665509 24482 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:57.668962 23929 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:19:57.670382 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:57.679860 24071 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.684172 23818 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:57.682822 24071 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:19:57.704648 24071 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.739378 23966 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:57.742334 24045 raft_consensus.cc:359] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.743067 24045 raft_consensus.cc:385] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.743414 24045 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.744164 24045 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.746474 24403 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.748070 24045 ts_tablet_manager.cc:1434] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260709 12:19:57.750967 24413 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.742199 24044 raft_consensus.cc:359] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.752058 24044 raft_consensus.cc:385] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.759001 24044 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.763303 24045 tablet_bootstrap.cc:492] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:57.771963 24044 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.773856 24044 ts_tablet_manager.cc:1434] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.002s
I20260709 12:19:57.786450 24406 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:57.791009 24045 tablet_bootstrap.cc:654] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.822343 24044 tablet_bootstrap.cc:492] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Bootstrap starting.
I20260709 12:19:57.828248 23751 catalog_manager.cc:5697] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:57.834909 24413 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.835484 24413 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.838013 24413 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:57.840508 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:57.842562 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:57.847752 23817 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:57.849439 24413 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.876686 24044 tablet_bootstrap.cc:654] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:57.858632 23966 consensus_peers.cc:597] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:57.899788 24493 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:57.911298 24045 tablet_bootstrap.cc:492] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:57.912145 24045 ts_tablet_manager.cc:1403] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.163s	user 0.012s	sys 0.006s
I20260709 12:19:57.915951 24045 raft_consensus.cc:359] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.919479 24044 tablet_bootstrap.cc:492] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: No bootstrap required, opened a new log
I20260709 12:19:57.921150 24045 raft_consensus.cc:385] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.921579 24045 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.922065 24044 ts_tablet_manager.cc:1403] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.005s
I20260709 12:19:57.924911 24045 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.925254 24044 raft_consensus.cc:359] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.926049 24044 raft_consensus.cc:385] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.926378 24044 raft_consensus.cc:740] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.928236 24045 ts_tablet_manager.cc:1434] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 12:19:57.927681 24044 consensus_queue.cc:260] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.929349 24045 tablet_bootstrap.cc:492] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:57.930518 24044 ts_tablet_manager.cc:1434] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:57.936501 24045 tablet_bootstrap.cc:654] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.938434 23752 catalog_manager.cc:5697] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:57.947388 24045 tablet_bootstrap.cc:492] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:57.948369 24045 ts_tablet_manager.cc:1403] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 12:19:57.951192 24045 raft_consensus.cc:359] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.951877 24045 raft_consensus.cc:385] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.952145 24045 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.952880 24045 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.955446 24045 ts_tablet_manager.cc:1434] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:19:57.956524 24045 tablet_bootstrap.cc:492] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:57.964339 24045 tablet_bootstrap.cc:654] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.976492 24045 tablet_bootstrap.cc:492] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:57.976959 24045 ts_tablet_manager.cc:1403] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 12:19:57.979609 24045 raft_consensus.cc:359] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.980211 24045 raft_consensus.cc:385] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.980451 24045 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.981014 24045 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.983330 24045 ts_tablet_manager.cc:1434] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:19:57.984925 24045 tablet_bootstrap.cc:492] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c: Bootstrap starting.
I20260709 12:19:57.990224 24045 tablet_bootstrap.cc:654] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.994874 24045 tablet_bootstrap.cc:492] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c: No bootstrap required, opened a new log
I20260709 12:19:57.994856 24413 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.995476 24045 ts_tablet_manager.cc:1403] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:19:57.995447 24413 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.998317 24045 raft_consensus.cc:359] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:57.998974 24045 raft_consensus.cc:385] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.999030 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:57.999310 24045 raft_consensus.cc:740] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.000000 24045 consensus_queue.cc:260] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:58.000818 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:58.002229 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:58.002355 24045 ts_tablet_manager.cc:1434] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:19:58.003098 24478 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.003726 24413 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:58.061002 24493 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.061496 24493 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:58.063400 24493 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:58.064181 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:58.064296 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:58.064826 23848 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:58.064915 23929 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:58.065793 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:19:58.066481 24493 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.066833 24493 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.067178 24493 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.072715 24493 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:58.074654 24493 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:58.075273 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:58.075451 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:58.075901 23929 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.075901 23848 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.079483 23854 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.082898 23929 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:58.083886 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:58.084625 24493 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.085117 24493 raft_consensus.cc:697] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:58.085830 23848 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:58.085923 24493 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:58.100698 23751 catalog_manager.cc:5697] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:58.184346 23800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:58.194708 24071 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.195293 24071 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:58.196991 24071 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:19:58.197819 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:58.198051 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:19:58.200378 23817 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:19:58.201121 24071 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.207810 24478 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.221539 24356 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:58.230551 24474 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.231045 24474 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:58.233050 24474 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:58.234920 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:19:58.235761 23923 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:58.236804 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:58.237401 24474 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.237731 24474 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.238067 24474 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.245507 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:19:58.246309 23848 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 0.
I20260709 12:19:58.246721 24474 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:58.248890 24474 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:19:58.254914 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:19:58.254678 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:19:58.255499 23848 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.255532 23923 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.261302 23848 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:58.267246 23923 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:19:58.268333 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:19:58.268970 24493 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.269703 24493 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:19:58.271494 24493 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:19:58.295146 23751 catalog_manager.cc:5697] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:58.424795 23848 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.467703 23848 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.495631 24493 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.511543 24493 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.678186 24511 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.689433 24493 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.641085 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:59.667953 24518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:59.668066 24516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:59.668085 24515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:59.669942 22701 server_base.cc:1061] running on GCE node
I20260709 12:19:59.671612 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:59.671919 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:59.672152 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599599672132 us; error 0 us; skew 500 ppm
I20260709 12:19:59.672783 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:59.676635 22701 webserver.cc:533] Webserver started at http://127.22.43.68:39153/ using document root <none> and password file <none>
I20260709 12:19:59.677160 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:59.677389 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:59.677701 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:59.678937 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-3-root/instance:
uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
format_stamp: "Formatted at 2026-07-09 12:19:59 on dist-test-slave-0768"
I20260709 12:19:59.684269 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:19:59.688784 24523 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:59.689765 22701 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:19:59.690256 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-3-root
uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
format_stamp: "Formatted at 2026-07-09 12:19:59 on dist-test-slave-0768"
I20260709 12:19:59.690644 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:59.709452 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:59.711406 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:59.734933 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:59.739450 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:59.739666 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:59.739997 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:59.740155 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:59.823285 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.68:43439
I20260709 12:19:59.823902 24587 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.68:43439 every 8 connection(s)
I20260709 12:19:59.828920 22701 auto_leader_rebalancer-test.cc:439] add a tserver: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:19:59.849426 24588 heartbeater.cc:344] Connected to a master server at 127.22.43.126:38021
I20260709 12:19:59.849946 24588 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:59.850705 24588 heartbeater.cc:507] Master 127.22.43.126:38021 requested a full tablet report, sending...
I20260709 12:19:59.853602 23752 ts_manager.cc:194] Registered new tserver with Master: 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:19:59.855459 23752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59378
I20260709 12:20:00.333590 23929 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:00.363772 24001 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:00.366894 24599 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:00.368235 23848 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:00.374950 24598 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:00.399904 24597 raft_consensus.cc:2955] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:00.403674 24000 raft_consensus.cc:2955] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:00.408529 23847 raft_consensus.cc:2955] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:20:00.423036 23895 consensus_peers.cc:597] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 536d25b8a1934dfd8c9ecb2fa2068928. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.432444 23752 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:00.454389 24000 consensus_queue.cc:237] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:00.473320 23923 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:00.478014 24607 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:00.478485 23847 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:00.480335 24511 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:00.489887 24607 raft_consensus.cc:2955] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:20:00.491231 23969 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9527aa74b6e94801a45ae653023f6793. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.491982 23923 raft_consensus.cc:2955] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:00.494534 23847 raft_consensus.cc:2955] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:00.512302 23923 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:00.529187 23749 catalog_manager.cc:5697] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:20:00.540716 23895 consensus_peers.cc:597] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d55123f416ba4e9a930f3a24bb6c88f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.540700 24000 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:00.543701 23854 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:00.543927 24596 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:00.546063 24598 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:00.571857 24597 raft_consensus.cc:2955] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:00.575140 23854 raft_consensus.cc:2955] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:00.576272 24000 raft_consensus.cc:2955] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:00.590252 23749 catalog_manager.cc:5697] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:00.593421 23923 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:00.606324 24000 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:00.607357 23847 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:00.607785 23895 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf7ddeeeb6384431bc2cc3bcf50c2a16. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.608032 24596 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:00.609421 24597 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:00.626173 24597 raft_consensus.cc:2955] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:00.629375 23847 raft_consensus.cc:2955] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:00.630868 24000 raft_consensus.cc:2955] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:00.645869 23749 catalog_manager.cc:5697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:00.858381 24588 heartbeater.cc:499] Master 127.22.43.126:38021 was elected leader, sending a full tablet report...
I20260709 12:20:00.872018 24620 ts_tablet_manager.cc:933] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:00.874452 24620 tablet_copy_client.cc:323] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:20:00.890225 24622 ts_tablet_manager.cc:933] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:00.898574 24622 tablet_copy_client.cc:323] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:00.926237 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet 536d25b8a1934dfd8c9ecb2fa2068928 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:20:00.926903 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet 536d25b8a1934dfd8c9ecb2fa2068928 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-536d25b8a1934dfd8c9ecb2fa2068928
I20260709 12:20:00.929633 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 9527aa74b6e94801a45ae653023f6793 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:00.930339 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 9527aa74b6e94801a45ae653023f6793 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-9527aa74b6e94801a45ae653023f6793
I20260709 12:20:00.946419 24014 tablet_copy_source_session.cc:215] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:00.948334 23939 tablet_copy_source_session.cc:215] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:00.953850 24622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9527aa74b6e94801a45ae653023f6793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:00.961349 24620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 536d25b8a1934dfd8c9ecb2fa2068928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:00.973371 24622 tablet_copy_client.cc:806] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:00.974228 24622 tablet_copy_client.cc:670] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:00.979977 24622 tablet_copy_client.cc:538] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:00.993083 24622 tablet_bootstrap.cc:492] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:00.995035 24620 tablet_copy_client.cc:806] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:00.995772 24620 tablet_copy_client.cc:670] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:01.000160 24620 tablet_copy_client.cc:538] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:01.012365 24620 tablet_bootstrap.cc:492] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:01.023916 24622 tablet_bootstrap.cc:492] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:01.025072 24622 tablet_bootstrap.cc:492] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:01.025837 24622 ts_tablet_manager.cc:1403] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.008s
I20260709 12:20:01.029096 24622 raft_consensus.cc:359] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:01.030068 24622 raft_consensus.cc:740] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:01.030875 24622 consensus_queue.cc:260] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:01.057729 24622 ts_tablet_manager.cc:1434] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.021s
I20260709 12:20:01.065495 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-9527aa74b6e94801a45ae653023f6793 received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:01.066057 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-9527aa74b6e94801a45ae653023f6793 on tablet 9527aa74b6e94801a45ae653023f6793 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:01.086920 24622 ts_tablet_manager.cc:933] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:01.098827 24622 tablet_copy_client.cc:323] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:20:01.100422 24620 tablet_bootstrap.cc:492] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:01.103982 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet d55123f416ba4e9a930f3a24bb6c88f3 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:20:01.104614 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet d55123f416ba4e9a930f3a24bb6c88f3 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-d55123f416ba4e9a930f3a24bb6c88f3
I20260709 12:20:01.107589 24620 tablet_bootstrap.cc:492] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:01.109791 24620 ts_tablet_manager.cc:1403] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.098s	user 0.018s	sys 0.008s
I20260709 12:20:01.112785 23939 tablet_copy_source_session.cc:215] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:01.113992 24620 raft_consensus.cc:359] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:01.115257 24620 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:01.116291 24622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55123f416ba4e9a930f3a24bb6c88f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:01.115993 24620 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:01.119148 24620 ts_tablet_manager.cc:1434] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:20:01.126344 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-536d25b8a1934dfd8c9ecb2fa2068928 received from {username='slave'} at 127.0.0.1:35824
I20260709 12:20:01.126943 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-536d25b8a1934dfd8c9ecb2fa2068928 on tablet 536d25b8a1934dfd8c9ecb2fa2068928 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:01.134816 24631 ts_tablet_manager.cc:933] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:01.149577 24631 tablet_copy_client.cc:323] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:20:01.151669 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet cf7ddeeeb6384431bc2cc3bcf50c2a16 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:20:01.152225 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet cf7ddeeeb6384431bc2cc3bcf50c2a16 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-cf7ddeeeb6384431bc2cc3bcf50c2a16
I20260709 12:20:01.154661 24622 tablet_copy_client.cc:806] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:01.155449 24622 tablet_copy_client.cc:670] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:01.160754 23939 tablet_copy_source_session.cc:215] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:01.161515 24622 tablet_copy_client.cc:538] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:01.165298 24631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7ddeeeb6384431bc2cc3bcf50c2a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:01.171036 24622 tablet_bootstrap.cc:492] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:01.183784 24631 tablet_copy_client.cc:806] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:01.184568 24631 tablet_copy_client.cc:670] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:01.188823 24631 tablet_copy_client.cc:538] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:01.199357 24631 tablet_bootstrap.cc:492] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:01.219599 24622 tablet_bootstrap.cc:492] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:01.220809 24622 tablet_bootstrap.cc:492] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:01.221637 24622 ts_tablet_manager.cc:1403] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.051s	user 0.027s	sys 0.005s
I20260709 12:20:01.225023 24622 raft_consensus.cc:359] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:01.226514 24622 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:01.227289 24622 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:01.228716 24631 tablet_bootstrap.cc:492] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:01.229771 24631 tablet_bootstrap.cc:492] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:01.229827 24622 ts_tablet_manager.cc:1434] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:20:01.230567 24631 ts_tablet_manager.cc:1403] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.009s
I20260709 12:20:01.231886 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d55123f416ba4e9a930f3a24bb6c88f3 received from {username='slave'} at 127.0.0.1:35824
I20260709 12:20:01.232395 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d55123f416ba4e9a930f3a24bb6c88f3 on tablet d55123f416ba4e9a930f3a24bb6c88f3 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:01.233646 24631 raft_consensus.cc:359] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:01.234577 24631 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:01.235270 24631 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:01.237840 24631 ts_tablet_manager.cc:1434] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:01.241060 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-cf7ddeeeb6384431bc2cc3bcf50c2a16 received from {username='slave'} at 127.0.0.1:35824
I20260709 12:20:01.241540 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-cf7ddeeeb6384431bc2cc3bcf50c2a16 on tablet cf7ddeeeb6384431bc2cc3bcf50c2a16 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:01.402881 24563 raft_consensus.cc:1217] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:01.437503 24563 raft_consensus.cc:1217] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:01.670543 24563 raft_consensus.cc:1217] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:01.704833 24563 raft_consensus.cc:1217] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:01.918021 24607 raft_consensus.cc:1064] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:01.921069 24607 consensus_queue.cc:237] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:01.934041 24563 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.936695 24493 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:01.951023 23926 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.954571 23854 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.956212 24511 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:01.961056 24493 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:01.980274 24511 raft_consensus.cc:2955] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:01.984428 23923 raft_consensus.cc:2955] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:01.985922 23854 raft_consensus.cc:2955] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:01.993103 24563 raft_consensus.cc:2955] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.002321 23749 catalog_manager.cc:5697] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:02.037205 24598 raft_consensus.cc:1064] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:02.040041 24598 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:02.055341 24563 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.057250 24000 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.057744 24598 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:02.059396 23848 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.061129 24597 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:02.062860 24421 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:02.074546 24000 consensus_queue.cc:237] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:02.083254 24562 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.083336 23854 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.086447 24493 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:02.088845 24493 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:02.101703 24511 raft_consensus.cc:2955] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.107756 24561 raft_consensus.cc:2955] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.118922 24421 raft_consensus.cc:2955] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.128063 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9527aa74b6e94801a45ae653023f6793 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:02.132705 23847 raft_consensus.cc:2955] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.169138 23751 catalog_manager.cc:5697] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.177415 24598 raft_consensus.cc:1064] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
W20260709 12:20:02.181298 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 78120.6us
W20260709 12:20:02.183410 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 72220.2us
I20260709 12:20:02.186604 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet 9527aa74b6e94801a45ae653023f6793 with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35544
I20260709 12:20:02.186892 24598 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:02.195463 23854 raft_consensus.cc:2955] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.199656 24000 raft_consensus.cc:2955] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.207522 24597 raft_consensus.cc:1064] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:02.208089 24656 tablet_replica.cc:333] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:20:02.207430 24563 raft_consensus.cc:2955] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.221303 24597 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:02.225682 23752 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:02.237502 24563 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.237706 24561 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.240931 23848 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.238951 24000 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.242272 24655 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:02.244204 24655 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:02.257282 24598 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:02.240573 23999 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.239045 23847 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.260484 24656 raft_consensus.cc:2243] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:02.261435 24656 raft_consensus.cc:2272] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:02.267482 24598 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:02.270145 24656 ts_tablet_manager.cc:1916] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:02.284468 24597 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:20:02.296404 24598 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:02.296887 24653 raft_consensus.cc:2955] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.299538 23999 raft_consensus.cc:2955] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.343083 24598 raft_consensus.cc:2955] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.356238 23752 catalog_manager.cc:5697] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.370615 24561 raft_consensus.cc:2955] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.381619 23999 raft_consensus.cc:2955] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.386896 23926 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:02.388828 24563 raft_consensus.cc:2955] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.392995 24000 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.394181 23847 raft_consensus.cc:2955] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.395396 24421 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:02.397475 23848 raft_consensus.cc:2955] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.406585 24655 raft_consensus.cc:2955] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.413703 24000 raft_consensus.cc:2955] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.422612 24561 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.429375 24597 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:02.431223 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 536d25b8a1934dfd8c9ecb2fa2068928 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:02.438325 24561 raft_consensus.cc:2955] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.432307 24656 ts_tablet_manager.cc:1929] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:02.442239 24656 log.cc:1199] T 9527aa74b6e94801a45ae653023f6793 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/9527aa74b6e94801a45ae653023f6793
I20260709 12:20:02.442581 23749 catalog_manager.cc:5697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.444766 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 9527aa74b6e94801a45ae653023f6793 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:02.472355 23926 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:02.473212 23923 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:02.477226 23750 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.479609 24561 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.479974 24563 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.482528 24653 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:02.482946 24421 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:02.489441 23848 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.490726 23854 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.492204 24655 raft_consensus.cc:2955] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.493185 24598 raft_consensus.cc:2955] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.502130 24597 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:02.501868 24653 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:20:02.503902 24563 raft_consensus.cc:2955] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.514977 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d55123f416ba4e9a930f3a24bb6c88f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:02.514261 24561 raft_consensus.cc:2955] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.520685 23848 raft_consensus.cc:2955] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.520915 23751 catalog_manager.cc:5697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.520685 23847 raft_consensus.cc:2955] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:02.540452 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf7ddeeeb6384431bc2cc3bcf50c2a16 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:02.543224 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet 536d25b8a1934dfd8c9ecb2fa2068928 with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60686
I20260709 12:20:02.545372 24666 tablet_replica.cc:333] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:20:02.546468 24666 raft_consensus.cc:2243] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:02.548020 24666 raft_consensus.cc:2272] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:02.556442 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet cf7ddeeeb6384431bc2cc3bcf50c2a16 with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52308
I20260709 12:20:02.563970 24666 ts_tablet_manager.cc:1916] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:02.564553 23749 catalog_manager.cc:5697] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:02.586819 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet d55123f416ba4e9a930f3a24bb6c88f3 with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52308
I20260709 12:20:02.599238 24667 tablet_replica.cc:333] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:20:02.600457 24667 raft_consensus.cc:2243] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:02.601207 24667 raft_consensus.cc:2272] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:02.604662 24667 ts_tablet_manager.cc:1916] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:02.610261 24666 ts_tablet_manager.cc:1929] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:02.610731 24666 log.cc:1199] T 536d25b8a1934dfd8c9ecb2fa2068928 P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/536d25b8a1934dfd8c9ecb2fa2068928
I20260709 12:20:02.612516 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet 536d25b8a1934dfd8c9ecb2fa2068928 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:02.619149 24667 ts_tablet_manager.cc:1929] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:02.619578 24667 log.cc:1199] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/cf7ddeeeb6384431bc2cc3bcf50c2a16
I20260709 12:20:02.621292 24667 tablet_replica.cc:333] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:20:02.621162 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet cf7ddeeeb6384431bc2cc3bcf50c2a16 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:02.622490 24667 raft_consensus.cc:2243] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:02.623202 24667 raft_consensus.cc:2272] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:02.626231 24667 ts_tablet_manager.cc:1916] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:02.636709 24667 ts_tablet_manager.cc:1929] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:02.637069 24667 log.cc:1199] T d55123f416ba4e9a930f3a24bb6c88f3 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/d55123f416ba4e9a930f3a24bb6c88f3
I20260709 12:20:02.638500 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet d55123f416ba4e9a930f3a24bb6c88f3 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:03.670351 23999 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:03.677304 23846 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:03.677482 23969 consensus_peers.cc:597] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45f9750732564b8ebf9a7d205547b35c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:03.677850 23923 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:03.678683 24493 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:03.679553 24639 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:03.687407 24639 raft_consensus.cc:2955] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.689333 23926 raft_consensus.cc:2955] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.693084 23848 raft_consensus.cc:2955] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.713799 23750 catalog_manager.cc:5697] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.739499 23848 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:03.747795 23999 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:03.750061 23926 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:03.750123 24664 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:03.751852 24668 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:03.763679 24664 raft_consensus.cc:2955] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.766559 24000 raft_consensus.cc:2955] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.775215 23926 raft_consensus.cc:2955] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.787576 23751 catalog_manager.cc:5697] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:03.805841 23820 consensus_peers.cc:597] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d00e1a3cc444623bdf4910b98044d66. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:03.808334 24000 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
W20260709 12:20:03.815913 23969 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3482cac0ee5745259004349e6078cf03. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:03.817538 23847 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:03.817675 23926 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:03.818773 24493 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:03.819933 24639 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:03.828852 24641 raft_consensus.cc:2955] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.830284 23926 raft_consensus.cc:2955] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.833243 23847 raft_consensus.cc:2955] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.844480 23923 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:03.855290 23751 catalog_manager.cc:5697] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:20:03.863989 23895 consensus_peers.cc:597] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d53a1203874c465cbc2d50279fc76c4b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:03.864202 23999 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:03.866151 24655 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:03.874034 23847 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:03.875260 24421 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:03.887696 24421 raft_consensus.cc:2955] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.889441 23847 raft_consensus.cc:2955] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.891996 24000 raft_consensus.cc:2955] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:03.906764 23751 catalog_manager.cc:5697] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:04.090792 24692 ts_tablet_manager.cc:933] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:04.092993 24692 tablet_copy_client.cc:323] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:04.094812 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 45f9750732564b8ebf9a7d205547b35c from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:04.095368 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 45f9750732564b8ebf9a7d205547b35c from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-45f9750732564b8ebf9a7d205547b35c
I20260709 12:20:04.102752 24014 tablet_copy_source_session.cc:215] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:04.106078 24692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f9750732564b8ebf9a7d205547b35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:04.119189 24692 tablet_copy_client.cc:806] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:04.119855 24692 tablet_copy_client.cc:670] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:04.124017 24692 tablet_copy_client.cc:538] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:04.132162 24692 tablet_bootstrap.cc:492] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:04.150569 24692 tablet_bootstrap.cc:492] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.151319 24692 tablet_bootstrap.cc:492] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:04.151878 24692 ts_tablet_manager.cc:1403] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.001s
I20260709 12:20:04.154414 24692 raft_consensus.cc:359] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:04.155117 24692 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:04.155638 24692 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:04.158443 24692 ts_tablet_manager.cc:1434] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:20:04.160279 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-45f9750732564b8ebf9a7d205547b35c received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:04.160701 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-45f9750732564b8ebf9a7d205547b35c on tablet 45f9750732564b8ebf9a7d205547b35c with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:04.318818 24692 ts_tablet_manager.cc:933] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:04.320483 24692 tablet_copy_client.cc:323] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:20:04.321914 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet d53a1203874c465cbc2d50279fc76c4b from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:20:04.322363 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet d53a1203874c465cbc2d50279fc76c4b from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-d53a1203874c465cbc2d50279fc76c4b
I20260709 12:20:04.327569 23939 tablet_copy_source_session.cc:215] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:04.330729 24692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53a1203874c465cbc2d50279fc76c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:04.345988 24692 tablet_copy_client.cc:806] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:04.346571 24692 tablet_copy_client.cc:670] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:04.352423 24692 tablet_copy_client.cc:538] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:04.352682 24697 ts_tablet_manager.cc:933] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:20:04.364377 24692 tablet_bootstrap.cc:492] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:04.365751 24697 tablet_copy_client.cc:323] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
I20260709 12:20:04.392386 23864 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet 5d00e1a3cc444623bdf4910b98044d66 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:20:04.393092 23864 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet 5d00e1a3cc444623bdf4910b98044d66 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-5d00e1a3cc444623bdf4910b98044d66
I20260709 12:20:04.401854 23864 tablet_copy_source_session.cc:215] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:04.402474 24692 tablet_bootstrap.cc:492] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.403472 24692 tablet_bootstrap.cc:492] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:04.404206 24692 ts_tablet_manager.cc:1403] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.017s
I20260709 12:20:04.405689 24697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d00e1a3cc444623bdf4910b98044d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:04.407588 24692 raft_consensus.cc:359] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:04.408468 24692 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:04.409158 24692 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:04.411705 24692 ts_tablet_manager.cc:1434] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:04.414865 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d53a1203874c465cbc2d50279fc76c4b received from {username='slave'} at 127.0.0.1:35824
I20260709 12:20:04.415336 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d53a1203874c465cbc2d50279fc76c4b on tablet d53a1203874c465cbc2d50279fc76c4b with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:04.429047 24697 tablet_copy_client.cc:806] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:04.429783 24697 tablet_copy_client.cc:670] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:04.433832 24697 tablet_copy_client.cc:538] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:04.437789 24692 ts_tablet_manager.cc:933] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:04.443725 24697 tablet_bootstrap.cc:492] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:04.481433 24697 tablet_bootstrap.cc:492] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.482591 24697 tablet_bootstrap.cc:492] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:04.483397 24697 ts_tablet_manager.cc:1403] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.007s
I20260709 12:20:04.488095 24697 raft_consensus.cc:359] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:04.489097 24697 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:04.492208 24697 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:04.495823 24697 ts_tablet_manager.cc:1434] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:20:04.497673 23864 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-5d00e1a3cc444623bdf4910b98044d66 received from {username='slave'} at 127.0.0.1:42458
I20260709 12:20:04.498155 23864 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-5d00e1a3cc444623bdf4910b98044d66 on tablet 5d00e1a3cc444623bdf4910b98044d66 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:04.530193 24692 tablet_copy_client.cc:323] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:04.532374 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 3482cac0ee5745259004349e6078cf03 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:04.532984 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 3482cac0ee5745259004349e6078cf03 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-3482cac0ee5745259004349e6078cf03
I20260709 12:20:04.540781 24014 tablet_copy_source_session.cc:215] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:04.543577 24692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3482cac0ee5745259004349e6078cf03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:04.557389 24692 tablet_copy_client.cc:806] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:04.558041 24692 tablet_copy_client.cc:670] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:04.561950 24692 tablet_copy_client.cc:538] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:04.572340 24692 tablet_bootstrap.cc:492] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:04.592077 24692 tablet_bootstrap.cc:492] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.593150 24692 tablet_bootstrap.cc:492] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:04.593797 24692 ts_tablet_manager.cc:1403] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.002s
I20260709 12:20:04.596415 24692 raft_consensus.cc:359] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:04.596791 24561 raft_consensus.cc:1217] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:04.597374 24692 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:04.598031 24692 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:04.600302 24692 ts_tablet_manager.cc:1434] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:20:04.606426 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-3482cac0ee5745259004349e6078cf03 received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:04.608820 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-3482cac0ee5745259004349e6078cf03 on tablet 3482cac0ee5745259004349e6078cf03 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:04.824640 24561 raft_consensus.cc:1217] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:04.934737 24561 raft_consensus.cc:1217] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:04.984372 24561 raft_consensus.cc:1217] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:05.185442 24672 raft_consensus.cc:1064] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:05.188298 24672 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:05.199554 24561 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.200918 24639 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.203790 23923 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.207430 23846 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.208580 24672 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:05.209851 24641 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.221642 24707 raft_consensus.cc:2955] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.225508 23846 raft_consensus.cc:2955] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.239147 23923 raft_consensus.cc:2955] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.243479 24561 raft_consensus.cc:2955] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.248557 23750 catalog_manager.cc:5697] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.292117 24000 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:05.301411 24561 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:05.301826 23923 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:05.304979 24707 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:05.305963 24672 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:05.321759 24639 raft_consensus.cc:2955] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.323449 24561 raft_consensus.cc:2955] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.345286 23751 catalog_manager.cc:5697] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.341300 23926 raft_consensus.cc:2955] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.354200 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 45f9750732564b8ebf9a7d205547b35c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:05.356304 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet 45f9750732564b8ebf9a7d205547b35c with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60686
I20260709 12:20:05.358359 24716 tablet_replica.cc:333] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:20:05.359467 24716 raft_consensus.cc:2243] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.360196 24716 raft_consensus.cc:2272] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.364621 24716 ts_tablet_manager.cc:1916] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:05.369935 24664 raft_consensus.cc:1064] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:05.372493 24664 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:05.386236 24716 ts_tablet_manager.cc:1929] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:05.386765 24716 log.cc:1199] T 45f9750732564b8ebf9a7d205547b35c P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/45f9750732564b8ebf9a7d205547b35c
I20260709 12:20:05.388934 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet 45f9750732564b8ebf9a7d205547b35c (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:05.392359 24000 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.392971 23926 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.393760 24706 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:05.393801 24561 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.394799 24684 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:05.396669 24684 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.416852 24684 raft_consensus.cc:2955] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.423766 24563 raft_consensus.cc:2955] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.436443 23999 raft_consensus.cc:2955] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.440924 23751 catalog_manager.cc:5697] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:05.454972 23846 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:05.466779 24421 raft_consensus.cc:1064] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:05.467476 23999 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:05.470253 24706 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:05.447333 23923 raft_consensus.cc:2955] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.477764 24562 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:05.485868 24684 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:05.495677 24421 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:05.501073 24664 raft_consensus.cc:2955] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.511862 24563 raft_consensus.cc:2955] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.513348 23999 raft_consensus.cc:2955] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.526037 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d00e1a3cc444623bdf4910b98044d66 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:05.532970 24000 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.538244 23751 catalog_manager.cc:5697] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:05.540529 24702 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.555936 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d00e1a3cc444623bdf4910b98044d66 with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35544
I20260709 12:20:05.557082 24563 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.562639 23846 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.568689 24421 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:05.571905 24722 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:05.580119 24725 tablet_replica.cc:333] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:20:05.582921 24725 raft_consensus.cc:2243] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.583757 24725 raft_consensus.cc:2272] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.594990 24722 raft_consensus.cc:2955] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.598832 24639 raft_consensus.cc:1064] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:05.605394 24000 raft_consensus.cc:2955] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.602591 24639 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:05.625793 24725 ts_tablet_manager.cc:1916] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:05.642961 24562 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.644541 24641 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.647280 23846 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.650846 24639 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.657426 23751 catalog_manager.cc:5697] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.683971 24641 raft_consensus.cc:2955] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.640559 24563 raft_consensus.cc:2955] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.691839 23923 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.692942 24725 ts_tablet_manager.cc:1929] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:05.697079 24725 log.cc:1199] T 5d00e1a3cc444623bdf4910b98044d66 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/5d00e1a3cc444623bdf4910b98044d66
I20260709 12:20:05.698860 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 5d00e1a3cc444623bdf4910b98044d66 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:05.695508 23846 raft_consensus.cc:2955] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.696110 23923 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:05.703897 24639 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.708602 24000 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:05.710194 24702 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:05.713814 24563 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:05.719732 24702 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:05.719635 24562 raft_consensus.cc:2955] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.725140 24721 raft_consensus.cc:2955] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.729712 24561 raft_consensus.cc:2955] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.734197 24000 raft_consensus.cc:2955] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.748904 23752 catalog_manager.cc:5697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.753432 23846 raft_consensus.cc:2955] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.760864 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet d53a1203874c465cbc2d50279fc76c4b with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60686
I20260709 12:20:05.761859 24716 tablet_replica.cc:333] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:20:05.762866 24716 raft_consensus.cc:2243] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.763577 24716 raft_consensus.cc:2272] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.762173 23751 catalog_manager.cc:5697] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:05.767666 24716 ts_tablet_manager.cc:1916] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:05.781040 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d53a1203874c465cbc2d50279fc76c4b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:05.787523 23923 raft_consensus.cc:2955] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.791316 24716 ts_tablet_manager.cc:1929] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:05.791867 24716 log.cc:1199] T d53a1203874c465cbc2d50279fc76c4b P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/d53a1203874c465cbc2d50279fc76c4b
I20260709 12:20:05.793327 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet d53a1203874c465cbc2d50279fc76c4b (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:05.833832 24000 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:05.838759 23854 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:05.838753 24562 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:05.840533 24641 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:05.842093 24733 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:20:05.846662 24641 raft_consensus.cc:2955] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.854728 24561 raft_consensus.cc:2955] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.858331 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3482cac0ee5745259004349e6078cf03 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:05.859390 23846 raft_consensus.cc:2955] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.867825 23752 catalog_manager.cc:5697] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:05.880548 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet 3482cac0ee5745259004349e6078cf03 with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35544
I20260709 12:20:05.881495 24725 tablet_replica.cc:333] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:20:05.882606 24725 raft_consensus.cc:2243] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.883323 24725 raft_consensus.cc:2272] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.886960 24725 ts_tablet_manager.cc:1916] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:05.901294 24725 ts_tablet_manager.cc:1929] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:05.901705 24725 log.cc:1199] T 3482cac0ee5745259004349e6078cf03 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/3482cac0ee5745259004349e6078cf03
I20260709 12:20:05.903592 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 3482cac0ee5745259004349e6078cf03 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:06.944058 23854 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
W20260709 12:20:06.956067 23820 consensus_peers.cc:597] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1b7bbae4eed4b9b88eeba1ae28c6ecb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:06.956125 24002 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:06.958125 24684 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.959095 23923 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:06.960649 24684 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.977308 24002 raft_consensus.cc:2955] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:06.976248 24735 raft_consensus.cc:2955] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:06.981168 23921 raft_consensus.cc:2955] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.012552 23751 catalog_manager.cc:5697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.021663 24000 consensus_queue.cc:237] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:07.041831 23921 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:07.042197 23969 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a79eabff38b4edebe70e32ff0d72afc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.043406 24733 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.046434 23854 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.047592 24733 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.056833 24733 raft_consensus.cc:2955] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.059350 23921 raft_consensus.cc:2955] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.060087 23846 raft_consensus.cc:2955] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.076884 23749 catalog_manager.cc:5697] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.078183 23921 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:07.099640 23854 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.100196 24000 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:07.100418 23895 consensus_peers.cc:597] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4a453d774d845e59416b4429315c41f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.102977 24702 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.104825 24722 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.113612 24722 raft_consensus.cc:2955] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.115732 24000 raft_consensus.cc:2955] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.118141 23846 raft_consensus.cc:2955] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.136732 23854 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:07.137295 23752 catalog_manager.cc:5697] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:07.145833 23920 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.147603 24738 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:07.148573 23820 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b6aae08bca4478b92abb367635b948e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.148341 24000 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.150741 24738 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:07.163535 24739 raft_consensus.cc:2955] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.166847 23920 raft_consensus.cc:2955] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.177716 24000 raft_consensus.cc:2955] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:07.189744 23749 catalog_manager.cc:5697] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:07.371716 24756 ts_tablet_manager.cc:933] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:20:07.373596 24756 tablet_copy_client.cc:323] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
I20260709 12:20:07.375072 23864 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:20:07.375523 23864 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-d1b7bbae4eed4b9b88eeba1ae28c6ecb
I20260709 12:20:07.380776 23864 tablet_copy_source_session.cc:215] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:07.383996 24756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:07.401520 24756 tablet_copy_client.cc:806] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:07.402233 24756 tablet_copy_client.cc:670] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:07.408878 24756 tablet_copy_client.cc:538] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:07.417466 24756 tablet_bootstrap.cc:492] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:07.456176 24756 tablet_bootstrap.cc:492] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:07.457291 24756 tablet_bootstrap.cc:492] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:07.458093 24756 ts_tablet_manager.cc:1403] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.041s	user 0.030s	sys 0.010s
I20260709 12:20:07.460359 24756 raft_consensus.cc:359] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:07.461061 24756 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:07.461654 24756 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:07.465624 24756 ts_tablet_manager.cc:1434] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:20:07.467371 23864 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d1b7bbae4eed4b9b88eeba1ae28c6ecb received from {username='slave'} at 127.0.0.1:42458
I20260709 12:20:07.467805 23864 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d1b7bbae4eed4b9b88eeba1ae28c6ecb on tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:07.471191 24760 ts_tablet_manager.cc:933] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:07.472848 24760 tablet_copy_client.cc:323] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:07.474493 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 4a79eabff38b4edebe70e32ff0d72afc from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:07.475075 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 4a79eabff38b4edebe70e32ff0d72afc from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-4a79eabff38b4edebe70e32ff0d72afc
I20260709 12:20:07.477620 24756 ts_tablet_manager.cc:933] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:07.498581 24014 tablet_copy_source_session.cc:215] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:07.501504 24756 tablet_copy_client.cc:323] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:20:07.503643 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet c4a453d774d845e59416b4429315c41f from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:20:07.504133 24760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a79eabff38b4edebe70e32ff0d72afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:07.504272 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet c4a453d774d845e59416b4429315c41f from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-c4a453d774d845e59416b4429315c41f
I20260709 12:20:07.512287 23939 tablet_copy_source_session.cc:215] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:07.517203 24756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a453d774d845e59416b4429315c41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:07.536945 24756 tablet_copy_client.cc:806] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:07.537570 24756 tablet_copy_client.cc:670] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:07.538173 24760 tablet_copy_client.cc:806] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:07.538851 24760 tablet_copy_client.cc:670] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:07.604584 24756 tablet_copy_client.cc:538] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:07.619845 24764 ts_tablet_manager.cc:933] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:20:07.648752 24764 tablet_copy_client.cc:323] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
I20260709 12:20:07.660460 24756 tablet_bootstrap.cc:492] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:07.660673 24760 tablet_copy_client.cc:538] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:07.689918 24760 tablet_bootstrap.cc:492] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:07.690148 23864 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet 5b6aae08bca4478b92abb367635b948e from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:20:07.694109 23864 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet 5b6aae08bca4478b92abb367635b948e from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-5b6aae08bca4478b92abb367635b948e
I20260709 12:20:07.742648 23864 tablet_copy_source_session.cc:215] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:07.747273 24764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6aae08bca4478b92abb367635b948e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:07.783185 24760 tablet_bootstrap.cc:492] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:07.784466 24760 tablet_bootstrap.cc:492] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:07.785358 24760 ts_tablet_manager.cc:1403] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.096s	user 0.021s	sys 0.017s
I20260709 12:20:07.791170 24764 tablet_copy_client.cc:806] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:07.792083 24764 tablet_copy_client.cc:670] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:07.792510 24756 tablet_bootstrap.cc:492] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:07.793695 24756 tablet_bootstrap.cc:492] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:07.794397 24756 ts_tablet_manager.cc:1403] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.134s	user 0.035s	sys 0.032s
I20260709 12:20:07.795249 24760 raft_consensus.cc:359] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:07.796852 24760 raft_consensus.cc:740] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:07.797698 24760 consensus_queue.cc:260] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:07.798520 24756 raft_consensus.cc:359] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:07.803974 24756 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:07.803268 24760 ts_tablet_manager.cc:1434] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.007s
I20260709 12:20:07.804809 24756 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:07.810757 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-4a79eabff38b4edebe70e32ff0d72afc received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:07.811301 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-4a79eabff38b4edebe70e32ff0d72afc on tablet 4a79eabff38b4edebe70e32ff0d72afc with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:07.812846 24756 ts_tablet_manager.cc:1434] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:20:07.814604 24561 raft_consensus.cc:1217] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:07.817811 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-c4a453d774d845e59416b4429315c41f received from {username='slave'} at 127.0.0.1:35824
I20260709 12:20:07.818418 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-c4a453d774d845e59416b4429315c41f on tablet c4a453d774d845e59416b4429315c41f with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:07.824942 24764 tablet_copy_client.cc:538] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:07.846814 24764 tablet_bootstrap.cc:492] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:07.868268 24764 tablet_bootstrap.cc:492] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:07.869515 24764 tablet_bootstrap.cc:492] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:07.870440 24764 ts_tablet_manager.cc:1403] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.003s
I20260709 12:20:07.874653 24561 raft_consensus.cc:1217] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:07.874605 24764 raft_consensus.cc:359] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:07.875598 24764 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:07.876328 24764 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:07.884711 24764 ts_tablet_manager.cc:1434] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:20:07.894507 23864 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-5b6aae08bca4478b92abb367635b948e received from {username='slave'} at 127.0.0.1:42458
I20260709 12:20:07.895026 23864 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-5b6aae08bca4478b92abb367635b948e on tablet 5b6aae08bca4478b92abb367635b948e with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:08.011063 24561 raft_consensus.cc:1217] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:08.109822 24561 raft_consensus.cc:1217] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:08.363003 24722 raft_consensus.cc:1064] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:08.365278 24722 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:08.374163 24561 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.375072 24000 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.376585 24722 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:08.377740 23846 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.377607 24702 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:08.381079 24702 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:08.399732 24750 raft_consensus.cc:2955] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.401264 24000 raft_consensus.cc:2955] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.408571 23846 raft_consensus.cc:2955] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.416317 24739 raft_consensus.cc:1064] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:08.418603 24561 raft_consensus.cc:2955] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.423245 24739 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:08.438228 23751 catalog_manager.cc:5697] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.452577 24561 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.453181 23923 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.453981 24000 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.460938 24766 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:08.468101 24738 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:20:08.473935 24766 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:20:08.510980 24778 raft_consensus.cc:2955] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.518566 24561 raft_consensus.cc:2955] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.522550 23999 raft_consensus.cc:2955] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.534792 23923 raft_consensus.cc:2955] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.549288 23921 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:08.552153 23751 catalog_manager.cc:5697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.564347 24002 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:08.566731 24781 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:08.576773 24561 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:08.581434 24722 raft_consensus.cc:2955] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.588953 23999 raft_consensus.cc:2955] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.594515 24781 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:08.598775 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4a453d774d845e59416b4429315c41f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:08.602495 23750 catalog_manager.cc:5697] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.614494 24733 raft_consensus.cc:1064] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:08.613633 24561 raft_consensus.cc:2955] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.616959 24733 consensus_queue.cc:237] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:08.626433 24562 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.628423 24641 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:08.629289 23923 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.631680 23846 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.634251 24672 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:08.634337 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet c4a453d774d845e59416b4429315c41f with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60686
I20260709 12:20:08.637434 24766 raft_consensus.cc:1064] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:08.640834 24766 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:08.642151 24788 tablet_replica.cc:333] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:20:08.643584 24788 raft_consensus.cc:2243] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.644322 24788 raft_consensus.cc:2272] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.649009 24788 ts_tablet_manager.cc:1916] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:08.655536 24733 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:08.659220 24562 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.660033 24002 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.661178 24778 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:08.665223 24778 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:08.683988 24672 raft_consensus.cc:2955] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.685691 23923 raft_consensus.cc:2955] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.688410 23920 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:08.691763 24778 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:08.696470 23846 raft_consensus.cc:2955] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.706821 24788 ts_tablet_manager.cc:1929] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:08.707422 24788 log.cc:1199] T c4a453d774d845e59416b4429315c41f P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/c4a453d774d845e59416b4429315c41f
I20260709 12:20:08.709280 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet c4a453d774d845e59416b4429315c41f (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:08.718194 24563 raft_consensus.cc:2955] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.719419 24739 raft_consensus.cc:2955] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.722620 24002 raft_consensus.cc:2955] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.713318 23750 catalog_manager.cc:5697] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.743371 23923 raft_consensus.cc:2955] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.771191 23747 catalog_manager.cc:5697] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.787070 23999 consensus_queue.cc:237] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:08.760798 24563 raft_consensus.cc:2955] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.792019 24562 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:08.793766 24733 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:08.796005 23854 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:08.800444 24795 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:08.805469 23854 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:08.812897 24777 raft_consensus.cc:2955] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.818333 23923 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:08.818241 24562 raft_consensus.cc:2955] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.819782 24563 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:08.821537 24766 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:20:08.836673 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a79eabff38b4edebe70e32ff0d72afc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:08.836637 23751 catalog_manager.cc:5697] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.840001 24778 raft_consensus.cc:2955] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.841856 23846 raft_consensus.cc:2955] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.848187 24739 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:08.851922 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a79eabff38b4edebe70e32ff0d72afc with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35544
I20260709 12:20:08.853351 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b6aae08bca4478b92abb367635b948e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:08.854796 24797 tablet_replica.cc:333] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:20:08.856784 24797 raft_consensus.cc:2243] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.857662 24797 raft_consensus.cc:2272] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.862803 23751 catalog_manager.cc:5697] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.864164 23923 raft_consensus.cc:2955] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.866669 24797 ts_tablet_manager.cc:1916] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:08.870723 24563 raft_consensus.cc:2955] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.888703 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b6aae08bca4478b92abb367635b948e with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52308
I20260709 12:20:08.895210 24798 tablet_replica.cc:333] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:20:08.896435 24798 raft_consensus.cc:2243] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.897239 24798 raft_consensus.cc:2272] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.898896 24797 ts_tablet_manager.cc:1929] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:08.902666 24797 log.cc:1199] T 4a79eabff38b4edebe70e32ff0d72afc P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/4a79eabff38b4edebe70e32ff0d72afc
I20260709 12:20:08.904736 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 4a79eabff38b4edebe70e32ff0d72afc (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:08.907647 24798 ts_tablet_manager.cc:1916] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:08.933763 23846 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:08.938819 24563 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:08.941509 24766 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:08.944234 23923 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:08.946357 24766 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:08.949236 24739 raft_consensus.cc:2955] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.964515 24563 raft_consensus.cc:2955] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.965418 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:08.969424 24798 ts_tablet_manager.cc:1929] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:08.970130 24798 log.cc:1199] T 5b6aae08bca4478b92abb367635b948e P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/5b6aae08bca4478b92abb367635b948e
I20260709 12:20:08.963037 23923 raft_consensus.cc:2955] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:08.972190 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet 5b6aae08bca4478b92abb367635b948e (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:08.976878 23749 catalog_manager.cc:5697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.997200 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52308
I20260709 12:20:08.999114 24798 tablet_replica.cc:333] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:20:09.000761 24798 raft_consensus.cc:2243] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.001423 24798 raft_consensus.cc:2272] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.004143 24798 ts_tablet_manager.cc:1916] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:09.019290 24798 ts_tablet_manager.cc:1929] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:09.019676 24798 log.cc:1199] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/d1b7bbae4eed4b9b88eeba1ae28c6ecb
I20260709 12:20:09.021049 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet d1b7bbae4eed4b9b88eeba1ae28c6ecb (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:10.067929 23999 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
W20260709 12:20:10.076898 23969 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 362d811dc320452d8daaca5fda5cd52a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:10.077642 23923 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:10.079238 24672 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:10.080760 23846 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:10.082254 24641 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:10.088320 24641 raft_consensus.cc:2955] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.090906 23920 raft_consensus.cc:2955] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.110446 23751 catalog_manager.cc:5697] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:10.123971 23920 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:10.126030 23846 raft_consensus.cc:2955] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:20:10.142757 23895 consensus_peers.cc:597] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 945f6253667d4ed18d5bf1c3fd3cc9e9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:10.142970 24002 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:10.144580 24781 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:10.144878 23847 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:10.152307 24781 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:10.161954 24702 raft_consensus.cc:2955] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.163486 23847 raft_consensus.cc:2955] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.169982 23999 raft_consensus.cc:2955] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.183538 24002 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:10.185143 23749 catalog_manager.cc:5697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:20:10.205086 23969 consensus_peers.cc:597] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 769e238f62804be6900a5660ed34e431. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:10.206063 23848 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:10.207890 23920 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:10.209235 24641 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:10.299919 24641 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:20:10.299942 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 77348.1us
I20260709 12:20:10.325591 24672 raft_consensus.cc:2955] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.325939 23846 raft_consensus.cc:2955] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.349776 23847 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:10.350029 23920 raft_consensus.cc:2955] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.351294 23747 catalog_manager.cc:5697] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:20:10.372299 23820 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d2bef15f0a6452999bc8b6f4e360c3e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:10.373422 24002 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:10.375506 24802 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:10.376288 23923 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:10.378518 24738 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:10.388011 24738 raft_consensus.cc:2955] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.390820 24002 raft_consensus.cc:2955] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.390956 23923 raft_consensus.cc:2955] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.415654 23751 catalog_manager.cc:5697] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:10.579033 24822 ts_tablet_manager.cc:933] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:10.581811 24822 tablet_copy_client.cc:323] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:20:10.583099 24824 ts_tablet_manager.cc:933] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:10.583590 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet 945f6253667d4ed18d5bf1c3fd3cc9e9 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:20:10.584208 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet 945f6253667d4ed18d5bf1c3fd3cc9e9 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-945f6253667d4ed18d5bf1c3fd3cc9e9
I20260709 12:20:10.585265 24824 tablet_copy_client.cc:323] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:10.587025 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 362d811dc320452d8daaca5fda5cd52a from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:10.587471 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 362d811dc320452d8daaca5fda5cd52a from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-362d811dc320452d8daaca5fda5cd52a
I20260709 12:20:10.592355 23939 tablet_copy_source_session.cc:215] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:10.594622 24014 tablet_copy_source_session.cc:215] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:10.595834 24822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945f6253667d4ed18d5bf1c3fd3cc9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.605507 24824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362d811dc320452d8daaca5fda5cd52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.624099 24822 tablet_copy_client.cc:806] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:10.624827 24822 tablet_copy_client.cc:670] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:10.632772 24822 tablet_copy_client.cc:538] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:10.646754 24822 tablet_bootstrap.cc:492] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:10.674257 24822 tablet_bootstrap.cc:492] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:10.675242 24822 tablet_bootstrap.cc:492] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:10.675973 24822 ts_tablet_manager.cc:1403] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.004s
I20260709 12:20:10.678957 24822 raft_consensus.cc:359] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:10.680071 24822 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:10.680766 24822 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:10.688457 24822 ts_tablet_manager.cc:1434] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:20:10.692401 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-945f6253667d4ed18d5bf1c3fd3cc9e9 received from {username='slave'} at 127.0.0.1:35824
I20260709 12:20:10.692866 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-945f6253667d4ed18d5bf1c3fd3cc9e9 on tablet 945f6253667d4ed18d5bf1c3fd3cc9e9 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:10.699120 24824 tablet_copy_client.cc:806] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:10.699836 24824 tablet_copy_client.cc:670] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:10.703763 24824 tablet_copy_client.cc:538] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:10.714481 24824 tablet_bootstrap.cc:492] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:10.737047 24824 tablet_bootstrap.cc:492] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:10.737962 24824 tablet_bootstrap.cc:492] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:10.738670 24824 ts_tablet_manager.cc:1403] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 12:20:10.741590 24824 raft_consensus.cc:359] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:10.742455 24824 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:10.743324 24824 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:10.745787 24824 ts_tablet_manager.cc:1434] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:10.747481 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-362d811dc320452d8daaca5fda5cd52a received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:10.747897 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-362d811dc320452d8daaca5fda5cd52a on tablet 362d811dc320452d8daaca5fda5cd52a with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:10.761947 24824 ts_tablet_manager.cc:933] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:10.763599 24824 tablet_copy_client.cc:323] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:10.767396 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 769e238f62804be6900a5660ed34e431 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:10.767970 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 769e238f62804be6900a5660ed34e431 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-769e238f62804be6900a5660ed34e431
I20260709 12:20:10.774290 24014 tablet_copy_source_session.cc:215] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:10.776749 24824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769e238f62804be6900a5660ed34e431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.788573 24824 tablet_copy_client.cc:806] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:10.789381 24824 tablet_copy_client.cc:670] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:10.793186 24824 tablet_copy_client.cc:538] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:10.801932 24824 tablet_bootstrap.cc:492] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:10.829085 24824 tablet_bootstrap.cc:492] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:10.829842 24824 tablet_bootstrap.cc:492] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:10.830528 24824 ts_tablet_manager.cc:1403] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.029s	user 0.025s	sys 0.000s
I20260709 12:20:10.833639 24824 raft_consensus.cc:359] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:10.834393 24824 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:10.834905 24824 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:10.837117 24824 ts_tablet_manager.cc:1434] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:10.838891 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-769e238f62804be6900a5660ed34e431 received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:10.839316 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-769e238f62804be6900a5660ed34e431 on tablet 769e238f62804be6900a5660ed34e431 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:10.935680 24824 ts_tablet_manager.cc:933] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:20:10.939064 24824 tablet_copy_client.cc:323] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
I20260709 12:20:10.940997 23864 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet 5d2bef15f0a6452999bc8b6f4e360c3e from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:20:10.941627 23864 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet 5d2bef15f0a6452999bc8b6f4e360c3e from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-5d2bef15f0a6452999bc8b6f4e360c3e
I20260709 12:20:10.956045 23864 tablet_copy_source_session.cc:215] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:10.960783 24824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2bef15f0a6452999bc8b6f4e360c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.978926 24824 tablet_copy_client.cc:806] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:10.979521 24824 tablet_copy_client.cc:670] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:10.984329 24563 raft_consensus.cc:1217] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:10.987738 24824 tablet_copy_client.cc:538] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:10.997671 24824 tablet_bootstrap.cc:492] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:11.014964 24824 tablet_bootstrap.cc:492] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:11.015918 24824 tablet_bootstrap.cc:492] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:11.016600 24824 ts_tablet_manager.cc:1403] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.005s
I20260709 12:20:11.019477 24824 raft_consensus.cc:359] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:11.020355 24824 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:11.021029 24824 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:11.026531 24824 ts_tablet_manager.cc:1434] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:20:11.030073 23864 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-5d2bef15f0a6452999bc8b6f4e360c3e received from {username='slave'} at 127.0.0.1:42458
I20260709 12:20:11.030609 23864 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-5d2bef15f0a6452999bc8b6f4e360c3e on tablet 5d2bef15f0a6452999bc8b6f4e360c3e with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:11.060729 24563 raft_consensus.cc:1217] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:11.283159 24563 raft_consensus.cc:1217] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:11.480232 24672 raft_consensus.cc:1064] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:11.482686 24672 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:11.506433 24563 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:11.507774 23923 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:11.508350 23847 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:11.509207 24672 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:11.515425 24563 raft_consensus.cc:1217] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:11.523475 24834 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:11.524530 24817 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:11.559263 24835 raft_consensus.cc:2955] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.572110 24781 raft_consensus.cc:1064] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:11.574971 24781 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:11.592974 24562 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:11.603950 24814 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:20:11.604964 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 46356.6us
I20260709 12:20:11.616585 23920 raft_consensus.cc:2955] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.630955 24001 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:11.632550 24842 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:11.642071 23847 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:11.645844 24781 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:11.652249 23747 catalog_manager.cc:5697] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.671092 24810 raft_consensus.cc:2955] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.700853 24563 raft_consensus.cc:2955] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.713820 23846 raft_consensus.cc:2955] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.718519 24002 raft_consensus.cc:2955] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.727634 23751 catalog_manager.cc:5697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.730237 24563 raft_consensus.cc:2955] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:20:11.742913 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 46062.2us
I20260709 12:20:11.771569 23846 raft_consensus.cc:2955] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.778378 24817 raft_consensus.cc:1064] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:11.780776 24817 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:11.788142 23921 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:11.818024 23847 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:11.820052 24810 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:11.821132 23921 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:11.822996 24817 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:11.823225 24563 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:11.826347 24842 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:11.834604 24563 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:11.836412 24781 raft_consensus.cc:2955] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.823307 23847 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:11.839105 23854 raft_consensus.cc:2955] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.840921 24849 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:11.843130 24561 raft_consensus.cc:2955] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.854174 24002 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:11.859409 24560 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:11.861129 24850 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:11.863135 24850 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:11.865212 23848 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:11.867177 24849 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:11.879886 24834 raft_consensus.cc:2955] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.883208 24561 raft_consensus.cc:2955] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.885448 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 945f6253667d4ed18d5bf1c3fd3cc9e9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:11.885959 23848 raft_consensus.cc:2955] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.893432 23749 catalog_manager.cc:5697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.907289 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 362d811dc320452d8daaca5fda5cd52a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:11.907421 24563 raft_consensus.cc:2955] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.914426 23750 catalog_manager.cc:5697] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:11.904311 24817 raft_consensus.cc:2955] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.915629 23920 raft_consensus.cc:2955] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.919953 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet 945f6253667d4ed18d5bf1c3fd3cc9e9 with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52308
I20260709 12:20:11.937716 24802 raft_consensus.cc:1064] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:11.940610 24802 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:11.944051 24858 tablet_replica.cc:333] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:20:11.945122 24858 raft_consensus.cc:2243] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:11.945806 24858 raft_consensus.cc:2272] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:11.952428 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet 362d811dc320452d8daaca5fda5cd52a with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35544
I20260709 12:20:11.953157 23848 raft_consensus.cc:2955] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.953751 23747 catalog_manager.cc:5697] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:11.965737 24858 ts_tablet_manager.cc:1916] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:11.984431 24859 tablet_replica.cc:333] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:20:11.986102 24859 raft_consensus.cc:2243] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:11.991392 24859 raft_consensus.cc:2272] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:11.993213 24002 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:11.994884 24563 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:11.995342 24001 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:11.997394 24738 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:12.003897 23920 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:12.005849 24838 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:12.007480 24858 ts_tablet_manager.cc:1929] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:12.007982 24858 log.cc:1199] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/945f6253667d4ed18d5bf1c3fd3cc9e9
I20260709 12:20:12.013499 24859 ts_tablet_manager.cc:1916] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:12.014935 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet 945f6253667d4ed18d5bf1c3fd3cc9e9 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:12.016430 24561 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:12.024613 23920 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:12.026777 24834 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:12.037211 24859 ts_tablet_manager.cc:1929] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:12.037860 24859 log.cc:1199] T 362d811dc320452d8daaca5fda5cd52a P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/362d811dc320452d8daaca5fda5cd52a
I20260709 12:20:12.038872 24834 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:12.040164 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 362d811dc320452d8daaca5fda5cd52a (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:12.046483 24850 raft_consensus.cc:2955] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:12.049037 24563 raft_consensus.cc:2955] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:12.045601 24738 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:20:12.056428 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 769e238f62804be6900a5660ed34e431 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:12.066383 23751 catalog_manager.cc:5697] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:12.074502 24738 raft_consensus.cc:2955] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:12.077737 23929 raft_consensus.cc:2955] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:12.080623 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet 769e238f62804be6900a5660ed34e431 with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60686
I20260709 12:20:12.087313 23920 raft_consensus.cc:2955] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:12.095373 24001 raft_consensus.cc:2955] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:12.111112 24560 raft_consensus.cc:2955] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:12.104218 23749 catalog_manager.cc:5697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:12.138931 23848 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:12.149961 24561 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:12.150382 24001 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:12.152024 24839 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:12.154217 24838 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:12.165442 24864 tablet_replica.cc:333] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:20:12.164884 24738 raft_consensus.cc:2955] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:12.167623 24864 raft_consensus.cc:2243] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:12.168471 24864 raft_consensus.cc:2272] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:12.174119 24864 ts_tablet_manager.cc:1916] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:12.176750 23999 raft_consensus.cc:2955] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:12.177069 24561 raft_consensus.cc:2955] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:12.180572 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d2bef15f0a6452999bc8b6f4e360c3e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:12.208303 24864 ts_tablet_manager.cc:1929] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:12.204895 23751 catalog_manager.cc:5697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:12.208855 24864 log.cc:1199] T 769e238f62804be6900a5660ed34e431 P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/769e238f62804be6900a5660ed34e431
I20260709 12:20:12.211138 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet 769e238f62804be6900a5660ed34e431 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:12.221982 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d2bef15f0a6452999bc8b6f4e360c3e with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35544
I20260709 12:20:12.222975 24859 tablet_replica.cc:333] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:20:12.224134 24859 raft_consensus.cc:2243] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:12.224862 24859 raft_consensus.cc:2272] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:12.228083 24859 ts_tablet_manager.cc:1916] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:12.242074 24859 ts_tablet_manager.cc:1929] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:12.242445 24859 log.cc:1199] T 5d2bef15f0a6452999bc8b6f4e360c3e P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/5d2bef15f0a6452999bc8b6f4e360c3e
I20260709 12:20:12.243788 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 5d2bef15f0a6452999bc8b6f4e360c3e (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:13.295451 23999 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:13.301954 23920 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:13.302286 23969 consensus_peers.cc:597] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe9ef9f9e0c249d5bdb5743853fa3308. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:13.302814 23849 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:13.303272 24834 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:13.304205 24849 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:13.312042 24834 raft_consensus.cc:2955] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.314127 23849 raft_consensus.cc:2955] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.315637 23920 raft_consensus.cc:2955] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.330667 23749 catalog_manager.cc:5697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:13.332017 23920 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:13.348511 23848 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:13.348882 23895 consensus_peers.cc:597] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66100c48e39a42c7be31fa60db7a0d23. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:13.350128 24852 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:13.354745 24001 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:13.358367 24865 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:13.372437 24865 raft_consensus.cc:2955] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.378608 23854 raft_consensus.cc:2955] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.381721 24001 raft_consensus.cc:2955] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.408322 23751 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.415938 23854 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:13.427734 23999 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:13.428295 23820 consensus_peers.cc:597] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d880a30519445959394501b6616f15f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:13.429055 24839 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:13.429443 23929 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:13.431460 24839 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:20:13.442212 24866 raft_consensus.cc:2955] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.449575 23999 raft_consensus.cc:2955] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.453528 23920 raft_consensus.cc:2955] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.467453 23749 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.470746 23854 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:13.478436 23999 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:13.478461 23820 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bed4315a53504a7a84ffb2b5e251ea08. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:13.481201 24883 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:13.481648 23929 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:13.483166 24838 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:13.492573 24838 raft_consensus.cc:2955] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.501174 24001 raft_consensus.cc:2955] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.506078 23929 raft_consensus.cc:2955] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:13.519598 23750 catalog_manager.cc:5697] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:13.826365 24887 ts_tablet_manager.cc:933] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:13.828730 24887 tablet_copy_client.cc:323] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:13.830470 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet fe9ef9f9e0c249d5bdb5743853fa3308 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:13.831038 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet fe9ef9f9e0c249d5bdb5743853fa3308 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-fe9ef9f9e0c249d5bdb5743853fa3308
I20260709 12:20:13.839496 24014 tablet_copy_source_session.cc:215] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:13.842978 24887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9ef9f9e0c249d5bdb5743853fa3308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:13.857415 24889 ts_tablet_manager.cc:933] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:13.859754 24889 tablet_copy_client.cc:323] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:20:13.861528 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet 66100c48e39a42c7be31fa60db7a0d23 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:20:13.862147 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet 66100c48e39a42c7be31fa60db7a0d23 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-66100c48e39a42c7be31fa60db7a0d23
I20260709 12:20:13.862290 24887 tablet_copy_client.cc:806] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:13.862907 24887 tablet_copy_client.cc:670] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:13.867139 24887 tablet_copy_client.cc:538] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:13.870573 23939 tablet_copy_source_session.cc:215] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:13.874254 24889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66100c48e39a42c7be31fa60db7a0d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:13.877048 24887 tablet_bootstrap.cc:492] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:13.892784 24889 tablet_copy_client.cc:806] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:13.893488 24889 tablet_copy_client.cc:670] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:13.897712 24889 tablet_copy_client.cc:538] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:13.904646 24887 tablet_bootstrap.cc:492] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:13.905781 24887 tablet_bootstrap.cc:492] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:13.906598 24887 ts_tablet_manager.cc:1403] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.008s
I20260709 12:20:13.908385 24889 tablet_bootstrap.cc:492] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:13.910094 24887 raft_consensus.cc:359] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:13.911103 24887 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:13.911891 24887 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:14.021845 24887 ts_tablet_manager.cc:1434] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.115s	user 0.050s	sys 0.063s
I20260709 12:20:14.030189 24893 ts_tablet_manager.cc:933] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:20:14.050632 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-fe9ef9f9e0c249d5bdb5743853fa3308 received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:14.051362 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-fe9ef9f9e0c249d5bdb5743853fa3308 on tablet fe9ef9f9e0c249d5bdb5743853fa3308 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:14.082499 24893 tablet_copy_client.cc:323] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
I20260709 12:20:14.084275 23864 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet 8d880a30519445959394501b6616f15f from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:20:14.084843 23864 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet 8d880a30519445959394501b6616f15f from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-8d880a30519445959394501b6616f15f
I20260709 12:20:14.086163 24887 ts_tablet_manager.cc:933] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:20:14.093595 23864 tablet_copy_source_session.cc:215] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:14.096915 24893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d880a30519445959394501b6616f15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.120249 24893 tablet_copy_client.cc:806] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:14.120832 24893 tablet_copy_client.cc:670] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:14.124924 24889 tablet_bootstrap.cc:492] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:14.125839 24893 tablet_copy_client.cc:538] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:14.126271 24889 tablet_bootstrap.cc:492] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:14.127066 24889 ts_tablet_manager.cc:1403] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.219s	user 0.028s	sys 0.011s
I20260709 12:20:14.130486 24889 raft_consensus.cc:359] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:14.132085 24887 tablet_copy_client.cc:323] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
I20260709 12:20:14.132086 24889 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:14.133117 24889 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:14.133935 23864 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet bed4315a53504a7a84ffb2b5e251ea08 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:20:14.134505 23864 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet bed4315a53504a7a84ffb2b5e251ea08 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-bed4315a53504a7a84ffb2b5e251ea08
I20260709 12:20:14.144955 24889 ts_tablet_manager.cc:1434] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.005s
I20260709 12:20:14.148942 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-66100c48e39a42c7be31fa60db7a0d23 received from {username='slave'} at 127.0.0.1:35824
I20260709 12:20:14.149387 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-66100c48e39a42c7be31fa60db7a0d23 on tablet 66100c48e39a42c7be31fa60db7a0d23 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:14.149389 24893 tablet_bootstrap.cc:492] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:14.151298 23864 tablet_copy_source_session.cc:215] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:14.155287 24887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed4315a53504a7a84ffb2b5e251ea08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.168397 24887 tablet_copy_client.cc:806] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:14.168982 24887 tablet_copy_client.cc:670] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:14.176797 24887 tablet_copy_client.cc:538] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:14.190032 24887 tablet_bootstrap.cc:492] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:14.211453 24893 tablet_bootstrap.cc:492] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:14.212493 24893 tablet_bootstrap.cc:492] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:14.212829 24887 tablet_bootstrap.cc:492] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:14.213186 24893 ts_tablet_manager.cc:1403] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.064s	user 0.037s	sys 0.015s
I20260709 12:20:14.213634 24887 tablet_bootstrap.cc:492] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:14.214313 24887 ts_tablet_manager.cc:1403] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 12:20:14.216359 24893 raft_consensus.cc:359] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:14.217262 24893 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:14.217912 24893 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:14.218161 24887 raft_consensus.cc:359] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:14.219045 24887 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:14.219703 24887 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:14.220710 24893 ts_tablet_manager.cc:1434] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:20:14.222373 24887 ts_tablet_manager.cc:1434] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:14.223161 23864 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-8d880a30519445959394501b6616f15f received from {username='slave'} at 127.0.0.1:42458
I20260709 12:20:14.223583 23864 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-8d880a30519445959394501b6616f15f on tablet 8d880a30519445959394501b6616f15f with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:14.224826 23863 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-bed4315a53504a7a84ffb2b5e251ea08 received from {username='slave'} at 127.0.0.1:42458
I20260709 12:20:14.225247 23863 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-bed4315a53504a7a84ffb2b5e251ea08 on tablet bed4315a53504a7a84ffb2b5e251ea08 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:14.333578 24560 raft_consensus.cc:1217] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:14.360831 24560 raft_consensus.cc:1217] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:14.368220 24560 raft_consensus.cc:1217] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:14.705652 24560 raft_consensus.cc:1217] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:14.734151 24900 raft_consensus.cc:1064] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:14.736696 24900 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:14.743010 24560 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:14.744196 24002 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:14.744827 23849 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:14.746538 24879 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:14.747555 24781 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:14.748252 24900 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:14.773247 24879 raft_consensus.cc:2955] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:14.777518 24002 raft_consensus.cc:2955] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:14.779347 24560 raft_consensus.cc:2955] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:14.785794 23848 raft_consensus.cc:2955] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:14.798512 23750 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:14.846978 23929 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:14.853112 23848 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:14.853888 24560 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:14.855341 24781 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:14.858170 24865 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:14.866992 24900 raft_consensus.cc:2955] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:14.878988 24560 raft_consensus.cc:2955] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:14.888367 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66100c48e39a42c7be31fa60db7a0d23 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:14.899114 24838 raft_consensus.cc:1064] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:14.901546 23848 raft_consensus.cc:2955] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:14.902041 24838 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:14.909523 24896 raft_consensus.cc:1064] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:14.914692 24896 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:14.952250 24563 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:14.924541 23747 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:14.966470 24896 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:20:14.999378 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 79684.9us
I20260709 12:20:15.001432 23929 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:15.002005 23854 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:15.004846 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet 66100c48e39a42c7be31fa60db7a0d23 with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52308
I20260709 12:20:15.010066 24560 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:15.010110 24002 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:15.011907 24913 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:15.013556 24912 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:15.014159 24866 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:15.016374 24883 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:15.019610 23926 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:15.020089 24916 tablet_replica.cc:333] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:20:15.021111 24916 raft_consensus.cc:2243] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:15.031176 24883 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:15.035146 24916 raft_consensus.cc:2272] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:15.040092 24916 ts_tablet_manager.cc:1916] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:15.057319 24916 ts_tablet_manager.cc:1929] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:15.057862 24916 log.cc:1199] T 66100c48e39a42c7be31fa60db7a0d23 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/66100c48e39a42c7be31fa60db7a0d23
I20260709 12:20:15.056895 24838 raft_consensus.cc:2955] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.058753 23929 raft_consensus.cc:2955] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.064082 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet 66100c48e39a42c7be31fa60db7a0d23 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:15.063376 24867 raft_consensus.cc:2955] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.068650 23854 raft_consensus.cc:2955] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.070168 23926 raft_consensus.cc:2955] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.086416 23999 raft_consensus.cc:2955] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.094179 23747 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.096675 23749 catalog_manager.cc:5697] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.100539 24560 raft_consensus.cc:2955] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.125123 24560 raft_consensus.cc:2955] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.144405 24838 raft_consensus.cc:1064] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:15.152936 23999 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:15.159614 23848 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:15.164867 23926 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:15.149308 24838 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:15.167768 24896 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:15.171409 23999 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:15.173695 24561 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:15.179519 24563 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:15.181905 24834 raft_consensus.cc:2955] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.182631 24866 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:15.185431 24883 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:15.192107 24867 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:15.195086 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe9ef9f9e0c249d5bdb5743853fa3308 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:15.194377 23926 raft_consensus.cc:2955] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.197036 24866 raft_consensus.cc:2955] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.204398 24002 raft_consensus.cc:2955] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.206983 23749 catalog_manager.cc:5697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.221220 24563 raft_consensus.cc:2955] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.226260 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d880a30519445959394501b6616f15f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:15.233464 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet fe9ef9f9e0c249d5bdb5743853fa3308 with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60686
I20260709 12:20:15.241612 24925 tablet_replica.cc:333] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:20:15.243281 24925 raft_consensus.cc:2243] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:15.244866 24925 raft_consensus.cc:2272] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:15.250356 24563 raft_consensus.cc:2955] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.249517 23750 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.253744 24560 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:15.257527 24922 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:15.260131 24001 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:15.261022 23926 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:15.262161 24923 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:15.263051 24866 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:15.262904 24925 ts_tablet_manager.cc:1916] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:15.279636 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d880a30519445959394501b6616f15f with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35544
I20260709 12:20:15.292090 24923 raft_consensus.cc:2955] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.295243 24560 raft_consensus.cc:2955] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.299316 24002 raft_consensus.cc:2955] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.316709 23751 catalog_manager.cc:5697] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.328903 23926 raft_consensus.cc:2955] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.346009 24929 tablet_replica.cc:333] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:20:15.347873 24929 raft_consensus.cc:2243] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:15.348697 24929 raft_consensus.cc:2272] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:15.355880 24925 ts_tablet_manager.cc:1929] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:15.356475 24925 log.cc:1199] T fe9ef9f9e0c249d5bdb5743853fa3308 P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/fe9ef9f9e0c249d5bdb5743853fa3308
I20260709 12:20:15.358675 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet fe9ef9f9e0c249d5bdb5743853fa3308 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:15.361747 24929 ts_tablet_manager.cc:1916] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:15.363924 23849 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:15.371543 23926 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:15.372965 24922 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:15.374612 24560 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:15.381011 24923 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:15.384461 24838 raft_consensus.cc:2955] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.393957 23926 raft_consensus.cc:2955] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.393352 24560 raft_consensus.cc:2955] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.409044 23750 catalog_manager.cc:5697] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:15.411991 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bed4315a53504a7a84ffb2b5e251ea08 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:15.419880 24929 ts_tablet_manager.cc:1929] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:15.420735 24929 log.cc:1199] T 8d880a30519445959394501b6616f15f P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/8d880a30519445959394501b6616f15f
I20260709 12:20:15.421970 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet bed4315a53504a7a84ffb2b5e251ea08 with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52308
I20260709 12:20:15.423563 24916 tablet_replica.cc:333] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:20:15.424713 24916 raft_consensus.cc:2243] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:15.425377 24916 raft_consensus.cc:2272] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:15.428447 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 8d880a30519445959394501b6616f15f (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:15.430001 24916 ts_tablet_manager.cc:1916] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:15.446197 24916 ts_tablet_manager.cc:1929] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:15.446512 24916 log.cc:1199] T bed4315a53504a7a84ffb2b5e251ea08 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/bed4315a53504a7a84ffb2b5e251ea08
I20260709 12:20:15.448058 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet bed4315a53504a7a84ffb2b5e251ea08 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:16.501176 23999 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:16.507818 23926 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:16.508100 23969 consensus_peers.cc:597] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa7130e46e524c588b99e0dfff2518c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.510548 24932 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.515012 23848 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:16.520725 24912 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:16.524339 24932 raft_consensus.cc:2955] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.526587 23929 raft_consensus.cc:2955] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.535792 23848 raft_consensus.cc:2955] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.544790 23999 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:16.546141 23750 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:16.565742 23969 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c68dea7a8ca44705b1d5fe7b0748519d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.566886 23929 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:16.568102 23848 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:16.568938 24931 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:16.570699 24932 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:16.581068 24932 raft_consensus.cc:2955] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.588829 23849 raft_consensus.cc:2955] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.595149 23929 raft_consensus.cc:2955] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.610070 23751 catalog_manager.cc:5697] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.617314 23848 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
W20260709 12:20:16.632928 23820 consensus_peers.cc:597] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d728437e541d463594bcfe1155df3a32. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.635921 23999 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:16.636027 23929 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:16.637158 24922 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.638149 24838 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.645767 24922 raft_consensus.cc:2955] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.647497 23999 raft_consensus.cc:2955] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.653658 23929 raft_consensus.cc:2955] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.662012 24002 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:16.673296 23750 catalog_manager.cc:5697] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:20:16.698447 23969 consensus_peers.cc:597] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 880fc0774867427e9e9a605bad2bd375. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.702123 23921 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:16.702123 23848 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:16.705260 24913 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.706276 24942 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.721280 24942 raft_consensus.cc:2955] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.723425 23848 raft_consensus.cc:2955] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.725101 23929 raft_consensus.cc:2955] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:16.788002 23751 catalog_manager.cc:5697] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:16.960762 24954 ts_tablet_manager.cc:933] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:16.986819 24954 tablet_copy_client.cc:323] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:16.990759 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet c68dea7a8ca44705b1d5fe7b0748519d from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:16.991330 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet c68dea7a8ca44705b1d5fe7b0748519d from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-c68dea7a8ca44705b1d5fe7b0748519d
I20260709 12:20:17.000033 24014 tablet_copy_source_session.cc:215] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:17.003674 24954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68dea7a8ca44705b1d5fe7b0748519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.023201 24954 tablet_copy_client.cc:806] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:17.023778 24954 tablet_copy_client.cc:670] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:17.029439 24954 tablet_copy_client.cc:538] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:17.038406 24954 tablet_bootstrap.cc:492] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:17.057497 24956 ts_tablet_manager.cc:933] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:17.059720 24956 tablet_copy_client.cc:323] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:17.061578 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet aa7130e46e524c588b99e0dfff2518c4 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:17.062162 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet aa7130e46e524c588b99e0dfff2518c4 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-aa7130e46e524c588b99e0dfff2518c4
I20260709 12:20:17.070711 24954 tablet_bootstrap.cc:492] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:17.071695 24954 tablet_bootstrap.cc:492] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:17.072391 24954 ts_tablet_manager.cc:1403] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.000s
I20260709 12:20:17.075353 24954 raft_consensus.cc:359] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:17.077812 24014 tablet_copy_source_session.cc:215] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:17.079176 24954 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:17.079931 24954 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:17.085470 24956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7130e46e524c588b99e0dfff2518c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.086094 24954 ts_tablet_manager.cc:1434] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:20:17.087836 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-c68dea7a8ca44705b1d5fe7b0748519d received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:17.088243 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-c68dea7a8ca44705b1d5fe7b0748519d on tablet c68dea7a8ca44705b1d5fe7b0748519d with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:17.106575 24956 tablet_copy_client.cc:806] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:17.107385 24956 tablet_copy_client.cc:670] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:17.111129 24956 tablet_copy_client.cc:538] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:17.121388 24956 tablet_bootstrap.cc:492] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:17.130327 24954 ts_tablet_manager.cc:933] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:17.133466 24954 tablet_copy_client.cc:323] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:17.135367 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 880fc0774867427e9e9a605bad2bd375 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:17.135953 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 880fc0774867427e9e9a605bad2bd375 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-880fc0774867427e9e9a605bad2bd375
I20260709 12:20:17.143359 24956 tablet_bootstrap.cc:492] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:17.144091 24014 tablet_copy_source_session.cc:215] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:17.144508 24956 tablet_bootstrap.cc:492] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:17.145342 24956 ts_tablet_manager.cc:1403] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.002s
I20260709 12:20:17.147710 24954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880fc0774867427e9e9a605bad2bd375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.148989 24956 raft_consensus.cc:359] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:17.150051 24956 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:17.150789 24956 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:17.153916 24956 ts_tablet_manager.cc:1434] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 12:20:17.160430 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-aa7130e46e524c588b99e0dfff2518c4 received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:17.161001 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-aa7130e46e524c588b99e0dfff2518c4 on tablet aa7130e46e524c588b99e0dfff2518c4 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:17.171655 24954 tablet_copy_client.cc:806] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:17.172257 24954 tablet_copy_client.cc:670] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:17.175798 24954 tablet_copy_client.cc:538] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:17.186632 24954 tablet_bootstrap.cc:492] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:17.194772 24956 ts_tablet_manager.cc:933] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:20:17.197592 24956 tablet_copy_client.cc:323] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
I20260709 12:20:17.199383 23863 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet d728437e541d463594bcfe1155df3a32 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:20:17.199931 23863 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet d728437e541d463594bcfe1155df3a32 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-d728437e541d463594bcfe1155df3a32
I20260709 12:20:17.239900 23863 tablet_copy_source_session.cc:215] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:17.251317 24954 tablet_bootstrap.cc:492] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:17.252506 24954 tablet_bootstrap.cc:492] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:17.253183 24954 ts_tablet_manager.cc:1403] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.028s
I20260709 12:20:17.255864 24956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d728437e541d463594bcfe1155df3a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.256706 24954 raft_consensus.cc:359] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:17.258924 24954 raft_consensus.cc:740] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:17.259572 24954 consensus_queue.cc:260] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:17.262174 24954 ts_tablet_manager.cc:1434] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 12:20:17.265990 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-880fc0774867427e9e9a605bad2bd375 received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:17.266449 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-880fc0774867427e9e9a605bad2bd375 on tablet 880fc0774867427e9e9a605bad2bd375 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:17.288889 24956 tablet_copy_client.cc:806] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:17.289662 24956 tablet_copy_client.cc:670] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:17.293406 24956 tablet_copy_client.cc:538] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:17.308779 24956 tablet_bootstrap.cc:492] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:17.334312 24956 tablet_bootstrap.cc:492] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:17.335247 24956 tablet_bootstrap.cc:492] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:17.335893 24956 ts_tablet_manager.cc:1403] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260709 12:20:17.338956 24956 raft_consensus.cc:359] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:17.339813 24956 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:17.340451 24956 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:17.342968 24956 ts_tablet_manager.cc:1434] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:17.344820 23863 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d728437e541d463594bcfe1155df3a32 received from {username='slave'} at 127.0.0.1:42458
I20260709 12:20:17.345227 23863 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d728437e541d463594bcfe1155df3a32 on tablet d728437e541d463594bcfe1155df3a32 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:17.558303 24560 raft_consensus.cc:1217] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:17.601307 24560 raft_consensus.cc:1217] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:17.627243 24560 raft_consensus.cc:1217] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:17.955971 24560 raft_consensus.cc:1217] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:20:18.024932 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 46418.3us
I20260709 12:20:18.083521 24974 raft_consensus.cc:1064] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:18.087059 24974 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:18.107262 24969 raft_consensus.cc:1064] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:18.110008 24969 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:18.118446 24975 raft_consensus.cc:1064] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:18.121281 24560 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.121281 24975 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:18.126405 24968 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:18.135394 23847 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.140237 24561 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.144841 24974 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:18.144894 24968 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:18.145594 23847 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.148087 23920 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.149291 24561 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.149665 24969 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:18.151018 23849 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.153345 23921 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.161893 24968 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:18.151069 23920 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.198155 24975 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:18.200150 24968 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:18.200201 24913 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:18.203011 24913 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:18.204021 24974 raft_consensus.cc:2955] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.206111 24970 raft_consensus.cc:2955] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.225601 24561 raft_consensus.cc:2955] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.233355 24560 raft_consensus.cc:2955] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.241017 23847 raft_consensus.cc:2955] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.251205 23749 catalog_manager.cc:5697] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.271596 24974 raft_consensus.cc:2955] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.274560 23848 raft_consensus.cc:2955] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.293242 23847 raft_consensus.cc:2955] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.299362 23920 raft_consensus.cc:2955] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.309158 23929 raft_consensus.cc:2955] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.309367 23921 raft_consensus.cc:2955] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.320644 24561 raft_consensus.cc:2955] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.386193 23751 catalog_manager.cc:5697] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.394804 23751 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.424487 24000 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:18.424712 24001 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:18.424671 24002 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:18.430181 24561 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:18.431766 24974 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:18.443836 23921 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:18.444386 24931 raft_consensus.cc:2955] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.449304 24969 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:18.452817 23847 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:18.453388 23929 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:18.454418 24561 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:18.454905 24913 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:18.460098 24560 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:18.460153 24563 raft_consensus.cc:2955] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.461136 24969 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:18.460052 23929 raft_consensus.cc:2955] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.471930 24966 raft_consensus.cc:1064] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:18.472574 24913 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:20:18.475060 24966 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:18.476284 23847 raft_consensus.cc:2955] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.482810 24975 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:18.485282 24968 raft_consensus.cc:2955] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.487668 23749 catalog_manager.cc:5697] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.492163 23921 raft_consensus.cc:2955] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.495024 24563 raft_consensus.cc:2955] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.516204 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa7130e46e524c588b99e0dfff2518c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:18.473768 24974 raft_consensus.cc:2955] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.535072 23747 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.546650 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 880fc0774867427e9e9a605bad2bd375 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:18.550268 23921 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.552349 24560 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.552423 24977 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:18.554477 24977 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:18.563436 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet aa7130e46e524c588b99e0dfff2518c4 with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60686
I20260709 12:20:18.564105 24563 raft_consensus.cc:2955] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.568454 24001 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:18.567741 23751 catalog_manager.cc:5697] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 3 to 4, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.572365 24953 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:18.584815 23839 tablet_service.cc:1558] Processing DeleteTablet for tablet 880fc0774867427e9e9a605bad2bd375 with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60686
I20260709 12:20:18.587445 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet c68dea7a8ca44705b1d5fe7b0748519d with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35544
I20260709 12:20:18.591806 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c68dea7a8ca44705b1d5fe7b0748519d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:18.600675 24953 raft_consensus.cc:2955] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.606629 24560 raft_consensus.cc:2955] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.620107 25001 tablet_replica.cc:333] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:20:18.622555 24998 tablet_replica.cc:333] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:20:18.623963 24998 raft_consensus.cc:2243] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.624707 24998 raft_consensus.cc:2272] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.630517 24998 ts_tablet_manager.cc:1916] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:18.646520 24001 raft_consensus.cc:2955] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.658411 23929 raft_consensus.cc:2955] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.661140 25001 raft_consensus.cc:2243] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.661926 25001 raft_consensus.cc:2272] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.662550 23751 catalog_manager.cc:5697] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.669852 24998 ts_tablet_manager.cc:1929] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:18.670450 25001 ts_tablet_manager.cc:1916] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:18.670642 24998 log.cc:1199] T aa7130e46e524c588b99e0dfff2518c4 P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/aa7130e46e524c588b99e0dfff2518c4
I20260709 12:20:18.672818 24998 tablet_replica.cc:333] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:20:18.675951 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet aa7130e46e524c588b99e0dfff2518c4 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:18.699031 25001 ts_tablet_manager.cc:1929] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:18.699822 25001 log.cc:1199] T c68dea7a8ca44705b1d5fe7b0748519d P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/c68dea7a8ca44705b1d5fe7b0748519d
I20260709 12:20:18.716298 24998 raft_consensus.cc:2243] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.717373 24998 raft_consensus.cc:2272] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.704072 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet c68dea7a8ca44705b1d5fe7b0748519d (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:18.731500 24998 ts_tablet_manager.cc:1916] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:18.734427 23848 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:18.750201 24560 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:18.750710 23929 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:18.751893 24977 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:18.754396 24953 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:18.765758 24998 ts_tablet_manager.cc:1929] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:18.764899 24952 raft_consensus.cc:2955] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.766330 24998 log.cc:1199] T 880fc0774867427e9e9a605bad2bd375 P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/880fc0774867427e9e9a605bad2bd375
I20260709 12:20:18.767762 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet 880fc0774867427e9e9a605bad2bd375 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:18.770859 24561 raft_consensus.cc:2955] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.773895 23929 raft_consensus.cc:2955] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:18.776260 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d728437e541d463594bcfe1155df3a32 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:18.787038 23749 catalog_manager.cc:5697] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.806461 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet d728437e541d463594bcfe1155df3a32 with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52308
I20260709 12:20:18.815209 25002 tablet_replica.cc:333] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:20:18.816387 25002 raft_consensus.cc:2243] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.817119 25002 raft_consensus.cc:2272] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.820159 25002 ts_tablet_manager.cc:1916] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:18.832680 25002 ts_tablet_manager.cc:1929] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:18.833067 25002 log.cc:1199] T d728437e541d463594bcfe1155df3a32 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/d728437e541d463594bcfe1155df3a32
I20260709 12:20:18.834712 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet d728437e541d463594bcfe1155df3a32 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:20:19.830093 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:19.889848 23921 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:19.899502 23849 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:19.899502 24001 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:19.901692 24978 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:19.903669 24978 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:20:19.908878 23895 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f65f9b948cd4a8d88db397a8232dace. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:19.926767 24979 raft_consensus.cc:2955] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:19.929709 24002 raft_consensus.cc:2955] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:19.930598 23849 raft_consensus.cc:2955] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:19.930562 24000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3482cac0ee5745259004349e6078cf03"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:19.938388 24000 raft_consensus.cc:606] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:19.952003 23749 catalog_manager.cc:5697] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:19.991528 24000 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:20.008028 23849 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:20.008662 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
W20260709 12:20:20.008813 23969 consensus_peers.cc:597] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73d2fbc1f30749eba64903d7e79de8a7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:20.009305 23921 raft_consensus.cc:606] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:20.010031 24969 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.016397 23921 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:20.018285 24974 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.022650 24000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:20.023314 24000 raft_consensus.cc:606] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:20.026093 24000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:20.045800 24000 raft_consensus.cc:606] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:20.049271 24000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:20.050055 24000 raft_consensus.cc:606] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:20.049765 24913 raft_consensus.cc:2955] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:20.051540 23849 raft_consensus.cc:2955] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:20.053042 24002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:20.053607 24002 raft_consensus.cc:606] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:20.055912 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:20.057471 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:20.058490 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:20.068297 23747 catalog_manager.cc:5697] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:20.083739 23929 raft_consensus.cc:2955] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:20.091266 24000 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
W20260709 12:20:20.103475 23969 consensus_peers.cc:597] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 729f7490c64342bebf0188dd2f975e39. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:20.108346 23849 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:20.109376 23929 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:20.109652 24969 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.110925 24974 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.122885 25021 raft_consensus.cc:2955] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:20.126020 23929 raft_consensus.cc:2955] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:20.128234 24974 raft_consensus.cc:993] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:20.128757 24974 raft_consensus.cc:1081] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:20.124831 23849 raft_consensus.cc:2955] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:20.130388 24561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3482cac0ee5745259004349e6078cf03"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36558
I20260709 12:20:20.130962 24561 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:20.131286 24561 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.138857 23847 consensus_queue.cc:237] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:20.147825 24561 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:20.153247 24561 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:20.154929 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:20.155639 23848 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.157284 23747 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:20.161790 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:20.162513 24000 raft_consensus.cc:3055] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:20.162793 24000 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:20.163609 23848 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:20.163568 24000 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:20.164873 24000 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.165097 24524 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:20.176296 25026 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:20.177371 24000 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
W20260709 12:20:20.186509 23820 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8630b76482c543a2a08e289b32b13ab6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:20.190610 23929 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:20.191982 25004 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.195876 24000 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:20.197412 25004 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.200220 25026 raft_consensus.cc:697] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:20.201329 25026 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:20.217984 24952 raft_consensus.cc:2955] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:20.223239 23747 catalog_manager.cc:5697] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 2 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:20.242532 24000 raft_consensus.cc:2955] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:20.250509 25012 raft_consensus.cc:993] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:20.251236 25012 raft_consensus.cc:1081] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:20.255811 23849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:20:20.256364 23849 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:20.256719 23849 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.263356 23849 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.264921 24974 raft_consensus.cc:993] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:20.265602 25021 raft_consensus.cc:1081] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
W20260709 12:20:20.266665 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 44161.1us
I20260709 12:20:20.266798 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:20.267549 24002 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.267709 23847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:20:20.268254 23847 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:20.268563 23847 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.275265 24002 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:20.275415 23847 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.266795 23849 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:20.276656 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:20.277298 23847 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:20.277920 25032 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:20.278555 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:20.282586 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:20.290158 24002 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:20.281913 23747 catalog_manager.cc:5697] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 1 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.293773 23920 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.291563 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:20.290838 25032 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:20.282822 23921 raft_consensus.cc:2955] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:20:20.296761 25032 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.295874 23929 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:20.298108 23929 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:20.299065 23929 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.300380 23929 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.294183 24002 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:20.302280 24002 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.304531 24002 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.310040 25033 ts_tablet_manager.cc:933] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:20.316131 25033 tablet_copy_client.cc:323] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:20:20.317363 23920 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:20.318352 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet 9f65f9b948cd4a8d88db397a8232dace from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:20:20.318889 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:20.318948 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet 9f65f9b948cd4a8d88db397a8232dace from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-9f65f9b948cd4a8d88db397a8232dace
I20260709 12:20:20.320760 25032 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:20.321288 25021 raft_consensus.cc:993] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:20.321261 25032 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:20.321820 24002 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:20.321848 25021 raft_consensus.cc:1081] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:20.323781 23847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:20:20.324290 23847 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:20.324657 23847 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.324170 25032 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.331099 23847 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.331442 23939 tablet_copy_source_session.cc:215] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:20.334331 23847 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:20.334786 23929 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:20.335361 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:20.337747 24002 raft_consensus.cc:3055] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:20.338054 24002 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:20.338794 24002 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.339761 25033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f65f9b948cd4a8d88db397a8232dace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.340068 24002 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.335968 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:20.342412 23920 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.354065 23920 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:20.354970 24002 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:20.355544 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:20.356377 25028 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:20.356853 25028 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:20.357661 25028 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.368693 25033 tablet_copy_client.cc:806] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:20.371243 25033 tablet_copy_client.cc:670] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:20.371006 23747 catalog_manager.cc:5697] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 2, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.372874 23747 catalog_manager.cc:5697] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 2, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.378086 25033 tablet_copy_client.cc:538] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:20.379711 25021 raft_consensus.cc:993] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:20.380252 24969 raft_consensus.cc:1081] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:20.382439 23847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:20:20.382980 23847 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:20.383325 23847 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.389632 23847 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.392083 25033 tablet_bootstrap.cc:492] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:20.392516 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:20.392611 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:20.393179 24002 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:20.393260 23920 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.393564 24002 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:20.394431 24002 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.395434 24002 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.398113 23747 catalog_manager.cc:5697] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 2, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.403966 24002 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:20.410760 23818 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:20.412642 25028 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:20.413123 25028 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:20.413771 23920 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:20.414055 25028 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:20.414602 23847 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:20.416843 24969 raft_consensus.cc:993] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:20.417255 24969 raft_consensus.cc:1081] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:20.418908 24561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36558
I20260709 12:20:20.419445 24561 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:20.419785 24561 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.431805 24561 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:20.434227 25033 tablet_bootstrap.cc:492] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:20.435251 25033 tablet_bootstrap.cc:492] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:20.435974 25033 ts_tablet_manager.cc:1403] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.016s
I20260709 12:20:20.437130 24561 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:20.439370 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:20.440022 23920 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.439908 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:20.440835 24002 raft_consensus.cc:3055] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:20.441267 24002 raft_consensus.cc:740] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:20.442236 24002 consensus_queue.cc:260] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:20.442777 25033 raft_consensus.cc:359] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:20.443557 24002 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.443620 25033 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:20.444430 25033 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:20.447307 25033 ts_tablet_manager.cc:1434] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:20:20.449445 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-9f65f9b948cd4a8d88db397a8232dace received from {username='slave'} at 127.0.0.1:35824
I20260709 12:20:20.449962 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-9f65f9b948cd4a8d88db397a8232dace on tablet 9f65f9b948cd4a8d88db397a8232dace with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:20.449278 23747 catalog_manager.cc:5697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 2, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.459277 23920 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:20.460574 24524 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:20.461321 25026 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:20.461781 25026 raft_consensus.cc:697] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:20.462621 25026 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:20.470304 24002 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:20.478400 23747 catalog_manager.cc:5697] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 2 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:20.483467 25033 ts_tablet_manager.cc:933] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:20.489945 25033 tablet_copy_client.cc:323] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:20.491986 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 73d2fbc1f30749eba64903d7e79de8a7 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:20.492733 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 73d2fbc1f30749eba64903d7e79de8a7 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-73d2fbc1f30749eba64903d7e79de8a7
I20260709 12:20:20.501705 24014 tablet_copy_source_session.cc:215] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:20.505024 25033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d2fbc1f30749eba64903d7e79de8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.522905 25033 tablet_copy_client.cc:806] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:20.523568 25033 tablet_copy_client.cc:670] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:20.537915 25033 tablet_copy_client.cc:538] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:20.553217 25033 tablet_bootstrap.cc:492] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:20.577256 25033 tablet_bootstrap.cc:492] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:20.578248 25033 tablet_bootstrap.cc:492] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:20.578985 25033 ts_tablet_manager.cc:1403] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.000s
I20260709 12:20:20.582828 25033 raft_consensus.cc:359] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:20.584048 25033 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:20.584779 25033 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:20.587141 25033 ts_tablet_manager.cc:1434] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:20:20.590718 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-73d2fbc1f30749eba64903d7e79de8a7 received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:20.591185 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-73d2fbc1f30749eba64903d7e79de8a7 on tablet 73d2fbc1f30749eba64903d7e79de8a7 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:20.596666 25033 ts_tablet_manager.cc:933] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:20.598421 25033 tablet_copy_client.cc:323] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:20:20.602419 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 729f7490c64342bebf0188dd2f975e39 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:20:20.603159 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 729f7490c64342bebf0188dd2f975e39 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-729f7490c64342bebf0188dd2f975e39
I20260709 12:20:20.607589 24000 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:20.609118 25026 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:20.614753 24014 tablet_copy_source_session.cc:215] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:20.621865 25033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729f7490c64342bebf0188dd2f975e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.622145 23847 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:20.624397 25026 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:20.645062 25033 tablet_copy_client.cc:806] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:20.645656 25033 tablet_copy_client.cc:670] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:20.655300 25033 tablet_copy_client.cc:538] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:20.659724 25043 ts_tablet_manager.cc:933] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:20:20.663297 25043 tablet_copy_client.cc:323] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
I20260709 12:20:20.666296 23863 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet 8630b76482c543a2a08e289b32b13ab6 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:20:20.666872 23863 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet 8630b76482c543a2a08e289b32b13ab6 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-8630b76482c543a2a08e289b32b13ab6
I20260709 12:20:20.669553 25033 tablet_bootstrap.cc:492] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:20.678488 23863 tablet_copy_source_session.cc:215] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:20.686020 25043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8630b76482c543a2a08e289b32b13ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.722849 25043 tablet_copy_client.cc:806] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:20.723533 25043 tablet_copy_client.cc:670] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:20.730141 25043 tablet_copy_client.cc:538] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:20.730948 25033 tablet_bootstrap.cc:492] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:20.731922 25033 tablet_bootstrap.cc:492] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:20.732580 25033 ts_tablet_manager.cc:1403] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.063s	user 0.031s	sys 0.016s
I20260709 12:20:20.735801 25033 raft_consensus.cc:359] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:20.736539 25033 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:20.737193 25033 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:20.739413 25033 ts_tablet_manager.cc:1434] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:20.739812 24002 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.744102 24001 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.744946 25028 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.745833 25043 tablet_bootstrap.cc:492] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:20:20.748623 25032 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:20.758889 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-729f7490c64342bebf0188dd2f975e39 received from {username='slave'} at 127.0.0.1:34868
I20260709 12:20:20.759358 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-729f7490c64342bebf0188dd2f975e39 on tablet 729f7490c64342bebf0188dd2f975e39 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:20.779563 25043 tablet_bootstrap.cc:492] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:20.780632 25043 tablet_bootstrap.cc:492] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:20:20.781400 25043 ts_tablet_manager.cc:1403] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.013s
I20260709 12:20:20.786031 25043 raft_consensus.cc:359] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:20.787103 25043 raft_consensus.cc:740] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:20:20.787899 25043 consensus_queue.cc:260] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:20.793920 25043 ts_tablet_manager.cc:1434] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:20:20.799578 23920 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.799682 24560 raft_consensus.cc:1217] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:20.801160 23863 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-8630b76482c543a2a08e289b32b13ab6 received from {username='slave'} at 127.0.0.1:42458
I20260709 12:20:20.801643 23863 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-8630b76482c543a2a08e289b32b13ab6 on tablet 8630b76482c543a2a08e289b32b13ab6 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:20.806906 25004 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:20.828737 23921 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.830751 24001 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.833227 25032 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.834506 23920 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.857662 25028 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.859108 25028 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.882859 24001 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:20.889736 25026 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:20.898296 24000 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.900599 24952 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.914258 23926 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:20.918010 25026 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:20.920852 23929 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.922531 25028 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:21.080024 24560 raft_consensus.cc:1217] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:21.093120 24560 raft_consensus.cc:1217] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:21.159807 24560 raft_consensus.cc:1217] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:21.216874 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:21.284062 23847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:21.284669 23847 raft_consensus.cc:606] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:21.288491 23848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d880a30519445959394501b6616f15f"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:21.289104 23848 raft_consensus.cc:606] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 1 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:21.291786 24001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:21.292326 24001 raft_consensus.cc:606] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:21.296042 24001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0499f663114741880a025070e7b81f"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:21.296577 24001 raft_consensus.cc:606] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:21.296849 25012 raft_consensus.cc:1064] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:21.299582 25012 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:21.304723 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4a453d774d845e59416b4429315c41f"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:20:21.305384 23921 raft_consensus.cc:606] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:21.308671 23848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d728437e541d463594bcfe1155df3a32"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:21.309450 23848 raft_consensus.cc:606] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:21.316469 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:21.318113 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:21.319157 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:21.400274 24974 raft_consensus.cc:993] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:21.401017 25021 raft_consensus.cc:1081] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:21.402895 23848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e0499f663114741880a025070e7b81f"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:20:21.403743 23848 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:21.404348 23848 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:21.405278 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 47759.3us
I20260709 12:20:21.417218 24978 raft_consensus.cc:993] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:21.429289 25074 raft_consensus.cc:1081] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:21.427722 23848 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:21.470791 23848 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:21.479153 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:21.479758 24001 raft_consensus.cc:3055] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:21.480037 24001 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:21.480805 24001 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:21.482501 24001 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.482888 24561 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:21.502190 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:21.506002 23929 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.504634 24001 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:21.507500 23818 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:21.508381 25080 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:21.508853 25080 raft_consensus.cc:697] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:21.509670 25080 consensus_queue.cc:237] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:21.526275 25047 raft_consensus.cc:1064] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:21.530215 25047 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:21.543681 24561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4a453d774d845e59416b4429315c41f"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36552
I20260709 12:20:21.544382 24561 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:21.544728 24561 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.558722 24561 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:21.564023 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:21.564847 23921 raft_consensus.cc:3055] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:21.565218 23921 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:21.566887 24978 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:20:21.573988 23817 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.22.43.126:38021, user_credentials={real_user=slave}} blocked reactor thread for 80386.8us
I20260709 12:20:21.578336 23921 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:21.580403 23921 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.602628 25021 raft_consensus.cc:993] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:21.603174 25021 raft_consensus.cc:1081] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:21.605623 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:21.606297 24001 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.608356 24561 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:21.618520 24974 raft_consensus.cc:1064] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:21.622154 24974 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:21.625433 23848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:20:21.626078 23848 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:21.626416 23848 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.633292 23848 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:21.637202 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 216091us
I20260709 12:20:21.641566 24000 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:21.657493 23920 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:20:21.638619 25068 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 12:20:21.687124 24001 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:21.687628 23921 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:21.720096 24524 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:21.720992 23929 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:21.747098 24969 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:21.740976 25027 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:21.927538 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:21.928326 23921 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.942337 25032 raft_consensus.cc:993] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:20:21.942461 25075 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:21.942982 25032 raft_consensus.cc:1081] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:20:21.945752 23920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:20:21.946439 23920 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:21.946849 23920 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.976419 23921 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:21.980101 23817 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:21.981444 25032 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:21.990507 23920 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:21.982124 25032 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:21.992584 23920 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:21.992329 25032 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:22.002915 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 256129us
I20260709 12:20:22.017452 25027 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:22.019070 25027 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:22.030936 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 106033us
I20260709 12:20:22.033833 23854 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:20:22.040534 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 317244us
I20260709 12:20:22.048069 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:22.048832 23849 raft_consensus.cc:3055] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:22.049271 23849 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:22.050190 23849 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:22.051515 23849 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.062197 25094 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:22.087869 23920 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:22.090044 25070 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:22.100555 23851 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:22.116315 25094 consensus_queue.cc:1059] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:22.117272 25094 consensus_queue.cc:1243] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer 22996f888daf435398b693481171c18c log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:22.118093 25094 raft_consensus.cc:3055] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:22.118650 25094 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:22.119619 25094 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:22.121328 25094 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.133589 23848 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:22.135134 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49454us
I20260709 12:20:22.136276 23849 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:22.136986 25070 raft_consensus.cc:993] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:22.138459 25092 raft_consensus.cc:1081] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 1 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:22.149506 24560 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:22.172739 24561 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:20:22.221038 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.230813 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:22.231627 24001 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:22.259086 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 113200us
I20260709 12:20:22.261719 24561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d880a30519445959394501b6616f15f"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36570
I20260709 12:20:22.262413 24561 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:22.262784 24561 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.274719 23929 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:22.283526 24001 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:22.289350 24561 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:22.294062 25012 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.128s	sys 0.198s
W20260709 12:20:22.294520 25012 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.129s	sys 0.198s
I20260709 12:20:22.299082 24561 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:22.332386 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 53921.7us
I20260709 12:20:22.345281 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:22.346026 25004 raft_consensus.cc:1064] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:20:22.345981 23851 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:22.347451 23851 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:22.348291 23851 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:22.348233 25004 consensus_queue.cc:237] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:22.351370 23851 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.366106 23892 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:22.367588 25069 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:22.386433 25071 raft_consensus.cc:993] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:22.400416 25083 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:22.406046 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 230887us
I20260709 12:20:22.408951 23851 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:22.416172 24524 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:22.396994 25069 raft_consensus.cc:697] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:22.429157 25098 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:22.437209 25108 raft_consensus.cc:1081] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:22.429724 25098 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:22.429771 23922 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:22.439076 25098 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:22.449493 24000 raft_consensus.cc:2955] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:22.456017 24561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d728437e541d463594bcfe1155df3a32"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36570
I20260709 12:20:22.456764 24561 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:22.457203 24561 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.401417 25083 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:22.468513 25083 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:22.469792 24561 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:22.470505 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:22.472401 24002 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:22.482197 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.486346 23854 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:22.450542 25069 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:22.494387 23929 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:22.505635 25107 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:20:22.507282 24969 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:22.507887 24969 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:22.512357 24969 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:22.514233 25088 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 12:20:22.520382 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.515558 25097 raft_consensus.cc:2955] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:22.523783 24002 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:22.532011 25108 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:22.481220 25083 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:20:22.539316 23848 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:22.541462 25079 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:20:22.534152 25108 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:22.481657 25089 raft_consensus.cc:2955] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:20:22.567879 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60511.4us
I20260709 12:20:22.567926 23747 catalog_manager.cc:5697] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 2 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:22.570097 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:22.571537 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:22.572502 24974 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:22.576581 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:22.577167 23847 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:22.577409 23847 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:22.578032 23847 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:22.579245 23847 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.587123 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:22.592644 24561 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:22.597477 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:22.601971 23921 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.629263 24560 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:22.636274 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:22.637398 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:22.656190 24969 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:22.662386 25106 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:20:22.679834 23750 catalog_manager.cc:5697] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 2, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:20:22.689512 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 48067us
I20260709 12:20:22.693243 23921 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:22.630125 25021 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:20:22.697710 24001 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:22.703003 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:22.705066 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.814497 24003 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:22.810034 24002 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:22.863492 23847 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:22.897544 24001 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:22.901358 23998 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:22.871975 25085 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:22.929047 23999 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:22.956651 25085 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:23.016526 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:23.021045 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:23.033684 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.011826 25091 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:23.041760 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 173069us
I20260709 12:20:23.044675 23929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:20:23.045524 23929 raft_consensus.cc:606] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:23.045162 25091 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:23.021034 25085 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:23.076031 25091 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:23.070446 25004 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:23.078837 25004 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:23.081459 25004 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:23.082108 23853 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:23.088846 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 1568) took 1027 ms. Trace:
I20260709 12:20:23.089361 23845 rpcz_store.cc:276] 0709 12:20:22.061313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.062250 (+   937us) service_pool.cc:224] Handling call
0709 12:20:22.578632 (+516382us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:23.086870 (+508238us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327eee 000000000036eb39 00007fa28c39b1e0 00007fa28c4640c4 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:23.088104 (+  1234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.088289 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.088322 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:23.088438 (+   116us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:23.088476 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.088542 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.088655 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11980288}
I20260709 12:20:23.136198 25108 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:23.157922 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:23.161859 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:23.157871 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:23.181354 23851 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:23.187784 23966 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:23.198843 24974 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:23.182649 25108 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:23.209484 24000 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:23.186420 25085 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:20:23.142976 23850 raft_consensus.cc:2955] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:20:23.214330 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 170066us
I20260709 12:20:23.269435 23922 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:23.269989 25121 raft_consensus.cc:993] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:23.270602 25121 raft_consensus.cc:1081] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:23.215442 25108 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:23.296257 24004 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:23.298243 23920 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:23.255530 25099 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:20:23.305984 25138 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:23.271136 25085 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:20:23.310976 25108 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:23.311653 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:23.337558 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 139087us
I20260709 12:20:23.314901 25072 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:20:23.350522 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:23.449564 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 96683.7us
W20260709 12:20:23.447520 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 97388.3us
W20260709 12:20:23.491509 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 140034us
I20260709 12:20:23.348953 23854 raft_consensus.cc:2955] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:20:23.484912 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 169177us
W20260709 12:20:23.786116 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 292835us
W20260709 12:20:23.787144 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 301176us
I20260709 12:20:23.790171 25131 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:23.788651 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:23.828279 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:23.823269 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:23.842286 25084 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.843065 25084 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:23.846294 25118 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.847043 25118 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:23.759325 25138 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:20:23.432554 25074 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.353s
I20260709 12:20:23.809499 25106 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:23.874788 23850 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.623s	user 0.005s	sys 0.005s
I20260709 12:20:23.910043 23847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:23.911976 23847 raft_consensus.cc:606] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:23.912276 23818 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:23.898152 25084 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:23.950742 25093 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:23.763468 25108 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.135s
I20260709 12:20:23.934981 23926 raft_consensus.cc:2955] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:20:23.976498 24562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.105s	sys 0.203s
I20260709 12:20:23.836145 25131 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:23.951654 25093 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:24.004693 25096 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:24.005498 25133 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.355s	user 0.007s	sys 0.002s
I20260709 12:20:24.008929 25091 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:23.998270 25012 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.900163 25106 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:23.998822 24562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.105s	sys 0.203s
W20260709 12:20:24.083992 25143 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.192s	user 0.003s	sys 0.003s
I20260709 12:20:24.030828 25012 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:24.098631 25093 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:24.100726 25151 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:20:24.101382 25085 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:24.102233 25085 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:24.104923 25148 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:20:24.111189 25106 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:24.032073 25091 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
W20260709 12:20:24.120169 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 324612us
W20260709 12:20:24.144461 25004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.068s	sys 0.089s
I20260709 12:20:24.173936 24001 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:24.116542 25098 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 12:20:24.182004 23895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.139s	sys 0.227s
W20260709 12:20:24.188946 23895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.139s	sys 0.227s
I20260709 12:20:24.173799 25021 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:24.078999 25096 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:24.201506 25085 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:24.206465 25118 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:24.206948 25107 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:24.210610 25096 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:24.087051 24562 raft_consensus.cc:2955] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:24.213276 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:24.214618 23852 raft_consensus.cc:2410] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:20:24.215217 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1080) took 1044 ms. Trace:
I20260709 12:20:24.210618 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1076) took 1059 ms. Trace:
I20260709 12:20:24.218801 25012 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:24.219007 25131 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:24.194958 25021 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:24.221139 25149 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:20:24.222504 25021 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:24.215651 23852 rpcz_store.cc:276] 0709 12:20:23.170566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.174621 (+  4055us) service_pool.cc:224] Handling call
0709 12:20:24.212989 (+1038368us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327eee 000000000036eb39 00007fa28c39b1e0 00007fa28c4640c4 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:24.215137 (+  2148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11700096}
I20260709 12:20:24.235615 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:24.236830 23847 raft_consensus.cc:2955] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:24.216792 23854 rpcz_store.cc:276] 0709 12:20:23.151342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.152374 (+  1032us) service_pool.cc:224] Handling call
0709 12:20:23.153078 (+   704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:23.163106 (+ 10028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.163147 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:23.174305 (+ 11158us) log.cc:844] Serialized 556 byte log entry
0709 12:20:23.348824 (+174519us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:24.017273 (+668449us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:20:24.205622 (+188349us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.206781 (+  1159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.210172 (+  3391us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.210230 (+    58us) raft_consensus.cc:1685] finished
0709 12:20:24.210348 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.210517 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":111331712,"thread_start_us":174195,"threads_started":1,"wal-append.queue_time_us":639886}
W20260709 12:20:24.243968 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 354493us
I20260709 12:20:24.232868 25091 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:24.231765 25131 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:20:24.268970 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:24.269439 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:24.254935 25097 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.277431 25126 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.277307 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:24.276521 25097 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:24.278065 25126 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:24.307654 25126 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:24.311331 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 399111us
W20260709 12:20:24.311878 23820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.012s
W20260709 12:20:24.318172 23820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.005s	sys 0.012s
I20260709 12:20:24.343600 25047 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:24.324977 23845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:20:24.335925 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:24.362692 25134 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:24.363907 25106 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:24.377974 25093 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:24.346560 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:24.388410 24561 raft_consensus.cc:2955] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:20:24.402912 23817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.028s	sys 0.079s
W20260709 12:20:24.403466 23817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.028s	sys 0.079s
I20260709 12:20:24.363632 25134 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:24.408932 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:24.380525 23845 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:24.379009 25099 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:24.513052 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 106909us
I20260709 12:20:24.535640 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 1581) took 1966 ms. Trace:
I20260709 12:20:24.538305 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:24.554227 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:24.405925 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:24.557749 23997 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:24.558209 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:24.549238 25158 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:24.559098 25158 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:24.349459 25047 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:24.568069 25146 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:24.511945 23845 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:24.377748 25106 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:24.386853 25093 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:24.581795 25117 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:24.582551 25117 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:24.585328 25117 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:24.561803 25158 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:24.551680 24978 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:24.622893 25112 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:24.607074 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:24.574566 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:24.536165 23850 rpcz_store.cc:276] 0709 12:20:22.569193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.575433 (+  6240us) service_pool.cc:224] Handling call
0709 12:20:23.142157 (+566724us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:23.142435 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.142704 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:23.942411 (+799707us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.441527 (+499116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:24.441600 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:24.441652 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.441726 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.535557 (+ 93831us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1664,"raft.queue_time_us":37222,"spinlock_wait_cycles":5539584,"thread_start_us":439368,"threads_started":1}
I20260709 12:20:24.666244 25164 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:24.544304 25099 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:24.645366 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:24.643278 25096 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:24.642421 24978 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:24.720726 25160 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:24.642562 25146 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:24.727974 25146 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:24.761344 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:24.711753 23997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "769e238f62804be6900a5660ed34e431"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:24.645665 25162 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:24.780405 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:24.718626 25071 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:24.724086 25099 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:24.770478 25004 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.771024 25153 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:24.722385 25096 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:24.797780 25154 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 12:20:24.786927 23997 raft_consensus.cc:606] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:24.855376 25170 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:24.859225 24001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.016s	sys 0.054s
I20260709 12:20:24.791673 25093 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:24.791698 25079 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:24.721304 25160 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:24.796083 25071 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:24.819216 25162 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:24.686664 25112 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:25.344619 23926 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.015s	sys 0.020s
W20260709 12:20:25.417191 24526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.015s	sys 0.017s
W20260709 12:20:25.440114 23926 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.016s	sys 0.026s
W20260709 12:20:25.440366 24526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.016s	sys 0.018s
I20260709 12:20:24.864943 24978 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:25.441067 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 1556) took 1560 ms. Trace:
I20260709 12:20:24.965556 25155 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.441493 23926 rpcz_store.cc:276] 0709 12:20:23.881060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.887084 (+  6024us) service_pool.cc:224] Handling call
0709 12:20:23.934509 (+ 47425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.934811 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:24.229635 (+294824us) log.cc:844] Serialized 14 byte log entry
0709 12:20:25.440656 (+1211021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.440716 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:25.440760 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.440839 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.440970 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4804,"raft.queue_time_us":61524,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":1199832,"threads_started":2,"wal-append.queue_time_us":438064}
I20260709 12:20:24.938444 25171 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:24.884639 25099 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:25.329052 23892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.045s	sys 0.093s
W20260709 12:20:25.444362 23892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.045s	sys 0.106s
W20260709 12:20:25.421324 23895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.018s	sys 0.014s
W20260709 12:20:25.445007 23895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.018s	sys 0.015s
I20260709 12:20:25.445153 25162 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:25.391530 23894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.015s	sys 0.017s
W20260709 12:20:25.445997 23894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.015s	sys 0.019s
I20260709 12:20:25.446376 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:25.446923 24001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.032s	sys 0.074s
W20260709 12:20:25.318738 24561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.045s	sys 0.086s
I20260709 12:20:24.884810 25117 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:25.448168 24561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.047s	sys 0.098s
I20260709 12:20:25.448017 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:25.448480 25117 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:25.450587 25011 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.451437 25117 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:25.451391 25011 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:25.455062 25011 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:25.444384 25099 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:24.884799 25153 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:25.015566 25106 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:24.835351 25004 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.459849 25071 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:25.462436 25112 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:24.798585 25166 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:24.949362 25158 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:25.463742 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 286) took 1076 ms. Trace:
I20260709 12:20:25.464176 23926 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:25.549603 23818 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:25.435722 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 912) took 1100 ms. Trace:
I20260709 12:20:25.547252 24561 rpcz_store.cc:276] 0709 12:20:24.387674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.387808 (+   134us) service_pool.cc:224] Handling call
0709 12:20:24.388086 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:24.388300 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:24.777161 (+388861us) log.cc:844] Serialized 14 byte log entry
0709 12:20:25.463378 (+686217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.463429 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:25.463474 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.463544 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.463660 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":685726,"threads_started":2,"wal-append.queue_time_us":763745}
I20260709 12:20:25.465950 25160 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:24.972008 25088 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:25.151822 25172 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.340s	user 0.000s	sys 0.000s
I20260709 12:20:25.467226 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:25.467082 25079 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:24.852487 25089 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:25.554055 25076 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:25.173668 25174 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
I20260709 12:20:24.969300 25047 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:25.468959 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:25.469178 25170 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:24.973344 25131 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:24.905006 25142 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:25.349247 23999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.002s	sys 0.000s
I20260709 12:20:25.470988 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1087) took 1035 ms. Trace:
I20260709 12:20:25.471292 25097 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:25.471441 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 935) took 1066 ms. Trace:
I20260709 12:20:25.486215 25159 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.548642 25011 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.491268 25108 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:25.491860 23893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.007s	sys 0.003s
W20260709 12:20:25.505834 23967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.020s	sys 0.047s
I20260709 12:20:25.443940 25171 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.442777 25155 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:25.349262 23817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.048s	sys 0.045s
W20260709 12:20:25.539929 25178 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.564s	user 0.001s	sys 0.001s
I20260709 12:20:25.559644 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:25.625998 23817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.049s	sys 0.045s
I20260709 12:20:25.574327 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:25.630964 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 986798us
I20260709 12:20:25.631348 24004 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
W20260709 12:20:25.580134 23968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.008s	sys 0.009s
W20260709 12:20:25.129033 25165 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 12:20:25.558743 25112 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.602214 23854 rpcz_store.cc:276] 0709 12:20:24.435421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.435568 (+   147us) service_pool.cc:224] Handling call
0709 12:20:24.435934 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:24.638794 (+202860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:24.638828 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:24.638875 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:24.638911 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.470173 (+831262us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54002fb2d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:25.470233 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.470926 (+   693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465960192}
W20260709 12:20:25.602110 23999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.010s	sys 0.001s
W20260709 12:20:25.608412 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 52095us
I20260709 12:20:25.637980 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:25.551167 25158 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.575388 25088 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:25.622175 23967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.020s	sys 0.047s
I20260709 12:20:25.620690 24969 raft_consensus.cc:2955] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:20:25.647488 23968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.008s	sys 0.010s
W20260709 12:20:25.621959 23893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.007s	sys 0.003s
I20260709 12:20:25.653167 25170 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:25.654227 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 207438us
I20260709 12:20:25.655344 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:25.660219 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:25.660306 23892 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:25.608578 25089 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.635655 25004 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:25.681849 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:25.684571 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:25.630802 25096 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:25.689083 25199 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.554492 23997 rpcz_store.cc:276] 0709 12:20:24.334994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.434434 (+1099440us) service_pool.cc:224] Handling call
0709 12:20:25.434979 (+   545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.435223 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.435266 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.435335 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:25.435383 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.435462 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.435629 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:25.691829 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:25.692631 23997 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:25.613106 25131 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.600559 25076 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.672256 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:25.708391 25190 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.716607 25190 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.709147 25200 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.709820 25179 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:25.712195 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:25.552412 25166 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:25.719436 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:25.720809 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60657.9us
I20260709 12:20:25.683820 25170 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:25.723519 25088 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:25.621867 24525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.009s	sys 0.023s
I20260709 12:20:25.629611 25108 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.728088 23851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:25.732712 23929 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:25.678685 25047 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:25.633684 25159 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:25.627046 25011 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:25.656072 25112 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.698771 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:25.623502 25142 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:25.738178 25139 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.857577 23851 raft_consensus.cc:606] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:25.861449 25108 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:25.794312 25175 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.430s	user 0.000s	sys 0.001s
I20260709 12:20:25.672379 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:25.862721 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:25.610464 23925 rpcz_store.cc:276] 0709 12:20:24.404886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.405840 (+   954us) service_pool.cc:224] Handling call
0709 12:20:24.579667 (+173827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:24.780312 (+200645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:24.781575 (+  1263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:24.783838 (+  2263us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:24.791610 (+  7772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.471199 (+679589us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400279cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:25.471257 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.471383 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326674816}
I20260709 12:20:25.866509 25004 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:25.859467 24562 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 1.646s	user 0.012s	sys 0.009s
I20260709 12:20:25.690089 25199 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.854063 25188 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:25.725548 25173 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:20:25.842152 25028 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:25.799978 25178 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:20:25.760365 25107 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:25.718562 25096 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.874811 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:25.871204 25108 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.756845 25117 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:25.951611 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:25.956952 25187 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 12:20:25.795689 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 35) took 1766 ms. Trace:
I20260709 12:20:25.845091 25160 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.853916 25195 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.855854 25139 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.866649 25138 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:25.854635 23996 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:25.865522 25170 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:25.973527 25076 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:25.976806 23929 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
W20260709 12:20:25.865072 24525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.009s	sys 0.036s
I20260709 12:20:25.724534 24555 raft_consensus.cc:2955] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:25.949627 25094 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:25.983753 23893 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:25.952551 25099 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:25.956212 25004 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.993726 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:25.869750 25047 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:26.025827 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1085) took 1734 ms. Trace:
W20260709 12:20:26.004606 23845 consensus_meta.cc:287] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.368s	user 0.010s	sys 0.003s
I20260709 12:20:26.005550 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:26.008167 25198 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.954926 25088 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:25.982959 25107 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:26.016580 25142 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:25.997339 23817 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.542s (SENT) [suppressed 4 similar messages]
I20260709 12:20:25.960135 25153 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:25.859743 25200 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.874982 25179 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.992664 25096 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.991150 25108 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:26.063953 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 908) took 1724 ms. Trace:
I20260709 12:20:26.090461 23845 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:26.062733 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:25.986423 25188 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:25.995273 25117 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:26.086562 25192 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:26.026299 23849 rpcz_store.cc:276] 0709 12:20:24.291665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.291829 (+   164us) service_pool.cc:224] Handling call
0709 12:20:24.292348 (+   519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:24.292866 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:24.292913 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:24.293564 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.689750 (+396186us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:24.689804 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.691066 (+  1262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.025597 (+1334531us) raft_consensus.cc:1685] finished
0709 12:20:26.025619 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.025768 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":395676,"threads_started":1,"wal-append.queue_time_us":632470}
I20260709 12:20:25.998315 25028 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:26.088698 25164 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:26.018442 25171 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:26.088070 25196 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:26.027890 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 917) took 1188 ms. Trace:
I20260709 12:20:26.089826 25107 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.103011 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 62) took 1830 ms. Trace:
I20260709 12:20:26.019413 25138 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:26.105391 25179 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:26.098517 24000 rpcz_store.cc:276] 0709 12:20:24.329109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.337586 (+  8477us) service_pool.cc:224] Handling call
0709 12:20:24.338067 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:24.338519 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:24.338563 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:24.339140 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.527135 (+187995us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:24.674852 (+147717us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.694010 (+ 19158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.694115 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.053439 (+1359324us) raft_consensus.cc:1685] finished
0709 12:20:26.053465 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.053605 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36676,"prepare.queue_time_us":191387,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":28587,"raft.queue_time_us":12262,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":40720,"thread_start_us":312904,"threads_started":2,"wal-append.queue_time_us":458317}
I20260709 12:20:26.107977 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:26.029779 25158 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:26.111207 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:26.025604 25160 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:26.095714 25153 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:26.120373 23846 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:26.092494 25072 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:26.121902 25161 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:26.028111 25094 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:26.125660 24001 rpcz_store.cc:276] 0709 12:20:24.272447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.272610 (+   163us) service_pool.cc:224] Handling call
0709 12:20:24.273016 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:24.273441 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:24.273483 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:24.276787 (+  3304us) log.cc:844] Serialized 26 byte log entry
0709 12:20:25.447470 (+1170683us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:25.447529 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.447623 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.102760 (+655137us) raft_consensus.cc:1685] finished
0709 12:20:26.102790 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.102934 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":1653,"thread_start_us":1148232,"threads_started":1,"wal-append.queue_time_us":1699584}
I20260709 12:20:26.128316 25191 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:26.100252 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 58) took 1899 ms. Trace:
I20260709 12:20:26.098026 25168 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:26.110538 25198 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:26.095557 25088 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:26.137131 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:26.119257 25194 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:26.123124 25131 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.124258 25089 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:26.149003 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 915) took 1703 ms. Trace:
I20260709 12:20:26.113459 25079 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.151242 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:26.134980 25011 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.123456 23996 rpcz_store.cc:276] 0709 12:20:24.833904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.177014 (+343110us) service_pool.cc:224] Handling call
0709 12:20:26.019265 (+842251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.126519 25155 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.100214 25184 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:26.127332 25199 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.147318 25112 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:26.122991 25192 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:26.130110 25190 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.122203 25196 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:26.141935 25166 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.167753 24001 rpcz_store.cc:276] 0709 12:20:24.445796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.147827 (+1702031us) service_pool.cc:224] Handling call
0709 12:20:26.148277 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.148539 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.148591 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.148656 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:26.148704 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.148783 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.148928 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.163354 25191 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:26.162194 25170 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:26.142323 25153 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:26.185953 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 914) took 1802 ms. Trace:
I20260709 12:20:26.132550 25164 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:26.209403 25191 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.231472 23853 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:26.243782 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 36) took 1830 ms. Trace:
I20260709 12:20:26.146584 25072 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:26.155638 25161 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:26.215644 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:26.224032 25004 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:26.199193 24969 consensus_meta.cc:287] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.001s
I20260709 12:20:26.209048 24003 rpcz_store.cc:276] 0709 12:20:24.383730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.141218 (+1757488us) service_pool.cc:224] Handling call
0709 12:20:26.141628 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.164389 (+ 22761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.164435 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.164497 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:26.164542 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.185713 (+ 21171us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b540020e9d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:26.185754 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.185867 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51707136}
I20260709 12:20:26.244277 23853 rpcz_store.cc:276] 0709 12:20:24.413703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.420438 (+  6735us) service_pool.cc:224] Handling call
0709 12:20:26.166037 (+1745599us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:26.178685 (+ 12648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.243370 (+ 64685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.243700 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3447040}
I20260709 12:20:26.202411 25194 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:26.241348 25094 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:26.245903 23845 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.172003 25168 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:26.269358 25047 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:26.204890 25184 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:25.993042 23927 rpcz_store.cc:276] 0709 12:20:23.903568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.908255 (+  4687us) service_pool.cc:224] Handling call
0709 12:20:24.327612 (+419357us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:24.327911 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:24.367957 (+ 40046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:24.382742 (+ 14785us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:24.580116 (+197374us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.727934 (+147818us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:24.728005 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.728107 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:25.622326 (+894219us) raft_consensus.cc:1685] finished
0709 12:20:25.622352 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.659028 (+ 36676us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22909,"raft.queue_time_us":37852,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":9142,"spinlock_wait_cycles":6194048,"thread_start_us":41339,"threads_started":1,"wal-append.queue_time_us":919454}
I20260709 12:20:26.289753 25096 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.147814 23998 rpcz_store.cc:276] 0709 12:20:24.199452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.199583 (+   131us) service_pool.cc:224] Handling call
0709 12:20:24.201174 (+  1591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:24.201545 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:24.201577 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:24.202071 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.520767 (+318696us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:24.520823 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.520919 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.064069 (+1543150us) raft_consensus.cc:1685] finished
0709 12:20:26.089216 (+ 25147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.099018 (+  9802us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1121,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":318246,"threads_started":1,"wal-append.queue_time_us":770051}
I20260709 12:20:26.184976 25198 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:26.289500 25108 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.287456 25188 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.293166 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:47066 (request call id 1083) took 1999 ms. Trace:
I20260709 12:20:26.294757 25028 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.294963 25117 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:26.297392 25160 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:26.296134 23995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 913) took 1945 ms (client timeout 1900 ms). Trace:
I20260709 12:20:26.324829 25134 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:26.325434 25088 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:26.322976 23845 rpcz_store.cc:276] 0709 12:20:24.290909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.296208 (+  5299us) service_pool.cc:224] Handling call
0709 12:20:26.288011 (+1991803us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":255}
I20260709 12:20:26.326660 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1095) took 1768 ms. Trace:
I20260709 12:20:26.330511 25164 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:26.520784 23998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:41366
W20260709 12:20:26.329406 23995 rpcz_store.cc:269] 0709 12:20:24.346192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.361721 (+ 15529us) service_pool.cc:224] Handling call
0709 12:20:26.208808 (+1847087us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:26.290134 (+ 81326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71248256}
I20260709 12:20:26.622200 23998 raft_consensus.cc:606] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:26.622360 25153 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:26.523901 25165 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:20:26.475632 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 1558) took 2572 ms. Trace:
I20260709 12:20:26.624600 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 902) took 2836 ms. Trace:
I20260709 12:20:26.624898 23920 rpcz_store.cc:276] 0709 12:20:23.902867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.902991 (+   124us) service_pool.cc:224] Handling call
0709 12:20:24.570837 (+667846us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:24.571018 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.460657 (+889639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.460690 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.460743 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:25.460770 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.475219 (+1014449us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b540018a1d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:26.475308 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.475515 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059392128}
I20260709 12:20:26.625159 23999 rpcz_store.cc:276] 0709 12:20:23.788451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.788558 (+   107us) service_pool.cc:224] Handling call
0709 12:20:23.829650 (+ 41092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:23.853257 (+ 23607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.853307 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:23.873309 (+ 20002us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.310666 (+437357us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:24.529831 (+219165us) log.cc:844] Serialized 14 byte log entry
0709 12:20:25.636360 (+1106529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.373766 (+737406us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b2400261158. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa2841e59c4 00007fa2841e3acb 00007fa28439edc9 00007fa28439ea55 00007fa28439dfb0 00007fa287014488 00007fa287014be8 00007fa286fec398 00007fa286fe776a 00007fa286fe6bb6
0709 12:20:26.384583 (+ 10817us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b540014b254. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:26.384676 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.624269 (+239593us) raft_consensus.cc:1685] finished
0709 12:20:26.624298 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.624473 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37517,"prepare.queue_time_us":326928,"prepare.run_cpu_time_us":4819,"prepare.run_wall_time_us":15483,"raft.queue_time_us":152298,"raft.run_cpu_time_us":2234,"raft.run_wall_time_us":27274,"spinlock_wait_cycles":62825600,"thread_start_us":1633719,"threads_started":3,"wal-append.queue_time_us":709144}
I20260709 12:20:26.288647 25192 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.590794 25161 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:26.589314 25198 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:26.591208 25194 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:26.359292 25196 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:26.339269 25138 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.610276 25159 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:26.376483 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:26.332839 23850 rpcz_store.cc:276] 0709 12:20:24.558262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.770310 (+212048us) service_pool.cc:224] Handling call
0709 12:20:24.817341 (+ 47031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.526007 (+708666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.530208 (+  4201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.535729 (+  5521us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:25.537272 (+  1543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.326384 (+789112us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54002d4bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:26.326437 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.326599 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579995904}
I20260709 12:20:26.372778 25107 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:26.695459 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 1614) took 2123 ms. Trace:
I20260709 12:20:26.696141 23847 rpcz_store.cc:276] 0709 12:20:24.571776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.868601 (+1296825us) service_pool.cc:224] Handling call
0709 12:20:25.869035 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.953424 (+ 84389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.953457 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.953503 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:25.953535 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.695033 (+741498us) spinlock_profiling.cc:243] Waited 84.2 ms on lock 0x7b5400073d54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:26.695115 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.695333 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193574272}
W20260709 12:20:26.704200 23819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.010s	sys 0.031s
W20260709 12:20:26.706625 23819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.010s	sys 0.031s
W20260709 12:20:26.704813 23892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.016s	sys 0.031s
W20260709 12:20:26.708979 23892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.016s	sys 0.031s
W20260709 12:20:26.710733 23817 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.008s	sys 0.019s
W20260709 12:20:26.727874 23817 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.009s	sys 0.019s
W20260709 12:20:26.728235 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 730899us
W20260709 12:20:26.717595 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 858811us
W20260709 12:20:26.704118 25167 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.003s	sys 0.017s
W20260709 12:20:26.705084 24562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.006s	sys 0.040s
W20260709 12:20:26.733700 23895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.041s	sys 0.079s
W20260709 12:20:26.744117 23895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.041s	sys 0.080s
W20260709 12:20:26.744935 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 1.0143e+06us
W20260709 12:20:26.747398 23820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.012s	sys 0.039s
W20260709 12:20:26.747762 23820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.012s	sys 0.039s
W20260709 12:20:26.753356 24525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.008s	sys 0.039s
I20260709 12:20:26.763389 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:26.726706 25164 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:20:26.739763 24527 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.791s	user 0.016s	sys 0.036s
I20260709 12:20:26.776471 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:26.845438 24969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.002s	sys 0.034s
I20260709 12:20:26.997071 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:20:26.999547 24969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.007s	sys 0.044s
I20260709 12:20:26.999725 23929 raft_consensus.cc:3055] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:20:26.853686 24004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.002s	sys 0.019s
I20260709 12:20:27.000128 23929 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:20:27.000593 24004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.003s	sys 0.028s
I20260709 12:20:26.891461 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:26.875648 23893 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.012s	sys 0.016s
I20260709 12:20:26.999155 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:26.936653 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:26.996733 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.003116 23921 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:26.839112 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:27.001928 23893 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.016s	sys 0.019s
W20260709 12:20:27.005151 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 755830us
I20260709 12:20:27.002424 23920 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
W20260709 12:20:26.753849 24562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.007s	sys 0.040s
I20260709 12:20:27.008725 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:26.798730 25134 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:26.879037 25128 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.012s	sys 0.017s
I20260709 12:20:27.011688 23929 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:26.775197 24525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.008s	sys 0.039s
W20260709 12:20:26.747093 25167 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.006s	sys 0.019s
W20260709 12:20:26.790613 25191 consensus_meta.cc:287] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.002s
W20260709 12:20:26.839605 24555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.008s	sys 0.007s
I20260709 12:20:27.009716 24561 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:27.010308 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:27.005172 24527 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.066s	user 0.018s	sys 0.050s
I20260709 12:20:27.034595 23929 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.043920 23923 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.044306 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:26.867612 25198 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:26.863121 25012 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:26.841761 25207 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:27.036896 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:26.765965 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1070) took 1090 ms. Trace:
W20260709 12:20:27.016731 23966 connection.cc:256] RPC call timeout handler was delayed by -1.1789926469998591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 12:20:27.038267 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:26.966567 25107 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.060413 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:27.048357 24555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.010s	sys 0.014s
I20260709 12:20:26.790253 25159 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:26.931185 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:26.916779 25168 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:27.042068 24000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.030s	sys 0.039s
W20260709 12:20:27.160123 24000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.032s	sys 0.040s
W20260709 12:20:27.036705 25128 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.016s	sys 0.028s
I20260709 12:20:27.055218 23928 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.039314 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.068295 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.162787 23921 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.007486 25164 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.102717 23923 raft_consensus.cc:2410] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:27.105388 25214 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:27.106410 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.107911 25161 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:27.108837 25215 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:27.109323 25196 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:27.111284 24562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 309) took 4198 ms. Trace:
I20260709 12:20:27.048566 25191 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:20:27.112622 23750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43184 (request call id 221) took 4726 ms. Trace:
I20260709 12:20:27.054759 23997 rpcz_store.cc:276] 0709 12:20:25.675833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.693696 (+ 17863us) service_pool.cc:224] Handling call
0709 12:20:26.376319 (+682623us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327eee 000000000036eb39 00007fa28c39b1e0 00007fa28c4640c4 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:26.761568 (+385249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13714176}
I20260709 12:20:27.030951 25138 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:27.042115 25146 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:27.056990 25198 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.132270 25139 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:27.053972 25012 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.036077 25134 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.148746 23929 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:27.136615 25069 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:27.030220 25004 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:27.056486 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:27.054184 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.170261 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.199380 23999 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:27.155715 25208 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:27.113281 25130 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:27.177179 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:27.196198 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:27.197073 25198 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.176555 25210 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:27.196907 25069 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.165475 25159 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.057564 25207 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.167557 25214 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.225419 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:27.183861 23924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 939) took 2767 ms (client timeout 1542 ms). Trace:
I20260709 12:20:27.175504 25161 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.187979 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 323) took 1614 ms. Trace:
I20260709 12:20:27.176890 25196 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.251262 23928 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:27.265920 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.183421 25138 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.276378 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.273926 24969 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:27.223191 25130 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.277987 24969 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:27.273729 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 263293us
I20260709 12:20:27.275004 23849 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:27.221163 23922 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.183810 25146 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.179754 25215 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.245478 23853 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:27.246881 25183 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:27.272055 23927 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:20:27.287788 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.268849 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.176064 23750 rpcz_store.cc:276] 0709 12:20:22.386708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.386881 (+   173us) service_pool.cc:224] Handling call
0709 12:20:27.112503 (+4725622us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:23.042654 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:23.043318 (+   664us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:23.043349 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:20:23.043361 (+    12us) tablet.cc:662] Decoding operations
0709 12:20:23.043685 (+   324us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:23.043732 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:23.043759 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:23.047290 (+  3531us) tablet.cc:701] Row locks acquired
0709 12:20:23.047314 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:20:23.061055 (+ 13741us) write_op.cc:270] Start()
0709 12:20:23.071172 (+ 10117us) write_op.cc:276] Timestamp: P: 1783599623058157 usec, L: 0
0709 12:20:23.072966 (+  1794us) op_driver.cc:348] REPLICATION: starting
0709 12:20:23.074177 (+  1211us) log.cc:844] Serialized 538 byte log entry
0709 12:20:25.497189 (+2423012us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b54003003a8. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d8089e1 00007fa28d80764c 00007fa28ae833bb 00007fa28ae8571a 00007fa28ae856a8 00007fa28ae85628 00007fa28ae855e3 00007fa28ae847fc 00007fa28d2b72f6 00007fa28d2b1aa8 00007fa287458310
0709 12:20:25.497359 (+   170us) op_driver.cc:464] REPLICATION: finished
0709 12:20:26.317813 (+820454us) write_op.cc:301] APPLY: starting
0709 12:20:26.317936 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:26.318055 (+   119us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:26.318093 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:26.319662 (+  1569us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:26.323218 (+  3556us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:26.323285 (+    67us) write_op.cc:312] APPLY: finished
0709 12:20:26.571695 (+248410us) log.cc:844] Serialized 23 byte log entry
0709 12:20:26.578839 (+  7144us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:26.578962 (+   123us) write_op.cc:454] Released schema lock
0709 12:20:26.579020 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:26.607392 (+ 28372us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:26.607444 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":79,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":818141,"apply.run_cpu_time_us":2834,"apply.run_wall_time_us":289497,"num_ops":1,"prepare.queue_time_us":353808,"prepare.run_cpu_time_us":3159,"prepare.run_wall_time_us":34059,"replication_time_us":1486191,"spinlock_wait_cycles":12141824,"thread_start_us":265713,"threads_started":1}]]}
I20260709 12:20:27.292614 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:27.268548 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 160561us
I20260709 12:20:27.300508 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:27.305022 24001 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.279811 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:27.301820 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 78532.8us
I20260709 12:20:27.302021 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.307029 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.303364 24969 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:27.308055 24969 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:27.202204 25004 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.285930 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.308655 24969 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.314133 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.231765 25208 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:27.315522 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 126523us
W20260709 12:20:27.252666 23924 rpcz_store.cc:269] 0709 12:20:24.410325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.414608 (+  4283us) service_pool.cc:224] Handling call
0709 12:20:26.913325 (+2498717us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:27.176713 (+263388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9624448}
I20260709 12:20:27.362249 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.363437 24969 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:27.309598 23895 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:27.373334 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 65087.3us
I20260709 12:20:27.378582 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.246673 25210 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:27.380872 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 71392us
I20260709 12:20:27.315124 25229 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:27.383360 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:27.386248 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 80367.5us
I20260709 12:20:27.386332 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:27.389601 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:27.387306 25229 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.390861 25231 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:27.390976 25208 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.391188 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:27.391482 25231 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.392068 25229 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.316579 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:27.365024 25130 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.311950 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:27.395383 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88373us
I20260709 12:20:27.396139 24969 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:27.369798 25161 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.397336 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.368115 25214 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.366360 25012 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.363338 25159 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.397353 24969 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.401041 24001 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:27.376775 25211 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:27.384166 25213 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:27.404570 24003 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.414656 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.415225 24003 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:27.416152 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.417115 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.392540 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:27.394794 25134 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:27.438962 25220 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:20:27.410419 25073 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:27.411242 25164 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:27.304199 25183 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.454773 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.393040 23850 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:27.454945 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:27.388731 25226 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:27.172358 24562 rpcz_store.cc:276] 0709 12:20:22.903785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.909941 (+  6156us) service_pool.cc:224] Handling call
0709 12:20:22.926487 (+ 16546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.927037 (+   550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.927063 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:23.254618 (+327555us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b2c00076218. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa285d45a11 00007fa285d55372 00007fa287487a01 00007fa28744c43a 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2
0709 12:20:23.255322 (+   704us) log.cc:844] Serialized 556 byte log entry
0709 12:20:24.080709 (+825387us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:25.957750 (+1877041us) log.cc:844] Serialized 14 byte log entry
0709 12:20:27.034998 (+1077248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.045593 (+ 10595us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:27.049134 (+  3541us) raft_consensus.cc:1685] finished
0709 12:20:27.052261 (+  3127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.101630 (+ 49369us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":558,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":12794,"spinlock_wait_cycles":4158848,"thread_start_us":1851077,"threads_started":2,"wal-append.queue_time_us":1660070,"wal-append.run_cpu_time_us":3649,"wal-append.run_wall_time_us":1317310}
I20260709 12:20:27.479809 24969 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:27.456378 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:27.459586 25191 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.261766 24555 rpcz_store.cc:276] 0709 12:20:25.568888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.570853 (+  1965us) service_pool.cc:224] Handling call
0709 12:20:25.631239 (+ 60386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.667736 (+ 36497us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:26.235880 (+568144us) log.cc:844] Serialized 14 byte log entry
0709 12:20:27.163734 (+927854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:27.166037 (+  2303us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:27.167039 (+  1002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.175971 (+  8932us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.183531 (+  7560us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":256,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":173,"thread_start_us":894578,"threads_started":1,"wal-append.queue_time_us":824197}
I20260709 12:20:27.471941 25236 raft_consensus.cc:993] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:27.470413 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.413566 25234 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:27.473304 25138 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:27.473207 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.503046 25234 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:27.503777 25234 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.504703 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.474972 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:27.460413 23922 raft_consensus.cc:2955] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:27.508517 25207 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.509099 23853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:27.509850 23853 raft_consensus.cc:606] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 1 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:27.511658 25004 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:27.476384 23818 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:27.476891 25073 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.487197 25210 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:27.496467 25218 log.cc:927] Time spent T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 12:20:27.497812 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 910) took 3165 ms. Trace:
I20260709 12:20:27.514844 24002 rpcz_store.cc:276] 0709 12:20:24.332022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.347651 (+ 15629us) service_pool.cc:224] Handling call
0709 12:20:26.091659 (+1744008us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:26.091914 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.280153 (+188239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.280210 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.280267 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:26.280311 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.497543 (+1217232us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540009a6d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:27.497613 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.497745 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451403904}
I20260709 12:20:27.515970 25073 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.513872 25161 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:27.516772 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 916) took 2748 ms. Trace:
I20260709 12:20:27.516921 25161 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.498634 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.517232 24004 rpcz_store.cc:276] 0709 12:20:24.768189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.166188 (+1397999us) service_pool.cc:224] Handling call
0709 12:20:26.181696 (+ 15508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.183319 (+  1623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.183345 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.218401 (+ 35056us) log.cc:844] Serialized 556 byte log entry
0709 12:20:27.001020 (+782619us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:27.001059 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.001130 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:27.516544 (+515414us) raft_consensus.cc:1685] finished
0709 12:20:27.516569 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.516710 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":782303,"threads_started":1,"wal-append.queue_time_us":958766}
W20260709 12:20:27.521164 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 64869.9us
I20260709 12:20:27.521584 25215 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:27.522342 25118 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:27.522814 25118 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:27.478524 25223 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.289s	user 0.000s	sys 0.003s
I20260709 12:20:27.522022 25236 raft_consensus.cc:1081] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
W20260709 12:20:27.521786 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 67543.7us
I20260709 12:20:27.523479 25069 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:27.491720 25226 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.525332 25161 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:27.525372 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.523218 25118 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:27.527047 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 50737.8us
I20260709 12:20:27.527586 25134 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:27.538264 25134 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:27.539450 25134 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.523250 25231 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:27.528354 23817 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:27.526443 25226 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:27.522153 25071 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:27.540975 25071 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.541113 25004 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:27.541431 25071 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:27.541734 25004 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:27.541643 23817 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:27.542378 25004 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.543166 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:27.543880 23818 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:27.545742 23817 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:27.556929 23818 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:27.557476 25240 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:27.559685 25240 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:27.560117 25240 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.547809 25093 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:27.567317 25196 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.548483 25159 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:27.546123 25073 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:27.562660 25093 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:27.569036 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:27.575670 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:27.570779 25004 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.577051 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.574713 25093 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.571473 25073 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:27.579150 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.578706 25073 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.581861 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.571122 25159 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:27.584445 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.715616 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:27.715492 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:27.577811 23924 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:27.742449 23818 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:27.576543 25214 raft_consensus.cc:2955] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:27.745760 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.657387 25159 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.583055 25004 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.754463 25200 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:27.760501 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.771016 24560 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:27.779956 24524 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:27.743250 25164 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:27.583608 25183 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.741529 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.750265 25227 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:27.794066 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 260883us
I20260709 12:20:27.800071 24969 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:27.804865 24969 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:27.806664 24524 connection.cc:256] RPC call timeout handler was delayed by -2.0051984389999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260709 12:20:27.809478 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.791639 25235 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:27.807215 25162 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:27.814872 24969 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:27.814554 25162 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.806424 25234 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.819017 25215 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:27.819729 25215 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.820423 25162 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:27.818271 24524 connection.cc:256] RPC call timeout handler was delayed by -1.9790984389999267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260709 12:20:27.797101 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.823904 25215 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:27.796130 23997 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.828019 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.828799 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.829530 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.830436 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.830521 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.842556 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.797637 25161 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:20:27.843523 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.844295 24562 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:27.844468 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.845211 24556 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.807328 25128 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:27.846608 23924 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.847615 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.847869 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.847956 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.848610 24001 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.848784 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.842707 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.849625 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.846199 25128 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.850449 24001 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.855826 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.855919 23966 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:27.857143 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.860639 25113 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:27.864125 25113 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:27.864617 25113 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:27.849686 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.863462 24560 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:27.851725 24558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 297) took 1105 ms. Trace:
I20260709 12:20:27.873256 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.867691 24557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 327) took 2243 ms. Trace:
I20260709 12:20:27.869477 25128 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.861012 25184 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:27.870545 25240 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.871305 24525 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:27.871363 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.861968 25071 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.873226 24558 rpcz_store.cc:276] 0709 12:20:26.746762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.747773 (+  1011us) service_pool.cc:224] Handling call
0709 12:20:27.842554 (+1094781us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:27.851629 (+  9075us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374783872}
I20260709 12:20:27.884047 25072 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.875988 24557 rpcz_store.cc:276] 0709 12:20:25.624486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.657564 (+ 33078us) service_pool.cc:224] Handling call
0709 12:20:27.861913 (+2204349us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327eee 000000000036eb39 00007fa28c39b1e0 00007fa28c4640c4 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:27.862088 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.867305 (+  5217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.867337 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:27.867386 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:27.867421 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.867487 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.867614 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132886912}
I20260709 12:20:27.885951 25128 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:27.877764 25073 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.887233 25118 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.888100 25073 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.890571 24563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 324) took 2318 ms. Trace:
I20260709 12:20:27.892820 25240 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.894387 25093 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:27.895364 25108 raft_consensus.cc:993] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:27.896354 25093 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:27.896847 25108 raft_consensus.cc:1081] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:27.891021 24563 rpcz_store.cc:276] 0709 12:20:25.572551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.572720 (+   169us) service_pool.cc:224] Handling call
0709 12:20:26.987180 (+1414460us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:27.889169 (+901989us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327e9c 00007fa284327a5b 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:27.889370 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.889557 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.889592 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:27.889737 (+   145us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:27.889784 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.889856 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.890508 (+   652us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22589696}
I20260709 12:20:27.904186 25071 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:27.891557 25118 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:27.909871 25113 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:27.913462 25113 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:27.917150 25234 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:27.947824 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1089) took 3510 ms. Trace:
I20260709 12:20:27.948840 23846 rpcz_store.cc:276] 0709 12:20:24.436721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.436882 (+   161us) service_pool.cc:224] Handling call
0709 12:20:24.535816 (+ 98934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.141144 (+1605328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.946955 (+1805811us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54004295d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:27.947512 (+   557us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3643559296}
I20260709 12:20:27.952240 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:27.953039 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 1618) took 1052 ms. Trace:
I20260709 12:20:27.954073 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:27.955060 23749 catalog_manager.cc:5697] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:27.962270 23846 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:27.965270 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 947) took 2290 ms. Trace:
I20260709 12:20:27.852718 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.875007 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.973362 23926 rpcz_store.cc:276] 0709 12:20:25.674750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.677536 (+  2786us) service_pool.cc:224] Handling call
0709 12:20:25.711656 (+ 34120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.126681 (+415025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.126731 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.126787 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:26.126834 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.964507 (+1837673us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400105c54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:27.964607 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.964930 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953865600}
I20260709 12:20:27.977066 24003 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:27.980860 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.974831 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:27.980914 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:27.983122 24562 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.987777 24563 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:27.992409 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:27.995396 23924 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:27.991200 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.000753 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.000967 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:28.001857 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:27.973011 23845 rpcz_store.cc:276] 0709 12:20:26.900823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.913250 (+ 12427us) service_pool.cc:224] Handling call
0709 12:20:27.039917 (+126667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.305201 (+265284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.306701 (+  1500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:27.312384 (+  5683us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:27.316484 (+  4100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.952372 (+635888us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54002d50d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:27.952484 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.952842 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572304512}
I20260709 12:20:27.986377 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.008721 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:27.918205 25159 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:28.008324 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.007719 23747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59378 (request call id 136) took 5537 ms. Trace:
I20260709 12:20:28.012037 24563 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.013393 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.012053 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:28.014251 24559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 299) took 1266 ms (client timeout 1578 ms). Trace:
I20260709 12:20:28.015125 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:28.025085 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:28.025306 23895 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:28.027184 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.027673 24004 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:28.028316 23997 raft_consensus.cc:2410] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:20:28.016798 24559 rpcz_store.cc:269] 0709 12:20:26.747360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.753235 (+  5875us) service_pool.cc:224] Handling call
0709 12:20:27.995847 (+1242612us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:28.014128 (+ 18281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486608768}
I20260709 12:20:28.021811 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.033056 25198 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.034511 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.036337 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.033823 25198 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:28.029785 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.039062 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.022670 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.039680 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.040580 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.041646 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.037714 25198 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.044485 24525 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:28.037308 23996 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:28.056998 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 1623) took 1047 ms. Trace:
I20260709 12:20:28.071452 24563 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:28.055063 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.051993 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 1625) took 1015 ms. Trace:
I20260709 12:20:28.074937 25243 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.075394 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.075487 25243 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:28.076874 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.077201 25243 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.053571 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.080080 23854 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:28.081698 23847 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:28.073956 23849 rpcz_store.cc:276] 0709 12:20:27.036511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.036629 (+   118us) service_pool.cc:224] Handling call
0709 12:20:28.051517 (+1014888us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001f40d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:28.051761 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515748736}
I20260709 12:20:28.071220 23848 rpcz_store.cc:276] 0709 12:20:27.009313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.009437 (+   124us) service_pool.cc:224] Handling call
0709 12:20:28.055549 (+1046112us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:28.055924 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:28.056338 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:28.056375 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:28.056456 (+    81us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:28.056534 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.056613 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.056790 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7118720}
I20260709 12:20:28.088433 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.089571 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 957) took 1337 ms. Trace:
I20260709 12:20:28.090423 23927 rpcz_store.cc:276] 0709 12:20:26.741368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.742849 (+  1481us) service_pool.cc:224] Handling call
0709 12:20:26.913954 (+171105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:27.304511 (+390557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.076464 (+771953us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54000118d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:28.077444 (+   980us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640073600}
I20260709 12:20:28.011162 23747 rpcz_store.cc:276] 0709 12:20:22.434394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.434583 (+   189us) service_pool.cc:224] Handling call
0709 12:20:27.949838 (+5515255us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:23.018153 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:23.018745 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:23.018786 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:20:23.018803 (+    17us) tablet.cc:662] Decoding operations
0709 12:20:23.019136 (+   333us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:23.019192 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:23.019217 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:23.019404 (+   187us) tablet.cc:701] Row locks acquired
0709 12:20:23.019418 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:20:23.019544 (+   126us) write_op.cc:270] Start()
0709 12:20:23.019649 (+   105us) write_op.cc:276] Timestamp: P: 1783599623019503 usec, L: 0
0709 12:20:23.019669 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:20:23.020345 (+   676us) log.cc:844] Serialized 533 byte log entry
0709 12:20:23.899057 (+878712us) op_driver.cc:464] REPLICATION: finished
0709 12:20:25.003347 (+1104290us) write_op.cc:301] APPLY: starting
0709 12:20:25.013166 (+  9819us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:25.153359 (+140193us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:25.326820 (+173461us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:25.520185 (+193365us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:25.537113 (+ 16928us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:25.542477 (+  5364us) write_op.cc:312] APPLY: finished
0709 12:20:25.585197 (+ 42720us) log.cc:844] Serialized 23 byte log entry
0709 12:20:27.048286 (+1463089us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:27.054873 (+  6587us) write_op.cc:454] Released schema lock
0709 12:20:27.058480 (+  3607us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:27.137729 (+ 79249us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:27.137767 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":941292,"apply.run_cpu_time_us":64578,"apply.run_wall_time_us":2165101,"num_ops":1,"prepare.queue_time_us":436266,"prepare.run_cpu_time_us":9871,"prepare.run_wall_time_us":24342,"raft.queue_time_us":1178186,"raft.run_cpu_time_us":164174,"raft.run_wall_time_us":1873174,"replication_time_us":837476,"thread_start_us":2577563,"threads_started":5,"wal-append.queue_time_us":1128214,"wal-append.run_cpu_time_us":94386,"wal-append.run_wall_time_us":3095532}]]}
I20260709 12:20:28.092561 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.094813 23845 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:28.097381 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1068) took 2422 ms. Trace:
I20260709 12:20:28.099921 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:28.114780 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:28.064611 23751 catalog_manager.cc:5697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 2, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:28.102718 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.076937 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:28.107455 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:28.108358 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:28.110504 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.113569 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:28.097168 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.109396 23893 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:28.120008 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:28.120437 23851 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:28.085830 23995 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:28.125399 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.127149 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.128338 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.128693 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.128935 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:28.129243 23920 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:28.129828 24557 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:28.130187 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.130762 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:28.131341 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.131556 24554 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
W20260709 12:20:28.132232 24554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 295) took 1386 ms (client timeout 1635 ms). Trace:
I20260709 12:20:28.132380 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:28.132570 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:28.130863 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.132411 23928 raft_consensus.cc:2393] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:28.136394 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.128331 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:28.140007 24561 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:28.141569 23848 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:28.141772 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 1567) took 1047 ms. Trace:
I20260709 12:20:28.142251 23923 rpcz_store.cc:276] 0709 12:20:27.094975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.174954 (+ 79979us) service_pool.cc:224] Handling call
0709 12:20:28.130554 (+955600us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:28.141692 (+ 11138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7639424}
I20260709 12:20:28.142781 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.142822 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.143494 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.146376 24562 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.142041 25113 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.146948 25113 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:28.131569 25069 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:28.147408 25113 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.148904 24559 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:28.150032 23997 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:28.150395 25188 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:28.153422 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.154165 24558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36570
I20260709 12:20:28.154524 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 1630) took 1043 ms. Trace:
I20260709 12:20:28.154861 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:28.155189 23850 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.155108 23852 rpcz_store.cc:276] 0709 12:20:27.111080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.111204 (+   124us) service_pool.cc:224] Handling call
0709 12:20:28.152931 (+1041727us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:28.154435 (+  1504us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49574144}
I20260709 12:20:28.156047 25226 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.156548 25226 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:28.156970 25226 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:28.132750 24554 rpcz_store.cc:269] 0709 12:20:26.746112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.753075 (+  6963us) service_pool.cc:224] Handling call
0709 12:20:28.107060 (+1353985us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327eee 000000000036eb39 00007fa28c39b1e0 00007fa28c4640c4 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:28.132152 (+ 25092us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367325440}
I20260709 12:20:28.160261 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.154542 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.104441 24000 rpcz_store.cc:276] 0709 12:20:25.675171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.178065 (+502894us) service_pool.cc:224] Handling call
0709 12:20:26.203005 (+ 24940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.203373 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.203404 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.254493 (+ 51089us) log.cc:844] Serialized 26 byte log entry
0709 12:20:28.094791 (+1840298us) spinlock_profiling.cc:243] Waited 976 us on lock 0x7b1800092080. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec0d1
0709 12:20:28.095204 (+   413us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:28.095278 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.095383 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.095470 (+    87us) raft_consensus.cc:1685] finished
0709 12:20:28.095480 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.097160 (+  1680us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5200,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":5312,"spinlock_wait_cycles":2245888,"thread_start_us":875989,"threads_started":1,"wal-append.queue_time_us":888911}
I20260709 12:20:28.164234 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:28.165207 23849 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.168673 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.154982 24558 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:28.170181 24558 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.171097 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:28.162822 23926 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:28.049289 24003 raft_consensus.cc:2955] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:28.173528 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.154196 23893 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:28.139722 25146 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:28.176510 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.179333 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.179935 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.180001 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.182260 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.183696 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.186326 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:28.163033 23852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:20:28.187579 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.200117 23850 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:28.193562 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.206314 23854 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:28.206861 23925 raft_consensus.cc:2410] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:28.207765 23921 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:28.207922 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:28.209110 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.210062 23926 raft_consensus.cc:2410] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:28.211330 23853 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:28.172932 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.227118 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:28.226382 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:28.213016 23929 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:28.212571 25159 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:28.230295 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 1570) took 1052 ms. Trace:
I20260709 12:20:28.230752 23929 rpcz_store.cc:276] 0709 12:20:27.179671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.189790 (+ 10119us) service_pool.cc:224] Handling call
0709 12:20:28.172528 (+982738us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:28.230226 (+ 57698us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8386560}
I20260709 12:20:28.231978 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:28.233350 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:28.231487 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:28.223618 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:28.226672 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:28.234300 23929 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.235289 23820 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:28.236274 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:28.236579 23845 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:28.238355 23852 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:28.238729 25135 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.238868 23852 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.239234 25135 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:28.239730 25135 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.242609 25091 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:28.242925 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 94932.6us
I20260709 12:20:28.218717 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.187570 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.251814 23893 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:28.255235 23995 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:28.258067 23928 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:28.226188 23923 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:28.252058 25106 raft_consensus.cc:993] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:28.270846 23928 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:28.257241 25198 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:28.274046 25153 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:28.274616 25153 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:28.274971 25153 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.275879 23893 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:28.278610 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:28.257234 25226 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:28.264286 24558 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:28.285691 23849 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:28.286423 23926 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.287192 23846 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.291028 23929 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:28.293540 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.298159 23854 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.298602 23818 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:28.300040 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:20:28.289321 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 98204.8us
I20260709 12:20:28.298182 25198 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:28.303733 24525 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:28.304245 24978 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.304699 24978 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:28.305202 24978 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.305773 25242 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.306238 25242 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:28.306605 25242 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.303054 23845 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.301986 23848 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:28.268198 25243 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:28.282622 23922 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.331872 24952 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.504611 24952 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:28.370761 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:28.505697 24952 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.466423 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:28.427532 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.411211 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:28.293568 24558 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:28.500630 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.518608 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.516803 25226 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:28.345952 25106 raft_consensus.cc:1081] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 1 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:28.524116 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:28.526819 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 212806us
W20260709 12:20:28.528972 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 229044us
I20260709 12:20:28.529234 25164 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.529851 25164 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:28.530318 25164 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.530405 25188 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:28.531105 25188 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:28.439316 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:28.346244 23927 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
W20260709 12:20:28.536247 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 125195us
I20260709 12:20:28.400027 23852 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:28.546958 25097 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.553862 25097 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:28.554291 25097 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.554869 25243 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:28.557636 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.547955 24004 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:28.564517 23847 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:20:28.568486 25153 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:28.550379 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:28.575026 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 229287us
I20260709 12:20:28.575878 23854 raft_consensus.cc:2393] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:28.574983 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.575891 23818 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:28.580452 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.591831 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.593804 23895 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:28.597553 23846 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:28.601964 23848 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:28.591457 23850 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 3. Ops: []
I20260709 12:20:28.608748 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:28.610481 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 52878us
I20260709 12:20:28.611212 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:28.582587 25097 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:28.532323 25188 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:28.596377 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.645694 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:28.646481 25084 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:28.646834 25097 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:28.646999 25084 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:28.639597 25214 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:28.649641 25234 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.660458 24559 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.650992 25084 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.667446 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.668203 23817 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:28.669117 23895 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:28.662156 25234 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:28.671501 25069 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:28.649700 25113 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:28.675472 25234 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.676048 23852 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:28.680392 25214 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:28.698791 25113 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:28.697775 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:20:28.705051 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 52885.5us
I20260709 12:20:28.694649 23996 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.708004 23820 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:28.709208 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.712445 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:60702 (request call id 1644) took 1178 ms. Trace:
I20260709 12:20:28.715670 25106 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:28.676568 25198 consensus_queue.cc:1059] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:20:28.693069 25153 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:28.717626 25106 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:28.722929 25106 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.714671 23852 rpcz_store.cc:276] 0709 12:20:27.530883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.161605 (+630722us) service_pool.cc:224] Handling call
0709 12:20:28.708872 (+547267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:28.737255 23820 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:28.760567 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 165400us
W20260709 12:20:28.761065 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 187218us
W20260709 12:20:28.773818 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 256863us
I20260709 12:20:28.744047 25076 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:20:28.747164 25164 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:28.782502 25163 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:28.782800 23996 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.785568 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.787873 23820 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:28.788626 23966 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:28.779877 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.793323 23849 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:28.780956 25135 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.006s
I20260709 12:20:28.800715 25076 raft_consensus.cc:3055] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:28.802557 25226 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:28.801162 25076 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:20:28.891726 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 112968us
I20260709 12:20:28.893081 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:20:28.900027 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 104341us
I20260709 12:20:28.806866 25135 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:28.912488 23854 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.913384 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.917066 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:28.923448 23820 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:28.928416 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 135890us
I20260709 12:20:28.929972 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.930982 25091 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:28.931370 25091 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:28.920416 25214 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:28.933210 25091 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:28.934953 25091 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.934746 25076 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:28.936780 25076 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.939250 23853 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.941751 25164 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:28.942252 25139 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:28.952917 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 152727us
W20260709 12:20:28.928017 24978 consensus_meta.cc:287] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.005s
W20260709 12:20:28.967747 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 44372.9us
I20260709 12:20:28.973847 25106 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:28.976764 25106 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:28.956882 25258 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:20:28.979061 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:28.980465 25198 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:28.981575 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.982535 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:28.969821 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:28.959816 25226 raft_consensus.cc:697] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:28.988921 24952 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:28.992417 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:28.991580 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 233585us
W20260709 12:20:28.993598 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 229232us
W20260709 12:20:28.998665 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 72527.3us
W20260709 12:20:28.992491 25242 consensus_meta.cc:287] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.004s
I20260709 12:20:29.000522 25242 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.003295 25242 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:28.965382 24978 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.005599 24978 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:29.006109 24558 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:28.980494 25135 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:29.008443 25113 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:29.008724 25198 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.011072 25198 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:29.011658 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.012473 23927 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:29.012609 25236 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.012925 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:28.996841 25146 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:29.013000 25236 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:29.013726 25146 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:29.014233 25146 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:29.017004 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 234631us
I20260709 12:20:29.018319 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.018976 23820 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.021118 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:29.015472 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:29.025002 24952 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:29.029266 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.027608 23852 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:29.014708 25236 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:29.036160 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 49665.5us
I20260709 12:20:29.038546 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:29.024175 25163 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:29.039486 25265 consensus_queue.cc:1059] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:29.040011 25163 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:29.040503 25163 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.040941 25188 consensus_queue.cc:1059] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:29.042042 25188 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.042379 25188 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:29.043329 25188 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.044620 25262 consensus_queue.cc:1059] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:20:29.048516 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.048740 25226 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.049245 23924 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:29.049332 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.032013 25135 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:29.046125 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.054998 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.056313 23923 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:29.057452 25236 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.052965 25135 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:29.058583 25135 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.062786 25261 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:20:29.063941 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 74055.2us
I20260709 12:20:29.067580 25234 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.068241 23817 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.070046 25139 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:29.070186 25163 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.066141 23820 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.073675 24952 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.075558 25097 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:29.076973 25097 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:29.077348 25097 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.077064 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:29.077939 23923 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:29.078320 23923 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:29.079275 23923 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.080736 23923 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.085459 24952 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:29.071008 25198 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.090202 25198 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:29.091080 25097 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.092213 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:29.093264 25097 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:29.086047 24952 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:29.097213 24952 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:29.084396 25263 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.148s	user 0.004s	sys 0.004s
I20260709 12:20:29.088578 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.088920 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.089434 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.086632 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.107110 23923 raft_consensus.cc:2410] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:29.114867 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.115206 23924 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
W20260709 12:20:29.116083 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:29.116918 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.116842 25242 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:20:29.119112 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 119096us
W20260709 12:20:29.120223 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 71527us
I20260709 12:20:29.123173 25139 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.122789 25163 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:29.124279 23922 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:29.117298 24558 raft_consensus.cc:2955] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:29.126706 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.129783 25188 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.130185 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.138700 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.139453 23926 raft_consensus.cc:2393] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:20:29.140693 25264 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.220s	user 0.004s	sys 0.000s
I20260709 12:20:29.149322 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.113152 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:29.147343 23969 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:29.155213 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.157557 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.160363 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:29.163841 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.164783 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:29.165850 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 94529.9us
I20260709 12:20:29.166921 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.167125 24952 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.167717 23928 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:29.149232 25261 raft_consensus.cc:697] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:29.169238 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.171253 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.165786 25097 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:20:29.156950 25234 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:29.187141 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:29.190169 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:20:29.193022 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 127226us
W20260709 12:20:29.195096 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.149607 25084 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.202123 25273 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:29.206328 25273 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:29.206861 25273 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.210456 24952 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:29.214579 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.213131 25113 raft_consensus.cc:3055] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.217485 25113 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:29.217613 23922 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:20:29.218533 25113 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.219789 25113 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.215348 25084 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:29.220359 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:29.226423 23927 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:29.231770 24560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36570
I20260709 12:20:29.232306 24560 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:29.232615 24560 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.232926 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:29.233314 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:29.234128 23845 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:29.234586 25139 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:29.234406 25261 consensus_queue.cc:237] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.236037 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:29.236236 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:29.236616 23854 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.237370 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:29.242588 23849 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:29.245951 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:29.243609 24560 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.247370 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:29.248422 25198 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.249405 25267 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.250880 23996 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:29.251564 24560 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:29.249820 25267 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:29.252790 25267 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.238431 25163 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:29.253804 25163 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:29.254086 25267 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.254315 25163 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.252086 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:29.274185 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 75678.6us
I20260709 12:20:29.275497 23854 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:29.279667 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:29.281186 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:29.245285 25084 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:29.285043 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:29.295639 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:29.302055 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:29.275164 25135 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:29.311667 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.305284 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:29.313717 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:29.294723 25272 consensus_queue.cc:1059] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 12:20:29.312516 25274 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 12:20:29.320891 25278 consensus_queue.cc:1059] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:20:29.321529 23817 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.322603 25280 raft_consensus.cc:3055] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:29.323021 25280 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:29.323355 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:29.324088 25280 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.325443 25280 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:29.329648 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:29.297020 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 73772us
I20260709 12:20:29.337968 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:29.339419 25106 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.340510 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:29.303220 25084 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.343024 23895 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:29.352602 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 48044.4us
I20260709 12:20:29.303408 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:29.305406 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:29.300175 25164 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 12:20:29.369961 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 65804.1us
I20260709 12:20:29.342279 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:29.381687 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.341280 25273 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.385210 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.372563 25188 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:20:29.402685 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 155928us
W20260709 12:20:29.433046 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 51454.5us
I20260709 12:20:29.434010 23817 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.430920 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:29.436427 25214 raft_consensus.cc:3055] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.436884 25214 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:29.437621 25135 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:29.437901 25214 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.404690 24554 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:29.439572 25214 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.440316 25159 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:29.443727 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 50792.4us
I20260709 12:20:29.446712 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:29.449918 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.426007 25164 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.450730 25163 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.451192 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.451385 25262 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.451808 25262 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:29.452462 23892 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.452800 25262 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:29.431288 25269 log.cc:927] Time spent T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:20:29.454214 25163 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:29.400540 25234 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.440750 25159 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:29.404397 23995 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:29.398958 25146 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.471092 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.456305 25084 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:29.465560 25159 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.471371 25268 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.462700 25188 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:29.481325 24563 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:29.468838 25265 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:29.496812 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 52684us
I20260709 12:20:29.490545 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:29.491082 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 44472.7us
I20260709 12:20:29.495108 25291 consensus_queue.cc:1059] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:29.482826 25163 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.506309 23892 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.484730 25262 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.512388 23820 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.512612 25291 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.513412 25291 raft_consensus.cc:3055] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.513767 25288 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.514413 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.514528 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.515743 23817 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.513826 25291 raft_consensus.cc:740] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:20:29.517902 25277 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.134s	user 0.004s	sys 0.000s
I20260709 12:20:29.518173 25291 consensus_queue.cc:260] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.520052 25291 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.517163 25290 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.513438 23820 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.521848 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.523818 23820 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.524250 24952 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.523671 25164 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.526567 25163 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.523331 23969 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:29.529838 25198 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.523012 25226 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:29.534139 25226 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:29.534519 25226 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.530411 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:29.538414 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53175.3us
I20260709 12:20:29.539235 23892 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.539444 23817 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.540429 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.540755 25159 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.528316 25288 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:29.542078 25164 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.542659 25288 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.540609 23817 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.541558 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:29.531780 25273 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:29.546880 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.523902 25265 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.554064 24978 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.554595 23817 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.522673 25146 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:29.556536 24952 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.557309 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:29.521343 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:29.550076 25288 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.560223 24558 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.551548 25188 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:29.562834 25097 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.558187 25283 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:20:29.572392 23892 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.570187 25281 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:29.563930 25234 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:29.596108 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 49325.7us
I20260709 12:20:29.596650 23892 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:29.562945 25113 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:29.564561 25288 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:29.595472 23926 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:29.605060 25288 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:29.605561 24524 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.605940 25288 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.608851 25242 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.609006 25266 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.609582 25242 consensus_queue.cc:1059] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:29.610481 25242 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:29.610841 25242 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:29.611725 25242 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.612849 25242 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.614313 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:29.614480 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.614969 23924 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.609483 25265 consensus_queue.cc:1059] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:20:29.616247 25265 raft_consensus.cc:3055] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.616671 25265 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:29.617807 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:29.620568 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:29.621840 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:29.623029 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:29.623597 23922 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.624603 24978 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.627558 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:29.628736 25272 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.629621 25272 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:29.630086 25272 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:29.630551 25272 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.599978 25198 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.631949 23892 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.633186 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.635870 25153 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.634925 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.636256 23922 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:29.636996 23892 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.654392 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.713981 24978 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:29.714205 23846 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:29.714402 25282 raft_consensus.cc:3055] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.714776 25282 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:29.715158 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:29.639621 25265 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.654819 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:29.678287 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.653120 25272 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.650072 25159 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:29.717705 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.721333 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.667692 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.668009 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:29.687386 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 176773us
I20260709 12:20:29.739137 25265 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.740705 23818 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:29.663676 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.742033 23926 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:29.742216 25159 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.743983 25159 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:29.664588 25234 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.746255 25302 raft_consensus.cc:3055] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.746635 25302 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:29.747453 25302 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.748854 25302 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.749047 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:29.749621 23926 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.752475 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:29.756551 23926 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:29.756872 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:29.655035 25146 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:29.758085 25146 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.760254 25146 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:29.662590 23927 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:29.705169 25188 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.762744 25188 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.764566 24524 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.765250 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.766072 25214 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.766429 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.662923 23751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43178 (request call id 251) took 7214 ms. Trace:
I20260709 12:20:29.765425 25188 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:29.767551 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:29.774459 25214 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.666251 23747 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 2 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:29.709568 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.666965 23852 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:29.666257 23924 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:29.711768 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.779363 23747 catalog_manager.cc:5697] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 2 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:29.713480 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 76594.7us
I20260709 12:20:29.672260 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.667682 23749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43186 (request call id 242) took 7008 ms. Trace:
I20260709 12:20:29.665604 25226 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.672719 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.647846 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:29.648375 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:29.652501 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:29.663004 24558 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:29.735296 23846 raft_consensus.cc:3055] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.651072 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.638298 25153 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:20:29.735605 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:29.735723 23850 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.667994 24004 raft_consensus.cc:3055] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.639380 25236 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.766826 25146 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.738268 25272 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:29.803773 23928 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.765519 24524 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.802788 24004 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:29.786928 23892 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.781051 23747 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:29.809051 23747 catalog_manager.cc:5697] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:29.811738 23817 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:29.802762 23846 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:29.812903 24952 consensus_queue.cc:1059] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:29.812924 23817 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.815428 25135 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:29.815965 25135 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:29.816039 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:29.816933 25135 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.819224 24952 raft_consensus.cc:3055] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:29.819646 24952 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:29.767189 23751 rpcz_store.cc:276] 0709 12:20:22.449034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.449171 (+   137us) service_pool.cc:224] Handling call
0709 12:20:29.662834 (+7213663us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:28.791227 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:28.915766 (+124539us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:28.915799 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:20:28.915815 (+    16us) tablet.cc:662] Decoding operations
0709 12:20:28.916158 (+   343us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:28.916214 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:28.916243 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:28.916441 (+   198us) tablet.cc:701] Row locks acquired
0709 12:20:28.916461 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:20:28.916591 (+   130us) write_op.cc:270] Start()
0709 12:20:28.916718 (+   127us) write_op.cc:276] Timestamp: P: 1783599628916553 usec, L: 0
0709 12:20:28.916744 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:20:28.917386 (+   642us) log.cc:844] Serialized 538 byte log entry
0709 12:20:29.404086 (+486700us) op_driver.cc:464] REPLICATION: finished
0709 12:20:29.547545 (+143459us) write_op.cc:301] APPLY: starting
0709 12:20:29.547610 (+    65us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:29.547727 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:29.547829 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:29.548038 (+   209us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:29.548194 (+   156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:29.548241 (+    47us) write_op.cc:312] APPLY: finished
0709 12:20:29.548433 (+   192us) log.cc:844] Serialized 23 byte log entry
0709 12:20:29.548577 (+   144us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:29.548656 (+    79us) write_op.cc:454] Released schema lock
0709 12:20:29.548702 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:29.549022 (+   320us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:29.550849 (+  1827us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66547,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":118766,"apply.run_cpu_time_us":1445,"apply.run_wall_time_us":1445,"num_ops":1,"prepare.queue_time_us":619902,"prepare.run_cpu_time_us":2874,"prepare.run_wall_time_us":131588,"replication_time_us":484531,"spinlock_wait_cycles":61696,"thread_start_us":65037,"threads_started":1}]]}
I20260709 12:20:29.820408 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:20:29.821625 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 170621us
I20260709 12:20:29.826460 24952 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.808490 23925 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.831725 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:29.809906 25266 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.834738 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:29.838173 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 56341.5us
I20260709 12:20:29.810537 23845 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:29.810915 25084 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.812750 25242 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.809540 25188 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:29.830641 25267 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:29.911578 23854 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
W20260709 12:20:29.912223 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 81601.7us
W20260709 12:20:29.913455 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 148016us
I20260709 12:20:29.833788 23995 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:29.915877 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.920908 24004 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.918452 23846 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.928735 23846 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:29.923142 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 91034us
I20260709 12:20:29.926862 25278 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.935024 25153 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:29.935576 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.935550 25278 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.915336 25268 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.925916 25188 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.939947 25188 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:29.940745 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 91991.4us
I20260709 12:20:29.930254 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:29.949232 25084 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.953150 23928 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:29.955519 23925 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:29.958143 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.958390 24004 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:20:29.931780 25291 consensus_queue.cc:1175] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 12:20:29.932118 25267 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:29.963706 25262 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:29.964470 25267 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.803941 23749 rpcz_store.cc:276] 0709 12:20:22.659207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.659361 (+   154us) service_pool.cc:224] Handling call
0709 12:20:29.667607 (+7008246us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:28.288001 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:28.591708 (+303707us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:28.598245 (+  6537us) write_op.cc:435] Acquired schema lock
0709 12:20:28.600188 (+  1943us) tablet.cc:662] Decoding operations
0709 12:20:28.651935 (+ 51747us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:28.664313 (+ 12378us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:28.666983 (+  2670us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:28.701366 (+ 34383us) tablet.cc:701] Row locks acquired
0709 12:20:28.701807 (+   441us) write_op.cc:260] PREPARE: finished
0709 12:20:28.703400 (+  1593us) write_op.cc:270] Start()
0709 12:20:28.703557 (+   157us) write_op.cc:276] Timestamp: P: 1783599628703333 usec, L: 0
0709 12:20:28.703597 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:20:28.704416 (+   819us) log.cc:844] Serialized 595 byte log entry
0709 12:20:29.202072 (+497656us) op_driver.cc:464] REPLICATION: finished
0709 12:20:29.505531 (+303459us) write_op.cc:301] APPLY: starting
0709 12:20:29.509387 (+  3856us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:29.528711 (+ 19324us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:29.528861 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:29.545051 (+ 16190us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:29.545988 (+   937us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:29.546061 (+    73us) write_op.cc:312] APPLY: finished
0709 12:20:29.546368 (+   307us) log.cc:844] Serialized 23 byte log entry
0709 12:20:29.546600 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:29.546697 (+    97us) write_op.cc:454] Released schema lock
0709 12:20:29.546750 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:29.547166 (+   416us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:29.547199 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":331279,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":269518,"apply.run_cpu_time_us":2506,"apply.run_wall_time_us":65501,"num_ops":1,"prepare.queue_time_us":144299,"prepare.run_cpu_time_us":10431,"prepare.run_wall_time_us":525152,"raft.queue_time_us":281530,"raft.run_cpu_time_us":31723,"raft.run_wall_time_us":304518,"replication_time_us":498314,"thread_start_us":378271,"threads_started":4,"wal-append.queue_time_us":81755}]]}
I20260709 12:20:29.922065 25164 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:29.974063 23997 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:29.974092 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:29.974285 25164 raft_consensus.cc:697] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:29.974587 25226 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:29.975750 25278 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:29.975469 25164 consensus_queue.cc:237] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:29.976105 25234 consensus_queue.cc:1059] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:29.977412 24978 raft_consensus.cc:3055] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.976997 25282 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:29.977797 24978 raft_consensus.cc:740] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:29.978277 25282 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.979280 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.983605 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:29.992211 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:29.993090 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:29.993304 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.993731 25283 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:29.994028 23849 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:29.994804 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.998378 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:29.986199 25242 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:30.006191 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 76063.5us
I20260709 12:20:29.994277 25283 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:30.011066 23852 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.011475 24524 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:30.012250 25280 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:29.979012 24978 consensus_queue.cc:260] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.012658 25280 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:30.013072 25280 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.013623 24978 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.999992 25278 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.016242 25283 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.019021 23820 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.020661 24952 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:30.030987 23846 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:30.034665 25302 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.035254 23998 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.046396 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:30.066156 25198 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.066651 25198 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:30.067649 25198 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.069146 25198 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.043094 25302 raft_consensus.cc:697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:30.043555 25163 consensus_queue.cc:1059] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 12:20:30.085399 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 58951.5us
I20260709 12:20:30.044034 25234 consensus_queue.cc:1059] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:20:30.074316 25301 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:30.092941 25301 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:30.093443 25301 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.074999 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:30.087339 25306 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:20:30.074013 25291 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:30.088290 25135 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:30.102938 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:30.110548 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 96818.7us
I20260709 12:20:30.083776 25280 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.117753 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:30.127755 25278 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:30.128274 25278 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:30.128449 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.129197 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.129837 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.130395 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:30.131008 23928 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:30.130283 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.128680 25278 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.130573 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.132941 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:30.116212 25084 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:30.132969 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:30.135155 23923 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.134033 23854 raft_consensus.cc:1240] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.135772 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.136145 23892 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:30.139537 23892 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:30.145380 23922 raft_consensus.cc:2410] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:30.145780 25146 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.111856 25135 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.147976 25135 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:30.149991 23927 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:30.108940 25291 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.157300 25139 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:30.157744 25139 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:30.147957 25317 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.159325 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.161460 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:30.161620 25226 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:30.162511 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:30.162576 25113 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:30.163586 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:30.164461 23851 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.158684 25139 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.168044 23923 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:30.132244 25265 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:30.133867 24978 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:30.168538 25280 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:30.174714 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.137900 25266 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.178637 23892 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:30.148924 23850 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:20:30.120817 25302 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.172704 25146 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.209151 23929 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:30.210881 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.195983 25084 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:30.173928 25226 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:30.225852 25226 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:30.202490 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 52729.3us
I20260709 12:20:30.214308 25139 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:30.216724 25188 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:30.220773 23845 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
W20260709 12:20:30.222080 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.234856 25280 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:30.224879 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 63508.9us
I20260709 12:20:30.236714 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.237159 25226 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.237615 25113 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.238647 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:30.239540 25113 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:30.242573 25113 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:30.243062 25113 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:30.232806 25263 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:20:30.246449 24000 raft_consensus.cc:1240] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:30.247084 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:30.241391 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 66778.1us
I20260709 12:20:30.248207 24524 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.201217 25318 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:30.251543 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:30.255426 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.221993 25084 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:30.260525 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:30.260630 25146 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:30.262850 25319 log.cc:927] Time spent T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.135s	user 0.003s	sys 0.000s
I20260709 12:20:30.263928 24524 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.209982 25265 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.272959 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:30.305083 25280 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:30.264470 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 85910.6us
I20260709 12:20:30.307422 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:30.309007 25326 consensus_queue.cc:1059] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:30.310340 25318 raft_consensus.cc:3055] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.310778 25318 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:30.311782 25318 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.312743 25226 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:30.314647 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.315018 23892 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:30.315311 25325 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:30.316366 25325 raft_consensus.cc:3055] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.316424 25321 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:30.316792 25325 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:30.317044 25321 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:30.317991 25321 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.317679 25325 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.319692 25325 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.280371 25084 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.283270 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:20:30.278554 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 111576us
I20260709 12:20:30.264487 25310 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.283421 25113 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.322182 25310 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:30.323110 25310 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.323814 25113 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:30.285439 25317 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.208542 24978 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.324847 25262 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:30.325259 25262 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:30.325608 25262 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:30.325659 24558 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.326125 24978 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:30.290601 25266 consensus_queue.cc:1059] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:30.329048 25266 consensus_queue.cc:1243] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:30.329564 25266 raft_consensus.cc:3055] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.329891 25266 raft_consensus.cc:740] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:30.330724 25266 consensus_queue.cc:260] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.331920 25266 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.332034 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:30.292630 25265 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:30.293708 25267 consensus_queue.cc:1059] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:30.294023 25296 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:30.295909 23928 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:30.296381 25291 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:30.297087 25283 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.297992 25146 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.299186 23997 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:30.289582 24004 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:30.350464 24001 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:30.350944 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 973) took 1078 ms. Trace:
I20260709 12:20:30.351495 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:20:30.351779 25287 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:20:30.352303 24001 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:30.302013 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:30.354219 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 52285us
I20260709 12:20:30.355379 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:30.283576 25272 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:30.356076 25280 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.337669 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:30.356607 25272 raft_consensus.cc:3055] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.357110 24002 raft_consensus.cc:2393] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:30.343081 25106 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:30.351284 24004 rpcz_store.cc:276] 0709 12:20:29.272350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.272515 (+   165us) service_pool.cc:224] Handling call
0709 12:20:29.667881 (+395366us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54001de320. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873c3dc0 00007fa28744fe18 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6
0709 12:20:30.350862 (+682981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717927680}
I20260709 12:20:30.357671 25106 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.358378 25287 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.345676 25296 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:30.359630 25296 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.360003 25106 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:30.349579 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:30.357033 25272 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:30.358848 25287 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.355445 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.376358 23854 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:30.376529 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:30.376940 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.377130 24002 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.319869 25318 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.365317 23847 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.343441 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:30.372439 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:30.373555 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.310079 23924 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:30.375273 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:30.379107 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:30.379413 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:30.380185 24003 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:30.382794 23847 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.382963 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:30.383121 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.385833 23925 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.381758 23850 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.388907 25262 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.370796 25310 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.314441 25301 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.394440 23895 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:30.395861 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:30.397845 23846 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.398130 24002 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
W20260709 12:20:30.445384 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44397.7us
I20260709 12:20:30.390765 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:30.375182 25291 raft_consensus.cc:3055] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:20:30.447353 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 64297.7us
I20260709 12:20:30.451769 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.445097 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:30.381865 25280 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:30.451978 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 57629.2us
I20260709 12:20:30.450747 23927 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.454914 25326 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:30.456103 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.456509 25287 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:30.460464 23850 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:30.375607 25267 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:20:30.469108 23928 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.446223 23995 raft_consensus.cc:1240] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:30.475417 23998 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.451171 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:30.390908 25135 consensus_queue.cc:1059] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:20:30.452265 25291 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:30.453069 25242 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.483357 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.484450 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.473923 25164 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:30.491489 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:30.454243 25278 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.487736 25146 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.493700 25113 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.500862 23922 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.515130 23928 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.534299 23851 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:30.495476 25164 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.543056 23922 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.543332 25278 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:30.545364 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53960.7us
I20260709 12:20:30.546542 23966 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:30.501595 25284 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:30.548833 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.508034 25301 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:30.509981 25324 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.553274 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:30.510620 25262 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:30.511936 25242 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:20:30.557920 24952 raft_consensus.cc:3055] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:20:30.333949 25234 consensus_queue.cc:1175] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "22996f888daf435398b693481171c18c" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:30.558686 24952 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:30.550753 25226 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.550961 25113 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.540475 25302 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:20:30.568589 23852 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.553853 25287 consensus_queue.cc:1059] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 12:20:30.569902 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.571724 23929 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.510376 25291 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:30.583936 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 132245us
I20260709 12:20:30.573698 25272 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.591670 25287 raft_consensus.cc:3055] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.593336 25272 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.593641 25287 raft_consensus.cc:740] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:30.594667 25287 consensus_queue.cc:260] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.594944 25084 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.595120 24952 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.595980 25287 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.596446 24952 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:30.587832 25163 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:30.593591 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.588546 25106 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:30.599393 25242 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.585577 25226 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.585594 25283 consensus_queue.cc:1059] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:20:30.600368 25291 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.600638 25283 raft_consensus.cc:3055] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.601027 25283 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:30.601909 25283 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:30.583863 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 130593us
I20260709 12:20:30.603210 25283 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.602824 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:30.607088 25278 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.607645 25278 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:30.607707 25084 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:30.589968 25262 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:30.608737 25278 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.620448 24002 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:30.623330 23925 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:30.627532 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:30.628794 23966 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:30.632189 25163 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:30.591679 25146 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:30.592217 25164 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:30.633126 25146 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:20:30.635251 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.631413 25330 consensus_queue.cc:1059] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:20:30.617457 25301 consensus_queue.cc:1059] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:20:30.639828 25106 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:20:30.640503 25084 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:30.641070 23997 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.644433 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:30.649623 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:30.666704 23926 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:30.650666 23923 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.655464 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:20:30.661473 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.670331 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:30.670449 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:30.626744 25226 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:30.723985 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:30.724730 23851 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:30.724032 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:30.726239 24004 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.663501 25280 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:30.728076 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 83751.9us
I20260709 12:20:30.733572 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:30.664374 25284 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.634287 25282 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:20:30.719451 25326 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:30.726621 25321 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:20:30.744441 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 79549.9us
I20260709 12:20:30.727349 25324 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.731909 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:30.727604 25331 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.665793 25262 consensus_queue.cc:1059] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:20:30.727021 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:30.727201 25135 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:30.736680 25242 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.755069 24004 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:30.757500 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.757781 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.764107 25331 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:30.751269 25335 raft_consensus.cc:3055] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.749873 25280 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:30.777998 25284 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:30.777359 25335 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:30.779104 25284 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.782786 25335 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.740823 25146 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.784334 25335 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.785055 24554 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.761910 25324 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.786263 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:30.787418 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:30.767468 25135 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.750633 25321 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.789987 23995 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.790488 23995 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:30.791410 25135 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:30.779778 25296 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.792654 25272 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.792742 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:30.793001 24561 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:30.793517 24562 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.793972 25296 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:30.794322 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:30.795047 24562 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:30.794952 25331 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.795545 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:30.794207 23996 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.775025 25242 raft_consensus.cc:697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:30.797317 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:30.798041 24004 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:30.797715 25242 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.790488 25324 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:30.799436 25226 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.804430 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.782917 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:30.805661 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.813431 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:30.776124 23922 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 2: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:30.791612 25321 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:30.784399 25146 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:30.807931 24554 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 12:20:30.843118 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.814033 25324 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.836243 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.848398 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:30.813076 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 53029.3us
I20260709 12:20:30.852129 23926 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:30.852385 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.853215 25332 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:30.842820 24554 pending_rounds.cc:85] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 4
W20260709 12:20:30.858016 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 100318us
I20260709 12:20:30.814304 25280 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.845218 25282 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.853564 23846 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:30.866710 25084 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:30.851699 25291 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:30.877305 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:30.880270 25333 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.074s	user 0.003s	sys 0.000s
W20260709 12:20:30.881711 25334 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:20:30.791433 23995 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.893034 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.883080 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:30.891465 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:30.868542 24554 pending_rounds.cc:107] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:20:30.905215 23820 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:30.906677 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:30.870613 25278 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:30.846844 25324 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:30.894568 23893 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:30.913916 23893 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:30.910570 24554 raft_consensus.cc:2889] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:30.893635 25262 consensus_queue.cc:1243] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer 22996f888daf435398b693481171c18c log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:30.916472 25302 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:20:30.916718 25139 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.910949 25135 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.876199 25282 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.928227 23845 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:30.892036 25283 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.929647 25321 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:30.932098 25321 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.932443 25321 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:30.934898 24558 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.918020 25266 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:30.939041 25282 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:30.982180 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 75589.9us
I20260709 12:20:30.983304 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:30.984758 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 53279.3us
W20260709 12:20:30.996430 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.904644 25291 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:30.930869 25278 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:30.985982 25272 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:30.904381 25332 consensus_queue.cc:1059] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:20:30.947705 25350 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:30.999774 25283 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:31.012604 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:31.013172 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.015323 25291 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.018349 24524 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:31.019624 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:31.019867 25280 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.021278 25324 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.022899 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:31.025053 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:31.029690 25113 raft_consensus.cc:3055] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:31.030146 25113 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:31.007057 23995 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.003140 23922 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:31.066234 23921 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:31.090164 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.031024 25113 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.066135 25349 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:31.025863 23854 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:31.144393 25291 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:31.156946 23996 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:31.150012 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.158069 25349 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:31.088533 25326 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.156540 25291 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.159346 25326 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.160769 25291 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.163165 23892 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:31.163690 23997 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:31.164234 25234 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:31.164659 25234 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.149158 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.165732 23854 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:31.159229 25349 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.161602 25326 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.165022 25234 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:31.173698 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:31.173584 25310 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:20:31.166849 25350 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:31.183223 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 116942us
I20260709 12:20:31.092095 25278 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:31.180054 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 161773us
I20260709 12:20:31.141795 25331 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.180509 24952 consensus_queue.cc:1059] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:31.182237 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 85351.9us
I20260709 12:20:31.171244 25291 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.179854 24002 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.141849 25272 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 12:20:31.186792 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.196105 23817 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:31.026567 25084 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.189092 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.184022 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:31.185361 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:31.218931 25353 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:20:31.195977 25331 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.181846 25135 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:20:31.225023 24002 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:31.227129 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:31.184805 25139 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:20:31.239436 25331 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.233227 25282 consensus_queue.cc:1059] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:20:31.241423 23925 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:31.186257 25321 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.243405 23998 raft_consensus.cc:3055] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:31.243894 23998 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:31.244961 25321 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.244897 23998 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.215974 25113 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.187842 25350 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.198225 25291 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.202737 25348 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:20:31.270597 25272 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:31.262030 25284 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.262869 25164 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:31.263053 25135 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:31.249011 25335 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:31.235320 23997 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:31.266549 23854 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:31.287917 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:31.208863 25356 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:31.288769 23851 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:31.289251 25356 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.271075 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:31.261737 23998 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.291491 24003 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:31.292541 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88692.8us
W20260709 12:20:31.284787 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:31.293984 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 105476us
I20260709 12:20:31.298183 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.298352 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.299263 23921 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
W20260709 12:20:31.293990 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 97996.4us
I20260709 12:20:31.301846 23928 raft_consensus.cc:1240] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:31.305529 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:31.292483 25284 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.291445 25164 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:31.296036 25330 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.308311 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:31.265478 25318 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:20:31.272347 25283 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:20:31.316840 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:31.313410 25284 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.325608 23820 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:31.294278 25272 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.319216 25324 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.318506 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:31.332949 25339 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:20:31.333290 25350 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:31.313990 25309 consensus_queue.cc:1059] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:20:31.319504 25262 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:31.319814 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:31.334677 24003 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:31.323211 23996 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:31.336620 25324 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.390233 25324 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:31.386385 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 86029.6us
I20260709 12:20:31.374334 25164 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.387533 25280 raft_consensus.cc:3055] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:31.394976 23893 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:31.395123 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 69574.1us
W20260709 12:20:31.399817 25336 log.cc:927] Time spent T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.631s	user 0.000s	sys 0.007s
I20260709 12:20:31.405145 25310 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:31.408627 24952 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:31.333673 25338 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:20:31.412930 25262 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.414654 24563 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.401173 25287 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.415515 25198 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:31.321054 25330 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.423964 25356 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.406409 25280 raft_consensus.cc:740] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:31.400975 25282 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:20:31.432106 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.405921 25266 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:31.452421 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60857.7us
I20260709 12:20:31.456411 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.458810 25363 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.459559 25363 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.403295 24525 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:31.464815 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:31.467015 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:31.477636 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 160825us
I20260709 12:20:31.504125 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:31.505074 23851 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:31.420821 25310 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.445724 25198 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:31.430511 25332 consensus_queue.cc:1059] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:20:31.430727 25262 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.511027 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:31.433249 25287 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.517212 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:31.502951 25317 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.461980 25266 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.509346 25349 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:31.524835 25340 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:31.510200 25291 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.524195 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:31.532423 24563 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:20:31.523039 25364 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:20:31.539400 25272 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.539659 25287 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:31.513545 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 177251us
I20260709 12:20:31.545032 25266 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.545579 25262 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:31.546995 25310 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.547492 23921 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:31.548174 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.521230 25309 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:31.554883 25340 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:31.566058 25309 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.566969 24563 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:31.567409 25340 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.568238 25309 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.551049 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.554883 24525 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:31.568394 25330 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.554773 25234 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.556852 25113 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:31.564560 24003 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:31.520216 25324 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.547973 25284 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.571750 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:31.538318 25363 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:31.571774 25356 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:31.554772 25374 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.575443 25106 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:31.582808 23893 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:31.605698 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.587280 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.531203 25317 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:31.597393 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.590293 24002 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:31.584024 25288 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.589326 24000 raft_consensus.cc:1240] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:31.601972 25242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.019s	sys 0.018s
I20260709 12:20:31.606989 25318 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.604271 25374 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.618918 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:31.619321 25362 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:20:31.612677 25356 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:31.604276 24558 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:31.605610 25106 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:31.618458 25318 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.628232 25318 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.628574 25106 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.629462 25324 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.623334 25374 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.630184 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:20:31.616118 25242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.019s	sys 0.019s
I20260709 12:20:31.587668 25198 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.630786 24004 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.629765 25106 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.640919 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:31.644661 25356 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.650422 24004 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:31.615300 25288 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.651515 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:31.641173 25234 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.654536 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:31.655821 25372 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.656318 25372 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.643287 25309 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.659441 25321 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.659741 25317 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.660001 25321 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.654740 25324 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:31.664901 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.665391 25321 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.670181 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.670868 23924 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:31.676867 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:31.686333 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.687425 23997 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:31.690313 25367 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:20:31.643002 24525 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:31.692551 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:31.683249 25135 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:31.665429 25324 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:31.664222 25309 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:31.706554 25377 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:20:31.699147 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:31.663376 25372 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.701211 25234 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.712858 25324 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.716913 25288 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.718703 24560 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:31.707000 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:31.721700 25366 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.703857 25284 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:31.721347 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.736699 23922 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
W20260709 12:20:31.725829 23995 consensus_meta.cc:287] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.003s
I20260709 12:20:31.731848 25234 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.742923 25234 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.748793 23895 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:31.748744 25366 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.750114 24978 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:31.751200 25366 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.753242 23995 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:31.701253 25318 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:31.741806 25371 log.cc:927] Time spent T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.230s	user 0.004s	sys 0.000s
I20260709 12:20:31.734419 23998 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:31.742159 25309 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.752051 25164 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.774901 24978 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.775414 24978 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.776933 24978 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:31.727985 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 89360.6us
W20260709 12:20:31.773350 25301 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:20:31.787475 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.788511 23997 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:31.791205 25342 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:31.791752 25342 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:31.778373 25284 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:31.793192 25284 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.773008 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1009) took 1236 ms. Trace:
I20260709 12:20:31.794853 23995 rpcz_store.cc:276] 0709 12:20:30.534190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.536290 (+  2100us) service_pool.cc:224] Handling call
0709 12:20:30.552640 (+ 16350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:30.789849 (+237209us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b540015cd20. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873c3dc0 00007fa28744e1c0 00007fa28744f231 00007fa28744bd8f 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c
0709 12:20:30.941287 (+151438us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b58000101d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873a80aa 00007fa28742a447 00007fa287442fe7 00007fa2874447de 00007fa28744eb49 00007fa28744f416 00007fa28744bd8f 00007fa28744b83e 00007fa28c410419 00007fa285987bd4
0709 12:20:31.753666 (+812379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.770219 (+ 16553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213636224}
I20260709 12:20:31.797500 25234 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.799880 25234 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.801616 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:31.801868 25318 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.802759 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:31.803376 24559 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.803989 25344 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:31.804509 25344 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.785522 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.803030 23893 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:31.814788 23925 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:31.817291 23817 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:31.818614 25163 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.818783 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:31.819628 23997 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.819411 25163 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.792917 25342 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.824542 25382 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:31.824807 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:31.825470 23995 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.826551 25163 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.831576 25374 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.832489 25198 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.833001 25198 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:31.834769 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.807606 25344 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:31.821673 25318 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.839638 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.846078 23846 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:31.818697 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:31.835650 25342 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.849700 25344 consensus_queue.cc:1059] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:31.851204 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:31.835469 25291 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.844839 25318 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.861088 23850 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:31.864094 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:31.864724 24561 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:31.852372 23845 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:31.853197 23925 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:31.863665 25318 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.867139 25242 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:20:31.872895 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:31.855820 25291 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.880813 23820 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:31.873916 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:31.882266 25347 raft_consensus.cc:3055] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:31.862924 25349 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:31.882642 25347 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:31.863952 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:31.884074 24558 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:31.863757 25284 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:31.876960 24559 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:31.859958 25382 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:31.887073 25369 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.439s	user 0.005s	sys 0.000s
I20260709 12:20:31.887288 25198 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.887080 25267 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.887529 25163 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.889109 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.862875 24562 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:31.891371 24560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 257) took 1113 ms. Trace:
W20260709 12:20:31.870469 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 60396.8us
I20260709 12:20:31.885702 25291 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.915385 24002 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:31.908314 23852 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:31.913617 25242 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:20:31.920102 25374 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:31.920027 23893 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:31.920567 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.915719 24560 rpcz_store.cc:276] 0709 12:20:30.777992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.778154 (+   162us) service_pool.cc:224] Handling call
0709 12:20:30.806750 (+ 28596us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:30.807028 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.733979 (+926951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:31.891145 (+157166us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54004e3754. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:31.891293 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2100861184}
I20260709 12:20:31.916587 24978 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.927165 23820 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:31.927069 24978 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.918130 25163 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.928382 25163 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.928464 25198 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:31.928959 25198 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.918280 25317 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:31.930136 25317 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.930967 25198 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.932035 25317 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.895114 23995 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:31.915177 25366 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.933749 25280 consensus_queue.cc:260] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.935238 25280 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.936149 24978 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:31.937588 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:31.882905 25318 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.941892 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:31.942714 25317 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:31.942922 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.943378 25310 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.943276 25317 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.943830 25310 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.944010 23995 raft_consensus.cc:2393] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:31.903671 25326 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.934768 25366 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.946067 24978 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:31.946657 24978 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:31.914158 25267 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.947635 24978 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:31.939044 25382 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:31.944303 25164 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:31.954159 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.954334 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.945590 25310 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.955082 23927 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:31.954123 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.955076 23920 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:31.956224 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:31.956722 23920 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.956897 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.957064 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.957530 23927 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:31.939334 24525 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:31.958459 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:31.959574 23927 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.959915 23854 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:31.949716 25267 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:31.962316 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:31.965210 23928 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:31.954697 25164 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:31.966295 23928 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:20:31.953191 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:31.949292 25326 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:31.974176 23998 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
W20260709 12:20:31.975920 25390 log.cc:927] Time spent T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:20:31.976101 25326 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:31.977113 25360 raft_consensus.cc:3055] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:31.968680 23928 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:31.969626 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:31.978740 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:31.979786 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:31.970505 25389 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:20:31.981160 23920 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:31.971344 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:31.977578 25360 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:31.978544 23997 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:31.967024 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:32.276618 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:32.017442 23925 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:32.278265 23927 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:31.966703 25164 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.279513 23928 raft_consensus.cc:1240] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:32.280324 24978 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.277920 25282 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:31.966933 25349 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:32.288126 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:32.288591 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.292522 23926 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 2: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:32.300076 24978 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.308965 24563 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
W20260709 12:20:32.306711 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 335419us
I20260709 12:20:32.306753 25278 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:32.301608 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 1692) took 1027 ms. Trace:
I20260709 12:20:32.290673 25374 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:32.286186 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:32.317386 25139 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.287132 25266 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:32.322790 23920 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:32.298260 25284 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:32.279295 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:32.330894 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:32.303256 25282 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:32.341708 24978 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:32.319912 25321 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.349411 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:32.327467 25374 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.344847 25266 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.352638 25360 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.345327 25349 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:20:32.345126 25317 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:32.323587 25324 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:32.338723 25284 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.320192 25356 consensus_queue.cc:1059] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:20:32.313546 23852 rpcz_store.cc:276] 0709 12:20:31.271762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.292159 (+ 20397us) service_pool.cc:224] Handling call
0709 12:20:32.027723 (+735564us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54001e46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:32.298796 (+271073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121469696}
I20260709 12:20:32.323202 25242 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:20:32.325965 25302 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:20:32.357254 25282 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:32.366328 25374 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.384811 23749 catalog_manager.cc:5697] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 2, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:32.366627 23922 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:32.390678 23747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59378 (request call id 137) took 3212 ms. Trace:
I20260709 12:20:32.378237 25284 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.371951 25324 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.343168 25139 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.410104 23747 rpcz_store.cc:276] 0709 12:20:29.170814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.174024 (+  3210us) service_pool.cc:224] Handling call
0709 12:20:29.222605 (+ 48581us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5400002490. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284328640 00007fa28d1ff846 00007fa28d30990e 00007fa28b7ca2a4 00007fa28b7ca232 00007fa28b7ca161 00007fa28b7ca0dc 00007fa28b7c9392 00007fa28578748c 00007fa2857868c6
0709 12:20:32.383380 (+3160775us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:30.098073 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:30.166112 (+ 68039us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:30.166149 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:20:30.166171 (+    22us) tablet.cc:662] Decoding operations
0709 12:20:30.166831 (+   660us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:30.166908 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:30.166935 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:20:30.167346 (+   411us) tablet.cc:701] Row locks acquired
0709 12:20:30.167364 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:20:30.167498 (+   134us) write_op.cc:270] Start()
0709 12:20:30.167607 (+   109us) write_op.cc:276] Timestamp: P: 1783599630167460 usec, L: 0
0709 12:20:30.167628 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:20:30.168265 (+   637us) log.cc:844] Serialized 1798 byte log entry
0709 12:20:30.498136 (+329871us) op_driver.cc:464] REPLICATION: finished
0709 12:20:30.670013 (+171877us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa2843420ac 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa28ae82ef0
0709 12:20:30.995590 (+325577us) write_op.cc:301] APPLY: starting
0709 12:20:30.995713 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:30.995882 (+   169us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:30.995903 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:31.006332 (+ 10429us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:31.006514 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:20:31.006566 (+    52us) write_op.cc:312] APPLY: finished
0709 12:20:31.016084 (+  9518us) log.cc:844] Serialized 41 byte log entry
0709 12:20:31.016303 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:31.016415 (+   112us) write_op.cc:454] Released schema lock
0709 12:20:31.016461 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:31.016836 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:31.016865 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8518,"reported_tablets":7,"spinlock_wait_cycles":6072576,"child_traces":[["op",{"apply.queue_time_us":470457,"apply.run_cpu_time_us":2972,"apply.run_wall_time_us":30472,"num_ops":4,"prepare.queue_time_us":255073,"prepare.run_cpu_time_us":3519,"prepare.run_wall_time_us":77536,"replication_time_us":323225,"spinlock_wait_cycles":3349248,"thread_start_us":563573,"threads_started":2}]]}
I20260709 12:20:32.387938 25356 consensus_queue.cc:1243] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:32.389263 25360 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:32.426538 24978 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.433787 24978 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.393481 25366 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:32.362323 25321 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.408671 25335 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:32.399951 25318 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:32.458688 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:32.459479 23920 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
W20260709 12:20:32.460846 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.417618 25340 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:32.445298 25356 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:32.482746 24563 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:32.483565 23817 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:32.474960 25335 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:32.484678 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:32.426926 25339 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:20:32.495123 24560 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:32.495682 24560 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:20:32.497243 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 142408us
I20260709 12:20:32.505754 23920 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:32.496592 24560 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.507890 24560 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:32.499799 25310 consensus_meta.cc:287] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.004s
I20260709 12:20:32.482255 25356 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:20:32.496037 25280 consensus_meta.cc:287] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.560s	user 0.014s	sys 0.003s
W20260709 12:20:32.500381 25267 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.536s	user 0.014s	sys 0.000s
I20260709 12:20:32.490994 25340 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:20:32.506191 25163 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.574s	user 0.014s	sys 0.001s
W20260709 12:20:32.505649 25291 consensus_meta.cc:287] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.003s
I20260709 12:20:32.511490 25309 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:32.494747 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:32.559736 24556 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:32.560045 25266 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:32.560818 25344 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.504499 25198 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:20:32.546525 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:32.504745 25242 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:32.502983 25342 consensus_meta.cc:287] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.010s
I20260709 12:20:32.563035 23895 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:32.541783 25347 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.565793 25344 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:32.568948 25398 log.cc:927] Time spent T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:20:32.569460 25397 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:20:32.555122 25309 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:32.518702 25310 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.579856 24560 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:20:32.594483 24560 pending_rounds.cc:85] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 4
I20260709 12:20:32.594841 24560 pending_rounds.cc:107] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:20:32.595127 24560 raft_consensus.cc:2889] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:32.582778 23920 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:20:32.590044 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 105423us
I20260709 12:20:32.532495 25267 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:32.578503 25401 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.207s	user 0.001s	sys 0.001s
I20260709 12:20:32.569933 25404 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:32.555493 25291 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.584952 25266 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:32.607095 24978 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:32.554067 25163 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.609835 23923 raft_consensus.cc:2368] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
I20260709 12:20:32.579221 25407 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:32.627727 25407 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.622241 25266 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.551710 25335 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.569267 25356 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.636742 24978 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:32.638936 25366 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.584451 25324 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:32.529083 25349 consensus_queue.cc:1243] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:32.610706 25347 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:32.585018 25242 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.606129 25403 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:32.625182 25348 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.636479 25266 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:32.653182 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.628158 25407 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.610074 25413 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.633859 25302 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:32.656687 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:32.625845 25404 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.697443 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.698169 23851 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:32.661677 25356 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.610352 25340 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.677923 25349 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:32.709528 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:32.683717 25302 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.691972 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.652427 25366 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.730140 25321 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:32.731936 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.696480 25324 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:32.742475 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.712595 25339 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:32.710500 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:32.658901 25403 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.656590 25309 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.725793 25302 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.688119 25348 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.765818 23847 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:32.769239 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.727483 25296 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:32.774718 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 461208us
I20260709 12:20:32.788439 23851 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 2: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:32.786597 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:32.789207 23926 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:32.688869 25413 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.796240 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.770117 25406 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.797137 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.787950 23852 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:32.803515 23849 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:32.793215 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:32.801524 23853 raft_consensus.cc:2410] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:32.762178 25139 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:32.798758 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.736850 25349 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.806934 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.842981 23848 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:32.774901 25301 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.847304 23851 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:32.792655 25415 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:32.861495 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 72967.6us
I20260709 12:20:32.793738 25412 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:32.870085 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:32.801538 25310 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:32.871311 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:32.871563 24000 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.871903 23848 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:20:32.881023 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 89586.2us
I20260709 12:20:32.883522 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:32.884268 24002 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:32.807497 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:32.891301 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.774834 25324 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.807669 25344 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:32.791617 25296 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.898546 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:32.866979 25139 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.902236 24003 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:32.905236 24002 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:32.770586 25339 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:32.861657 25291 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:32.878814 25309 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:32.916865 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 136235us
I20260709 12:20:32.917678 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.922951 24001 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:32.924111 24003 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:32.902240 25361 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.901741 23922 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.929272 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:32.863883 25301 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.909092 25344 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:32.942728 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 80324.7us
I20260709 12:20:32.840325 25406 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:32.973554 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 48081.6us
I20260709 12:20:32.933661 23996 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:32.932687 25426 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:32.934861 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:32.989527 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:32.957499 25084 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.914613 25139 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.015556 25349 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.015930 25139 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:32.986779 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:33.017856 23926 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.895983 25412 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:32.879527 25415 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:32.999382 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.020067 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:33.020357 23893 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.069705 24003 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.070956 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.071571 23927 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:33.021869 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:32.940275 25361 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:33.050377 25417 log.cc:927] Time spent T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:20:33.050788 25342 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.051741 25296 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:33.052673 25404 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.052788 25403 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.022867 25426 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:33.056643 25282 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.000s
I20260709 12:20:33.059032 25339 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:32.981498 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.059599 25366 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:33.061275 25360 consensus_meta.cc:287] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.625s	user 0.001s	sys 0.007s
I20260709 12:20:33.061167 25406 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:33.061978 25164 consensus_meta.cc:287] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.758s	user 0.013s	sys 0.000s
I20260709 12:20:33.062330 25413 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.024487 25163 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.017856 23849 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:33.063195 25349 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:33.065213 23848 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:33.066134 25432 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.068584 23926 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
W20260709 12:20:33.079571 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59298.8us
I20260709 12:20:33.113415 24556 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 12:20:33.078675 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 71036.9us
I20260709 12:20:32.971465 25344 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.007141 25427 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:33.102029 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.104434 23853 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:33.148283 23893 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:33.076095 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 194107us
W20260709 12:20:33.106891 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.114732 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 1643) took 1149 ms. Trace:
W20260709 12:20:33.104315 25374 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
W20260709 12:20:33.139089 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 68358.2us
I20260709 12:20:33.099762 25405 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.173075 25405 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.173364 23817 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.163591 23923 rpcz_store.cc:276] 0709 12:20:31.956517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.956691 (+   174us) service_pool.cc:224] Handling call
0709 12:20:33.106121 (+1149430us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b540039a154. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:33.106314 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1499916544}
I20260709 12:20:33.146684 25356 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.139734 24003 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:33.102886 25310 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:33.025767 25084 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.050379 25433 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:20:33.148079 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.080020 23892 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:33.110476 25339 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.093730 25342 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.107390 25445 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.141927 23997 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:20:33.105975 25282 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.170981 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 1634) took 1219 ms. Trace:
I20260709 12:20:33.180384 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:33.160853 24556 pending_rounds.cc:85] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 4
I20260709 12:20:33.186522 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:33.208932 23854 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.187263 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.188717 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.146018 25436 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:33.191319 23848 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:33.138391 25266 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.198525 23999 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:33.143358 25164 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:33.200582 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.144661 25434 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:20:33.215284 23820 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.171316 25427 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:33.204607 25405 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.180172 25198 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:33.210418 24002 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:33.183276 25324 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.202009 24978 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:33.208716 23929 rpcz_store.cc:276] 0709 12:20:31.952609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.952864 (+   255us) service_pool.cc:224] Handling call
0709 12:20:31.953626 (+   762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:31.978113 (+ 24487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:31.978143 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:32.013043 (+ 34900us) log.cc:844] Serialized 26 byte log entry
0709 12:20:32.690863 (+677820us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:32.690904 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.020378 (+329474us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5400329954. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:33.020428 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.150091 (+129663us) raft_consensus.cc:1685] finished
0709 12:20:33.150114 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.170894 (+ 20780us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":184,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":33226,"spinlock_wait_cycles":56423040,"thread_start_us":410751,"threads_started":1,"wal-append.queue_time_us":633067}
I20260709 12:20:33.210739 24001 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:33.216355 24003 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:33.200726 25395 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:20:33.148978 25349 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.191813 25317 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 12:20:33.219909 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 139953us
I20260709 12:20:33.213748 24556 pending_rounds.cc:107] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 2.5
W20260709 12:20:33.247478 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.150029 25432 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.252035 24978 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:33.205749 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.184770 25356 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:33.315100 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60069.3us
I20260709 12:20:33.340811 23892 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:33.318146 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.316601 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:33.228035 25427 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.226681 25340 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:33.182389 25374 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.258378 24556 raft_consensus.cc:2889] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.214617 25301 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:33.332532 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 117323us
W20260709 12:20:33.334252 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 113891us
I20260709 12:20:33.201045 25339 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.217790 25436 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.315627 25419 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:33.341800 23851 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.341841 23848 raft_consensus.cc:2368] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
I20260709 12:20:33.227113 25198 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.255169 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.369822 24003 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:33.232429 25424 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:33.346688 25444 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 12:20:33.348218 23966 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.675s (SENT) [suppressed 39 similar messages]
W20260709 12:20:33.349291 25302 consensus_meta.cc:287] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.000s
I20260709 12:20:33.208478 25445 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.350912 25344 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:33.352064 25412 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.353611 25414 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:33.161614 25439 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:20:33.356769 23892 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:33.357542 24000 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:33.405772 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.406694 24000 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:33.315290 25139 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:33.253795 25425 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:33.255201 23854 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:33.353868 25266 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:33.344350 25429 log.cc:927] Time spent T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.328s	user 0.005s	sys 0.002s
W20260709 12:20:33.377717 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 163754us
I20260709 12:20:33.363816 23893 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.376328 25340 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:20:33.427179 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 63473.9us
I20260709 12:20:33.380806 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.339236 25361 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.360138 25310 raft_consensus.cc:697] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:33.363238 23996 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:33.361142 25395 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:33.232847 25428 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.164s
W20260709 12:20:33.410250 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53597us
I20260709 12:20:33.464553 23892 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:33.412354 25441 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:33.465732 25459 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:33.465641 25441 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.466300 25459 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.466806 25428 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:33.467558 25428 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.468502 25459 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:33.469081 25450 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:20:33.470696 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 44003.6us
I20260709 12:20:33.413015 25430 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:33.376742 25198 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:33.395347 25284 consensus_meta.cc:287] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.964s	user 0.012s	sys 0.001s
I20260709 12:20:33.424763 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.390036 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.432299 25324 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:33.365638 25440 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:33.485059 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.397840 25302 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.439738 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.487778 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.434854 23893 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:33.489280 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 54672.5us
I20260709 12:20:33.407939 25415 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.408226 25291 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.453261 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.505074 23848 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:33.422063 25139 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.423949 25412 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:33.436517 25449 log.cc:927] Time spent T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:20:33.383069 25419 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.476810 24000 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
W20260709 12:20:33.481331 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 133124us
I20260709 12:20:33.491400 24003 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:33.495949 25464 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:33.496629 25442 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 12:20:33.496668 25454 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:33.497310 25435 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:20:33.498399 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.498425 25432 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:33.498833 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:33.500702 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.501399 25434 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:33.507277 23893 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.422960 25414 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.509312 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:33.535804 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.514333 25456 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:33.514914 25445 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:33.453644 23997 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:33.462951 25426 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.524468 23851 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:33.483359 25284 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.525545 25458 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.529330 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.484721 25440 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:33.508453 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44032.4us
I20260709 12:20:33.548676 25466 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:33.549077 23892 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:33.529417 25164 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.517493 25139 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.537345 25266 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:33.552665 25436 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.553040 25266 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:33.553267 25405 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:33.516525 25084 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:33.519068 25412 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.517110 25324 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:33.520437 25317 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:33.537415 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.585691 25441 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.585922 25317 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.539780 25428 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.586062 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.586265 23853 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:33.586347 25317 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.586580 25428 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.586752 23846 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:33.587055 23853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:33.587103 25428 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.587776 23853 raft_consensus.cc:606] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:33.587914 25412 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.588150 23853 raft_consensus.cc:614] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:33.589327 23853 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:33.542836 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.544610 25445 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.450702 25425 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.485687 25430 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.545492 23966 leader_election.cc:400] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
I20260709 12:20:33.548617 25440 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.548615 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.501986 25462 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.392757 25424 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.530807 25361 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:33.550503 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.574590 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:33.615249 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 64820.8us
I20260709 12:20:33.616045 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:33.617493 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:33.517854 25291 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.550709 25434 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.543558 23852 raft_consensus.cc:2368] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
I20260709 12:20:33.539273 23924 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.546231 25431 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:33.597756 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 52554.5us
I20260709 12:20:33.625002 23854 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:33.553473 25266 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.567936 25339 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:33.593824 25309 consensus_meta.cc:287] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.005s
I20260709 12:20:33.566232 25446 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.577848 25456 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:33.554915 25349 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.565963 25373 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:33.537204 25454 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.529599 25342 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:33.589316 25302 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.579521 25356 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.566418 25423 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.534884 25310 consensus_queue.cc:237] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.590135 25414 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.596546 25084 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.535012 25340 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.623736 24978 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:33.602728 25164 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:33.615259 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.608734 25242 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.534798 25464 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.549325 25466 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.621462 25405 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.621294 25403 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:33.599656 25445 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.616883 25462 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:33.629295 25347 consensus_meta.cc:287] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.975s	user 0.001s	sys 0.012s
I20260709 12:20:33.628587 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 85) took 1047 ms. Trace:
I20260709 12:20:33.585708 25324 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.637450 25432 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.619724 25361 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.658380 25419 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.659310 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.659966 25198 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.660866 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:33.704768 23854 raft_consensus.cc:2368] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
I20260709 12:20:33.662011 23995 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:33.662565 25084 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.663851 25267 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.665925 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:33.674494 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 57071.1us
I20260709 12:20:33.647193 25382 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:33.603834 25458 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.687826 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.688977 25428 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:33.709684 23892 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:33.703564 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.684828 25403 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:33.666038 25423 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.674463 25164 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.719863 24978 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:33.640239 25431 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.720805 23996 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:33.721356 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:33.647019 25446 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.711467 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.722209 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.744975 23893 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.722429 25361 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.724068 25403 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.690456 23925 rpcz_store.cc:276] 0709 12:20:32.581329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.585320 (+  3991us) service_pool.cc:224] Handling call
0709 12:20:32.630711 (+ 45391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:32.676688 (+ 45977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:32.681075 (+  4387us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:32.754691 (+ 73616us) log.cc:844] Serialized 26 byte log entry
0709 12:20:32.943001 (+188310us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:32.943062 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.943413 (+   351us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.617509 (+674096us) raft_consensus.cc:1685] finished
0709 12:20:33.619279 (+  1770us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.625754 (+  6475us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3792,"raft.queue_time_us":6505,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":19889,"thread_start_us":129672,"threads_started":1,"wal-append.queue_time_us":399436}
I20260709 12:20:33.691648 25317 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.697016 25433 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.721557 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.730788 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.768107 24002 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:33.768517 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.769112 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:33.734452 25445 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:33.735621 23922 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.000s
I20260709 12:20:33.736619 25139 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.737372 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.725056 25374 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.655687 25373 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.738817 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.722689 25348 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.740250 25430 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:33.740469 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.781505 23924 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:33.785071 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1079) took 1002 ms. Trace:
I20260709 12:20:33.774937 23922 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:33.786327 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1078) took 1003 ms. Trace:
I20260709 12:20:33.711084 25284 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:33.792518 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.793354 23927 raft_consensus.cc:2410] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:33.756873 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:33.759348 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.710590 25382 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:33.754621 23852 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:33.764678 25454 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.766162 25464 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.769765 24002 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.703040 25432 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.773442 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.773926 24978 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.755455 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.807941 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:33.808003 25266 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.808583 23997 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:33.809496 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.785414 23924 rpcz_store.cc:276] 0709 12:20:32.782865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.784210 (+  1345us) service_pool.cc:224] Handling call
0709 12:20:33.498673 (+714463us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:33.785007 (+286334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9370368}
I20260709 12:20:33.742911 25440 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.787992 23929 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:20:33.738817 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:33.790879 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.791474 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.794756 23854 raft_consensus.cc:2376] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3. Re-sending same reply.
I20260709 12:20:33.796236 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.797699 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.701926 25456 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.775992 25198 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.800211 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.802745 24004 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:33.837546 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.802807 24978 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.786720 23922 rpcz_store.cc:276] 0709 12:20:32.782536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.783984 (+  1448us) service_pool.cc:224] Handling call
0709 12:20:33.786262 (+1002278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:33.804075 25458 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.804265 25434 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.843816 24978 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:33.805267 25451 log.cc:927] Time spent T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:20:33.805662 25432 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.806704 25084 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:33.810920 24002 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:33.777272 25310 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.779147 25469 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:33.812388 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.814086 25466 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.818147 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:33.819218 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1160) took 1074 ms. Trace:
I20260709 12:20:33.850538 24560 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.772975 25433 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.830228 23851 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:33.814924 25382 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:33.832331 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.832123 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.834370 23926 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:33.834966 23849 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:33.846915 25407 consensus_meta.cc:287] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.160s	user 0.009s	sys 0.005s
I20260709 12:20:33.838022 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:33.871328 23923 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.818787 23997 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:33.839576 25423 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:33.841369 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:33.844031 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.804862 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.872766 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.847221 23848 raft_consensus.cc:2368] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
I20260709 12:20:33.853700 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.850467 23847 rpcz_store.cc:276] 0709 12:20:32.742015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.742172 (+   157us) service_pool.cc:224] Handling call
0709 12:20:33.815749 (+1073577us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54001b1cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:33.815845 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36084352}
I20260709 12:20:33.843541 25139 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.849086 24563 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:33.830514 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.851406 23893 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.862092 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.836768 25266 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:33.835843 23927 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:33.875258 24561 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:33.875298 23895 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.882041 24560 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:33.882423 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:33.883476 23847 raft_consensus.cc:2393] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:33.888938 24004 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:33.891184 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.861598 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.897756 24978 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:33.863029 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.864825 25416 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.865213 25084 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.893307 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.894758 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.902951 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.855403 25469 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.870096 24559 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:33.896145 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:33.899163 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.846216 25374 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:20:33.903829 24560 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:33.901582 24561 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:33.892297 23847 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:33.905059 23893 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.905140 24978 raft_consensus.cc:697] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:33.876554 25382 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.905990 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.908434 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.877329 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.911834 23853 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:33.863217 25310 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.908450 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.876842 24557 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:33.909655 23923 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:33.916504 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:33.921775 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.913646 23847 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:33.922664 24561 raft_consensus.cc:2410] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:33.907680 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.917595 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.894054 23996 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:33.892757 23852 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:33.929576 23851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:33.934985 23851 raft_consensus.cc:606] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:33.935364 23851 raft_consensus.cc:614] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:33.930406 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.929587 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.931003 23849 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:33.936332 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.876214 25407 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.936594 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:33.918820 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:33.932283 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.932387 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.900281 25446 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.910048 25198 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:33.933233 24978 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:33.916826 25472 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:33.937733 23847 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:33.910537 25469 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.952805 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:33.939960 23929 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:33.944061 23926 raft_consensus.cc:2368] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3.
I20260709 12:20:33.953466 24561 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.945212 25431 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:33.945608 25342 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:33.960146 23850 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:33.933272 24525 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:33.910344 25084 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.934852 25374 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:33.947927 25339 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:33.948575 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.952566 25198 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.972827 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:33.973205 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:33.971148 25339 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.979601 23997 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 2: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:33.977468 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:33.951547 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.964926 25472 raft_consensus.cc:697] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:33.987864 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:33.968185 25342 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:33.988447 25198 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.968612 25374 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:33.997859 24978 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:33.959254 25412 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:33.990248 25339 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.905784 25416 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.007627 24978 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:34.000535 25427 consensus_meta.cc:287] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.004s
I20260709 12:20:34.013015 25427 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.018397 24002 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.025679 23921 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:34.008957 25374 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.010856 24559 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:34.049252 25407 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.006213 25373 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:34.065011 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.065723 24558 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:34.066794 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.039214 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.069352 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.072002 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.073122 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.073963 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.074146 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.074798 23999 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:34.075165 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.075580 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.076352 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.076634 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.077196 23999 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:34.077415 25479 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:20:34.078708 25482 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:20:34.057411 25234 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:34.081569 25234 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.083595 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.085317 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:34.086268 23920 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:34.087574 24561 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:34.087580 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.095255 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.098989 24002 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:34.073740 23924 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:34.082657 25440 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:34.013227 25472 consensus_queue.cc:237] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.112820 25310 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.068483 25342 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.062932 25427 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:34.101236 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.092649 23997 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.110733 24978 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.111753 25234 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.112162 25084 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:34.129964 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 362) took 1404 ms. Trace:
I20260709 12:20:34.130735 25198 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:34.117349 23920 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:34.134838 25425 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.136686 25412 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.125124 25469 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.073134 25424 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.141247 24560 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:34.146978 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.152884 23920 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:34.161751 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.162514 23923 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:34.162931 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.165624 24003 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:34.167649 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.168501 23924 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 1.
I20260709 12:20:34.149493 25339 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.171393 23999 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:34.172336 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.172889 23999 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:34.173177 25339 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:34.173957 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:34.174787 25412 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:34.175148 25412 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:34.175302 25469 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.175508 25412 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.178910 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.180438 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 1703) took 1126 ms. Trace:
I20260709 12:20:34.180536 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.181015 23848 rpcz_store.cc:276] 0709 12:20:33.054130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.548314 (+494184us) service_pool.cc:224] Handling call
0709 12:20:34.180227 (+631913us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400073354. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:34.180366 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566212352}
I20260709 12:20:34.181586 24003 raft_consensus.cc:2393] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:34.182436 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.183189 24001 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:34.188472 25416 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.188468 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.190944 25403 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.192159 23997 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:34.191992 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.194926 25317 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:34.195432 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.195948 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.193078 25403 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.197906 23999 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.203241 23921 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:20:34.204392 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.205221 24001 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.196929 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.130431 24556 rpcz_store.cc:276] 0709 12:20:32.726143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.738316 (+ 12173us) service_pool.cc:224] Handling call
0709 12:20:32.782755 (+ 44439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.379124 (+596369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.129673 (+750549us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54004678d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:34.129895 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667645184}
I20260709 12:20:34.160526 25198 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:34.214788 25164 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:34.212507 23995 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:34.222360 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.210783 23925 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:34.227073 25405 consensus_meta.cc:287] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.003s
I20260709 12:20:34.252511 25462 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.252978 25405 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:34.231101 23997 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:34.230281 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:34.254879 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.254776 25374 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:34.255780 25198 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:34.256002 23997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:34.256325 25198 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:34.256853 25198 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:34.239984 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.258116 23998 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:34.258401 25403 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:34.237635 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.245082 25282 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:34.226455 23999 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:34.266561 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.267683 23929 raft_consensus.cc:2393] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:34.267143 24001 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:34.272787 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.268219 23893 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:34.277467 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.279016 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:20:34.303999 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.296130 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.306806 23817 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:34.309526 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:34.294727 25469 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:34.314461 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.316957 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.317795 23849 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:34.319025 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.319978 23927 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:34.307597 23997 raft_consensus.cc:606] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:34.324010 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.324230 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.313184 25416 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:34.328052 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.307569 25455 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:34.324957 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.328763 23848 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:34.325897 23927 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:34.327139 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.335359 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.322382 25374 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:34.361027 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 426279us
I20260709 12:20:34.364042 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.329164 25469 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:34.366621 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.319823 25424 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:34.334136 25416 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:34.371428 23845 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:34.378767 23921 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:34.379887 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 1700) took 1326 ms. Trace:
I20260709 12:20:34.380367 23846 rpcz_store.cc:276] 0709 12:20:33.053328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.587402 (+534074us) service_pool.cc:224] Handling call
0709 12:20:33.587669 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.787077 (+199408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.787106 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.787149 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:33.787178 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.379637 (+592459us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400299854. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:34.379681 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:34.379817 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458199936}
I20260709 12:20:34.334641 25455 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:34.383955 25424 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:34.388516 24003 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:34.390583 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.420516 25198 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:34.424824 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.425621 23921 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:34.426523 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:34.427138 23920 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.409998 25344 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:34.435817 23817 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:34.440407 25373 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:34.440618 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:34.440862 25373 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.441211 25373 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.442415 25291 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.442550 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:34.443408 23922 raft_consensus.cc:2393] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:34.446592 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.447217 23927 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:34.448969 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.419745 25425 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:34.451654 23818 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:34.458094 25491 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:20:34.455665 25344 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.477394 25424 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.529919 25455 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:34.612062 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 155227us
I20260709 12:20:34.613473 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:34.614902 25455 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:34.533103 25425 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.403201 25469 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.419571 25416 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.537446 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1180) took 1105 ms. Trace:
I20260709 12:20:34.537773 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:34.631539 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 93850.6us
I20260709 12:20:34.632666 23966 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:34.538585 25433 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:34.634335 25335 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:34.635723 25335 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:34.636085 25335 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.636415 25335 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.637209 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.637497 25425 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.637979 23845 raft_consensus.cc:2376] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3. Re-sending same reply.
I20260709 12:20:34.638137 25455 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.638235 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.638626 25455 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.543817 23920 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:34.639449 25428 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:34.639810 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.640949 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.641335 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:34.549314 25373 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.641966 23845 raft_consensus.cc:2376] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3. Re-sending same reply.
I20260709 12:20:34.643426 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:34.643781 25373 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.644114 23845 raft_consensus.cc:2368] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
I20260709 12:20:34.564878 25324 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.645341 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.574942 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:34.577841 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.648653 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:34.649333 24554 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.650640 24558 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:34.652189 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:34.652747 25464 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:34.581691 23997 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:20:34.652776 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 732633us
I20260709 12:20:34.581929 25340 raft_consensus.cc:3055] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:34.654137 25340 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:34.582727 23996 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:34.655076 25340 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.655591 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:34.656122 25340 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:34.655623 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.583076 23924 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:34.659088 23845 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:34.660503 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.588009 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:34.587018 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.569830 23893 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:34.583611 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:20:34.598675 23850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1152) took 1946 ms (client timeout 2031 ms). Trace:
I20260709 12:20:34.588263 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.663206 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:34.633594 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:34.663836 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:34.664261 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:34.664547 23923 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.458500 25440 consensus_queue.cc:1059] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:34.666181 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:34.608553 23749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43184 (request call id 222) took 4615 ms. Trace:
I20260709 12:20:34.668382 23854 raft_consensus.cc:2368] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
I20260709 12:20:34.531594 25198 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:34.615918 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 164346us
I20260709 12:20:34.669093 23818 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:34.532812 25412 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.616981 25407 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:34.672395 25407 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.672909 25407 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.619043 25462 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:34.636303 25514 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:34.540105 25493 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.165s	user 0.001s	sys 0.003s
I20260709 12:20:34.644786 25324 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.649243 25466 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.661247 23849 raft_consensus.cc:2368] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
I20260709 12:20:34.571770 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.665733 23928 raft_consensus.cc:2368] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
W20260709 12:20:34.665843 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 96095.2us
W20260709 12:20:34.662336 23850 rpcz_store.cc:269] 0709 12:20:32.652724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.652859 (+   135us) service_pool.cc:224] Handling call
0709 12:20:34.598368 (+1945509us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002d4bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:34.598576 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2987126656}
I20260709 12:20:34.666446 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.690582 23853 raft_consensus.cc:2368] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
I20260709 12:20:34.653303 25464 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:34.667130 25374 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:34.666975 23848 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:34.594573 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:34.639848 25428 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:34.698173 25412 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.702844 25428 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:34.703531 25466 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:34.685286 25284 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:34.705000 25284 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.705468 25284 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:34.696441 25374 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.706372 25374 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:34.660496 25395 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:20:34.671870 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.671783 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:34.618081 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1048) took 1117 ms. Trace:
I20260709 12:20:34.674779 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.604030 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:34.611521 24004 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:34.682021 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.709224 24001 rpcz_store.cc:276] 0709 12:20:33.500256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.270591 (+770335us) service_pool.cc:224] Handling call
0709 12:20:34.270832 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:34.271199 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:34.271225 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:34.276724 (+  5499us) log.cc:844] Serialized 26 byte log entry
0709 12:20:34.417589 (+140865us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:34.447758 (+ 30169us) log.cc:844] Serialized 14 byte log entry
0709 12:20:34.448085 (+   327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.448160 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:34.615853 (+167693us) spinlock_profiling.cc:243] Waited 75.5 ms on lock 0x7b1800387d60. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:20:34.617791 (+  1938us) raft_consensus.cc:1685] finished
0709 12:20:34.617899 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:34.618026 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29994,"prepare.run_cpu_time_us":16989,"prepare.run_wall_time_us":68507,"raft.queue_time_us":187,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":30301,"spinlock_wait_cycles":173651328,"thread_start_us":98486,"threads_started":1,"wal-append.queue_time_us":223739}
I20260709 12:20:34.712697 23892 leader_election.cc:400] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
I20260709 12:20:34.714061 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:34.715847 23818 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.716187 23892 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:34.683339 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 317542us
I20260709 12:20:34.666932 23924 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:34.676338 25405 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:34.679396 25344 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:34.705773 25466 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.730358 23892 leader_election.cc:400] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
I20260709 12:20:34.708674 25164 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:34.696656 25464 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:34.712111 25431 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:34.667100 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.689075 23893 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:34.743481 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 54530.9us
I20260709 12:20:34.743860 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:34.744921 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:34.746042 25454 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:34.719520 25403 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:34.746690 25454 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.746791 25342 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:34.747131 25403 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:34.747613 25403 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:34.748303 25454 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:34.719982 25424 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:34.754243 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.754637 25515 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:34.755065 25515 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:34.755012 25403 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.756099 25515 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:34.757346 25515 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:34.757437 25403 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.757553 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.758770 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.759255 23850 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:34.707937 23854 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:34.760844 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:34.761586 24560 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:34.717017 23966 leader_election.cc:400] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
I20260709 12:20:34.718832 23929 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:34.718969 23818 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.763082 23966 leader_election.cc:403] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:34.719681 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:34.721403 23820 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:34.763700 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44794.6us
I20260709 12:20:34.764539 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:34.764564 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:34.766772 23818 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:34.766777 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 45495.4us
W20260709 12:20:34.768208 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 51338us
I20260709 12:20:34.768761 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:34.701467 23927 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:34.769968 25342 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
I20260709 12:20:34.732900 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:34.731336 23892 leader_election.cc:400] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
I20260709 12:20:34.734561 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.735054 25405 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:34.726300 25412 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:34.737509 23845 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:34.779598 23854 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:34.782255 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:34.694470 23923 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:34.717566 23925 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.720849 25440 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:34.782119 25373 consensus_queue.cc:1059] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:20:34.668515 23749 rpcz_store.cc:276] 0709 12:20:29.992933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.993092 (+   159us) service_pool.cc:224] Handling call
0709 12:20:30.014416 (+ 21324us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b54003129d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b6090 00007fa287454f3a 00007fa28d20ae9c 00007fa28d30904e 00007fa28b7ca2a4 00007fa28b7ca232 00007fa28b7ca161 00007fa28b7ca0dc 00007fa28b7c9392 00007fa28578748c 00007fa2857868c6
0709 12:20:34.608460 (+4594044us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:32.726113 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:32.919373 (+193260us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:32.922700 (+  3327us) write_op.cc:435] Acquired schema lock
0709 12:20:32.926647 (+  3947us) tablet.cc:662] Decoding operations
0709 12:20:33.012393 (+ 85746us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:33.012632 (+   239us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:33.012707 (+    75us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:33.081741 (+ 69034us) tablet.cc:701] Row locks acquired
0709 12:20:33.094565 (+ 12824us) write_op.cc:260] PREPARE: finished
0709 12:20:33.109370 (+ 14805us) write_op.cc:270] Start()
0709 12:20:33.121058 (+ 11688us) write_op.cc:276] Timestamp: P: 1783599633104813 usec, L: 0
0709 12:20:33.140211 (+ 19153us) op_driver.cc:348] REPLICATION: starting
0709 12:20:33.232559 (+ 92348us) log.cc:844] Serialized 538 byte log entry
0709 12:20:33.771258 (+538699us) op_driver.cc:464] REPLICATION: finished
0709 12:20:33.891809 (+120551us) write_op.cc:301] APPLY: starting
0709 12:20:33.895410 (+  3601us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:33.905482 (+ 10072us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:33.918889 (+ 13407us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:33.931843 (+ 12954us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:33.932003 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:33.932057 (+    54us) write_op.cc:312] APPLY: finished
0709 12:20:33.944958 (+ 12901us) log.cc:844] Serialized 23 byte log entry
0709 12:20:33.945136 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:33.945218 (+    82us) write_op.cc:454] Released schema lock
0709 12:20:33.945257 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:33.945626 (+   369us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:33.945665 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81161,"reported_tablets":7,"spinlock_wait_cycles":5278592,"child_traces":[["op",{"apply.queue_time_us":100498,"apply.run_cpu_time_us":2593,"apply.run_wall_time_us":67673,"num_ops":1,"prepare.queue_time_us":271243,"prepare.run_cpu_time_us":117162,"prepare.run_wall_time_us":830250,"raft.queue_time_us":131456,"raft.run_cpu_time_us":12969,"raft.run_wall_time_us":62730,"replication_time_us":630876,"thread_start_us":399987,"threads_started":4,"wal-append.queue_time_us":343825}]]}
I20260709 12:20:34.790297 24554 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:34.790640 25373 consensus_queue.cc:1243] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:20:34.791183 25373 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:34.791769 25374 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:34.792204 25405 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.776301 25425 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.768880 23820 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:34.769104 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.686057 25462 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.802103 25339 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:34.802699 25324 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.803568 25462 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:34.797824 23895 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:34.804802 25395 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:34.805328 25395 raft_consensus.cc:697] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:34.791508 25373 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:34.749543 25454 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.806617 23966 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.771245 23892 leader_election.cc:403] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:34.740518 25164 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.767309 25416 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:34.774755 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.777076 23851 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:34.772188 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:34.767477 25424 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:34.786703 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:34.811307 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:34.782652 23747 catalog_manager.cc:5697] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 2 to 3, term changed from 1 to 3, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to <none>, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:20:34.799971 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.806326 25395 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:34.796171 25407 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:34.822994 25407 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:34.823715 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:34.824525 23997 raft_consensus.cc:2393] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 2: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:34.825706 23847 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:34.829162 23817 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:34.692489 25514 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:34.807616 25373 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:34.813289 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 44471.2us
I20260709 12:20:34.815104 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:34.816972 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 85758.4us
I20260709 12:20:34.839207 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.839315 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:34.840884 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.838725 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:34.817550 25164 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.818338 25462 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:34.875465 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:34.815872 25374 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:34.815637 25431 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:34.856386 23818 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.881979 23850 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:34.883757 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.860359 23747 catalog_manager.cc:5697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 2, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.864151 25340 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:34.818526 25440 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:34.874364 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:34.847635 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:34.879479 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:34.831724 25469 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
I20260709 12:20:34.879705 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:34.895004 24561 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:34.883813 23892 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:34.863374 24524 leader_election.cc:400] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3.
I20260709 12:20:34.897418 23851 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:34.897598 24524 leader_election.cc:403] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:34.898918 24524 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.885771 23747 catalog_manager.cc:5697] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 2, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.901429 23747 catalog_manager.cc:5697] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 2 to 3, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 3 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.903712 25410 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3.
I20260709 12:20:34.904476 25410 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:34.907627 24524 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:34.903055 23747 catalog_manager.cc:5697] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 3, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 3 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.914256 23747 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 2, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.916374 23747 catalog_manager.cc:5697] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 2 to 3, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 3 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:34.919780 25520 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:34.920353 25520 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:34.920851 25520 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.930805 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:34.901441 24561 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:34.934981 25410 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:34.936961 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:34.894764 23847 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:34.836745 25407 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:34.846371 25416 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:34.842156 25291 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:20:34.943279 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 106144us
I20260709 12:20:34.938898 25533 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:34.939752 25534 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:34.892774 25373 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.948801 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:34.890378 25234 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.891161 25340 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:34.959555 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 148300us
I20260709 12:20:35.017166 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:34.874258 25424 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:34.975780 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 84760us
I20260709 12:20:34.976517 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:35.024606 25525 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:20:35.025183 25407 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:34.834473 25139 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 12:20:34.949975 23747 catalog_manager.cc:5697] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 2, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 2 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:20:34.979955 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 104609us
I20260709 12:20:35.026463 23820 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:34.983038 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 99316.4us
I20260709 12:20:34.883504 25464 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:35.011281 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 62561.9us
I20260709 12:20:35.030061 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:34.847157 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:34.890718 25454 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:34.665043 23998 rpcz_store.cc:276] 0709 12:20:33.431665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.259752 (+828087us) service_pool.cc:224] Handling call
0709 12:20:34.260040 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:34.264891 (+  4851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:34.265143 (+   252us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:34.322140 (+ 56997us) log.cc:844] Serialized 26 byte log entry
0709 12:20:34.432864 (+110724us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:34.437549 (+  4685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.448280 (+ 10731us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:34.537235 (+ 88955us) raft_consensus.cc:1685] finished
0709 12:20:34.537250 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:34.537384 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2931,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"thread_start_us":89221,"threads_started":1,"wal-append.queue_time_us":208993}
I20260709 12:20:35.035873 23820 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.027444 23892 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:34.974627 23995 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:35.031674 23969 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:34.975746 25410 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:35.022855 25524 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.002s
I20260709 12:20:35.040195 23820 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:35.049310 23820 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:35.011516 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:35.048180 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 191858us
I20260709 12:20:35.042484 23747 catalog_manager.cc:5697] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 2, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.060786 23818 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:35.061488 23747 catalog_manager.cc:5697] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 2, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.021623 25340 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.064836 23820 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:35.014904 25472 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:35.010327 25403 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:35.014868 25466 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:35.036659 25534 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:35.034967 25374 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:35.038066 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:35.047374 25440 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:35.083760 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 56389.7us
I20260709 12:20:35.056761 25291 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:35.063867 25139 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.081230 25416 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.050320 23925 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:35.068161 25424 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:35.074617 25324 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:35.024659 25234 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.033982 25407 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.079090 25534 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:35.084232 25533 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.081036 25374 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.058184 25454 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.090183 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:35.039906 25464 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.082072 25403 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.110057 25413 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:35.199787 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:35.178102 25374 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.156354 25520 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:35.198613 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 125236us
I20260709 12:20:35.120572 25324 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:35.116814 25139 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:35.104478 25530 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:35.120306 25424 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:35.212942 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 139389us
I20260709 12:20:35.154990 25416 raft_consensus.cc:697] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:20:35.222512 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 196701us
W20260709 12:20:35.228502 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 138646us
I20260709 12:20:35.266970 24561 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:35.236377 25540 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:35.263043 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.272472 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.243120 25514 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:35.258929 25324 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.261771 25530 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.271219 25424 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:35.333138 24555 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:35.333904 25139 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:35.344950 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 81991.9us
W20260709 12:20:35.351696 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 79315.1us
I20260709 12:20:35.354518 23818 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.357261 25545 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:35.357738 25545 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:35.358126 25545 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:35.359122 25520 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:35.359788 25454 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:35.360301 25403 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:35.363657 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.369364 23820 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.327663 25532 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:35.356901 25519 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.283345 25405 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:20:35.361399 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:35.294471 25540 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:35.428905 25234 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:35.347535 25530 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:35.404116 25537 log.cc:927] Time spent T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
I20260709 12:20:35.397024 23820 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:35.365857 25462 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:20:35.418522 25527 log.cc:927] Time spent T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:20:35.419039 25440 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:35.368220 25514 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:35.428442 25425 consensus_meta.cc:287] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.004s
W20260709 12:20:35.377344 23852 consensus_meta.cc:287] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.003s
W20260709 12:20:35.442544 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 161416us
I20260709 12:20:35.389923 25533 raft_consensus.cc:697] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:20:35.439561 25284 consensus_meta.cc:287] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.003s
W20260709 12:20:35.439489 25335 consensus_meta.cc:287] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.802s	user 0.012s	sys 0.000s
W20260709 12:20:35.446007 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49102us
W20260709 12:20:35.440115 25455 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.001s
I20260709 12:20:35.454324 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:35.457194 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:35.460134 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 428527us
I20260709 12:20:35.472295 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:35.472927 24561 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:35.473748 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:20:35.474285 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 194948us
I20260709 12:20:35.474992 24561 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:35.477967 23969 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:20:35.481009 24001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.000s	sys 0.015s
W20260709 12:20:35.481375 24001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.000s	sys 0.016s
I20260709 12:20:35.444010 24556 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
W20260709 12:20:35.501914 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.484802 23999 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:35.459369 25425 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:35.459197 23852 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:35.467183 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.472535 25440 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:35.401990 25416 consensus_queue.cc:237] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.468333 25462 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:35.482718 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:35.532562 23848 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:20:35.535255 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60180.1us
I20260709 12:20:35.544667 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:35.501165 25431 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:35.537423 25403 consensus_queue.cc:1059] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:35.551415 25324 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.553799 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:35.537806 25536 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 12:20:35.561455 25550 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:35.464968 25284 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.546591 23969 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:35.541177 25412 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:20:35.538450 23998 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:35.277626 25534 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.532254 25548 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:35.409512 25532 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.550609 25541 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:35.551332 25431 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:35.562435 25321 raft_consensus.cc:3055] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:35.476595 25335 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.518805 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.535878 25464 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:35.536497 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:35.419363 25519 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.596542 25321 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:35.608556 25532 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:35.608705 25321 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.514185 25456 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.563442 23845 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.610066 25321 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.609964 25456 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.612143 25456 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:35.563172 25538 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 12:20:35.612787 25284 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:35.511902 25555 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:35.613379 23997 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:35.613822 25555 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.615939 25555 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:35.512614 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:35.564857 23966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.020s	sys 0.047s
W20260709 12:20:35.617060 23966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.020s	sys 0.048s
W20260709 12:20:35.617367 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 587365us
I20260709 12:20:35.581734 25548 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.620217 23966 leader_election.cc:400] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
W20260709 12:20:35.564292 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 208184us
W20260709 12:20:35.474071 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 112648us
I20260709 12:20:35.620497 25548 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:35.481040 25455 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.622720 25518 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:35.623337 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.623433 25455 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:35.602916 25544 consensus_queue.cc:1175] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:20:35.624190 25455 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.571588 25344 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:35.624936 25344 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.624707 25455 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.625344 25344 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.625576 23846 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:35.627499 23820 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.629406 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:35.623561 25340 consensus_meta.cc:287] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.000s
I20260709 12:20:35.623245 25518 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.638816 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:35.620519 23966 leader_election.cc:403] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:20:35.605276 25164 consensus_meta.cc:287] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.717s	user 0.006s	sys 0.005s
W20260709 12:20:35.604826 25428 consensus_meta.cc:287] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.899s	user 0.009s	sys 0.003s
I20260709 12:20:35.636356 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.636451 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.643952 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:20:35.644665 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 108749us
I20260709 12:20:35.609447 25519 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:35.647372 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 102811us
I20260709 12:20:35.605042 25520 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:35.650945 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:35.654066 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.632369 25514 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:35.654390 23893 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:35.633224 24559 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.657397 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:35.653640 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:35.598021 25533 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.662194 24000 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:20:35.647620 25373 consensus_meta.cc:287] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.625s	user 0.001s	sys 0.010s
I20260709 12:20:35.669256 25373 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:35.624439 25551 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:20:35.674058 25542 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:20:35.677278 25515 consensus_meta.cc:287] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.919s	user 0.011s	sys 0.004s
I20260709 12:20:35.637295 25340 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.684290 25552 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:35.684557 25455 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:35.684939 25552 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:35.685492 25552 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:35.688680 24001 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:35.638106 25360 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:35.648774 25164 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.690697 25472 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:35.690346 25360 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.691126 25472 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:35.691591 25472 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:35.691834 25164 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:35.662796 25520 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.648239 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d880a30519445959394501b6616f15f"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:35.694557 25520 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:35.694759 24004 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:35.685273 25340 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:35.662230 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:35.696166 24562 raft_consensus.cc:2410] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:35.697041 25374 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.668459 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.653872 25428 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.703387 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:35.703666 25424 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.704921 25428 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:35.705578 24560 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:35.706213 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.692740 25360 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:35.624357 25431 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.649694 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.661377 25284 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
I20260709 12:20:35.699756 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:35.663023 23966 leader_election.cc:400] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
W20260709 12:20:35.724946 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 62098.8us
I20260709 12:20:35.621560 25530 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:35.729523 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 80053us
I20260709 12:20:35.645433 25324 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:35.710041 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:35.711475 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:35.717500 25535 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.550s	user 0.007s	sys 0.011s
I20260709 12:20:35.717686 25518 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:35.717970 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:35.707921 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.736332 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:35.736733 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:35.715387 25424 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:35.717828 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:35.737105 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:35.741009 23851 raft_consensus.cc:2393] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:35.745857 25374 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:35.746500 24562 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:35.749267 23853 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:35.750149 25560 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:35.750562 25560 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.750893 25560 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:35.751703 25530 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:35.752779 25545 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:35.733268 25466 consensus_meta.cc:287] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.652s	user 0.007s	sys 0.004s
I20260709 12:20:35.755465 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:35.759722 24001 raft_consensus.cc:2368] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4.
I20260709 12:20:35.762177 23892 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:35.760602 25454 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:35.764560 23818 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.767635 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.754347 25466 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:35.779438 24563 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.785965 23852 raft_consensus.cc:606] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 3 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:35.749253 25344 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.778281 25558 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.788982 25344 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:35.789487 25558 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:35.789666 24559 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:35.790859 25558 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.792608 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:35.794505 23995 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:35.794435 24559 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.795905 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.807031 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.808183 23998 raft_consensus.cc:2393] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:35.809305 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.769112 25454 raft_consensus.cc:697] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:35.812817 24559 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:35.812414 25454 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.772550 25514 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:35.815369 23845 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:20:35.816754 24524 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:35.817749 25324 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.818423 25324 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.822077 25324 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:35.822654 25545 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:35.823407 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:35.776144 25428 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:35.827513 25428 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.828158 25428 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:35.832979 23929 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:35.833648 23922 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:35.834990 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:35.836648 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.839663 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:35.797595 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:35.842753 23851 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:35.840783 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.845042 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.846767 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.849277 23927 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:20:35.851455 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.853839 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.856221 23926 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:35.857498 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:35.858752 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:35.859328 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:35.859900 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:35.860514 23850 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:35.859486 23847 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:35.863996 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:35.865392 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:35.861538 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:35.867043 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:35.868259 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:35.869434 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:35.870201 23847 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:35.871266 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:35.872535 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:35.873623 23847 raft_consensus.cc:2410] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:35.876400 23850 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:35.883237 23929 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:35.833664 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:35.829276 25428 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.913921 24563 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:35.881043 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:35.914482 25433 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:35.915069 23924 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:35.887892 23969 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:35.916849 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.892475 23851 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:35.884747 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:35.848724 25344 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:35.881687 25518 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:35.935184 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 47361.7us
W20260709 12:20:35.936045 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.881632 25340 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:35.849324 25284 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:35.899734 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:35.941644 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1191) took 1272 ms. Trace:
I20260709 12:20:35.941839 23892 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:35.899873 23845 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:20:35.842634 25374 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:35.900308 25541 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:35.900779 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 395) took 1099 ms. Trace:
I20260709 12:20:35.900939 25324 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:35.947043 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:35.904892 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 1748) took 1243 ms. Trace:
I20260709 12:20:35.886457 23998 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:35.906358 25321 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:35.907961 25472 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:35.908809 25560 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.919572 23849 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:35.858667 25530 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:35.962634 23849 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:35.928205 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 70756.7us
I20260709 12:20:35.930013 23850 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:35.942184 23853 rpcz_store.cc:276] 0709 12:20:34.668921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.732616 (+ 63695us) service_pool.cc:224] Handling call
0709 12:20:35.941427 (+1208811us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b5400403154. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:35.941571 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086904064}
I20260709 12:20:35.966045 23966 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:35.902127 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1058) took 2105 ms. Trace:
I20260709 12:20:35.947845 23846 rpcz_store.cc:276] 0709 12:20:34.661566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.661669 (+   103us) service_pool.cc:224] Handling call
0709 12:20:34.661947 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.626008 (+964061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.904653 (+278645us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b54001e46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:35.904833 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215736576}
I20260709 12:20:35.939953 25543 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.938743 25551 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:35.983465 25560 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:35.987264 25534 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.994416 23925 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
W20260709 12:20:35.999727 25569 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:20:35.944211 25234 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:36.006325 23820 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:35.967056 24003 rpcz_store.cc:276] 0709 12:20:33.796601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.438136 (+641535us) service_pool.cc:224] Handling call
0709 12:20:34.531994 (+ 93858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:34.532222 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:20:34.673248 (+141026us) log.cc:844] Serialized 14 byte log entry
0709 12:20:35.901653 (+1228405us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b1800415c60. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287
0709 12:20:35.901756 (+   103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:35.901811 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:35.901857 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.901959 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:35.902068 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11563,"prepare.queue_time_us":46231,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":41,"raft.queue_time_us":65990,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":37423,"spinlock_wait_cycles":26493696,"thread_start_us":701027,"threads_started":3,"wal-append.queue_time_us":569524}
I20260709 12:20:36.003202 25552 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:35.948271 23892 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:36.017217 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 51326.6us
I20260709 12:20:36.009806 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:20:36.023483 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 75325.2us
I20260709 12:20:35.949623 25555 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:36.015308 25560 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.001796 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:35.946918 24555 rpcz_store.cc:276] 0709 12:20:34.811714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.812191 (+   477us) service_pool.cc:224] Handling call
0709 12:20:34.890430 (+ 78239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.367041 (+476611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:35.900533 (+533492us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54004e2354. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:35.900718 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833906944}
I20260709 12:20:36.031390 25413 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:36.035697 23999 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:36.052556 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:35.945442 25540 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
W20260709 12:20:36.044245 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 46448.3us
I20260709 12:20:36.045074 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:35.949313 25453 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:20:35.989861 25472 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:36.005142 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:36.021201 25543 raft_consensus.cc:697] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:35.948870 25541 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.042346 25395 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.964097 25321 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.028115 25555 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:36.047158 25373 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:36.063071 25344 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:36.063285 23892 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:36.048944 25412 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:36.085587 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 67632.4us
I20260709 12:20:36.089491 24003 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:36.050554 25560 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.071305 25317 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:20:36.080829 23995 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:36.096652 25555 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:36.093773 25395 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:36.092814 24562 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
W20260709 12:20:36.126534 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 104227us
I20260709 12:20:36.106314 25456 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:36.104951 25373 raft_consensus.cc:697] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:36.114842 25472 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:36.127060 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:36.139428 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.140285 23820 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:36.146912 24555 raft_consensus.cc:2368] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
W20260709 12:20:36.148654 25568 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:20:36.148874 24555 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:36.151849 25560 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:36.152086 25566 log.cc:927] Time spent T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:20:36.154204 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:36.155227 24002 raft_consensus.cc:2410] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:36.117049 25342 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:20:36.158914 23895 leader_election.cc:400] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
I20260709 12:20:36.159382 23895 leader_election.cc:403] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:20:36.160028 25567 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.250s	user 0.003s	sys 0.000s
I20260709 12:20:36.160058 25317 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:36.132790 25472 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.164521 25374 consensus_queue.cc:1059] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:36.141695 25284 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:20:36.171864 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.164748 25344 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.164553 25321 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:36.166265 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:36.134361 25456 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:36.173776 24561 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:36.182672 23921 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:36.186041 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:36.190152 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:36.191037 23925 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:36.191875 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:36.192596 23925 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 2: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:36.194712 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:36.195266 23929 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:36.195322 25456 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.197172 25284 raft_consensus.cc:3055] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:36.197629 25284 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:36.198278 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:36.198567 25284 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.198817 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:36.199903 25284 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.200073 23922 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:36.132064 25543 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.200191 25539 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:36.170264 25533 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:36.204068 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.212263 23925 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:36.210822 23929 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:36.173305 25552 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:36.175762 25344 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:36.174568 25560 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:20:36.201757 25454 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:36.212000 25234 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:36.239152 25431 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:36.265967 25234 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.268446 25234 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:36.269313 25335 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:36.272248 25317 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
I20260709 12:20:36.274797 24559 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:36.276507 24558 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:36.276605 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:36.278949 25164 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:36.280098 25472 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:36.281661 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.282766 25548 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:36.283417 25548 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:36.262506 25454 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.284569 25548 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.188591 25395 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.262660 25360 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.248116 25530 consensus_queue.cc:1059] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 12:20:36.323982 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 162348us
I20260709 12:20:36.324620 23820 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:36.325412 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 119487us
I20260709 12:20:36.236601 25373 consensus_queue.cc:237] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.329769 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.330003 23817 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.332136 23817 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.335973 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:36.336803 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:36.324714 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49574.1us
I20260709 12:20:36.342649 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:36.360826 24561 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
W20260709 12:20:36.361738 25589 log.cc:927] Time spent T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:20:36.367023 23895 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:36.343258 23966 leader_election.cc:400] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3.
I20260709 12:20:36.343683 25532 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:36.329802 25428 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:36.335453 25164 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:36.335518 25425 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:36.347366 23893 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:36.335690 25335 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:36.349381 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:36.351271 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:36.352938 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:36.352828 25424 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:36.354373 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:36.369966 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.342905 25541 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:36.331442 25547 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:36.332428 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:36.397822 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 44975.2us
W20260709 12:20:36.380038 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 55624us
I20260709 12:20:36.342909 25552 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:36.401990 25454 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:36.331156 25555 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.404014 24558 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:36.386502 25518 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:36.406070 25541 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:36.407043 25555 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:36.408878 25555 consensus_queue.cc:1059] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.380497 25428 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.401733 25425 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:36.407989 23893 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:36.388504 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.370193 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:20:36.433033 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 62926.6us
I20260709 12:20:36.375003 25530 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.379081 25198 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:36.384972 25559 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:36.382647 25472 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.440768 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:36.444190 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:36.374668 25464 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:20:36.450892 23921 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:36.449064 23926 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:20:36.451627 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 43757.4us
W20260709 12:20:36.525552 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 137116us
I20260709 12:20:36.453735 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:36.420722 23997 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:36.447278 25559 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.593815 23925 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
W20260709 12:20:36.596891 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 70856.6us
I20260709 12:20:36.599574 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:36.600306 23920 raft_consensus.cc:2393] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:36.449652 25425 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:36.437407 25198 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:36.529793 25555 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:36.446262 25284 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:36.607574 23893 leader_election.cc:400] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4.
I20260709 12:20:36.581957 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:36.533371 25520 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:36.446597 25533 raft_consensus.cc:697] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:36.450181 25335 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.154s
I20260709 12:20:36.596387 25559 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:36.694527 25548 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:36.717578 25284 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:36.717778 25548 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.607812 25555 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.719488 25555 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:36.718773 25284 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.717038 24525 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.606772 25198 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:36.446712 25530 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.450304 25342 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.180s
I20260709 12:20:36.608171 25599 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:36.718703 25425 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.612146 25540 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:36.727641 25454 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.730214 24558 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:36.749429 25533 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.532871 25472 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.771034 25464 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:36.771644 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:36.837558 25603 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:20:36.839504 25604 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:20:36.835316 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.752238 25164 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.759714 25548 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:36.746693 25540 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.762466 25605 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:36.762347 25454 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.743775 25599 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:36.827349 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.793442 24525 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:36.843580 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.826712 25428 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:36.848853 25614 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:36.861321 25602 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:20:36.862329 25530 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:36.834218 25520 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:36.863692 25344 consensus_meta.cc:287] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.614s	user 0.002s	sys 0.009s
I20260709 12:20:36.864758 25321 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:36.865289 25613 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:36.853425 25198 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.870144 25234 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.846522 25464 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.876789 25605 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:36.911366 25598 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:20:36.914032 25601 log.cc:927] Time spent T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:20:36.851023 25164 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:36.926959 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 83463.7us
I20260709 12:20:36.934728 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.865244 25555 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.914305 25613 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.941941 23996 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:36.915658 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 141645us
I20260709 12:20:36.948120 24525 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:36.952049 25360 consensus_meta.cc:287] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.003s
I20260709 12:20:36.952587 25360 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:36.940783 25198 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:36.876502 25520 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.910971 25548 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:20:36.908046 25344 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.911180 25321 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:36.933535 25614 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:36.986881 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:36.957073 25342 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:36.916981 25234 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:36.943172 25613 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:36.973424 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:36.985872 25605 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:37.006242 25335 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:20:37.015372 24004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1071) took 1388 ms (client timeout 1510 ms). Trace:
W20260709 12:20:37.019744 24004 rpcz_store.cc:269] 0709 12:20:35.627323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.627442 (+   119us) service_pool.cc:224] Handling call
0709 12:20:37.015156 (+1387714us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b54001a77d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:37.015315 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108021376}
I20260709 12:20:37.016533 24000 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:37.024040 25234 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:37.024514 25164 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.007110 25472 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:37.009945 25614 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:20:37.037240 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.039173 25321 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:37.006011 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 58016.9us
I20260709 12:20:37.044626 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.004101 25560 consensus_queue.cc:1059] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:20:37.046465 23996 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:37.047097 25540 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:37.047910 25615 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:20:37.025539 25605 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:37.057205 25605 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.048259 25555 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.039853 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.032392 25324 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.019403 25335 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:20:37.054819 25610 log.cc:927] Time spent T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:20:37.055712 24525 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:37.062914 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1197) took 2388 ms. Trace:
I20260709 12:20:37.073469 23848 rpcz_store.cc:276] 0709 12:20:34.674802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.778579 (+103777us) service_pool.cc:224] Handling call
0709 12:20:34.794283 (+ 15704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.543187 (+748904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.062660 (+1519473us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54001b1cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:37.062850 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696847744}
I20260709 12:20:37.034495 25464 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:37.051988 25543 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:37.052366 25599 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:37.068846 25454 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.069779 25433 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:37.083678 25433 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:37.097635 24560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36558 (request call id 393) took 2315 ms (client timeout 1873 ms). Trace:
W20260709 12:20:37.098233 24560 rpcz_store.cc:269] 0709 12:20:34.781836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.781979 (+   143us) service_pool.cc:224] Handling call
0709 12:20:37.097377 (+2315398us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54005f14d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:37.097510 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2121905024}
W20260709 12:20:37.107239 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 51620.9us
I20260709 12:20:37.111346 25412 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.112629 25412 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
W20260709 12:20:37.110502 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 137716us
I20260709 12:20:37.077400 25543 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:20:37.102746 25492 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.002s	sys 0.013s
W20260709 12:20:37.118350 25492 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.002s	sys 0.013s
I20260709 12:20:37.120929 24003 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:37.121140 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.121702 25520 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.125789 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.129230 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:37.129959 24004 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.069826 25324 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.149919 25472 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:37.117398 25428 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:37.121227 25344 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:37.122144 25433 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:37.158742 25559 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.159360 25593 raft_consensus.cc:3055] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:37.160041 25412 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.172945 24004 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:37.173754 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.179275 24004 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:20:37.163463 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.181008 24004 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:37.121728 25335 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.166234 25593 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:37.172674 25543 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:37.187013 25617 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:20:37.188997 25559 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:37.190891 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56180 (request call id 8) took 1556 ms. Trace:
I20260709 12:20:37.191257 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:37.191512 23852 rpcz_store.cc:276] 0709 12:20:35.634035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.635211 (+  1176us) service_pool.cc:224] Handling call
0709 12:20:37.190677 (+1555466us) spinlock_profiling.cc:243] Waited 92 ms on lock 0x7b54001e3cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa287446853 00007fa28c41460a 00007fa28599a7d4 00007fa28599a762 00007fa28599a691 00007fa28599a60c 00007fa2859998c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:37.190789 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211488512}
I20260709 12:20:37.192129 23996 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.200104 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1085) took 1090 ms. Trace:
I20260709 12:20:37.200663 24000 rpcz_store.cc:276] 0709 12:20:36.109348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.128029 (+ 18681us) service_pool.cc:224] Handling call
0709 12:20:37.016066 (+888037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:37.021124 (+  5058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.199812 (+178688us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54001a77d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:37.200010 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040315136}
I20260709 12:20:37.208494 25551 raft_consensus.cc:3055] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:37.209043 25551 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:37.209170 25324 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.209894 25551 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.217500 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.231774 23924 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:37.239630 25428 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:37.240489 23996 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:37.187052 25593 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.243561 25593 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.246239 25551 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:37.246513 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 94) took 1798 ms. Trace:
I20260709 12:20:37.247001 23854 rpcz_store.cc:276] 0709 12:20:35.448488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.448633 (+   145us) service_pool.cc:224] Handling call
0709 12:20:35.452537 (+  3904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.609509 (+156972us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:35.706917 (+ 97408us) log.cc:844] Serialized 14 byte log entry
0709 12:20:35.951594 (+244677us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:35.951648 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:35.951687 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.246250 (+1294563us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54002fb7d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:37.246297 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:37.246429 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":184425,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":108,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":31397,"spinlock_wait_cycles":360373504,"thread_start_us":341324,"threads_started":2,"wal-append.queue_time_us":355238,"wal-append.run_cpu_time_us":2024,"wal-append.run_wall_time_us":1082922}
W20260709 12:20:37.253788 25632 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 12:20:37.273296 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 279131us
W20260709 12:20:37.274672 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 133770us
I20260709 12:20:37.278650 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.279930 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.279654 24554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 391) took 1278 ms. Trace:
I20260709 12:20:37.281566 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.284086 25335 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:37.286701 23920 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:20:37.284597 25335 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.289147 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:37.289186 23923 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:37.290622 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.293228 23927 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:37.293403 23929 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:37.291731 25634 consensus_queue.cc:1059] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:37.294353 23922 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:20:37.288316 25374 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:37.294400 23926 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:37.295271 25374 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.292425 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:20:37.296259 23920 raft_consensus.cc:606] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
W20260709 12:20:37.297227 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.303685 25374 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:37.305568 23927 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:37.306564 23996 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:37.309017 25583 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 1.061s	user 0.002s	sys 0.011s
I20260709 12:20:37.310750 24563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 389) took 1310 ms. Trace:
I20260709 12:20:37.311146 24563 rpcz_store.cc:276] 0709 12:20:36.000417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.007091 (+  6674us) service_pool.cc:224] Handling call
0709 12:20:36.007828 (+   737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:36.008318 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:36.008357 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:36.019385 (+ 11028us) log.cc:844] Serialized 494 byte log entry
0709 12:20:36.132842 (+113457us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:36.132883 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.132951 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:37.308379 (+1175428us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:20:37.310425 (+  2046us) raft_consensus.cc:1685] finished
0709 12:20:37.310448 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:37.310686 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178191616,"thread_start_us":80698,"threads_started":1,"wal-append.queue_time_us":153975}
I20260709 12:20:37.314924 25335 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:37.316862 25139 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.281503 24554 rpcz_store.cc:276] 0709 12:20:36.001152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.123282 (+1122130us) service_pool.cc:224] Handling call
0709 12:20:37.123570 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:37.123763 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:37.233983 (+110220us) log.cc:844] Serialized 14 byte log entry
0709 12:20:37.277013 (+ 43030us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:37.278028 (+  1015us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:37.279206 (+  1178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.279320 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:37.279552 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":124709,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":1065,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1315,"thread_start_us":121644,"threads_started":2,"wal-append.queue_time_us":42993}
I20260709 12:20:37.317400 25139 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.318600 23996 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:37.319506 25139 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.319887 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:37.320176 25344 raft_consensus.cc:3055] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:37.320595 25344 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:37.321257 25374 consensus_queue.cc:1059] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:37.321352 25344 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.322957 25374 raft_consensus.cc:3055] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:37.323359 25374 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:37.323514 25581 raft_consensus.cc:3055] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:37.323980 25581 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:37.324431 25374 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.324771 25581 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.325786 25374 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.321501 24559 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:37.325845 25581 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:37.339762 23847 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:37.337986 24559 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:37.340207 23847 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:37.338585 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:37.342741 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:37.346715 23854 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:37.338349 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:37.341605 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.348846 23966 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:37.349382 23846 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:37.337111 23848 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:37.350584 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.352182 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.340730 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.352960 23920 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:37.337635 25543 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:37.355389 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:37.356410 25570 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.441s	user 0.016s	sys 0.004s
I20260709 12:20:37.333782 23845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:37.352108 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:37.357592 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:37.358677 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.334599 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:37.323526 25344 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:37.341850 25547 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:37.333900 25545 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:37.392210 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.392143 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.387115 25416 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:37.347203 25605 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:37.364375 25570 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.449s	user 0.016s	sys 0.004s
I20260709 12:20:37.357661 25593 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:37.389351 25612 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:37.391040 23845 raft_consensus.cc:606] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:37.347740 25403 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:20:37.394658 23852 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.427035 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:37.357474 25335 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:20:37.438199 23854 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:37.387326 25565 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:20:37.392995 24525 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:37.426452 23845 raft_consensus.cc:614] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:37.443704 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.425700 25593 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.435276 25616 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:37.436853 25612 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:37.438654 25514 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:37.459585 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.460294 23849 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:37.461189 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:37.461382 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:37.422946 25416 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.462299 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.462602 25582 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:37.463682 25416 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.463907 23966 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:37.420706 25572 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:20:37.465950 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:37.466382 23892 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:37.425362 25605 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.418274 25545 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.474668 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:37.414191 25547 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.475286 23892 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:37.452487 25593 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.477799 25634 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:37.477948 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:37.489902 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:37.508020 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:37.508980 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.509479 23892 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:37.510118 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.511104 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.465152 25533 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:37.474319 25582 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:37.507227 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:37.474028 25321 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:37.531527 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:37.532001 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.532877 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:37.534778 23853 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:37.477871 25630 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:37.512892 25405 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:37.508335 25403 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:37.540439 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.542027 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 111) took 1771 ms. Trace:
I20260709 12:20:37.542466 24003 rpcz_store.cc:276] 0709 12:20:35.770805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.104037 (+333232us) service_pool.cc:224] Handling call
0709 12:20:37.096466 (+992429us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:37.096723 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:37.121425 (+ 24702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.541786 (+420361us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b540034ba54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:37.541967 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59228416}
I20260709 12:20:37.471143 25514 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.547995 25540 raft_consensus.cc:3055] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:37.547804 23852 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:37.564507 23926 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:37.564852 23852 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:37.512794 25198 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:37.465690 25616 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.487349 25565 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:37.474203 25609 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
W20260709 12:20:37.495424 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 108271us
I20260709 12:20:37.482554 25416 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:37.555210 23923 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:37.580796 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.555449 23927 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:37.581357 23923 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:37.513474 25634 raft_consensus.cc:697] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:37.512586 25324 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:37.556938 23925 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:37.585980 23849 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:37.557247 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.585183 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.530750 25582 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:37.526988 25631 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:37.512653 25599 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.593219 25599 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.531535 25533 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.594342 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:37.567149 23852 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:37.595916 25533 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:37.568037 25335 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:37.562166 25462 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:37.563222 25540 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:37.597162 25335 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.575806 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.577636 25547 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:37.583110 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:37.577667 25545 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:37.587280 23927 raft_consensus.cc:2393] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:37.610839 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:37.595836 25599 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.597723 25540 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.575714 25605 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.567780 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.597247 25462 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.593053 25631 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.613595 25634 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.615067 25335 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:37.636373 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.579932 25428 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:37.553390 25612 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.640661 25616 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:37.641755 24560 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:37.596020 25582 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:37.628049 23845 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:37.617609 25413 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:37.582190 25565 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.642858 25631 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.586310 25416 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:37.638053 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 67649.8us
I20260709 12:20:37.656587 23852 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:37.647603 25540 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.647377 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.666343 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.667138 23851 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:37.667042 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.668833 24003 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:37.669154 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:37.671303 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.636282 25599 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:20:37.673820 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.669785 23852 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:37.672727 24000 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:37.653976 25413 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.643759 25593 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.659252 25631 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:37.647068 25428 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.661643 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:37.690958 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.694561 25413 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:37.676201 23922 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:37.724062 25577 log.cc:927] Time spent T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 1.543s	user 0.003s	sys 0.001s
I20260709 12:20:37.726420 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:37.727492 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:37.728037 25593 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:37.729449 25565 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.730224 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:37.703182 25545 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.731509 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:37.732128 24557 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 1.
I20260709 12:20:37.731997 25545 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:37.733083 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:37.734135 25545 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.708053 24525 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:37.735397 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 57536.8us
I20260709 12:20:37.735788 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.736876 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:37.730063 25605 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:37.676846 23924 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:37.707820 25631 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:37.762873 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:37.942430 24004 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:37.943746 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.926630 23927 raft_consensus.cc:2410] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:20:37.790694 23999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1235) took 1771 ms (client timeout 1562 ms). Trace:
I20260709 12:20:37.954125 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:37.946870 23999 rpcz_store.cc:269] 0709 12:20:36.018953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.052246 (+ 33293us) service_pool.cc:224] Handling call
0709 12:20:37.790413 (+1738167us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b540009b5d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:37.790602 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253678336}
I20260709 12:20:37.883992 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.958325 23850 raft_consensus.cc:2410] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:20:37.961282 23969 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:37.957944 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:37.958796 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.962850 24004 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:37.963091 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.964099 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.717545 25599 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.968078 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.969952 23928 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:20:37.880102 25650 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:20:37.972184 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:37.783552 25651 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:20:37.789295 23847 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:37.972858 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.735788 25416 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.977840 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.979426 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.989399 23999 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:37.989289 24004 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:37.984774 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:37.990908 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.948855 25514 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:37.924347 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.922785 25335 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:37.960680 25551 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:37.764389 24559 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:37.781437 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:37.986986 25555 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:38.037057 25555 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.034730 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:37.965932 25413 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:37.975440 25543 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:37.975154 25317 raft_consensus.cc:3055] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:37.987610 25492 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.017534 25552 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:38.043376 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 341811us
I20260709 12:20:38.061398 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:38.062165 23999 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:38.063090 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:38.064353 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:38.067231 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:38.068456 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:37.977365 25599 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.050325 25317 raft_consensus.cc:740] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:38.071485 25317 consensus_queue.cc:260] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.072062 25599 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:38.072469 25317 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.057319 25552 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:38.074002 25374 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.748s	user 0.004s	sys 0.009s
I20260709 12:20:38.074281 25552 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.051184 25413 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.057408 25492 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.082067 25492 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:38.079135 25413 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.044695 25551 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.085145 25462 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:38.085633 25551 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.085091 25582 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.045202 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:38.091787 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:38.093658 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:38.095443 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:38.098682 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:38.049752 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 313389us
I20260709 12:20:38.099679 25599 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:38.101025 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:38.101986 25599 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:38.102428 25599 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:38.102864 25599 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.102612 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:38.035288 25335 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.122404 25324 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:38.147593 25324 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.147975 25555 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:38.125628 25428 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.149784 25428 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:38.150488 25428 consensus_queue.cc:1243] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:38.150663 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:38.124665 25291 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:20:38.151783 24004 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:38.154667 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:38.158290 25533 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:38.158912 25533 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.159453 25533 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.129733 25665 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:38.096427 23999 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:38.145367 25631 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:38.125444 23924 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:38.146056 25663 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:38.128289 25611 raft_consensus.cc:2955] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:38.168977 23999 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:20:38.174551 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 139891us
I20260709 12:20:38.191453 23999 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:38.193171 23999 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:38.198629 23999 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:38.188664 25555 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.147994 25324 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.149448 25335 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.205132 23999 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:38.206571 25555 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.211784 23999 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:38.214957 23999 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:38.203804 25291 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:20:38.194772 25631 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:38.224406 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 121904us
I20260709 12:20:38.176585 25552 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.227092 24524 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:38.201972 25514 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:20:38.231057 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:38.206467 25416 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:20:38.218530 25335 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:38.243577 24004 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:38.229271 25291 consensus_queue.cc:1243] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:38.259094 25552 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.197784 25655 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:20:38.238242 25672 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:38.232923 25666 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:20:38.226799 25631 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.270262 25631 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.272137 25631 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:38.248615 25466 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:38.274313 24561 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:38.275415 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 302) took 1391 ms. Trace:
I20260709 12:20:38.275746 24561 rpcz_store.cc:276] 0709 12:20:36.883908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.884072 (+   164us) service_pool.cc:224] Handling call
0709 12:20:38.243281 (+1359209us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:38.243483 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:38.274693 (+ 31210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.275191 (+   498us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b54004a33d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:38.275357 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123840512}
I20260709 12:20:38.277354 25582 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:38.274369 25466 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:38.278388 25466 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:38.272032 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:38.229041 25594 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:20:38.293800 25555 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:38.249213 25335 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.287689 25324 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.302942 25518 raft_consensus.cc:3055] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:38.303417 25518 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:38.304221 25518 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.306804 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:38.309083 25599 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.272702 25631 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.297802 25335 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.350852 25631 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.352310 25663 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:38.383754 23892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.922s (SENT) [suppressed 14 similar messages]
I20260709 12:20:38.386560 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.389328 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1227) took 1040 ms. Trace:
I20260709 12:20:38.394330 23893 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:38.396952 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.405627 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.408392 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.409761 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:38.405989 23923 raft_consensus.cc:2955] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:38.410928 23922 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:38.411067 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1229) took 1061 ms. Trace:
I20260709 12:20:38.411697 23845 rpcz_store.cc:276] 0709 12:20:37.349468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.543217 (+193749us) service_pool.cc:224] Handling call
0709 12:20:37.543962 (+   745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:37.653431 (+109469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.410469 (+757038us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b54002fbcd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:38.410857 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137125120}
I20260709 12:20:38.417018 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.417660 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:38.428016 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.428694 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:38.431146 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.433955 23848 rpcz_store.cc:276] 0709 12:20:37.348920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.350768 (+  1848us) service_pool.cc:224] Handling call
0709 12:20:38.385801 (+1035033us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:38.388894 (+  3093us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3268352}
I20260709 12:20:38.435606 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:38.433365 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:38.438365 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:38.439566 24003 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:38.441869 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 335054us
I20260709 12:20:38.443444 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:38.443897 24555 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:38.446904 24561 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:38.447476 25416 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:20:38.448802 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 48184.6us
I20260709 12:20:38.449738 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1247) took 1528 ms. Trace:
I20260709 12:20:38.450464 25324 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:38.454694 25472 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:38.458452 24001 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:20:38.458179 25533 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.480676 24001 pending_rounds.cc:85] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 1
I20260709 12:20:38.471503 24002 rpcz_store.cc:276] 0709 12:20:36.920680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.920798 (+   118us) service_pool.cc:224] Handling call
0709 12:20:38.448346 (+1527548us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:38.448757 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:38.449130 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.449155 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:38.449208 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:38.449243 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.449323 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:38.449493 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9120000}
I20260709 12:20:38.488499 24001 pending_rounds.cc:107] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:38.503037 24001 raft_consensus.cc:2889] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:38.508806 23854 raft_consensus.cc:2368] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4.
I20260709 12:20:38.297380 25466 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.504124 25416 consensus_queue.cc:1243] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:38.527810 23848 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:38.520327 25556 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:20:38.521143 25565 consensus_queue.cc:1059] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:20:38.521901 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:38.523880 25680 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.525915 25533 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:38.513199 23893 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:38.511123 24560 raft_consensus.cc:2955] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:20:38.560580 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 127617us
I20260709 12:20:38.561620 23820 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:38.562705 25556 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:38.563172 25653 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:38.563700 25653 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:38.564263 25653 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:38.563226 25556 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:38.565721 25556 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:38.541381 24556 raft_consensus.cc:2410] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:38.575296 25599 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:38.576385 25532 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:38.577353 25544 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:38.582930 24563 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:20:38.590628 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 87931.8us
W20260709 12:20:38.594833 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.599313 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.613114 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1245) took 1695 ms. Trace:
I20260709 12:20:38.614568 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1241) took 1160 ms. Trace:
I20260709 12:20:38.626710 25433 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:38.626277 25680 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.627668 25675 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:38.629081 25675 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:38.629451 25675 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:38.627738 25433 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.631726 25466 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:38.633409 25433 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:38.634397 25680 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:38.613720 25514 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:38.635418 25514 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:38.639869 25676 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:38.617937 23849 rpcz_store.cc:276] 0709 12:20:37.454232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.462050 (+  7818us) service_pool.cc:224] Handling call
0709 12:20:38.614165 (+1152115us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54002d41d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:38.614382 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282795904}
I20260709 12:20:38.640791 25676 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.637056 25514 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:38.648291 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 57764.5us
I20260709 12:20:38.647938 25324 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:38.661300 25514 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.663154 25518 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:38.664204 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 226324us
I20260709 12:20:38.647156 25676 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.665915 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1222) took 1318 ms. Trace:
I20260709 12:20:38.666342 23846 rpcz_store.cc:276] 0709 12:20:37.345805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.387450 (+ 41645us) service_pool.cc:224] Handling call
0709 12:20:38.402137 (+1014687us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:38.402602 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:38.403603 (+  1001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.403638 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:38.436247 (+ 32609us) log.cc:844] Serialized 494 byte log entry
0709 12:20:38.506871 (+ 70624us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:38.506917 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.506988 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:38.663625 (+156637us) raft_consensus.cc:1685] finished
0709 12:20:38.663648 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:38.663915 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4225792,"thread_start_us":67118,"threads_started":1,"wal-append.queue_time_us":135356}
I20260709 12:20:38.615809 23998 rpcz_store.cc:276] 0709 12:20:36.919869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.922015 (+  2146us) service_pool.cc:224] Handling call
0709 12:20:38.266628 (+1344613us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:38.266851 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:38.267080 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:20:38.522818 (+255738us) log.cc:844] Serialized 14 byte log entry
0709 12:20:38.606338 (+ 83520us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:38.607275 (+   937us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:38.608650 (+  1375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.609748 (+  1098us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:38.612777 (+  3029us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17301,"prepare.queue_time_us":310958,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":40045,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":172,"spinlock_wait_cycles":21049600,"thread_start_us":317194,"threads_started":2,"wal-append.queue_time_us":143709}
W20260709 12:20:38.647652 25678 log.cc:927] Time spent T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:20:38.646479 24525 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:38.684568 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 45292us
I20260709 12:20:38.685741 23892 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:38.687978 25673 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:38.688252 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:38.689302 25588 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:38.689806 25588 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.690233 25588 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.688756 25673 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.692715 23817 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:38.693917 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:38.694307 25492 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:38.695348 25492 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:38.698560 25541 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:38.699070 25541 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:38.699827 25324 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:38.700271 25541 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.701238 25324 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.702503 25541 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.697540 24560 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:38.717742 24563 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:38.718019 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:20:38.719872 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.724170 25673 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:38.724964 24557 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:38.727015 25593 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.727512 25593 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.730355 25600 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:38.731230 25600 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.733575 25600 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:38.734144 24000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1264) took 1465 ms (client timeout 1648 ms). Trace:
I20260709 12:20:38.735440 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.736304 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.737277 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:38.761420 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 68902us
W20260709 12:20:38.737636 25691 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.063s	user 0.003s	sys 0.000s
I20260709 12:20:38.738188 25595 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:38.740670 25675 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.742619 24562 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:38.743067 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49226.2us
I20260709 12:20:38.743413 24559 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:20:38.747967 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 59992.5us
I20260709 12:20:38.749809 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:38.750815 25424 raft_consensus.cc:3055] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:38.751721 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:38.752400 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.735374 23849 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:38.753273 25582 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:38.782451 25582 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.753386 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 119) took 1478 ms. Trace:
I20260709 12:20:38.758237 25425 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.758759 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.786589 25675 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:38.759147 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 112926us
W20260709 12:20:38.760426 24000 rpcz_store.cc:269] 0709 12:20:37.209780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.217136 (+  7356us) service_pool.cc:224] Handling call
0709 12:20:38.622901 (+1405765us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b5400410ad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:38.675495 (+ 52594us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032396032}
I20260709 12:20:38.763186 23850 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:38.720180 25676 raft_consensus.cc:2764] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:20:38.773476 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:38.773841 23817 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:38.774554 25611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35544 (request call id 74) took 4166 ms. Trace:
I20260709 12:20:38.771610 23895 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:38.775051 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.778079 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:38.785596 25582 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.787374 25424 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:38.790835 25593 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.797008 25433 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:38.816008 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:38.814553 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.786119 23996 rpcz_store.cc:276] 0709 12:20:37.275228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.308315 (+ 33087us) service_pool.cc:224] Handling call
0709 12:20:37.308649 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:37.318961 (+ 10312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.752847 (+1433886us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b54004119d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:38.753203 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22049536}
W20260709 12:20:38.852593 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.857977 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:38.855834 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:38.825767 25472 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:38.875558 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 97724.8us
I20260709 12:20:38.878835 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:38.859891 23853 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
W20260709 12:20:38.882078 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 108779us
I20260709 12:20:38.848158 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:38.853960 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:38.874773 25453 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:38.847666 25673 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:38.890256 23892 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:38.890949 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 124757us
I20260709 12:20:38.883901 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:38.874013 25472 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:38.894236 24558 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 3. Ops: []
I20260709 12:20:38.905584 23893 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:38.907789 25291 raft_consensus.cc:3055] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:38.907923 25542 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:38.908263 25291 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:20:38.908711 25688 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.242s	user 0.002s	sys 0.001s
I20260709 12:20:38.908582 25542 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.909644 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:38.909454 25291 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.910259 23996 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:38.911062 25291 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.907811 25655 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:38.914317 25335 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:38.915020 25335 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.897187 25595 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:38.903337 25395 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:38.894486 25520 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:38.914211 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:38.898655 25472 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.917531 25335 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:38.896904 24559 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:38.886695 25593 consensus_queue.cc:1059] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:20:38.902856 25453 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:38.911201 25542 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:38.923769 25690 log.cc:927] Time spent T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.257s	user 0.003s	sys 0.000s
W20260709 12:20:38.931239 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 47432.1us
I20260709 12:20:38.896973 25433 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.928777 25655 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:38.936628 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:38.939735 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:38.903366 25582 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:20:38.918774 25595 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.931918 23998 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:20:38.935187 25456 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:38.927224 25492 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:20:38.947715 25556 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.939073 25428 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:38.948796 25673 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:38.949415 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:38.949957 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:38.948297 25520 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.949908 25655 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.951015 24000 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.942991 25518 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.951713 25395 consensus_queue.cc:1059] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:38.953140 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:38.956254 25588 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:38.956676 25653 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.989858 24560 raft_consensus.cc:2410] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:38.931862 25453 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:38.788908 25611 rpcz_store.cc:276] 0709 12:20:34.607747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.658810 (+ 51063us) service_pool.cc:224] Handling call
0709 12:20:34.738264 (+ 79454us) log.cc:844] Serialized 494 byte log entry
0709 12:20:38.774340 (+4036076us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77163,"raft.queue_time_us":135590,"raft.run_cpu_time_us":2063,"raft.run_wall_time_us":271728,"thread_start_us":96920,"threads_started":1,"wal-append.queue_time_us":214138,"wal-append.run_cpu_time_us":3498,"wal-append.run_wall_time_us":1220569}
I20260709 12:20:38.958020 24004 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:38.959131 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:38.960807 25608 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:38.957723 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 74907.6us
I20260709 12:20:38.942922 25600 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:38.939004 24557 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:38.942941 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:38.974246 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.668243 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:38.970263 23820 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:38.983204 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:38.988322 25699 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:38.988747 23847 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.989080 25588 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:38.989096 23854 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:38.994872 24561 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:38.978972 25673 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.009605 24002 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:39.023273 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.985736 25518 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.019778 23892 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:39.003922 25395 consensus_queue.cc:1243] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:39.018206 25704 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:20:39.032691 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:39.033120 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f65f9b948cd4a8d88db397a8232dace with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:39.033499 23854 raft_consensus.cc:2376] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4. Re-sending same reply.
I20260709 12:20:39.034554 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:39.035601 25518 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.036580 25164 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:39.037029 25164 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.037384 25164 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:39.003453 25608 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.040659 25608 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:39.043910 25520 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.047549 25675 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:39.049593 25531 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.050899 23892 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:39.051229 25407 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:39.052361 23892 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:39.008344 25673 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:39.079474 25424 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.081194 25424 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:39.082078 25472 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.082572 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:39.084755 25701 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:20:39.086040 25593 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:39.086325 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 54505.8us
I20260709 12:20:39.086719 25593 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.088598 25595 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.089330 25593 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:39.087190 25531 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:39.090265 25531 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.092991 25531 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.085670 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:39.094683 25531 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:39.095019 25593 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:39.095274 25531 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.035647 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:39.099807 23847 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:20:39.105347 23847 pending_rounds.cc:85] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 5
I20260709 12:20:39.105660 23847 pending_rounds.cc:107] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:20:39.105973 23847 raft_consensus.cc:2889] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:39.106850 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 1773) took 1767 ms. Trace:
I20260709 12:20:39.106999 25425 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:39.100188 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:39.108605 25582 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:39.110630 25655 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:39.110901 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.110512 25582 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:39.114135 25588 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:39.114579 25588 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:39.114984 25588 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:39.102890 25472 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:39.103644 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 85537us
I20260709 12:20:39.107282 23847 rpcz_store.cc:276] 0709 12:20:37.338999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.339357 (+   358us) service_pool.cc:224] Handling call
0709 12:20:37.339638 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:37.788854 (+449216us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54000ea4a0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873ca06f 00007fa287442f60 00007fa2874447de 00007fa28744eb49 00007fa28744f416 00007fa28744bd8f 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62
0709 12:20:38.975698 (+1186844us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b580025a6d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873a80aa 00007fa28742a447 00007fa287442fe7 00007fa2874447de 00007fa28744eb49 00007fa28744f416 00007fa28744bd8f 00007fa28744b83e 00007fa28c410419 00007fa285987bd4
0709 12:20:39.106531 (+130833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:39.106781 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020305536}
W20260709 12:20:39.122080 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.104239 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:39.104816 25531 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:39.133185 25198 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:39.133796 25198 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.135546 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:39.135958 25198 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.107847 23852 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:39.116917 25514 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.118170 25608 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:39.085386 25600 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.118968 25395 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:39.155028 25700 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.201s	user 0.003s	sys 0.000s
I20260709 12:20:39.143150 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:39.156445 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:39.157205 23998 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:39.158993 25697 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 12:20:39.161085 25698 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.216s	user 0.001s	sys 0.001s
I20260709 12:20:39.164052 25492 raft_consensus.cc:3055] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:39.164526 25492 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:39.031580 25456 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:39.122795 23854 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
W20260709 12:20:39.145540 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44677us
I20260709 12:20:39.170152 24000 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
W20260709 12:20:39.176975 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 272823us
I20260709 12:20:39.208726 25608 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:39.209358 25608 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.209949 25454 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:39.210628 25454 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.211522 23966 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:39.215433 25456 raft_consensus.cc:993] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:39.215966 25541 raft_consensus.cc:1081] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:39.216233 25454 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.218437 25608 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:39.213609 25704 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:39.220476 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:39.225474 25588 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.226560 25425 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:39.227288 25595 consensus_queue.cc:1059] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:39.227978 25291 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:39.231352 25433 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:39.148240 25514 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.238139 25492 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.213693 23892 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:39.219219 25600 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:39.244599 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.249971 24002 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:39.250042 24561 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:20:39.259471 24561 pending_rounds.cc:85] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 4
I20260709 12:20:39.259804 24561 pending_rounds.cc:107] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:20:39.260087 24561 raft_consensus.cc:2889] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:39.251348 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:39.255162 25425 consensus_queue.cc:1243] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:39.262355 25545 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:39.264420 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 50870.3us
I20260709 12:20:39.266145 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:39.267361 23892 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:39.268054 25456 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:39.268873 25456 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:39.268329 23996 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:39.272668 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:39.274458 25469 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:39.276013 24004 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 4: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:39.279385 23818 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:20:39.280539 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60148.8us
I20260709 12:20:39.289714 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:39.272809 25456 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:39.271854 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:39.260120 25472 consensus_queue.cc:1059] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:20:39.287022 25595 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:39.306021 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:39.271492 25164 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.301868 25291 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:39.292982 25453 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:39.305670 25595 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:39.326558 24004 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 12:20:39.349193 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 55424.4us
I20260709 12:20:39.350464 25592 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:20:39.355108 25655 raft_consensus.cc:3055] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:39.355573 25655 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:39.356739 25514 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:39.356395 25655 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.338225 25595 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:39.324668 25291 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:39.368330 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:39.366432 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.363547 25655 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:39.382305 25588 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:39.372025 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 160563us
I20260709 12:20:39.383747 25291 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.385442 23966 leader_election.cc:400] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4.
I20260709 12:20:39.385783 23966 leader_election.cc:403] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:39.386735 25608 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4.
I20260709 12:20:39.387112 25593 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:39.389338 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.327194 25673 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.387485 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:39.394657 25335 raft_consensus.cc:3055] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:20:39.403628 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 85080.4us
W20260709 12:20:39.405700 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 106160us
W20260709 12:20:39.410871 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.415580 23817 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:39.416479 25655 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:39.417356 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.418004 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:39.418738 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 53701.8us
W20260709 12:20:39.420823 25694 log.cc:927] Time spent T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.538s	user 0.002s	sys 0.002s
I20260709 12:20:39.421494 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:39.422180 25655 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.422714 25655 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.423130 23928 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:20:39.423496 23928 pending_rounds.cc:85] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 2
I20260709 12:20:39.423736 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.424381 23923 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:39.424823 25655 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.423753 23928 pending_rounds.cc:107] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:20:39.425300 23928 raft_consensus.cc:2889] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:39.418818 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.426122 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:39.416968 23998 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:39.416985 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:39.429826 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.435485 23920 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:39.438234 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.435544 24557 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:39.439724 25653 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:39.441038 25608 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:20:39.441762 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 54347.7us
I20260709 12:20:39.443998 23817 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:39.445490 23817 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:39.445989 25600 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:39.446089 25424 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:39.402041 25335 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:39.447562 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.448087 25335 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.427248 25655 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:39.454378 25403 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.477775 24004 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:20:39.449846 25335 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.483402 25592 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:39.470660 25712 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.486500 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:39.490579 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.487702 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:39.492812 25704 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:39.493247 25704 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:39.493605 25704 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:39.468132 25608 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:39.497539 25592 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.498673 25608 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.499457 24558 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:39.499823 25592 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.477208 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:39.495771 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.496578 25542 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:39.471640 25425 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:39.496490 25403 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.486515 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.502552 25544 raft_consensus.cc:3055] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:39.503759 25544 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:39.504527 25403 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.504779 25673 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.504667 25544 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.506179 25544 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:39.511078 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:39.511489 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.512357 23997 raft_consensus.cc:2393] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 4: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:39.511502 25669 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:20:39.513274 23893 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:39.514010 25667 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:39.520108 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:39.520427 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:39.520658 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:39.521224 23852 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:39.521127 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.489455 25655 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:39.522643 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:39.523329 23997 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:39.523362 25655 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.520761 23854 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:39.529803 25712 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.532578 25712 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:39.536160 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.539907 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.541831 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.542562 23923 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:39.562417 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.520678 25667 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:39.543732 25164 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:39.575067 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:39.576033 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.573369 25472 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:39.586810 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.563213 25673 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.579283 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:39.574159 25711 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:20:39.660607 25608 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:39.661445 23998 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:39.665715 25713 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:20:39.666579 23923 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:39.667832 25704 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.592813 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:39.594990 25673 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.654788 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.571646 25702 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.587594 25667 raft_consensus.cc:697] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:39.679268 25702 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.689653 25673 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.696038 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.696151 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.684211 25702 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:39.699401 25702 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:39.699891 25702 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:39.700287 25702 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:39.700935 25680 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.701527 25680 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.702601 25712 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.703295 25712 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.707675 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.708379 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.709370 23928 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:39.714639 25667 consensus_queue.cc:237] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.720227 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:39.724772 25680 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.725790 25456 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:39.729225 25456 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:39.658936 25472 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.730620 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:20:39.748871 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 177771us
I20260709 12:20:39.732399 25472 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:39.815165 25715 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:20:39.815223 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:39.816772 23995 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:39.681833 25595 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.820134 25595 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:39.758829 25556 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:39.899773 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 324759us
I20260709 12:20:39.891635 25704 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:39.890551 25542 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:20:39.913300 25702 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.936292 25702 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:39.947710 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 90410us
I20260709 12:20:39.944247 25712 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:39.950176 23893 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:39.952409 25472 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:39.957312 25718 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:20:39.952142 25726 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:39.961249 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:39.966770 23997 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:39.977630 23893 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:39.979707 25726 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:39.982788 25673 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:39.959450 25472 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:39.987445 25472 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:39.986421 25673 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:39.989778 25673 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.002334 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:40.005502 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 319) took 1064 ms. Trace:
W20260709 12:20:40.005224 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 499481us
I20260709 12:20:40.009361 25492 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:39.986469 25726 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:40.005421 25472 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.026881 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.033547 25472 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.031538 25531 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.035737 25531 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:40.044068 25531 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.096028 25743 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.096766 25743 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.098183 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.099678 25743 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:40.100220 25743 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.102864 25740 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:40.103570 25740 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.105805 25740 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.106446 25740 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:40.107041 25740 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.108319 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.109319 25740 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.110198 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.100788 25743 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.110865 25740 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:40.111549 25740 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.112809 25743 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.114825 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.115569 23854 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:40.117134 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.117792 23854 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:40.121937 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.126132 25740 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:40.131217 25740 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.131844 25740 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.133978 25556 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:40.134400 25740 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.134603 25556 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.136751 25556 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:40.155510 23845 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:40.158394 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.159145 23845 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:40.168009 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:20:40.158403 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:40.171283 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.173611 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.174979 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.176379 25425 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:40.177049 25425 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.185398 25425 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:40.208449 25469 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:40.216022 25469 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.218331 25469 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.218451 23892 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.219905 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:40.220610 25469 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.221834 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.222540 23854 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:40.211951 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.228559 23928 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:40.223270 25669 consensus_queue.cc:1059] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:40.229629 25680 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:40.230470 25669 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:40.230225 25680 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.223959 25492 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:40.231730 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:40.232009 25492 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:40.226236 24001 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:40.232291 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.210366 25592 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:40.233564 25592 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.233966 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.235525 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.232475 25492 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.236136 23854 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:40.237686 23846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:20:40.243673 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.245471 23854 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:40.221047 23892 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.246073 25592 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.246713 25592 raft_consensus.cc:3055] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:40.247073 25592 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:40.250504 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:40.221143 25469 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:40.229184 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.255347 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:40.255268 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.232385 25680 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:40.258646 25680 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:40.259160 23926 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:20:40.259666 23926 pending_rounds.cc:85] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 1
I20260709 12:20:40.259917 23926 pending_rounds.cc:107] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:40.259245 25680 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.260150 23926 raft_consensus.cc:2889] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:40.259677 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.262537 25592 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.263890 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.264320 25680 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.268271 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.268635 25680 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:40.268888 23854 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:40.269198 25680 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:40.268962 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.270022 25680 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:40.270004 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.271737 23854 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:40.273131 25753 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:40.273829 25753 consensus_queue.cc:1059] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:40.264585 25592 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.275492 25753 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:40.275867 25753 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:40.276830 25753 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.278080 25753 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.285413 23854 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:40.290531 25469 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.291433 25755 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:40.294387 23854 raft_consensus.cc:2955] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:40.295712 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:40.296341 24001 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:40.300511 25492 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.302645 25492 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.303216 23893 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:40.304847 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:40.306854 25492 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:40.307365 25492 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.307806 25492 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:40.291960 25755 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.317947 25755 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.317833 24001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:40.327345 24001 raft_consensus.cc:606] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:40.332463 25492 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.324986 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.333667 23927 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:20:40.326606 23846 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:20:40.319522 25710 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.380s	user 0.002s	sys 0.000s
I20260709 12:20:40.334705 23846 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.324185 23845 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:20:40.341202 25531 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.359778 23847 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:40.334007 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 51509.5us
I20260709 12:20:40.343240 23846 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.345959 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:40.344861 25492 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.347196 23820 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.362876 25595 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:40.347852 25655 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.312443 25680 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.363844 25655 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.365330 25680 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:40.362968 25531 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.366608 25655 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:40.361739 24001 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:40.363078 23820 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.372949 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:40.373517 23927 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.374536 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.375160 23921 pending_rounds.cc:85] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 4
I20260709 12:20:40.375501 23921 pending_rounds.cc:107] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:20:40.375761 23921 raft_consensus.cc:2889] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:40.375981 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.376564 23922 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:40.376731 23928 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:40.377597 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.378593 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:40.379335 23920 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:40.380112 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.381211 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.375214 23849 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 1.
I20260709 12:20:40.382592 23997 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:40.377669 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.384761 23920 raft_consensus.cc:2410] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:20:40.348330 23854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:40.385327 23854 raft_consensus.cc:606] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.385699 23854 raft_consensus.cc:614] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:40.361443 24524 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.378671 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:40.384276 23817 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.390524 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:40.392903 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:40.394269 25756 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:40.394695 25756 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:40.395057 25756 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.395955 24002 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:40.396287 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.397100 23924 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:40.397656 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.398057 25755 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.398285 23928 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:40.398641 25755 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:40.400084 24001 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:40.399039 25755 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.397994 25680 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:40.430794 25291 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:40.432699 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.436834 23927 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:40.437779 25531 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:40.438189 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 53623.9us
I20260709 12:20:40.438835 25492 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:40.440276 25755 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.445657 25492 consensus_queue.cc:1059] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:40.446760 25755 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:40.447034 25592 raft_consensus.cc:3055] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:40.447448 25592 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:40.448290 25592 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.450107 25592 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:40.450718 23892 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.452170 23892 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.452602 25756 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.394027 24524 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.454438 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.454690 25558 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:40.455150 25558 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:40.455524 25558 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.455641 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.456900 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:40.458631 25198 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:40.459972 23892 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.463716 23922 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:40.464748 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.464969 23892 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.469811 25756 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:40.471275 23892 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.472287 25669 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:40.473004 25669 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:40.466614 25403 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:40.466699 23845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:40.475083 23845 raft_consensus.cc:606] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:40.475474 23845 raft_consensus.cc:614] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:40.454504 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60544.8us
W20260709 12:20:40.467439 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 83250.1us
I20260709 12:20:40.465277 25755 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.478375 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.478371 25755 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:40.479530 25755 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.480553 25595 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:40.465808 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.468122 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.479807 23845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:40.482486 23925 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:20:40.482620 23845 raft_consensus.cc:606] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:40.483072 23845 raft_consensus.cc:614] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:40.483362 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.462025 25655 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:40.461091 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.485708 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:40.508237 23923 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:40.508316 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:40.485618 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:40.486313 23925 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:40.486706 25655 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.488384 23817 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.513487 23820 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.491122 23922 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:20:40.491590 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:40.496790 23892 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:40.497450 25558 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.499411 25754 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:40.501093 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:40.501796 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:40.525786 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:40.527738 25558 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.521905 25592 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:40.528263 25754 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.528950 25592 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:40.503046 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:40.530038 24556 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:40.530186 25592 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.531487 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.532033 23850 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.504119 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:40.509840 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 64440.5us
I20260709 12:20:40.510190 23847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:40.516777 23817 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:40.534973 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.504805 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:40.520401 23927 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:40.530805 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:40.518558 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:40.539701 23847 raft_consensus.cc:606] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.540200 23847 raft_consensus.cc:614] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:40.514695 25472 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.541129 24524 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:40.538669 23893 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:40.545089 24002 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:40.547300 24003 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:40.553061 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.555998 23847 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.524874 25425 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:40.555299 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:40.525107 25291 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:40.521231 25556 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:40.550554 23997 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:40.565771 25556 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.566563 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:40.566392 25755 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.566919 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.524866 25740 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.562280 23925 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:40.568427 24560 raft_consensus.cc:1240] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:40.561697 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:40.568934 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.569525 23854 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:40.560214 24002 raft_consensus.cc:2393] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 4: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:40.527770 25198 consensus_queue.cc:1059] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:20:40.582873 23997 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:40.565096 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:40.546020 25752 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:40.539265 25743 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:40.579857 23854 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:40.580523 25556 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.580765 25321 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:40.581049 25740 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.582288 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:40.542675 25744 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:40.547755 25756 consensus_queue.cc:1059] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:20:40.548709 25472 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.587116 25752 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.581094 25755 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.627431 23847 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:40.583055 25291 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:20:40.634552 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.596378 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.636689 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.635030 25752 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.657284 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:40.658301 23925 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:40.642838 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.644122 23849 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:20:40.645042 23892 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.660149 23849 pending_rounds.cc:85] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 1
I20260709 12:20:40.660447 23849 pending_rounds.cc:107] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:20:40.660701 23849 raft_consensus.cc:2889] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:40.625972 25321 raft_consensus.cc:697] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:40.647505 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:40.662997 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:40.663178 25321 consensus_queue.cc:237] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.636781 25744 raft_consensus.cc:697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:40.677981 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.683544 23925 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:40.686203 23920 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:40.648624 23845 raft_consensus.cc:2376] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5. Re-sending same reply.
I20260709 12:20:40.688305 23849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:40.689720 23847 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:40.690042 23849 raft_consensus.cc:606] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.690404 23849 raft_consensus.cc:614] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:40.691095 23892 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:40.674355 25558 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:40.691946 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:40.693173 24001 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:40.696825 25744 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.731860 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.732806 23920 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:40.736322 25592 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:40.736908 25592 raft_consensus.cc:697] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:40.738260 25595 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.737854 25592 consensus_queue.cc:237] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.738768 25595 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.740847 25595 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.743671 23847 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:40.675370 25198 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:20:40.744827 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.753844 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:40.757427 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:40.758026 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 210913us
I20260709 12:20:40.737267 25752 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:40.762756 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.773895 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.775552 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.752318 25558 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:40.713212 25655 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.720405 25754 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.782902 23849 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:40.783882 25752 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.784113 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.784838 23849 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.784761 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.788975 25673 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:40.790304 24559 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:20:40.797686 23847 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:40.802695 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.807763 23849 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:40.797575 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.809594 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.810348 23847 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:40.810474 23929 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:40.812449 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.813325 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:40.814719 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 57348.1us
I20260709 12:20:40.819082 23923 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:40.781322 24554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 426) took 1648 ms. Trace:
I20260709 12:20:40.823423 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:40.823997 23925 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.812335 25403 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.830447 25558 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.843446 25403 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.845583 25403 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:40.838917 25784 consensus_queue.cc:1059] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:40.825610 25756 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:40.830924 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.838302 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.851507 24524 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.819895 25754 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:40.816705 25778 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.852713 25776 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:40.827929 25740 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.821300 24554 rpcz_store.cc:276] 0709 12:20:39.126152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.208906 (+ 82754us) service_pool.cc:224] Handling call
0709 12:20:39.209262 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:39.209651 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:39.209683 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:39.210239 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:20:39.407484 (+197245us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:39.565761 (+158277us) log.cc:844] Serialized 14 byte log entry
0709 12:20:39.580159 (+ 14398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:39.591485 (+ 11326us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:39.939257 (+347772us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18003761e0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:20:40.319010 (+379753us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:20:40.719443 (+400433us) raft_consensus.cc:1685] finished
0709 12:20:40.719466 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.774597 (+ 55131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":177193,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":4516,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":12524,"spinlock_wait_cycles":43835008,"thread_start_us":300322,"threads_started":2,"wal-append.queue_time_us":182190}
I20260709 12:20:40.821058 25608 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:20:40.857429 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.848604 25592 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.858606 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.859673 24524 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:20:40.847354 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.861816 25778 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.863412 25782 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:40.864183 25782 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:40.864353 25592 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:40.864734 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:40.865197 25784 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:40.865741 25784 raft_consensus.cc:697] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:40.866580 25592 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.867508 25754 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.869575 25754 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:40.864188 25778 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:40.870782 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:40.880177 25456 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.010s	sys 0.001s
I20260709 12:20:40.880501 23845 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:40.881603 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.882541 23845 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:20:40.883353 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.884512 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.885123 23845 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:40.864696 25782 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:40.886924 25472 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:40.886785 25782 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.866609 25784 consensus_queue.cc:237] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:40.873155 24525 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.900256 24525 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.857707 23850 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:40.878229 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.858424 25752 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:40.929868 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:40.930539 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:40.006212 24555 rpcz_store.cc:276] 0709 12:20:38.941356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.027495 (+ 86139us) service_pool.cc:224] Handling call
0709 12:20:39.504348 (+476853us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:39.504582 (+   234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:39.505030 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:39.575087 (+ 70057us) log.cc:844] Serialized 14 byte log entry
0709 12:20:39.930225 (+355138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:39.957583 (+ 27358us) log.cc:844] Serialized 26 byte log entry
0709 12:20:39.959592 (+  2009us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:39.962888 (+  3296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:39.962980 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:39.981603 (+ 18623us) raft_consensus.cc:1685] finished
0709 12:20:40.001530 (+ 19927us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.001761 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155414,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":4524,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":150793088,"thread_start_us":305505,"threads_started":2,"wal-append.queue_time_us":353786}
I20260709 12:20:40.871147 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.899331 25680 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:40.916330 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:40.938920 23892 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:40.918334 23999 consensus_meta.cc:287] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.915s	user 0.012s	sys 0.000s
W20260709 12:20:40.880533 25456 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.010s	sys 0.001s
I20260709 12:20:40.910570 23851 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:20:40.935793 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.939857 23999 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:40.934072 23848 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:40.942351 23850 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:40.901768 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.942844 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.954993 23923 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:40.955796 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:40.955993 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:40.956902 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.959385 25756 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:40.943063 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.959828 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:40.960844 23924 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:40.961062 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.901005 25608 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.952608 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:40.952333 23999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 126) took 2070 ms (client timeout 1723 ms). Trace:
I20260709 12:20:40.957866 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:40.950572 23818 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.901304 25791 raft_consensus.cc:3055] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:40.969856 23818 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.972231 23818 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:40.974082 23818 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:40.967272 23923 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:40.901983 25754 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:20:40.998695 23848 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:40.994441 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.001453 23818 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:40.967893 23999 rpcz_store.cc:269] 0709 12:20:38.881701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.888738 (+  7037us) service_pool.cc:224] Handling call
0709 12:20:39.047316 (+158578us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:40.002058 (+954742us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327e9c 00007fa284327a5b 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:40.952264 (+950206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23984768}
I20260709 12:20:40.965481 25472 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.019824 23920 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:40.966248 25778 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.000765 25740 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:41.044950 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:41.038165 25756 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:41.056260 25756 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.054917 23925 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:41.042984 23751 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 2 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:41.059332 25756 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:41.055590 25754 raft_consensus.cc:3055] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:41.060235 25754 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:40.971236 25791 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:41.000464 25779 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:40.974434 25744 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.036190 23845 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:41.024080 25655 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.023670 25595 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:41.020318 25796 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:41.000283 25769 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.063820 25740 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:41.048916 25403 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:41.073851 25403 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.076625 25403 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.078353 25669 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.078040 25740 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.078886 25669 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.081147 25669 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.069496 25788 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.082333 25753 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:41.082882 23950 debug-util.cc:398] Leaking SignalData structure 0x7b0800166460 after lost signal to thread 22704
I20260709 12:20:41.082829 25753 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.083369 25321 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:41.084183 23950 debug-util.cc:398] Leaking SignalData structure 0x7b0800163b80 after lost signal to thread 23786
I20260709 12:20:41.083967 25321 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.025260 25472 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.064530 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 1723) took 1644 ms. Trace:
I20260709 12:20:41.085682 25472 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:41.025399 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 125272us
I20260709 12:20:41.049217 25680 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:40.972066 25608 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.052614 23929 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:41.036634 25752 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.070765 25791 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.112772 25791 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:41.109915 25680 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.064433 25754 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.117583 25769 consensus_queue.cc:1059] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:41.091706 25321 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.085240 25753 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.086035 23926 rpcz_store.cc:276] 0709 12:20:39.419568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.419991 (+   423us) service_pool.cc:224] Handling call
0709 12:20:39.420320 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:40.260630 (+840310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.063478 (+802848us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b5400374bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:41.063663 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1928356736}
I20260709 12:20:41.117926 25655 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:41.120201 25744 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:41.073263 25796 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:41.121199 25680 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.085901 25795 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:41.121457 25796 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.122253 25795 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.124178 25796 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:41.125248 25795 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:41.068871 25595 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:41.072094 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 111100us
I20260709 12:20:41.081197 25667 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.063361 25778 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:41.023767 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 106434us
I20260709 12:20:41.130713 23854 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:41.082831 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:41.148978 24557 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 2: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:41.138827 24562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 433) took 1178 ms. Trace:
I20260709 12:20:41.149595 23820 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:41.139358 25779 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:41.150679 25779 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.150983 23852 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:41.151782 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:41.152546 23926 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:41.152674 24524 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:41.154563 23922 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:41.142588 23950 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2160 after lost signal to thread 23878
W20260709 12:20:41.155332 23950 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4aa0 after lost signal to thread 23879
W20260709 12:20:41.156646 23950 debug-util.cc:398] Leaking SignalData structure 0x7b08003085c0 after lost signal to thread 23953
W20260709 12:20:41.157006 23950 debug-util.cc:398] Leaking SignalData structure 0x7b0800391cc0 after lost signal to thread 23954
I20260709 12:20:41.156376 23751 catalog_manager.cc:5697] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 3, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 3 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:41.158874 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.142581 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.146697 25667 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.137639 23845 raft_consensus.cc:1240] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:41.151044 25779 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.165743 24556 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:41.166213 25779 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.152709 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 121) took 1033 ms. Trace:
I20260709 12:20:41.056954 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:41.154444 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:41.165817 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1256) took 1014 ms. Trace:
I20260709 12:20:41.167804 25667 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.168081 23853 rpcz_store.cc:276] 0709 12:20:40.151879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.142271 (+990392us) service_pool.cc:224] Handling call
0709 12:20:41.165749 (+ 23478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:41.150019 24562 rpcz_store.cc:276] 0709 12:20:39.960299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.961283 (+   984us) service_pool.cc:224] Handling call
0709 12:20:39.961614 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:39.962081 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:39.962114 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:39.962655 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 12:20:40.015437 (+ 52782us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:40.015509 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.015628 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:41.138545 (+1122917us) raft_consensus.cc:1685] finished
0709 12:20:41.138572 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:41.138763 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":422,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":50851,"threads_started":1,"wal-append.queue_time_us":76042,"wal-append.run_cpu_time_us":2105,"wal-append.run_wall_time_us":1044720}
I20260709 12:20:41.140136 25608 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:41.167013 23852 rpcz_store.cc:276] 0709 12:20:40.119377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.058883 (+939506us) service_pool.cc:224] Handling call
0709 12:20:41.059206 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.151517 (+ 92311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.152485 (+   968us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b54002fb7d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:41.152651 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210639104}
I20260709 12:20:41.141034 25469 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:41.160243 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.158905 23751 catalog_manager.cc:5697] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 2 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:41.166596 25776 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:41.129091 25595 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.164384 25778 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.193025 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.202760 23852 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:20:41.205102 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:41.191691 25456 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:41.206260 25456 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.206977 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1305) took 1247 ms. Trace:
I20260709 12:20:41.207449 23995 rpcz_store.cc:276] 0709 12:20:39.959260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.959388 (+   128us) service_pool.cc:224] Handling call
0709 12:20:41.206176 (+1246788us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:41.206396 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.206594 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.206631 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:41.206679 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:41.206718 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.206778 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:41.206917 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40112896}
I20260709 12:20:41.208343 24559 raft_consensus.cc:3055] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:41.208501 25456 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.208827 24559 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:41.186604 25469 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:41.209908 24559 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.210521 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:41.210724 25469 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.211748 25469 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.212030 24555 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:41.211153 24559 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.191488 25667 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:41.217640 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88945.7us
I20260709 12:20:41.219363 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:41.221843 25791 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:20:41.223805 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.226135 25667 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.228997 25667 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.229058 25803 consensus_queue.cc:1059] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:41.214121 25608 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.240743 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:41.239234 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 121709us
I20260709 12:20:41.252126 25472 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.254032 25770 raft_consensus.cc:3055] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:41.254491 25770 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:41.242100 25791 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:41.239408 25784 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:41.260221 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 266214us
I20260709 12:20:41.265226 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.276619 23849 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:41.277133 25797 consensus_queue.cc:1059] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:20:41.265981 25786 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:41.256445 25791 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:41.275890 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.261808 23924 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:41.279027 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.292856 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:41.311268 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 70602us
I20260709 12:20:41.310992 25770 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.282188 25782 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:41.320806 23999 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:41.285928 25791 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.321921 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.287107 25608 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:41.264253 25779 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:41.343101 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 184306us
I20260709 12:20:41.332782 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.348598 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.326551 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.349689 23893 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.335268 25770 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.354988 24001 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:41.355619 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.358642 23849 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:41.331329 25776 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:41.337703 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.329568 25782 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.367612 25782 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.332129 25595 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.371505 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:41.372099 23853 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.373574 23852 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:41.374719 23995 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:41.372092 25595 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.376916 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:41.377445 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.375922 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.378772 25556 raft_consensus.cc:3055] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:41.379158 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.357350 25796 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:41.380070 25799 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:20:41.352999 25667 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:20:41.382448 23892 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.382710 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.383936 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.384377 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:41.385176 25403 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:41.385701 25403 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:41.386222 25403 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:41.287446 25786 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.384750 23853 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:41.385115 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:41.388810 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.379221 25556 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:41.381511 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.378701 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.357033 25472 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.413550 23999 raft_consensus.cc:2410] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:41.355902 25492 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.354939 25814 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:41.356602 23998 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:41.427023 25776 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.427534 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.428180 23995 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:41.429174 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:41.435864 25806 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:20:41.440011 24000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1134) took 1954 ms (client timeout 1905 ms). Trace:
I20260709 12:20:41.445060 25779 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:41.445165 23846 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.447647 25492 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:41.440570 24000 rpcz_store.cc:269] 0709 12:20:39.485866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.486174 (+   308us) service_pool.cc:224] Handling call
0709 12:20:41.439743 (+1953569us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540009abd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:41.439923 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238961536}
I20260709 12:20:41.396934 25456 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:41.411675 25807 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:41.458427 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:47066 (request call id 1267) took 1286 ms. Trace:
I20260709 12:20:41.461356 23846 rpcz_store.cc:276] 0709 12:20:40.159409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.237546 (+ 78137us) service_pool.cc:224] Handling call
0709 12:20:41.443762 (+1206216us) spinlock_profiling.cc:243] Waited 88 ms on lock 0x7b5400299d54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa287443a3d 00007fa28c413cd0 00007fa285998254 00007fa2859981e2 00007fa285998111 00007fa28599808c 00007fa285997342 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:41.445826 (+  2064us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202498944}
I20260709 12:20:41.458283 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.462481 24001 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:41.463248 25752 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:41.463768 25752 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:41.464864 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 111846us
I20260709 12:20:41.463248 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:41.460417 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:41.466967 23921 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.467998 23922 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:41.412472 25782 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:20:41.471482 25752 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.467075 25807 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.500579 25807 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:41.502707 25786 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:41.507033 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:41.508289 23950 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce7a0 after lost signal to thread 24028
W20260709 12:20:41.508805 23950 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce920 after lost signal to thread 24029
I20260709 12:20:41.476666 25164 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:41.478461 23751 catalog_manager.cc:5697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 2 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:41.510689 25164 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:20:41.483254 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 463843us
I20260709 12:20:41.511639 25164 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.486243 25556 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.512363 25754 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.513058 25164 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:41.513240 25556 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.488363 25403 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.515949 25403 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.490335 23921 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:41.512249 23818 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.523270 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.523583 25773 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:41.510387 23950 debug-util.cc:398] Leaking SignalData structure 0x7b08002c86a0 after lost signal to thread 24587
I20260709 12:20:41.523653 25778 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.525828 25773 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.530558 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:41.546705 23928 raft_consensus.cc:2410] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:41.531546 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.462692 25814 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:41.543816 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 78283.9us
I20260709 12:20:41.552933 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.550555 23818 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.556639 23846 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:20:41.560251 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 205793us
W20260709 12:20:41.525388 23950 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1120 after lost signal to thread 24588
I20260709 12:20:41.562114 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.566382 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1179) took 1181 ms. Trace:
I20260709 12:20:41.561625 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.569840 25816 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.570354 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:41.571475 25544 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:41.572310 24559 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:41.572950 23818 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.566995 23928 rpcz_store.cc:276] 0709 12:20:40.377931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.398990 (+ 21059us) service_pool.cc:224] Handling call
0709 12:20:41.530412 (+1131422us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:41.558920 (+ 28508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80161024}
I20260709 12:20:41.580821 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:41.544451 25425 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:41.581907 25805 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:41.582854 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:41.583523 24557 raft_consensus.cc:1813] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Handling vote request from an unknown peer 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.583678 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.584138 24557 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 2: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:41.584980 25556 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:41.585549 25786 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.586113 25556 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:41.559299 25779 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.586583 25556 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:41.586268 23751 catalog_manager.cc:5697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 2 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:41.527740 25791 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.587504 25556 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.588071 23751 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 2 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:41.589365 25791 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:41.591027 25796 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:41.591234 25755 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:20:41.591493 25796 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:41.592000 25796 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:41.586308 25811 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.593080 25786 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.581948 25425 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.572968 25807 consensus_queue.cc:1059] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:20:41.595193 25608 raft_consensus.cc:993] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:41.595611 25807 raft_consensus.cc:3055] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:41.596040 25807 raft_consensus.cc:740] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:41.596653 24559 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:41.575264 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:41.597023 25807 consensus_queue.cc:260] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.601739 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:41.604463 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.588747 25556 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.577966 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:41.574990 23950 debug-util.cc:398] Leaking SignalData structure 0x7b0800368480 after lost signal to thread 25324
I20260709 12:20:41.613291 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:41.614130 24560 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.602748 23926 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:41.616457 23817 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:41.617072 25805 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:41.579725 25816 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.590893 25456 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:20:41.619946 23928 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:41.621513 25807 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.631716 23846 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:41.633471 25818 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:41.634217 25805 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:41.635185 25655 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.595633 25425 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.635630 25655 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:41.633195 25816 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.636081 25655 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.637921 25816 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:41.612759 25744 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:41.638959 25425 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:41.641063 25784 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:41.623170 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.622354 24557 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:41.642868 23818 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.644222 23818 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.623935 25608 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:20:41.622377 25791 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:41.647035 25811 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:41.628031 25814 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.650070 25797 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:41.650311 25544 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.650852 25544 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.651221 25544 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.652544 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:41.604090 25788 raft_consensus.cc:1081] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:41.634246 25813 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:41.653983 25744 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:41.654964 23747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43178 (request call id 252) took 7039 ms. Trace:
I20260709 12:20:41.656814 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:41.658947 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:41.659577 24000 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.615150 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:41.662149 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 47465.2us
I20260709 12:20:41.663173 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.669358 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:41.670483 24002 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:41.670733 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.672726 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:41.679713 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.687120 24558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36558
I20260709 12:20:41.669378 25791 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.666448 25788 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.692052 25800 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:20:41.693903 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.667743 25778 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:41.718133 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 320847us
I20260709 12:20:41.719017 23921 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:41.692375 25779 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.691282 25795 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:41.725824 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 313317us
I20260709 12:20:41.726303 25778 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:41.728089 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.729197 25778 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:41.729797 23893 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.730857 25778 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.733129 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:41.685480 24000 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:41.708534 24558 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:41.740360 23818 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:41.741578 25556 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:41.742267 25556 raft_consensus.cc:697] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:41.743237 25556 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.747644 25805 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:41.760087 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.718119 25816 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:41.728089 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.717948 25425 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.767258 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:41.715481 24559 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:41.769369 25770 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:41.770108 25771 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.774935 25403 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:41.773531 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 45509.7us
I20260709 12:20:41.767313 25816 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:41.760248 24558 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:41.779729 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.655556 23747 rpcz_store.cc:276] 0709 12:20:34.615670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.615852 (+   182us) service_pool.cc:224] Handling call
0709 12:20:41.654733 (+7038881us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:35.500704 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:35.554480 (+ 53776us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:35.554515 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:20:35.554533 (+    18us) tablet.cc:662] Decoding operations
0709 12:20:35.555559 (+  1026us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:35.555648 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:35.555678 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:20:35.556449 (+   771us) tablet.cc:701] Row locks acquired
0709 12:20:35.556468 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:20:35.556601 (+   133us) write_op.cc:270] Start()
0709 12:20:35.556711 (+   110us) write_op.cc:276] Timestamp: P: 1783599635556556 usec, L: 0
0709 12:20:35.556732 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:20:35.557328 (+   596us) log.cc:844] Serialized 4012 byte log entry
0709 12:20:35.915453 (+358125us) op_driver.cc:464] REPLICATION: finished
0709 12:20:37.338809 (+1423356us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa2843420ac 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa28ae82ef0
0709 12:20:37.389822 (+ 51013us) write_op.cc:301] APPLY: starting
0709 12:20:37.392343 (+  2521us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:37.441993 (+ 49650us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:37.444308 (+  2315us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:37.549523 (+105215us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:37.549733 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:20:37.549771 (+    38us) write_op.cc:312] APPLY: finished
0709 12:20:37.550057 (+   286us) log.cc:844] Serialized 77 byte log entry
0709 12:20:37.589637 (+ 39580us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:37.617049 (+ 27412us) write_op.cc:454] Released schema lock
0709 12:20:37.626952 (+  9903us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:37.657116 (+ 30164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:37.661379 (+  4263us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":198600,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":1441077,"apply.run_cpu_time_us":8209,"apply.run_wall_time_us":289166,"num_ops":10,"prepare.queue_time_us":308920,"prepare.run_cpu_time_us":14204,"prepare.run_wall_time_us":188335,"raft.queue_time_us":194640,"raft.run_cpu_time_us":27198,"raft.run_wall_time_us":1510474,"replication_time_us":358558,"spinlock_wait_cycles":18838272,"thread_start_us":1912826,"threads_started":5,"wal-append.queue_time_us":238655,"wal-append.run_cpu_time_us":39480,"wal-append.run_wall_time_us":2320474}]]}
I20260709 12:20:41.784173 24560 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:41.779179 25770 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:41.801538 23892 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:41.805123 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 134461us
I20260709 12:20:41.788179 25795 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.787992 25811 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.808604 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:41.806325 25823 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:41.811565 25791 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:41.816728 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:41.817674 25608 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:41.818233 25608 raft_consensus.cc:697] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:41.819159 25608 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.800246 25667 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.834829 24000 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:41.835376 24000 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:41.835983 24004 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:41.803810 25770 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:41.850076 24002 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:41.849447 24000 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.844828 25822 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.844907 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:41.861681 24000 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:41.839104 25788 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:20:41.863889 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:20:41.875977 25821 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:20:41.876848 23995 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 4: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:41.824795 25795 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.865463 24002 raft_consensus.cc:2376] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2. Re-sending same reply.
I20260709 12:20:41.853467 25791 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:41.894320 23892 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.864879 25456 consensus_queue.cc:1059] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:20:41.834854 25816 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.905238 24000 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:41.919909 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:41.920192 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.908377 25544 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.917603 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:41.921170 24000 raft_consensus.cc:2410] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:41.924980 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.927394 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.927847 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:41.933210 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.933631 25791 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.934613 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.936960 24558 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:41.937688 25796 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:41.939534 25544 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:41.939849 25796 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:41.940425 23999 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:41.943539 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.945147 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:41.945360 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.946262 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.946966 23845 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:41.946909 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:41.950373 24558 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:41.961373 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:41.962971 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 45459.7us
I20260709 12:20:41.963430 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.964346 24002 raft_consensus.cc:2410] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:41.966603 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.967384 24000 raft_consensus.cc:2368] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5.
W20260709 12:20:41.968245 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.969219 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:41.970187 23966 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:41.970383 23852 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:20:41.973997 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 92845.7us
I20260709 12:20:41.974072 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:41.976624 23849 raft_consensus.cc:2368] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5.
I20260709 12:20:41.977114 23853 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:41.981176 23854 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:41.981921 24525 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:41.964104 25803 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:41.962172 25795 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:41.984261 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:41.966403 25321 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:41.973372 25831 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:20:41.971453 25403 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:41.994952 24525 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:41.993790 25754 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:41.997454 25803 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:42.019546 24525 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:42.011008 25813 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.000957 25403 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.065171 25814 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.068511 25784 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:42.069164 25784 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.072438 25784 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:42.073725 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:42.074743 23854 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:42.020198 23845 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:42.020529 25754 raft_consensus.cc:697] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:42.023625 25807 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.026536 24557 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:42.087405 25608 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:42.120126 25845 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:42.121892 25839 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:20:42.129391 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:42.130456 25655 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.132714 25655 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:42.134042 25844 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:42.123088 25608 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.136538 25608 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:42.134546 25844 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.147912 24003 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:42.149091 24002 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:20:42.154959 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 65885.9us
I20260709 12:20:42.094040 25803 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.155026 25822 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:42.150244 25844 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.123358 25788 consensus_queue.cc:1059] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:20:42.120862 25845 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.175081 25608 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:42.196480 25841 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:20:42.213238 25608 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.213835 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:42.215396 25608 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:42.218458 24001 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:42.219592 25403 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:42.171391 25797 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:20:42.210284 24003 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.212126 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:42.212607 25845 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:42.221168 24004 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.222522 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:42.228727 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:42.218305 25753 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:42.223598 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:42.229744 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:42.230535 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:42.231289 23926 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.231325 23921 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:42.181694 25667 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:42.235571 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:42.236302 23921 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:42.237092 23928 raft_consensus.cc:1813] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Handling vote request from an unknown peer 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:42.238200 23928 raft_consensus.cc:2410] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:20:42.240697 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:42.243136 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:42.244642 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:42.246491 23929 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:42.249533 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:42.250757 24524 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:42.154258 25754 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.255178 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:42.232932 25608 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:42.260903 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:42.264981 24560 raft_consensus.cc:2393] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 4: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:42.234959 25753 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:20:42.262099 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 242119us
I20260709 12:20:42.240033 25667 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.253634 25815 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:42.255431 25811 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:20:42.277786 25815 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:42.278333 25811 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:42.278751 25811 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:42.257910 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:42.279055 25815 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.280790 25753 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.258771 25776 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:42.285903 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:42.255671 25784 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.263639 25814 consensus_queue.cc:1059] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:20:42.287865 25814 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:42.288225 25814 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:42.253665 25740 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:20:42.289040 25814 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.293469 24524 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:42.279506 25811 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.294946 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:42.303336 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:42.315196 23892 leader_election.cc:400] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5.
I20260709 12:20:42.318986 23892 leader_election.cc:403] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:20:42.315505 24004 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:42.317301 23926 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:42.328601 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:42.321439 23818 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:42.331890 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:42.280792 25815 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.338899 23892 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:42.342200 25321 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:20:42.342459 25773 consensus_queue.cc:1175] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:20:42.343035 25673 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:42.344498 25779 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:42.345713 25822 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.345927 25852 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.314805 25403 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:20:42.319059 25776 consensus_queue.cc:1175] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "22996f888daf435398b693481171c18c" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 6 } }
I20260709 12:20:42.330826 25843 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.268977 25608 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.334828 25814 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.317598 25803 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:20:42.319229 25807 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:20:42.334059 25823 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:20:42.317446 25770 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.342233 25854 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.352389 25811 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:42.363505 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 70101.8us
I20260709 12:20:42.353863 25779 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:42.366705 25822 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.384948 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:42.367993 25834 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.365296 25754 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:42.364024 25843 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.397092 23817 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:42.388993 25754 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:42.382349 25321 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:20:42.404413 25791 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:42.395532 25852 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.386940 25822 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.389508 25824 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:20:42.409161 25754 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:42.421964 25859 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.053s	user 0.001s	sys 0.001s
I20260709 12:20:42.422046 25770 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:42.423442 24001 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:42.424805 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:42.426045 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:42.426541 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:42.427398 24560 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:42.426653 23849 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:42.428850 25822 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:42.432483 23892 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:42.437927 23923 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:42.428704 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:42.411180 25291 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:20:42.449504 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.457687 25834 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.458820 25866 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:42.451022 25822 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:42.461933 25822 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.462350 25822 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.416206 25779 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:42.470476 25858 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:20:42.474817 25844 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.482507 25608 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:42.484246 25843 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:42.486032 25667 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.487766 23928 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:42.488837 25667 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:42.492297 25753 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.492952 25822 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.477783 25844 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:42.499320 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:42.509702 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:42.511277 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 122890us
I20260709 12:20:42.512969 23966 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:42.510442 23849 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:42.515592 23966 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:42.521451 23892 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:42.452461 25797 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:20:42.518778 25608 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.530784 25822 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:42.525408 25805 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:20:42.533058 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:42.533869 24560 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.536542 25844 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:42.537067 25844 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.538827 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:42.539490 23850 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.539788 25844 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:42.543478 25814 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.524878 25843 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:42.546288 25814 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.547639 25843 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.548049 25843 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.551218 25795 raft_consensus.cc:3055] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:42.551643 25795 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:20:42.552904 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.552464 25795 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.554073 25795 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.555470 24560 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:42.564170 25816 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.563797 25754 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.566787 25779 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.569361 23850 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
W20260709 12:20:42.577081 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 61548.3us
I20260709 12:20:42.583650 23892 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:42.575951 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 199466us
I20260709 12:20:42.584867 24524 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:42.585825 25680 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.586400 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:42.587352 25800 raft_consensus.cc:3055] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:42.589531 25800 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:42.589797 25680 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:42.590368 25680 raft_consensus.cc:697] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:42.591253 25680 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.590503 25800 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.593180 25800 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.594281 23846 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:42.594982 24525 leader_election.cc:400] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5.
I20260709 12:20:42.595294 24525 leader_election.cc:403] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:42.595427 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 276937us
I20260709 12:20:42.595687 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:42.595935 25813 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5.
I20260709 12:20:42.596376 24525 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:42.597178 25813 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.598898 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:42.605854 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:42.606966 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:42.609391 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:42.610047 24560 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.611485 25425 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.614208 25784 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:42.588063 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:42.588938 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:42.623658 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:42.623955 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:42.624248 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:42.624780 23847 raft_consensus.cc:2393] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:42.625919 23851 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.693516 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:42.696094 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 99984us
W20260709 12:20:42.697413 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 113849us
W20260709 12:20:42.739228 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.552228 25814 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:42.741462 24560 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:42.743323 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:42.747396 23848 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:20:42.749553 23847 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:42.752611 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 55385.9us
W20260709 12:20:42.700910 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 89799.7us
I20260709 12:20:42.756774 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:42.759547 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:42.760696 23999 raft_consensus.cc:2410] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:42.763013 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:42.784603 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.742640 23849 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:42.749214 23851 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:42.764422 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:42.807798 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:42.810061 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:42.814198 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 64766.1us
I20260709 12:20:42.813716 25885 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:42.815241 25885 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:42.819342 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:42.820019 23927 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:42.801810 23847 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:42.821568 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:42.801070 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 46883.2us
I20260709 12:20:42.699432 25872 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.824499 23893 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:42.824539 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 60231.4us
W20260709 12:20:42.823899 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60992.1us
I20260709 12:20:42.828900 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:42.743005 25771 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:42.750217 25556 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:42.843079 25885 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:42.845031 23847 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:42.829670 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:42.841024 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:43.041713 23924 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:42.703843 25779 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.818425 25796 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 12:20:42.838141 25321 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.043681 25321 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.819002 25852 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.963189 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:43.045215 25779 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.046671 24560 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 2: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:42.820184 25797 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.046998 25556 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.047629 25797 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:42.936088 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:42.923532 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:43.049041 23925 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:42.982688 25771 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:43.050062 25321 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.050182 25771 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.052070 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:42.745857 25778 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.217s
I20260709 12:20:42.997139 25867 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:43.056797 25754 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:42.998088 25886 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:43.058064 25886 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:42.998703 25198 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.000741 25865 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:43.001991 25878 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:20:43.002369 25877 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.003386 25805 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.010144 25780 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:42.993960 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 169532us
I20260709 12:20:43.038681 25843 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.088740 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:43.058717 25854 consensus_meta.cc:287] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.000s
I20260709 12:20:43.045848 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:43.050675 25556 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:42.984673 24562 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:43.059974 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 238465us
W20260709 12:20:43.062278 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 232665us
I20260709 12:20:42.995476 23995 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:20:43.088938 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:43.105698 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.111526 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:43.089288 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:43.093209 25805 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.122605 25805 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.122831 25797 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.092572 25877 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.124272 25797 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:43.124856 25797 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.125375 25877 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:43.080442 25865 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.127411 25835 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:43.130599 23966 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:43.105080 25800 consensus_meta.cc:287] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.004s
I20260709 12:20:43.061861 25886 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.134879 23923 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:43.137449 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.104393 25796 consensus_queue.cc:1243] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:20:43.114544 23995 pending_rounds.cc:85] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 5
I20260709 12:20:43.114826 25854 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5.
I20260709 12:20:43.114650 25824 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.129302 25865 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:43.117760 25867 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:43.161724 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:43.162592 23926 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:43.141746 25844 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.168979 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:43.154979 23995 pending_rounds.cc:107] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:20:43.173312 24002 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:43.173735 24002 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:43.146693 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:43.168704 25795 consensus_meta.cc:287] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.001s
I20260709 12:20:43.181301 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:43.174556 24002 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.160181 25805 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:43.182219 23927 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
W20260709 12:20:43.257936 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 77008.4us
I20260709 12:20:43.259119 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:43.174360 23995 raft_consensus.cc:2889] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:43.260865 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 96745.9us
I20260709 12:20:43.270467 23920 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:43.181185 25770 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.166744 25824 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.105603 25780 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:43.320993 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 54094.4us
I20260709 12:20:43.322242 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:43.322760 25872 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:43.322832 25291 consensus_queue.cc:1059] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:43.323980 25556 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:43.324155 25291 raft_consensus.cc:3055] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:43.324391 25556 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.282124 25492 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:43.286885 25868 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.290238 25544 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.258836 25805 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.336627 25815 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:43.348826 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 211352us
I20260709 12:20:43.350719 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:43.324196 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.365504 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:43.329521 25291 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:43.330961 25556 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.351847 25673 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.329080 25655 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:43.338241 25871 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.337297 25885 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:43.410066 25796 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:43.425532 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:43.372779 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.405752 25797 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.429936 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:43.411098 25872 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.413447 25843 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.421921 25796 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:43.347617 25544 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.442857 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:43.365607 25815 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.337641 25868 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.468273 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:43.441728 25773 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.469630 25595 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.433717 25899 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.434026 25788 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.425076 25754 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:20:43.415040 25673 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.424266 25885 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.469980 25773 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.479323 25780 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.482812 25744 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:43.476410 25595 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.484946 23997 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:43.424837 25655 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.488798 25805 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.489286 25834 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:20:43.413848 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 153219us
I20260709 12:20:43.491184 25872 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:43.491891 25905 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:20:43.497150 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:43.532392 25897 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:43.549870 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 52826.8us
I20260709 12:20:43.550019 25897 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.552057 25595 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.496374 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:43.426600 25871 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.451907 25291 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.450330 25796 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.465775 25835 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:43.515359 25868 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.520709 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:43.527735 23848 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:43.534765 23850 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:43.552228 25897 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.430920 25795 consensus_queue.cc:1059] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:20:43.366274 25867 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.469863 25889 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.561112 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:43.549220 24002 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.567776 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:43.581264 24560 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:43.567312 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:43.582602 23848 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
W20260709 12:20:43.535516 25898 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 12:20:43.538821 25907 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:20:43.536751 25887 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:20:43.558058 25425 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.583439 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:43.599283 23850 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:20:43.536623 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:20:43.540458 25903 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.003s
I20260709 12:20:43.609313 25796 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.535508 25773 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.539116 25834 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:20:43.592207 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.559484 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.537679 25655 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.595984 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:43.549428 25814 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:43.534304 25744 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.601505 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:43.602358 25544 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.602358 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:43.603698 25885 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.606099 25871 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.560178 25469 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.620805 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:43.587105 25889 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.634214 23850 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:43.634064 25469 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.635389 24558 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:43.637758 23966 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:43.616132 25608 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:43.538079 25673 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.509159 25899 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.586792 25807 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:20:43.638293 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:43.645710 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.627480 24002 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:43.618773 25824 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.649011 24001 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:43.636243 25469 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.651213 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.648942 23820 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:43.659950 25906 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:43.660450 25906 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.660835 25906 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.661228 25544 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:43.661679 25544 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.662092 25544 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.662621 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:43.648219 25754 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.666783 25754 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.668995 25754 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:43.670853 25796 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:43.670511 25544 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.672228 25834 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:43.676191 25791 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:20:43.676294 25544 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:43.678906 25886 consensus_meta.cc:287] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.534s	user 0.005s	sys 0.003s
I20260709 12:20:43.679358 25886 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.683133 25886 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.684734 25744 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.686184 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:43.687181 23846 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:43.688344 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:43.691491 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:43.692099 23848 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:43.691761 25556 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.693243 23849 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:43.693605 24562 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:43.697598 23853 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:20:43.698545 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:43.699134 23845 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.700739 25899 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.647770 25904 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:43.702867 25904 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.703766 25904 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.705613 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1221) took 1415 ms. Trace:
I20260709 12:20:43.655658 25655 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.706000 23920 rpcz_store.cc:276] 0709 12:20:42.290025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.315668 (+ 25643us) service_pool.cc:224] Handling call
0709 12:20:42.598702 (+283034us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:43.705450 (+1106748us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b540039b054. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:43.705554 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337540352}
I20260709 12:20:43.706844 25655 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.656540 25425 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:43.710516 25425 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.710961 25425 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:43.709405 25164 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:43.715479 25164 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:43.716408 25164 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.717363 25164 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.656853 24554 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: []
W20260709 12:20:43.719520 25902 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
I20260709 12:20:43.720186 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.721458 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.721709 25872 raft_consensus.cc:3055] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:43.722146 25872 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:43.722604 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.722919 25872 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.724108 25872 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.630750 25814 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.657305 24002 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:43.729482 23851 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
W20260709 12:20:43.730196 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.659299 25673 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:20:43.731097 25890 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.731343 25673 consensus_queue.cc:1243] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:20:43.731600 25890 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.733758 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1339) took 1157 ms. Trace:
I20260709 12:20:43.734422 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:43.735152 24557 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
W20260709 12:20:43.736485 25896 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.285s	user 0.003s	sys 0.000s
I20260709 12:20:43.739612 23818 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:43.742033 25886 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:43.742399 25886 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.742734 25886 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.742857 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.744691 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1182) took 1445 ms. Trace:
I20260709 12:20:43.745177 23998 rpcz_store.cc:276] 0709 12:20:42.299040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.317795 (+ 18755us) service_pool.cc:224] Handling call
0709 12:20:42.357363 (+ 39568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:42.561436 (+204073us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b1800427480. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435c455 00007fa287444060 00007fa287444bfb 00007fa28744f64b
0709 12:20:42.561588 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:20:42.583986 (+ 22398us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.136110 (+552124us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:43.180537 (+ 44427us) log.cc:844] Serialized 26 byte log entry
0709 12:20:43.258220 (+ 77683us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:43.571626 (+313406us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.614158 (+ 42532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.616835 (+  2677us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.717526 (+100691us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:20:43.744482 (+ 26956us) raft_consensus.cc:1685] finished
0709 12:20:43.744504 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.744634 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4434,"prepare.queue_time_us":332521,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":2094,"raft.queue_time_us":22421,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":24162,"spinlock_wait_cycles":106876672,"thread_start_us":506762,"threads_started":3,"wal-append.queue_time_us":571320}
I20260709 12:20:43.746922 25865 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:43.747452 25865 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.744589 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.748409 23997 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:43.749743 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.750375 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:43.752578 24554 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:43.751216 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:43.753679 23849 raft_consensus.cc:2393] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:43.728524 25814 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:43.751459 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:43.754709 24559 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:43.756145 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.756328 25803 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:43.766237 25803 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.757210 25291 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.758795 25778 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.759500 25911 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:43.764298 25815 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.765146 25848 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:43.747735 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.770843 24000 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:43.839495 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.840071 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:43.728581 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.767406 25889 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.734341 23854 rpcz_store.cc:276] 0709 12:20:42.576513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.577946 (+  1433us) service_pool.cc:224] Handling call
0709 12:20:42.578387 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:43.091313 (+512926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:43.091350 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:43.091792 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:20:43.442567 (+350775us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:43.442627 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.733230 (+290603us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54001b21d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:43.733298 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.733358 (+    60us) raft_consensus.cc:1685] finished
0709 12:20:43.733379 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.733680 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50475,"raft.queue_time_us":47283,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":30957,"spinlock_wait_cycles":1070142336,"thread_start_us":296717,"threads_started":1,"wal-append.queue_time_us":358262}
I20260709 12:20:43.735304 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:43.809682 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.840113 24000 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
W20260709 12:20:43.826805 25816 consensus_meta.cc:287] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.154s	user 0.007s	sys 0.005s
I20260709 12:20:43.786553 23818 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:43.818943 23893 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:43.733750 25890 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.709509 25655 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.853330 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:43.829233 25796 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:43.841408 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.806867 23895 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:43.816147 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.798623 25852 consensus_queue.cc:1059] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:20:43.817931 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:43.847097 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 60957.8us
I20260709 12:20:43.860170 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:43.840900 25865 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.848321 24003 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:43.854139 23929 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 1.
I20260709 12:20:43.828585 25803 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.855753 25816 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:43.825583 25669 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:43.873575 25816 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.825611 25791 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:43.874716 25791 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.877556 25791 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:43.882072 25823 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:43.886293 25816 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:43.886519 25823 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.886973 25823 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.887583 24004 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:43.882990 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:43.864296 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 57549.6us
I20260709 12:20:43.883731 25556 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:43.864140 25890 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:43.836670 25911 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.873680 25669 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.854049 25889 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:43.872308 24002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:43.898401 24002 raft_consensus.cc:606] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:43.826561 25906 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.829169 25778 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.894630 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:43.895289 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:43.855170 23997 raft_consensus.cc:2410] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:20:43.871557 25807 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.871946 25854 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:43.855031 25822 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:43.906277 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88562.9us
I20260709 12:20:43.891659 25811 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:43.902525 25889 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.862676 25796 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.897755 25556 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:20:43.907860 25854 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.909821 25890 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:43.947899 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:43.916940 25815 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:43.939419 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:20:43.945055 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 102064us
I20260709 12:20:43.905547 25904 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:43.987721 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 78723.7us
W20260709 12:20:43.993355 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 346596us
I20260709 12:20:43.960445 25556 consensus_queue.cc:1243] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:43.987119 23845 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:43.910429 25807 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.964514 25854 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.923120 25811 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:43.997015 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:43.967972 24554 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:43.984516 23995 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:43.958832 25889 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.917096 25822 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.945734 25886 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:43.971107 25815 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.025810 24524 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:44.029309 25814 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:43.983927 25608 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:44.034843 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 62225.5us
I20260709 12:20:44.039994 23892 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:44.035872 25814 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.047485 23892 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:44.006737 25865 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:20:44.007544 25425 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:44.035392 25815 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.081868 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:44.088642 23845 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.083334 24002 pending_rounds.cc:85] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 2
I20260709 12:20:44.078092 23892 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:44.093066 24002 pending_rounds.cc:107] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:20:44.093751 24002 raft_consensus.cc:2889] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:44.058329 25321 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.071380 25901 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:44.059402 25814 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.104401 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:44.060209 25744 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:44.104997 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.109195 23845 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:44.086817 25472 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:44.118580 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:44.114462 23921 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:44.047338 25608 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.089042 25771 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:20:44.130709 23926 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:44.118803 23966 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:44.098244 25456 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:44.129243 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.111562 25917 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:44.120568 25911 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.120316 25472 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.178130 25472 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.140084 25456 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:44.186872 25456 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.142311 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:44.142582 25918 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:20:44.146035 25778 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:44.146569 25904 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:44.146713 25796 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:44.191916 25904 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.192801 25822 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.192552 25904 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:44.131340 25906 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:44.195449 25904 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:44.196512 25886 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.204378 25669 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.204046 25815 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.206830 25844 raft_consensus.cc:3055] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:44.207433 25844 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:44.208489 25844 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.211556 25844 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:44.149495 25920 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:20:44.140203 25872 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:44.152204 25811 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:44.157416 24004 pending_rounds.cc:85] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 1
I20260709 12:20:44.274533 24004 pending_rounds.cc:107] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:44.274924 24004 raft_consensus.cc:2889] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:44.159091 25823 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:44.160216 25889 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.215399 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1194) took 1058 ms. Trace:
W20260709 12:20:44.287454 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.287546 24000 rpcz_store.cc:276] 0709 12:20:43.156712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.850060 (+693348us) service_pool.cc:224] Handling call
0709 12:20:43.850315 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.891238 (+ 40923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:43.891268 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.891306 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:43.891333 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.214983 (+323650us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b54001c84d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:44.215047 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:44.215319 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93702912}
I20260709 12:20:44.216475 25815 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.229137 25904 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:44.238886 25917 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.148208 25425 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:44.262941 23925 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:20:44.268105 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:44.279273 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.281752 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:44.282820 25754 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.285607 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.295511 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:44.296192 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.317636 23929 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:44.126084 25744 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.300001 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:44.318549 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.319104 23927 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:44.319245 23920 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:44.290565 25872 raft_consensus.cc:697] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:44.310279 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:44.342978 24003 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:44.119294 25901 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.312773 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.312949 23845 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:44.355950 23926 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:44.299829 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:44.315836 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:44.316380 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 48387.5us
I20260709 12:20:44.322448 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:44.358023 23853 raft_consensus.cc:2393] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:44.323006 23847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:44.358616 23847 raft_consensus.cc:606] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:44.358994 23847 raft_consensus.cc:614] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:44.302706 23928 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:44.325666 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.360526 23925 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:44.330277 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:44.334538 25919 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.214s	user 0.003s	sys 0.000s
I20260709 12:20:44.336361 25744 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.346815 23817 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:44.315547 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.361145 23846 raft_consensus.cc:2393] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 4: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:44.362071 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.367842 23925 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:44.369210 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:44.369920 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:44.370455 23926 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.370702 25901 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:44.374184 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 339246us
I20260709 12:20:44.369284 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:44.377310 23926 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:44.375731 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:44.380650 23920 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:44.382736 23817 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:44.385520 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:44.386547 23925 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:44.387601 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.388748 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:44.389678 24561 raft_consensus.cc:2368] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3.
I20260709 12:20:44.391893 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:44.398950 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.399020 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:44.324446 25911 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:44.400430 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.404393 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.422549 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:44.423184 24001 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.428475 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.430236 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.431577 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:44.431841 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:44.433467 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 50826.6us
I20260709 12:20:44.434718 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:44.390717 25164 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:44.436146 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.440675 23817 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:44.442241 23817 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:44.444115 25425 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:44.443598 23749 catalog_manager.cc:5697] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 4, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 4 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.444964 25655 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:44.325065 25754 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:44.315696 25917 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:44.458773 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:44.430425 25899 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:44.450687 25807 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:44.447772 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:44.446744 25744 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:44.459987 25754 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.465130 23751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59378 (request call id 138) took 9692 ms. Trace:
I20260709 12:20:44.478746 25823 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:44.474797 23751 rpcz_store.cc:276] 0709 12:20:34.742542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.742687 (+   145us) service_pool.cc:224] Handling call
0709 12:20:44.434509 (+9691822us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:41.949936 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:41.950714 (+   778us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:41.950774 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:20:41.950791 (+    17us) tablet.cc:662] Decoding operations
0709 12:20:41.972184 (+ 21393us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:41.988818 (+ 16634us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:41.991749 (+  2931us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:20:42.119568 (+127819us) tablet.cc:701] Row locks acquired
0709 12:20:42.119635 (+    67us) write_op.cc:260] PREPARE: finished
0709 12:20:42.119863 (+   228us) write_op.cc:270] Start()
0709 12:20:42.120090 (+   227us) write_op.cc:276] Timestamp: P: 1783599642119781 usec, L: 0
0709 12:20:42.120136 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:20:42.171318 (+ 51182us) log.cc:844] Serialized 2434 byte log entry
0709 12:20:42.916731 (+745413us) op_driver.cc:464] REPLICATION: finished
0709 12:20:43.453662 (+536931us) write_op.cc:301] APPLY: starting
0709 12:20:43.475429 (+ 21767us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:43.558287 (+ 82858us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:43.586704 (+ 28417us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:43.678507 (+ 91803us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:43.678829 (+   322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:20:43.678897 (+    68us) write_op.cc:312] APPLY: finished
0709 12:20:43.679254 (+   357us) log.cc:844] Serialized 53 byte log entry
0709 12:20:44.031292 (+352038us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:44.037102 (+  5810us) write_op.cc:454] Released schema lock
0709 12:20:44.059041 (+ 21939us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:44.128987 (+ 69946us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:44.130887 (+  1900us) write_op.cc:454] Released schema lock
0709 12:20:44.334003 (+203116us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
Metrics: {"mutex_wait_us":3032478,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":496327,"apply.run_cpu_time_us":16047,"apply.run_wall_time_us":666731,"num_ops":6,"prepare.queue_time_us":135610,"prepare.run_cpu_time_us":29479,"prepare.run_wall_time_us":381070,"raft.queue_time_us":326834,"raft.run_cpu_time_us":38896,"raft.run_wall_time_us":530322,"replication_time_us":698519,"spinlock_wait_cycles":18796416,"thread_start_us":812899,"threads_started":5,"wal-append.queue_time_us":587222,"wal-append.run_cpu_time_us":72151,"wal-append.run_wall_time_us":1159717}]]}
I20260709 12:20:44.479467 25872 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:44.471889 24001 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:44.481488 23846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:44.482234 23846 raft_consensus.cc:606] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:44.482529 23846 raft_consensus.cc:614] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:44.472991 25899 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:44.481428 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:44.473099 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:44.491602 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:44.486403 25744 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:44.500321 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:44.450850 25901 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:44.528154 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:44.450232 25904 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:44.551397 25904 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:44.551898 25854 consensus_meta.cc:287] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 12:20:44.551901 25904 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.552502 25854 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.553776 23926 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:44.555852 25854 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.448342 23749 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 3, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.533315 23818 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:44.574430 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:44.447639 25164 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:44.575423 25164 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:44.575033 23749 catalog_manager.cc:5697] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 3, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.427641 25894 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:20:44.579736 25811 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:44.580451 25811 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:44.581004 25673 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.580681 25744 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:44.577540 23749 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 3, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.569675 25321 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:44.617692 23749 catalog_manager.cc:5697] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 3, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.581529 25673 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.624356 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:44.625015 23928 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.585413 25740 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.635231 23920 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:44.629175 24001 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.636267 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.640738 23749 catalog_manager.cc:5697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 3, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.642648 23922 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:44.688287 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:44.688269 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:44.689596 23851 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:44.694736 23749 catalog_manager.cc:5697] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 3, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.696893 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:44.697531 23851 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:44.698968 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:44.697546 23920 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:44.698916 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:44.702997 25886 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:44.700824 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:44.708313 24001 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:44.708484 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.709012 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.709895 23929 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:44.711102 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.581601 25811 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.632853 25894 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.726361 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.729252 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:44.730167 23853 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.730718 23851 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:20:44.733342 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:44.733414 23892 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:44.682709 25425 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.747645 25425 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.750779 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:44.751063 25469 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:44.734252 23847 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:44.737632 23817 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:44.754947 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:44.704567 25843 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:44.757207 25843 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.757519 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:20:44.757982 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.758585 25673 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.759027 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:44.759325 25843 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.760020 25425 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.736925 23749 catalog_manager.cc:5697] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.764482 25899 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:44.763885 23749 catalog_manager.cc:5697] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 2, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.764761 25469 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.705374 25890 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:44.624643 25472 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.766139 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:44.765920 23749 catalog_manager.cc:5697] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:20:44.742004 25917 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.768733 23928 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:44.634291 25740 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.746320 25608 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:44.746681 25894 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.759948 25655 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:44.767408 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:44.744877 25814 consensus_meta.cc:287] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.000s
I20260709 12:20:44.770537 23853 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
W20260709 12:20:44.771256 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 472129us
I20260709 12:20:44.779424 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:44.785526 23853 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:44.786966 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:44.788160 23996 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:44.788810 24562 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:44.789222 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:44.789971 23851 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:44.794186 23846 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:44.797477 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.797611 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:44.798686 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.802163 23749 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:44.803422 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.804960 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:44.804993 23845 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:44.762511 25164 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:44.801736 25425 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:44.736021 25889 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.811126 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:44.813614 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:44.814853 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:44.815158 25472 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.815654 25740 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.815366 23852 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:44.816291 25852 raft_consensus.cc:993] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:44.816135 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:44.817065 23851 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:44.818925 23749 catalog_manager.cc:5697] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 3, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.820365 23893 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:44.820593 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.836575 23922 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:20:44.793143 25901 raft_consensus.cc:2764] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:20:44.843134 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:44.827651 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:44.843766 23926 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.806175 25844 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:20:44.818029 25164 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:44.793929 25655 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.837651 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.821524 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.839854 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.811910 23924 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:44.845456 23893 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:44.843148 23749 catalog_manager.cc:5697] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 3, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.828650 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:44.860208 23999 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:44.866348 25917 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:44.830164 25890 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.879345 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.876950 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:44.878899 25867 raft_consensus.cc:1081] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:44.880573 25843 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:44.939409 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:44.859236 25655 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.808069 25814 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:44.887255 23749 catalog_manager.cc:5697] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.979307 23749 catalog_manager.cc:5697] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 3, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 3 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:20:44.980203 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 105501us
I20260709 12:20:44.836115 25753 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.859028 25740 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:44.886794 23922 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:44.839016 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:44.967849 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 265976us
I20260709 12:20:44.968242 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:45.015404 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:44.969854 23926 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
W20260709 12:20:44.971943 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 150038us
I20260709 12:20:44.884341 25164 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:20:44.931282 25915 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:20:44.999207 23749 catalog_manager.cc:5697] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.968986 25778 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:45.016579 23820 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.042801 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:45.150827 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.084789 23749 catalog_manager.cc:5697] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 2, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.976394 25843 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:45.159394 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 142897us
I20260709 12:20:44.976112 25754 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:44.978329 25834 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:45.159149 24561 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:45.160303 23820 leader_election.cc:400] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3.
W20260709 12:20:45.035308 25932 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260709 12:20:45.010798 25917 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:45.011044 25815 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:45.034981 25931 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.006s
I20260709 12:20:45.169955 23749 catalog_manager.cc:5697] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:20:45.181777 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 296095us
W20260709 12:20:45.183465 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 201691us
I20260709 12:20:45.195039 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.199623 23893 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:45.150468 25911 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:45.225427 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.168843 25843 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.200487 23996 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:45.175477 25834 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:45.192183 25917 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.186199 25823 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:45.254410 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:45.254890 23998 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.150336 25164 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.009936 25904 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.240178 25778 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:45.187206 25754 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.240341 25911 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.248075 25890 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:45.270602 25890 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:45.270892 25911 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.271138 25890 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:45.274240 25952 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:45.274801 25952 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:45.275269 25952 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.246047 25834 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.259007 25917 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:45.283725 25894 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.259268 25823 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:45.312538 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 117638us
I20260709 12:20:45.282497 25865 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:45.320706 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 141546us
I20260709 12:20:45.326606 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.348076 25964 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:45.348645 25964 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.352272 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:45.352640 25164 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.352973 25904 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:45.354359 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1357) took 1041 ms. Trace:
W20260709 12:20:45.329711 25946 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:20:45.321360 25740 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:45.359134 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:45.328586 25934 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:20:45.361413 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 157) took 1068 ms. Trace:
I20260709 12:20:45.352825 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:45.329085 25948 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:20:45.329245 25935 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:20:45.378376 25933 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 12:20:45.382505 25964 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.384166 25815 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:45.345844 25885 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:45.385758 25814 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:45.347011 25865 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:45.429397 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 412970us
I20260709 12:20:45.429766 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.430089 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:45.431208 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.388583 25655 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.370915 24555 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:45.353691 25904 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:45.393030 23848 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:45.391978 23854 rpcz_store.cc:276] 0709 12:20:44.312611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.314374 (+  1763us) service_pool.cc:224] Handling call
0709 12:20:44.314645 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:44.335300 (+ 20655us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:44.682434 (+347134us) log.cc:844] Serialized 14 byte log entry
0709 12:20:44.975775 (+293341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:44.975839 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:44.975891 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.354116 (+378225us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b54002d4bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:45.354165 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.354300 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":429,"prepare.queue_time_us":276597,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":68377,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4450,"spinlock_wait_cycles":47053696,"thread_start_us":594262,"threads_started":2,"wal-append.queue_time_us":546685}
W20260709 12:20:45.394861 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 71001.8us
I20260709 12:20:45.440963 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:45.402776 23895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.004s
W20260709 12:20:45.441941 23895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.005s	sys 0.004s
I20260709 12:20:45.409439 25969 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:45.413867 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.414646 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 143) took 1157 ms. Trace:
I20260709 12:20:45.415083 25942 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:45.399041 25894 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:45.418408 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1263) took 1082 ms. Trace:
I20260709 12:20:45.406648 25960 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:45.419633 24554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 481) took 1149 ms. Trace:
W20260709 12:20:45.391551 25930 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.001s	sys 0.013s
I20260709 12:20:45.427668 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1220) took 1062 ms. Trace:
I20260709 12:20:45.435388 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.483433 23853 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:20:45.401170 25753 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.439003 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:45.450592 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:45.445694 25969 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.446195 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:45.453893 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:45.482695 24002 rpcz_store.cc:276] 0709 12:20:44.365637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.495787 (+130150us) service_pool.cc:224] Handling call
0709 12:20:44.496145 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:44.496426 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:44.555469 (+ 59043us) log.cc:844] Serialized 14 byte log entry
0709 12:20:44.979363 (+423894us) log.cc:844] Serialized 14 byte log entry
0709 12:20:45.427150 (+447787us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180007fc60. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa284361a40 00007fa28435c4e4 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287 00007fa287467208
0709 12:20:45.427314 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:45.427366 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:45.427408 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.427476 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.427597 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":419682,"prepare.queue_time_us":81933,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":478692,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":8046,"spinlock_wait_cycles":52987008,"thread_start_us":413816,"threads_started":1,"wal-append.queue_time_us":643906}
I20260709 12:20:45.446278 23921 rpcz_store.cc:276] 0709 12:20:44.256939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.257174 (+   235us) service_pool.cc:224] Handling call
0709 12:20:44.257555 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:44.276038 (+ 18483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:44.276085 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:44.276670 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 12:20:44.585559 (+308889us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:44.585602 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.585676 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.414443 (+828767us) raft_consensus.cc:1685] finished
0709 12:20:45.414464 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.414591 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25157,"raft.queue_time_us":25840,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":11473,"thread_start_us":262959,"threads_started":1,"wal-append.queue_time_us":799084}
I20260709 12:20:45.428507 25964 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:45.445705 25807 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:45.472167 25778 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.434193 25885 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.470134 23929 rpcz_store.cc:276] 0709 12:20:44.336178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.712292 (+376114us) service_pool.cc:224] Handling call
0709 12:20:44.712649 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:44.767898 (+ 55249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:44.767927 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:44.767963 (+    36us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:44.767990 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.418179 (+650189us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b54003755d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:45.418225 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.418347 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126642560}
W20260709 12:20:45.480774 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 49642.5us
W20260709 12:20:45.482726 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 129977us
I20260709 12:20:45.441435 25811 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.441017 25814 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:45.432246 25815 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.498369 25964 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.483914 25740 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.511897 25815 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.512193 25964 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:45.470644 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.492928 25753 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.514215 25807 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:45.514498 25753 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.475370 25291 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:45.479383 25894 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:45.482491 25930 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.001s	sys 0.013s
I20260709 12:20:45.514806 25807 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.514521 25823 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.516010 25796 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:45.517066 25807 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:45.501601 25778 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.523595 25778 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.471375 25872 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:45.475632 23895 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:45.531709 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 56175.9us
I20260709 12:20:45.483081 25791 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:45.503554 25865 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.504963 25952 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.505200 25843 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.496073 25425 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:45.505896 25885 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.507202 25655 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.508838 25811 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.453749 25852 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:45.483716 25960 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.480325 25904 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:45.535791 23895 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:45.573967 25778 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:45.574152 25904 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.576923 25904 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:45.520180 25890 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.525259 25834 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.537801 25848 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:45.606586 25936 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:45.607262 25936 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:45.607329 25655 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:45.607964 25655 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.608459 25936 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.540300 25791 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.611438 25791 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:45.479002 24554 rpcz_store.cc:276] 0709 12:20:44.270423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.273838 (+  3415us) service_pool.cc:224] Handling call
0709 12:20:44.294018 (+ 20180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:44.320002 (+ 25984us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:44.323014 (+  3012us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:44.434796 (+111782us) log.cc:844] Serialized 26 byte log entry
0709 12:20:44.733485 (+298689us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:44.740162 (+  6677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.771909 (+ 31747us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.419381 (+647472us) raft_consensus.cc:1685] finished
0709 12:20:45.419407 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.419563 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93512,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":8563,"thread_start_us":210545,"threads_started":1,"wal-append.queue_time_us":566964}
I20260709 12:20:45.399716 23995 rpcz_store.cc:276] 0709 12:20:44.292946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.492965 (+200019us) service_pool.cc:224] Handling call
0709 12:20:44.493294 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:44.590663 (+ 97369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:44.605656 (+ 14993us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:44.613086 (+  7430us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:44.615962 (+  2876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.321994 (+706032us) spinlock_profiling.cc:243] Waited 57.4 ms on lock 0x7b540020f3d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:45.328819 (+  6825us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.361322 (+ 32503us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132116352}
I20260709 12:20:45.544401 25952 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.544827 25815 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.613255 25815 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:45.544982 25937 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.277s	user 0.000s	sys 0.002s
I20260709 12:20:45.540695 25814 consensus_queue.cc:1059] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:20:45.616019 25814 raft_consensus.cc:3055] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:45.616379 25814 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:45.616829 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1216) took 1508 ms. Trace:
W20260709 12:20:45.546159 25469 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.003s
I20260709 12:20:45.540987 25872 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.619830 25788 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:45.620342 25788 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.621260 25872 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.547652 25958 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:45.621999 25958 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.624096 25958 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.549448 25969 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.550504 25796 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:45.625665 25796 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.627708 25796 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.630236 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.556463 23848 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:45.475896 25942 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.631319 25788 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:45.565133 25852 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:45.631943 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.632843 25942 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.565272 23998 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:45.516471 25894 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.567274 25917 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.636986 25917 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:45.584390 25953 log.cc:927] Time spent T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:20:45.586511 25807 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:45.638731 25807 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.640648 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.641312 23851 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:45.587085 25960 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.589365 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.589396 23846 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:45.644940 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.619822 25655 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.648309 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:45.648859 25940 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.373s	user 0.002s	sys 0.000s
I20260709 12:20:45.648994 24000 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:45.650178 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1358) took 1337 ms. Trace:
I20260709 12:20:45.650528 23849 rpcz_store.cc:276] 0709 12:20:44.312917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.314274 (+  1357us) service_pool.cc:224] Handling call
0709 12:20:44.328942 (+ 14668us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:44.329299 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:44.329325 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:44.329827 (+   502us) log.cc:844] Serialized 52 byte log entry
0709 12:20:44.780990 (+451163us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:44.781029 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.781111 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.648273 (+867162us) spinlock_profiling.cc:243] Waited 923 us on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:20:45.649852 (+  1579us) raft_consensus.cc:1685] finished
0709 12:20:45.649897 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.650119 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2640,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":2123648,"thread_start_us":381836,"threads_started":1,"wal-append.queue_time_us":876491}
I20260709 12:20:45.661429 25936 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.666707 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 1767) took 1570 ms. Trace:
I20260709 12:20:45.644901 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 152) took 2149 ms. Trace:
I20260709 12:20:45.667425 23924 rpcz_store.cc:276] 0709 12:20:44.096075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.097435 (+  1360us) service_pool.cc:224] Handling call
0709 12:20:44.133938 (+ 36503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:44.878768 (+744830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.666350 (+787582us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54002792d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:45.666603 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455609088}
I20260709 12:20:45.668475 23999 rpcz_store.cc:276] 0709 12:20:43.495196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.885797 (+390601us) service_pool.cc:224] Handling call
0709 12:20:44.495586 (+609789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:44.860812 (+365226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.644053 (+783241us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54001a7cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:45.644751 (+   698us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54001a7cd0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:45.644850 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197870848}
I20260709 12:20:45.669276 25843 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.632591 23848 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:45.533069 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:45.618497 23893 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:45.670300 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 137485us
W20260709 12:20:45.670696 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 52272.1us
I20260709 12:20:45.670984 25942 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:45.671489 23893 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:45.671888 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:45.673079 25198 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:45.619225 25815 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:45.673324 23820 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 1.805s (SENT) [suppressed 6 similar messages]
I20260709 12:20:45.673906 25917 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:45.674360 25917 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:45.674762 25917 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.617141 25814 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.617367 24004 rpcz_store.cc:276] 0709 12:20:44.108117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.156802 (+ 48685us) service_pool.cc:224] Handling call
0709 12:20:44.157156 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:44.320330 (+163174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:44.320361 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:44.321580 (+  1219us) log.cc:844] Serialized 52 byte log entry
0709 12:20:44.549217 (+227637us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:44.578427 (+ 29210us) log.cc:844] Serialized 14 byte log entry
0709 12:20:44.578657 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.578733 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.544374 (+965641us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:20:45.616445 (+ 72071us) raft_consensus.cc:1685] finished
0709 12:20:45.616558 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.616754 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101069,"prepare.queue_time_us":29315,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":25227,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":6226,"spinlock_wait_cycles":33330176,"thread_start_us":227276,"threads_started":1,"wal-append.queue_time_us":862271}
I20260709 12:20:45.632592 25852 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.678508 25814 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:45.681377 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:45.640790 25807 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:45.682370 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.683075 23998 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:45.683563 25811 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.684140 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.685470 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.686015 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.686174 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36570 (request call id 361) took 1303 ms. Trace:
I20260709 12:20:45.686625 24555 rpcz_store.cc:276] 0709 12:20:44.383022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.402441 (+ 19419us) service_pool.cc:224] Handling call
0709 12:20:45.685948 (+1283507us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400498c54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:45.686088 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937869568}
I20260709 12:20:45.687208 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:45.687758 25957 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 12:20:45.684265 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:45.689767 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.689978 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.690608 24003 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:45.687958 24001 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:45.695060 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.696310 25754 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.697178 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.696954 25917 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.698002 23923 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:45.698467 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.698863 25655 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.699434 25917 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:45.699579 24561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36570 (request call id 367) took 1268 ms (client timeout 1586 ms). Trace:
W20260709 12:20:45.700088 24561 rpcz_store.cc:269] 0709 12:20:44.431159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.431289 (+   130us) service_pool.cc:224] Handling call
0709 12:20:45.699403 (+1268114us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54004a33d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:45.699528 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427834112}
I20260709 12:20:45.701617 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.702358 25952 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:45.703197 25894 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:45.703709 25894 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:45.705114 25894 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.702491 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.708050 23818 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:45.709301 25952 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:45.709661 25952 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.710016 25952 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:45.710878 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.699388 25655 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.714871 25890 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.716082 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:45.716862 23999 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:45.718663 23818 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.698032 25815 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:45.722666 25815 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.723359 23818 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:45.721246 25952 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.724735 25815 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.725301 25958 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:45.725342 25815 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:45.726665 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.726768 25815 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:45.727427 25834 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:45.727998 25815 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:45.706560 24004 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:45.730199 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.619822 25469 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:45.731426 23920 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:45.729655 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:45.732728 23849 raft_consensus.cc:2368] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:20:45.733021 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.733445 23922 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:45.733575 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:45.734177 23923 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:45.734547 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.736649 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.737195 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:45.737936 23929 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:45.738826 25811 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:45.739545 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.739732 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.740196 23922 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:45.740264 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:45.741835 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:45.742682 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.744261 25965 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:45.744701 25965 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.744644 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.745218 25965 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.745434 23995 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:45.746063 25890 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:45.747308 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:45.746775 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.747972 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.748533 25890 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:45.750371 23817 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.751748 24561 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:45.753327 23923 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:45.753456 25890 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:45.754204 23924 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:45.755862 25824 consensus_queue.cc:1059] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:45.727500 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:45.670944 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:45.758052 25890 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:45.758517 25890 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.759047 25890 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:45.760037 25952 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.761111 25655 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.762923 25198 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:45.758343 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 87487.1us
I20260709 12:20:45.758585 23893 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:45.764695 25927 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:45.764750 24524 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:45.534152 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.765331 25927 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:20:45.765805 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 231738us
I20260709 12:20:45.766283 25754 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:45.766752 25754 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.766384 25927 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.767132 25754 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.768321 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.766878 25807 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:45.770488 25816 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:45.770877 25807 consensus_queue.cc:1059] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:45.771147 25816 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:45.771680 25807 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:45.772006 25807 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:45.773730 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:45.774482 25803 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:45.774778 23924 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:45.774987 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.773254 25807 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.776376 25807 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.780534 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:45.781359 23923 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:45.783078 25754 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.786156 24004 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:45.787866 23854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:45.787775 25803 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:45.802400 23854 raft_consensus.cc:606] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.802779 23854 raft_consensus.cc:614] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:45.788893 23892 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:45.805543 25667 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:45.806007 25667 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.806377 25667 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.806444 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.806869 25321 consensus_queue.cc:1059] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:45.807816 25198 raft_consensus.cc:3055] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:45.808139 25198 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:45.809315 25198 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.810804 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:45.812171 25321 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:45.812708 25321 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.813123 25321 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:45.815949 25667 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.795768 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.790985 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.797174 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:45.800887 25754 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.801499 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.802680 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:45.789526 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.825730 24000 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:45.827981 25952 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:45.828375 25952 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.829101 23923 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:45.816862 25815 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.796361 25469 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:45.821588 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.823124 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:45.823726 25823 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:45.820819 23995 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:45.831172 23999 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:45.835055 24525 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:45.871227 23846 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:20:45.870008 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 196697us
I20260709 12:20:45.866953 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.842949 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.844393 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.844631 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.845110 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.846596 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.810775 25198 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:45.855882 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:45.857759 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:45.861116 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.862144 23893 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:45.862694 23892 leader_election.cc:400] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:20:45.828716 25952 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.820716 25667 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.866058 23923 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:45.872449 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:45.889225 23850 raft_consensus.cc:2393] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:45.877746 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:45.889747 23851 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:45.885658 24000 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.886754 25403 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:45.888342 23893 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:45.884814 23892 leader_election.cc:403] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:20:45.893791 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:45.895671 25974 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:45.896440 25974 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.899014 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:45.899641 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:45.899971 23850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0499f663114741880a025070e7b81f"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:45.900779 23850 raft_consensus.cc:606] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 2 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.898811 23817 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:45.907186 25198 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:45.874846 25927 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:45.876822 25969 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.873265 25814 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:45.908479 23999 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:45.877089 25894 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:45.911074 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.916055 23851 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:20:45.914968 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:45.910468 25667 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:45.866374 25788 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:20:45.898229 23998 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:45.934360 23851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d728437e541d463594bcfe1155df3a32"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:20:45.934998 23851 raft_consensus.cc:606] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:20:45.917189 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 47790.5us
I20260709 12:20:45.924510 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.925760 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.926409 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.926823 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:45.927086 25974 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:45.920571 25872 consensus_queue.cc:1059] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:20:45.920508 25965 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.963110 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:45.964015 23926 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:45.928207 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.965911 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:45.966310 23920 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:45.920563 25472 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:45.968364 23846 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:45.928838 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.929649 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.901790 25852 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:45.930881 23999 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:45.907949 25844 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:20:45.932447 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.915401 25655 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:45.933458 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.923561 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.935441 23851 raft_consensus.cc:614] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:45.944857 24000 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:45.915709 25894 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.906487 25848 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:20:45.919374 25811 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:20:45.874244 25469 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.908444 25791 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:45.958990 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:45.960762 23921 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:45.961784 23817 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:45.971611 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:45.932214 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.972684 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:45.929014 25321 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:45.973737 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:46.023015 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:46.021596 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:45.975695 25973 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:46.047362 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:46.006747 23845 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:20:45.923671 25814 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:45.919585 25969 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.002331 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:45.975701 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:46.001183 25655 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:46.039705 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:46.041527 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:46.085693 24560 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:46.086190 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:46.087178 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:46.087226 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:46.090049 24561 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:46.042013 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.053611 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:20:46.030339 25940 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:46.095057 24563 raft_consensus.cc:2368] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6.
I20260709 12:20:45.974783 25472 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:46.057777 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49823.3us
I20260709 12:20:46.084689 23926 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
W20260709 12:20:46.096498 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 63966.4us
I20260709 12:20:46.028515 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:46.146693 24560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36558
I20260709 12:20:46.097267 23929 raft_consensus.cc:2368] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6.
I20260709 12:20:46.028910 25834 raft_consensus.cc:2764] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:20:46.031679 25894 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:46.102985 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:46.097002 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 55052.4us
I20260709 12:20:46.071269 25901 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:46.087792 25822 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:46.101845 25936 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.102355 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:46.079890 25964 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:20:46.160013 24525 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:46.155030 25976 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:20:46.152436 25791 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:46.157912 25822 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:46.154695 25958 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:20:46.166301 25901 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:46.198524 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:46.198884 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:46.174156 25771 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:46.163661 25807 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:20:46.205814 24524 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.212075 24524 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.187791 25917 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:46.214589 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 111719us
I20260709 12:20:46.188401 25815 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:46.206473 24558 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:46.217295 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:46.220333 23969 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.183708 25890 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.222601 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:46.211267 25964 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:46.213009 25927 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.224395 25816 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.229915 25472 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.230640 25901 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.232285 25890 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.233017 23847 raft_consensus.cc:2368] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6.
I20260709 12:20:46.218981 25973 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.233790 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:46.235797 24557 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:20:46.221071 25974 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:46.238363 25991 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:20:46.220013 25655 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.243213 25321 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.244028 23995 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:46.245316 25814 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.246796 25822 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.192193 25791 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.251255 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:46.252197 23850 raft_consensus.cc:2393] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:46.260352 25791 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:46.260897 25952 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.265751 23820 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.226717 25964 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:46.274986 25964 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:46.276116 23820 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:46.276530 25811 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:46.277009 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:46.277799 24561 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:46.265666 25894 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.268079 24558 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:20:46.278867 25811 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:46.279194 24558 pending_rounds.cc:85] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 4
I20260709 12:20:46.279558 24558 pending_rounds.cc:107] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:20:46.279839 24558 raft_consensus.cc:2889] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:46.281056 23854 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:20:46.276120 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:46.280697 25894 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.282456 23820 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:46.285952 25894 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:46.287453 25822 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:46.272179 23969 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.223186 25965 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.278652 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:46.289492 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:46.290836 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 64087.3us
I20260709 12:20:46.294720 24561 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:20:46.295199 25807 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:46.295615 23820 leader_election.cc:400] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6.
I20260709 12:20:46.296077 23820 leader_election.cc:403] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:20:46.295248 25906 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:46.281571 25865 raft_consensus.cc:3055] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:20:46.298724 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 337054us
I20260709 12:20:46.299844 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.301785 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.238384 25974 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:46.303553 23853 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:46.307432 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.312878 23820 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.313295 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:46.314793 23847 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:46.314679 25974 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.304526 25807 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:20:46.315657 25969 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.303825 25865 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:46.304401 25906 raft_consensus.cc:3055] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:46.298475 25811 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:46.303179 25927 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.297924 25771 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:46.306666 25889 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6.
I20260709 12:20:46.309902 25930 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:46.347662 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:46.349280 23927 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:46.350390 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:46.350723 25901 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.351248 23924 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:46.354677 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:46.355486 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:46.355988 23847 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:46.325775 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:46.319096 26000 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:46.310981 25824 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.324187 25906 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:46.359134 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:46.332024 25469 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.312690 25973 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.340174 25964 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.340946 25771 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.341919 25952 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.309270 25998 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:46.326728 23820 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:46.361495 25824 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.362783 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:46.361910 26000 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.367841 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:46.340291 25894 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:46.368319 25906 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.373232 25906 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:46.373405 25824 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.374450 26000 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:46.370038 25952 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:20:46.375244 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 284026us
I20260709 12:20:46.370285 25998 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.379875 25796 raft_consensus.cc:3055] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:46.380293 25796 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:46.380900 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.381194 25796 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.382385 25796 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:46.382474 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:46.384382 25788 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.385528 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:46.386138 24004 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:20:46.387081 25998 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:46.380832 24003 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:46.389953 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:46.391717 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:46.392030 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:46.392525 23999 raft_consensus.cc:2410] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:20:46.366420 25469 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:46.393496 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:46.393837 23854 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:46.393956 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:46.399150 23966 leader_election.cc:400] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6.
I20260709 12:20:46.399468 23966 leader_election.cc:403] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:46.403256 24525 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:46.403569 24004 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:46.410071 23846 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:46.412209 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:46.412438 23923 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:46.421758 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:46.425390 23921 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:46.428793 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:46.429675 23999 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:46.430510 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:46.431445 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:46.432080 23999 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:46.444113 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:46.442502 23851 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
W20260709 12:20:46.447116 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.450228 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:46.454849 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 51668.7us
I20260709 12:20:46.456634 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:46.459537 23966 leader_election.cc:400] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6.
I20260709 12:20:46.468784 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:46.428025 25469 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:46.453369 25844 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:46.474769 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:46.468019 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.475867 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:46.456194 25927 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.461679 25852 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.456333 25969 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:46.464519 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:46.460199 25872 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.461073 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:46.467053 25740 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:46.458437 25834 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6.
I20260709 12:20:46.486188 24525 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:46.457515 25970 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:20:46.474892 25844 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:46.489025 25994 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:46.453660 25814 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:20:46.475929 25469 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:46.487162 25425 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:46.492265 24557 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:46.492300 25655 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:46.493506 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:46.494851 25886 raft_consensus.cc:993] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:20:46.473331 25788 consensus_queue.cc:1059] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:20:46.487339 25852 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.528239 24554 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:46.514243 25927 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:46.522342 25844 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.547977 23895 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:46.549221 26001 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:46.517616 25740 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.514953 25872 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.549436 25994 raft_consensus.cc:1081] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 2 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:20:46.566162 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:46.562527 25788 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:46.571818 25788 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:46.572794 25788 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.573117 25963 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:46.573978 25788 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.574714 25852 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:46.562717 25970 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:46.575770 25970 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:46.576277 25970 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:46.565230 26001 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:46.566471 25964 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:46.568580 25822 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.595132 24001 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
W20260709 12:20:46.600584 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 116001us
I20260709 12:20:46.600785 23927 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
W20260709 12:20:46.601936 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.601820 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:46.610193 23927 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:46.610988 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:46.611760 23854 raft_consensus.cc:2393] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 2: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:46.593551 26001 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.614032 26001 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:46.604806 25964 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:20:46.618594 25904 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:46.605034 25814 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:46.628786 25740 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.629505 25872 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:46.630215 25814 raft_consensus.cc:697] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:46.631028 25814 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.639194 23927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35544
I20260709 12:20:46.639905 23927 raft_consensus.cc:606] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:46.641294 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:46.644304 23925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e0499f663114741880a025070e7b81f"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:20:46.644876 23925 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:46.603065 25822 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.645383 23925 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.648828 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:46.681174 25822 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.682410 23849 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:46.683431 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:46.679036 25970 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.689605 23892 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:46.694389 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:46.667775 23925 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.709542 23925 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.712126 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35544
I20260709 12:20:46.712980 23921 raft_consensus.cc:606] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:46.714231 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:46.715093 23849 raft_consensus.cc:3055] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:46.715504 23849 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:46.717960 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:46.716434 25822 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:46.730532 25744 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:46.731204 25744 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.736334 25865 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.738238 25469 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.739491 25744 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.737776 25865 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:46.741287 25469 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.742229 23923 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:46.742808 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:46.743069 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:46.743433 23854 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:46.743569 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:46.744194 23852 raft_consensus.cc:1813] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Handling vote request from an unknown peer 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:46.744056 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:46.744761 23852 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:46.744879 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:46.748071 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:46.748731 23929 raft_consensus.cc:1813] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Handling vote request from an unknown peer 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:46.749253 23929 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:46.751549 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:46.752743 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.727926 25822 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.750056 23849 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.757462 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:46.764328 23849 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.751367 25754 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:46.762105 25822 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:46.757761 25872 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:46.772298 23966 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.765786 25788 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:46.775135 25970 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:46.776228 23998 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:46.775199 25788 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.774523 25796 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:46.778522 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.794633 23997 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:46.780395 25788 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:46.798687 23848 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:46.798812 25834 consensus_queue.cc:1059] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:46.799945 25834 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:46.795758 25822 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.800945 23849 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:46.803503 25814 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:46.800326 25834 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:46.809381 23847 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:20:46.811278 24524 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:46.812546 25791 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:46.813565 25791 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:46.815172 25791 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:46.815940 25791 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:46.816897 25791 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:46.818181 24560 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:46.812690 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:46.818825 24560 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:46.811328 23892 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:46.914083 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 102820us
W20260709 12:20:46.915381 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.917269 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:46.918460 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:46.919245 24003 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:46.921739 23922 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:46.926666 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:46.820019 25927 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:46.940521 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:46.941215 24000 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:46.944829 24003 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:46.947124 24560 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:46.959019 24560 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:46.933579 25753 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:20:46.942632 26021 log.cc:927] Time spent T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:20:46.964752 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.965837 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:46.991731 23895 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:47.045125 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:47.086009 23969 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:46.956738 25894 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.954789 25927 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:47.055063 25958 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:47.058190 25906 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.992045 25834 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.091396 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:47.091676 25894 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:47.092677 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.093330 25927 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:47.050323 26016 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
W20260709 12:20:47.058233 25999 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:20:47.045773 25811 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:46.992905 25807 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.073272 25667 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:47.116390 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 124762us
I20260709 12:20:46.992487 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:47.057837 25770 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:47.089190 25469 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:47.124572 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:47.134209 23849 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:47.133818 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 141427us
I20260709 12:20:47.039047 25889 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 12:20:47.123510 23998 raft_consensus.cc:3055] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:47.143354 23924 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:47.121309 26024 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.138821 25744 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:47.123626 25958 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:47.147380 23924 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:47.127807 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 369) took 1155 ms. Trace:
I20260709 12:20:47.118217 25906 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.108824 25788 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.148192 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:47.176447 25906 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:47.176759 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.176491 25788 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:47.158083 25834 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.178902 25744 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:47.179363 25744 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:47.162853 25958 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.179838 25744 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:47.142725 23998 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:47.138147 25667 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.183679 23998 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.184406 25796 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.184711 25667 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:47.165542 25890 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:47.166683 25959 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:47.131932 25807 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.185801 25894 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:47.187192 25807 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:47.141822 25822 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:47.187649 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:47.172750 24555 rpcz_store.cc:276] 0709 12:20:45.971980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.974103 (+  2123us) service_pool.cc:224] Handling call
0709 12:20:46.661261 (+687158us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327eee 000000000036eb39 00007fa28c39b1e0 00007fa28c4640c4 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:46.670983 (+  9722us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327f8c 00007fa284327ef6 000000000036eb39 00007fa28c39b1e0 00007fa28c4640c4 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:46.671131 (+   148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:46.671625 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:46.671964 (+   339us) log.cc:844] Serialized 14 byte log entry
0709 12:20:46.769595 (+ 97631us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:46.913088 (+143493us) log.cc:844] Serialized 26 byte log entry
0709 12:20:46.939986 (+ 26898us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:46.964287 (+ 24301us) log.cc:844] Serialized 14 byte log entry
0709 12:20:47.039321 (+ 75034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.055984 (+ 16663us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:47.117592 (+ 61608us) raft_consensus.cc:1685] finished
0709 12:20:47.118869 (+  1277us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:47.125364 (+  6495us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1111,"prepare.queue_time_us":35778,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":6938,"raft.queue_time_us":36382,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":12253,"spinlock_wait_cycles":17336448,"thread_start_us":77293,"threads_started":1,"wal-append.queue_time_us":118521}
W20260709 12:20:47.145603 25844 consensus_meta.cc:287] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.000s
I20260709 12:20:47.191994 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:47.192966 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:47.191350 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 105452us
I20260709 12:20:47.191848 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:47.196993 23925 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:47.192540 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:47.206452 23849 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:47.139405 25770 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.215587 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:47.217788 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:47.241627 25198 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.195286 25844 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.239542 26027 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:47.264038 23999 raft_consensus.cc:2393] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:20:47.272300 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 124184us
I20260709 12:20:47.262761 26027 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.267751 25872 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:47.285713 23893 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:47.287464 23893 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:47.290017 25822 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:47.279592 26027 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.290642 25822 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:47.291169 25822 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:47.292374 25770 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:47.288226 25667 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.289484 25872 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.301142 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:47.306351 23818 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:47.283901 25959 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:47.318691 25959 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.321199 25959 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:47.320310 25822 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.324779 25844 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:47.330942 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:47.332785 25822 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:47.334154 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:47.335117 24004 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:47.336220 24004 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:47.339654 24003 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:47.342368 24004 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:20:47.343128 24004 pending_rounds.cc:85] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 1
I20260709 12:20:47.343403 24004 pending_rounds.cc:107] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:47.343679 24004 raft_consensus.cc:2889] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:47.349375 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:47.350378 24003 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:47.329486 25959 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.361044 25930 raft_consensus.cc:3055] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:47.361528 25930 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:47.362543 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:47.362388 25930 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.365538 25930 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.369810 25952 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:47.370958 25952 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.373024 25952 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:47.375262 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:47.376066 23923 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:47.377213 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:47.378058 23853 raft_consensus.cc:2393] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:47.379565 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:47.388408 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:47.394894 26001 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:47.402269 23995 raft_consensus.cc:1240] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:47.362598 25872 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:47.406868 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1298) took 1062 ms. Trace:
I20260709 12:20:47.407327 23926 rpcz_store.cc:276] 0709 12:20:46.344341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.346979 (+  2638us) service_pool.cc:224] Handling call
0709 12:20:46.347263 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:46.379161 (+ 31898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:46.379196 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:46.379239 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:46.379272 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.406640 (+1027368us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b5400375ad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:47.406687 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:47.406803 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72896896}
W20260709 12:20:47.408525 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 99819.2us
I20260709 12:20:47.410454 23818 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:47.411867 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:47.419198 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:47.419879 24002 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:47.425338 26002 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.426507 26002 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:47.426752 25655 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:47.427693 26002 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:47.429857 23847 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:47.431200 23847 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:47.429912 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:47.433954 23850 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:47.434291 23853 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:47.446626 26052 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:47.452392 24562 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:47.461422 23853 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:47.463338 24524 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:47.447957 26041 raft_consensus.cc:3055] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:47.429200 25744 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.482201 23921 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:47.444378 25904 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:20:47.487206 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 61001.5us
I20260709 12:20:47.491292 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1443) took 1105 ms. Trace:
I20260709 12:20:47.491895 24001 rpcz_store.cc:276] 0709 12:20:46.386183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.388752 (+  2569us) service_pool.cc:224] Handling call
0709 12:20:47.491044 (+1102292us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540040ddd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:47.491206 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345400576}
I20260709 12:20:47.494957 23893 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:47.471342 25865 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:47.468317 26041 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:47.501616 25850 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:47.511266 25850 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:47.511716 25850 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:47.500626 26035 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:20:47.513970 25865 raft_consensus.cc:697] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:47.518754 26041 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.519222 25865 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.520681 26041 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:47.522150 23736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 96453.4us
I20260709 12:20:47.522154 25930 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:47.532259 23818 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:47.515729 25852 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:47.534183 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:47.537431 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 48520.8us
I20260709 12:20:47.538399 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:47.534840 25930 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.516175 25894 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:20:47.537284 25852 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.546739 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:47.548352 24562 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:47.553200 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:20:47.620278 26051 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:20:47.534379 25811 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.540126 26055 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:47.541853 25822 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.626868 23995 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:47.540457 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:47.667661 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.675668 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 45063.5us
I20260709 12:20:47.544337 25744 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:47.543272 25930 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:47.628273 25901 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.626248 26042 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:47.695356 25425 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:47.652799 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:47.691408 25824 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.686448 26027 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:47.716189 25753 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.039s	sys 0.046s
I20260709 12:20:47.698683 23925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35544
W20260709 12:20:47.716631 25753 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.039s	sys 0.046s
I20260709 12:20:47.716933 25753 raft_consensus.cc:697] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:47.717025 23925 raft_consensus.cc:606] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:47.718665 25753 consensus_queue.cc:237] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.653498 25816 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:47.691504 26037 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:20:47.715552 25824 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.677850 26055 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:47.733762 26042 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.771613 25997 raft_consensus.cc:993] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:47.733352 25425 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.775859 26027 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:47.777077 25852 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:47.677410 25822 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.791520 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:47.792498 23850 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:47.773761 26055 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:47.785805 25770 raft_consensus.cc:1081] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:47.767517 25816 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.734338 25901 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.787712 25824 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:47.810274 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 178001us
I20260709 12:20:47.786230 26054 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:47.819056 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:47.821244 23995 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:47.807296 25811 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:47.831022 24562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36552
I20260709 12:20:47.831501 23850 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:20:47.831792 24562 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:47.832300 24562 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.835021 23849 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:47.844872 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:47.845383 23925 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.829409 23996 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:20:47.846638 25974 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.851646 23996 pending_rounds.cc:85] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 5
W20260709 12:20:47.874439 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 106062us
I20260709 12:20:47.814111 26054 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.854432 26049 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:20:47.887971 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 57374.5us
I20260709 12:20:47.834262 25811 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:47.895395 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 58484.9us
I20260709 12:20:47.877276 23996 pending_rounds.cc:107] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:20:47.854460 25964 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:20:47.855173 26056 consensus_queue.cc:1059] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:20:47.939841 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 43498.4us
W20260709 12:20:47.940788 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49248.6us
I20260709 12:20:47.944907 23925 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:47.859464 25974 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.936666 23996 raft_consensus.cc:2889] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:47.946220 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:47.877705 26061 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:20:47.950037 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:47.959726 24004 raft_consensus.cc:2410] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:47.950158 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:47.939198 25771 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.963116 25904 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:47.963670 25771 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.965822 25771 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:47.955049 25811 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:47.955576 25850 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.968330 25850 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:47.956355 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:47.953123 25425 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:47.971837 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:47.939752 26049 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:47.958772 24562 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:47.976169 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:47.976650 25816 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:47.980377 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:47.980931 24560 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:47.981797 23895 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:47.983245 24004 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:20:47.984978 23893 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:47.993202 24562 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:47.994372 26063 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:20:47.972560 24559 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:47.999689 23924 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:48.000757 25425 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:47.998911 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:47.996573 25667 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:48.002374 25667 raft_consensus.cc:697] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:48.002292 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.003491 25667 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.005384 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.006064 23922 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:48.008735 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.011404 25974 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.012776 23895 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:48.012802 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:47.996740 26042 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.014778 24004 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:20:48.014914 26028 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:47.979977 25822 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:48.015522 26028 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.015969 26028 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:48.016454 24525 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:48.018350 26056 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:48.019196 26056 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.019630 26056 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:47.987735 25753 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:48.028249 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:48.013660 23998 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.029193 24559 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:48.032225 26055 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:47.997197 25811 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:48.006733 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:48.033383 25816 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:48.034700 25425 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:48.078902 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.079653 24002 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:48.079906 25425 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.036193 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:48.080571 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.081197 23850 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:48.085422 26055 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.037146 23851 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:47.990692 23925 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: false } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.040759 23998 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:48.078984 25816 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.087322 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 176) took 1127 ms. Trace:
I20260709 12:20:48.087654 23998 rpcz_store.cc:276] 0709 12:20:46.960435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.091047 (+130612us) service_pool.cc:224] Handling call
0709 12:20:48.013021 (+921974us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b58001c43d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873a80aa 00007fa28742a447 00007fa287442fe7 00007fa2874447de 00007fa28745027c 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c
0709 12:20:48.087263 (+ 74242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538171136}
I20260709 12:20:48.041384 25901 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.041654 26054 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.088820 25816 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:48.038280 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.038339 25753 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.089854 25753 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:48.049307 26027 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:48.041436 26049 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.052829 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:48.090598 26027 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.092240 25815 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:48.092432 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:48.092625 26027 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.093392 26027 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:48.094460 26027 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:48.056576 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:48.046512 25811 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:48.098196 24001 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:48.098610 25811 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.099823 25811 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:48.057722 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:48.080598 25803 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:48.102375 25803 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.104856 25803 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:48.105033 26050 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.475s	user 0.000s	sys 0.003s
I20260709 12:20:48.052525 25865 raft_consensus.cc:3055] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:48.106034 25865 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:48.053409 25958 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:48.137625 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.138051 23850 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:48.138924 24001 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:48.140055 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.140413 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.141166 24001 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:48.142009 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:48.124437 23818 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:48.126780 23922 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:48.127040 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:48.127904 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:48.144938 23926 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:48.130029 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.145597 24004 raft_consensus.cc:2393] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:48.132553 24003 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:48.160940 23924 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:20:48.162379 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.165614 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.167383 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.170831 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.171152 24524 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:48.173904 23923 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:20:48.174883 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.175457 24001 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
W20260709 12:20:48.181187 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 56868.3us
I20260709 12:20:48.137846 26027 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:48.182487 23818 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:48.185142 23921 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:48.137527 25886 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.137820 25852 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.159225 25816 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.191282 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:48.193076 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:48.160422 25834 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:48.205379 23921 raft_consensus.cc:3055] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:48.205799 23921 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:48.207767 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.208647 23929 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:48.215330 23929 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:48.216432 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:48.223465 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:48.223737 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:48.037375 26028 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.213024 23921 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: false } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.180554 25904 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:48.233711 23921 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:48.180961 26029 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:48.189051 25655 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:48.242609 23892 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:48.245463 23850 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:48.188902 25974 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:48.177605 25930 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:20:48.192227 25967 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.203589 26061 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:48.262384 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.285255 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.227785 26055 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:48.235013 26000 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.235118 25952 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:48.189409 25865 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.256556 26049 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:48.293460 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.302947 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:48.247010 25927 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:48.195706 26056 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.254977 25655 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.204628 25886 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.284530 23921 raft_consensus.cc:2410] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:20:48.215483 25852 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.223493 25816 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.282510 26035 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.234381 25834 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.328403 24560 raft_consensus.cc:2368] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:20:48.295068 25952 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:48.295406 25997 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:48.344166 23848 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
W20260709 12:20:48.330952 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 88480.6us
I20260709 12:20:48.289170 26052 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:20:48.302439 25456 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:48.307413 26061 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:48.316257 25321 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:48.325239 25655 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:48.324576 26049 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:48.256669 26029 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.285140 25974 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.368818 25321 raft_consensus.cc:697] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:20:48.374440 26078 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:20:48.375123 25816 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:48.375887 25974 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.365404 26061 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.377151 26049 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.378870 26061 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.367580 25904 raft_consensus.cc:697] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:48.290966 25967 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.384100 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.384575 23895 leader_election.cc:400] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:20:48.384881 23895 leader_election.cc:403] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:48.342478 25952 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:48.339730 25852 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:48.322309 25927 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.370896 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:48.374730 25321 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.301929 26000 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.360496 26042 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.386880 25770 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:48.362649 26056 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.343173 26035 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.399675 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:20:48.392930 26071 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:20:48.380892 25904 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.422650 25886 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:48.363873 25456 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.353202 25997 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.417348 25927 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:48.417361 25967 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.397977 25403 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:20:48.430150 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.431820 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.444813 23854 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:20:48.446074 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:48.402030 25970 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:48.441267 25872 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:48.452090 25872 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.429589 25822 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:48.547199 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.543761 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:48.548360 24000 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:48.441434 26028 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:48.408864 26042 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.558825 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.567512 23998 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:48.567610 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.563772 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.565001 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:48.570290 24562 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:48.571190 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:48.412215 25770 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.458312 25852 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:48.581660 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.584472 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.585155 23925 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:20:48.592662 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:48.559130 25997 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.454960 25753 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.585659 26029 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.611057 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:48.583729 25852 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.586607 25904 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.585767 25872 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:48.587702 26000 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:48.589041 25770 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.614449 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.616727 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.617431 23929 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:20:48.616077 23921 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:48.609679 24000 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:20:48.618062 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.610401 25834 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:48.624617 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.624790 24525 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:48.613965 25852 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:48.613587 25740 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:48.628304 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.629761 23929 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:48.629726 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.632548 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.633668 24562 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:48.635957 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:48.640637 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:48.642331 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:48.633713 26089 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:48.617636 25904 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:48.641948 25811 consensus_meta.cc:287] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.000s
I20260709 12:20:48.644930 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:20:48.642982 26072 log.cc:927] Time spent T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.304s	user 0.000s	sys 0.004s
I20260709 12:20:48.643229 26088 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:48.655140 25456 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:48.656837 23999 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:48.657692 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:48.652614 25872 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:48.645044 26089 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:48.639076 25655 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.688783 25655 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.649537 25904 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.663370 25403 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:20:48.665788 25952 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:48.692178 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:48.666452 26027 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.700080 26027 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:48.666744 26089 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:48.652175 26085 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:48.660122 25816 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:48.659973 25872 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.708455 25952 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.708755 25872 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:48.673940 25753 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:48.675499 26080 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.342s	user 0.000s	sys 0.010s
W20260709 12:20:48.677577 26079 log.cc:927] Time spent T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.344s	user 0.005s	sys 0.008s
W20260709 12:20:48.680009 26073 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.346s	user 0.004s	sys 0.008s
I20260709 12:20:48.684875 25852 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:48.689953 26093 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:20:48.720711 25865 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:48.724360 25852 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:48.726027 25872 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:48.727591 26077 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.364s	user 0.001s	sys 0.006s
I20260709 12:20:48.729400 25872 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:48.767357 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 191) took 1218 ms. Trace:
I20260709 12:20:48.768473 23846 rpcz_store.cc:276] 0709 12:20:47.548314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.548448 (+   134us) service_pool.cc:224] Handling call
0709 12:20:47.965922 (+417474us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327e9c 00007fa284327a5b 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:47.966139 (+   217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:47.992289 (+ 26150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:47.992317 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:47.994574 (+  2257us) log.cc:844] Serialized 26 byte log entry
0709 12:20:48.163028 (+168454us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:48.163065 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.165834 (+  2769us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:48.566737 (+400903us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:20:48.766475 (+199738us) raft_consensus.cc:1685] finished
0709 12:20:48.766516 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:48.766979 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25781,"raft.queue_time_us":33937,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":52894720,"thread_start_us":168045,"threads_started":1,"wal-append.queue_time_us":316026}
I20260709 12:20:48.770756 23845 raft_consensus.cc:2368] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
I20260709 12:20:48.771840 23847 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:48.536381 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:48.776026 23849 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:48.776955 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:48.778905 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.780442 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.781347 23847 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:20:48.784690 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.785619 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.785856 23846 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:48.786677 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.787374 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.788043 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.788666 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:48.789016 23848 raft_consensus.cc:2393] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:48.795226 23853 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:48.814162 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:48.815572 23922 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:20:48.815469 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 157759us
I20260709 12:20:48.817322 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:48.678316 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.786648 23845 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:48.833864 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:48.835419 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:48.841617 24562 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:48.842522 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:48.844389 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:48.845463 23926 raft_consensus.cc:2368] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6.
I20260709 12:20:48.850014 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.850960 23997 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:48.854702 26042 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:48.859746 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:48.860570 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:48.860992 25865 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:48.864339 24562 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:48.865573 26035 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:48.850979 23854 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:48.820290 25815 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:20:48.876930 24001 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:48.877388 23895 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:48.877131 25865 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:20:48.878726 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 61689.1us
I20260709 12:20:48.883040 23969 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:48.884153 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:48.884562 25852 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:48.886128 24000 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:48.908617 25854 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:20:48.909126 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:48.909220 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.910221 23854 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:48.909482 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:48.915499 24000 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:48.925932 25872 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:48.929286 25834 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:48.923267 25854 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:48.935797 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 122736us
I20260709 12:20:48.938849 25834 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:48.939450 25834 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:48.940735 23892 leader_election.cc:400] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 2 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3.
I20260709 12:20:48.952328 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.953423 23995 raft_consensus.cc:2368] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:20:48.954509 25865 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:48.956686 23999 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
W20260709 12:20:48.964553 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 81964.3us
I20260709 12:20:48.967717 23818 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:48.969239 25815 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:48.972075 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.957854 25854 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:20:48.976825 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 67506.8us
I20260709 12:20:48.982077 24000 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
W20260709 12:20:48.985347 23749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43184 (request call id 223) took 11706 ms (client timeout 15000 ms). Trace:
I20260709 12:20:48.988484 23751 catalog_manager.cc:5697] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 2 to 3, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 3 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.974388 23895 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:49.011916 23925 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:20:49.013412 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 76742.5us
I20260709 12:20:49.014228 25848 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:49.015707 23895 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:49.018213 25854 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:48.993388 23749 rpcz_store.cc:269] 0709 12:20:37.278620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.280917 (+  2297us) service_pool.cc:224] Handling call
0709 12:20:37.911338 (+630421us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003129d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b6090 00007fa287454f3a 00007fa28d20ae9c 00007fa28d30904e 00007fa28b7ca2a4 00007fa28b7ca232 00007fa28b7ca161 00007fa28b7ca0dc 00007fa28b7c9392 00007fa28578748c 00007fa2857868c6
0709 12:20:48.985054 (+11073716us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:45.718424 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:45.719075 (+   651us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:45.719117 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:20:45.719140 (+    23us) tablet.cc:662] Decoding operations
0709 12:20:45.720980 (+  1840us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:45.721052 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:45.721082 (+    30us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:20:45.799726 (+ 78644us) tablet.cc:701] Row locks acquired
0709 12:20:45.799742 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:20:45.799886 (+   144us) write_op.cc:270] Start()
0709 12:20:45.799994 (+   108us) write_op.cc:276] Timestamp: P: 1783599645799840 usec, L: 0
0709 12:20:45.800014 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:20:45.800689 (+   675us) log.cc:844] Serialized 7108 byte log entry
0709 12:20:46.022582 (+221893us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b180021ffa0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435c455 00007fa2873c9190 00007fa2873c2ae7 00007fa2873c1dd9 00007fa2873cc930
0709 12:20:46.224676 (+202094us) op_driver.cc:464] REPLICATION: finished
0709 12:20:46.506499 (+281823us) write_op.cc:301] APPLY: starting
0709 12:20:46.512424 (+  5925us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:46.545165 (+ 32741us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:46.545193 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:46.547223 (+  2030us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:46.547545 (+   322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 12:20:46.547598 (+    53us) write_op.cc:312] APPLY: finished
0709 12:20:46.547986 (+   388us) log.cc:844] Serialized 125 byte log entry
0709 12:20:46.548162 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:46.548338 (+   176us) write_op.cc:454] Released schema lock
0709 12:20:46.548393 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:46.548777 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:46.548810 (+    33us) write_op.cc:454] Released schema lock
0709 12:20:46.936570 (+387760us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b54003129d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744932a 00007fa2873cef14 00007fa2873ceec3 00007fa2873cee38 00007fa2873cedf3 00007fa2873ce0dc 00007fa2873f7e16 00007fa2873dfcbb 00007fa2873ca39d 00007fa2873cdd75
Metrics: {"mutex_wait_us":196948,"reported_tablets":29,"spinlock_wait_cycles":325341952,"child_traces":[["op",{"apply.queue_time_us":246282,"apply.run_cpu_time_us":4484,"apply.run_wall_time_us":63405,"num_ops":18,"prepare.queue_time_us":332851,"prepare.run_cpu_time_us":28468,"prepare.run_wall_time_us":196666,"raft.queue_time_us":266064,"raft.run_cpu_time_us":26185,"raft.run_wall_time_us":748276,"replication_time_us":413733,"spinlock_wait_cycles":14708992,"thread_start_us":335904,"threads_started":4,"wal-append.queue_time_us":117045,"wal-append.run_cpu_time_us":31439,"wal-append.run_wall_time_us":1703639}]]}
I20260709 12:20:49.024251 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:49.028520 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:48.969866 25815 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.030305 25815 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:49.012349 23751 catalog_manager.cc:5697] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: leader changed from <none> to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 3 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:49.032684 23751 catalog_manager.cc:5697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:49.034430 25753 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:49.035205 25753 raft_consensus.cc:697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:49.036546 25753 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.036722 23751 catalog_manager.cc:5697] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 4, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 4 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.039819 23751 catalog_manager.cc:5697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:49.041370 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:49.042258 25865 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:49.042956 25865 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:49.044914 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 88899.7us
I20260709 12:20:49.046595 24524 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:49.047724 25865 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:49.048213 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:49.055637 24001 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:49.063061 23854 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:49.055588 25872 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.076819 25852 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:49.077369 25872 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.068825 25865 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:49.086894 25865 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.087195 25872 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:49.087320 25865 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:49.091536 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:49.093094 23818 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:49.095717 25994 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:49.096180 25994 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.093461 26035 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:49.078105 23751 catalog_manager.cc:5697] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.119752 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:49.120965 24560 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:49.120249 25815 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.125131 25815 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:49.130187 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88963us
I20260709 12:20:49.131583 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:49.139989 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 199774us
I20260709 12:20:49.141395 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:49.141762 23892 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:49.142383 24554 raft_consensus.cc:2368] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6.
W20260709 12:20:49.147114 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 68304.9us
I20260709 12:20:49.147487 23926 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:49.149168 24554 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:49.149801 23817 leader_election.cc:400] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6.
I20260709 12:20:49.150161 23817 leader_election.cc:403] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:20:49.151841 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:20:49.152756 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 43674.4us
I20260709 12:20:49.153587 23818 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:49.109747 24001 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:49.103438 25994 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:49.184589 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:49.168370 23751 catalog_manager.cc:5697] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 2 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.196746 23892 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:49.200121 25966 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:49.198962 23751 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 2 to 3, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:49.188783 25852 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:49.209786 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:49.204200 25865 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.213964 25456 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:20:49.216174 25865 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:49.234314 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 102921us
I20260709 12:20:49.241663 25904 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.242442 25904 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.244057 24001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:49.245033 24001 raft_consensus.cc:606] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:49.245419 24001 raft_consensus.cc:614] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:49.248035 26035 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:49.248689 24001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:49.249660 24001 raft_consensus.cc:606] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:20:49.250218 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 100740us
I20260709 12:20:49.256287 24555 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:20:49.256886 24555 pending_rounds.cc:85] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 4
I20260709 12:20:49.257270 24555 pending_rounds.cc:107] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:20:49.259450 25894 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:49.261211 25815 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:49.249671 26035 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.251379 26062 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:49.252107 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 96845.5us
I20260709 12:20:49.254614 25966 raft_consensus.cc:697] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:49.204289 26065 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:49.265911 24001 raft_consensus.cc:614] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:49.237354 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:49.257647 24555 raft_consensus.cc:2889] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:49.213981 24559 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:49.269279 26065 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.286068 25854 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:49.268591 25904 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:49.299065 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 110014us
I20260709 12:20:49.293047 23751 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 3, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:49.290585 26065 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:49.298310 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:49.309379 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 72163us
I20260709 12:20:49.310348 25655 consensus_queue.cc:1059] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 12:20:49.312175 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 102621us
I20260709 12:20:49.312644 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:49.317188 23998 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:49.314248 26084 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:49.306008 25854 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:49.325439 24001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:41366
W20260709 12:20:49.319696 26095 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:20:49.322080 23751 catalog_manager.cc:5697] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 3 to 4, term changed from 1 to 3, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to <none>, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:49.326256 23893 leader_election.cc:400] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:20:49.335887 23893 leader_election.cc:403] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:49.339614 24001 raft_consensus.cc:606] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:49.341311 24001 raft_consensus.cc:614] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:49.353128 23969 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:49.357218 23852 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:49.354743 23751 catalog_manager.cc:5697] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 4, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 4 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:49.337380 24554 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:20:49.364104 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:49.365638 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:49.371538 24001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:41366
I20260709 12:20:49.372193 24001 raft_consensus.cc:606] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:49.372527 24001 raft_consensus.cc:614] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:49.366623 25456 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:49.374785 26093 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:20:49.375597 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 183) took 1406 ms. Trace:
I20260709 12:20:49.376040 23996 rpcz_store.cc:276] 0709 12:20:47.968946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.974803 (+  5857us) service_pool.cc:224] Handling call
0709 12:20:48.006245 (+ 31442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:48.008997 (+  2752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:48.009040 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:48.009593 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:20:48.665339 (+655746us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b1800241d80. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec0d1 00007fa287407a0f
0709 12:20:48.959919 (+294580us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:48.960007 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.960121 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:49.052982 (+ 92861us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b1800241d80. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:20:49.369496 (+316514us) raft_consensus.cc:1685] finished
0709 12:20:49.369522 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.375372 (+  5850us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":399,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":12226,"spinlock_wait_cycles":44503552,"thread_start_us":283455,"threads_started":1,"wal-append.queue_time_us":942846}
I20260709 12:20:49.378528 25854 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.373881 23751 catalog_manager.cc:5697] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 3, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 3 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:20:49.375612 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:49.389158 23998 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:49.360639 26084 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:49.393411 23892 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:49.362524 25753 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:20:49.395756 25321 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:49.366302 25966 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.390658 23818 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:49.360976 25834 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.391563 26069 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:20:49.417546 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44012.5us
I20260709 12:20:49.409165 25655 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:49.422921 26069 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:49.422049 25456 consensus_queue.cc:1059] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:20:49.442333 25904 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:49.457907 23893 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:49.456451 23820 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:49.468089 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:49.471627 23852 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:49.472237 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:49.473083 26084 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:49.459477 25655 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:49.479619 25655 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.483655 25952 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:49.484894 25321 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:49.486804 26065 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.487840 25778 raft_consensus.cc:3055] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:49.488365 25778 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:49.488926 26065 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:49.473678 26084 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.492887 26062 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6.
I20260709 12:20:49.493331 26084 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:49.495090 23820 leader_election.cc:400] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6.
I20260709 12:20:49.497838 23852 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
W20260709 12:20:49.516417 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 55762.6us
I20260709 12:20:49.523923 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:49.524881 23854 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:20:49.525785 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:49.529810 23998 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:49.488369 25753 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:20:49.478956 26069 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.542191 25848 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.560475 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:49.565665 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:49.567080 23921 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:49.489523 25778 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.533370 25872 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:49.537803 25321 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.576539 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 80518us
I20260709 12:20:49.587366 26028 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:49.588771 25852 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:49.589406 25852 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.575258 25872 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.609117 25994 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.587447 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:49.626549 24004 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:49.599116 25816 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:49.601696 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:49.604387 26069 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:49.607053 25778 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:49.607595 25321 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: false } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.610275 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:49.610775 25872 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:49.582435 26085 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:49.611570 25834 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:49.594167 23922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:20:49.641027 24004 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:20:49.643810 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:49.652380 23848 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:49.645602 23929 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:20:49.645943 24524 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:49.587369 25848 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.643499 25816 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.641997 25865 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.642896 25655 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:20:49.658046 23845 raft_consensus.cc:1240] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:20:49.649188 26085 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.652271 23922 raft_consensus.cc:606] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:49.661410 23920 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:49.666530 23924 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:20:49.677996 23848 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:20:49.684734 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:49.666095 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:49.691965 23893 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:49.681218 23924 pending_rounds.cc:85] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 4
I20260709 12:20:49.697701 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:49.700871 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 50387us
I20260709 12:20:49.667397 25823 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.703914 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:49.667130 25456 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.666626 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:49.671376 26058 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:49.710640 26061 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:49.710822 25823 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.712641 24000 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:20:49.713028 24000 pending_rounds.cc:85] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 2
I20260709 12:20:49.713265 24000 pending_rounds.cc:107] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:20:49.713495 24000 raft_consensus.cc:2889] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:49.668895 25865 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:49.714035 25824 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:49.714745 25824 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:49.663771 25816 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:49.715834 25865 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:49.670730 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:49.694802 23924 pending_rounds.cc:107] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 12:20:49.716917 23924 raft_consensus.cc:2917] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 12:20:49.717518 23924 raft_consensus.cc:2889] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:49.717149 25456 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.676026 25848 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:49.718354 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:35822 (request call id 8) took 1770 ms. Trace:
I20260709 12:20:49.710641 24563 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:49.719180 23925 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:20:49.721580 26126 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:49.675043 26085 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:49.661845 25321 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:49.723752 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:49.724829 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:49.736351 23996 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:49.725169 24001 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:49.722354 26126 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.727173 25823 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:49.715831 25824 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.727882 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:49.728377 26058 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:49.750425 26058 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:49.728719 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:49.734359 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:49.751885 23997 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:49.706147 25904 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:49.744382 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:49.762405 23996 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:49.719203 23924 rpcz_store.cc:276] 0709 12:20:47.948183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.949450 (+  1267us) service_pool.cc:224] Handling call
0709 12:20:48.089092 (+139642us) log.cc:844] Serialized 556 byte log entry
0709 12:20:48.678540 (+589448us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b1800158020. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:20:48.680300 (+  1760us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b1800158020. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f557 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:20:48.867143 (+186843us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b1800158020. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:20:49.718238 (+851095us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43104,"raft.queue_time_us":176901,"raft.run_cpu_time_us":37,"raft.run_wall_time_us":41,"spinlock_wait_cycles":118723456,"thread_start_us":101829,"threads_started":1,"wal-append.queue_time_us":200233}
I20260709 12:20:49.795789 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:49.784374 25198 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:20:49.815811 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:49.818571 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:49.891125 25852 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:49.892204 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:49.892997 23925 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:49.835784 25904 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:49.836553 25994 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:49.766263 23929 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:20:49.837757 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:20:49.842144 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 196333us
I20260709 12:20:49.843371 25456 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:49.844270 25969 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:49.908658 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:49.910220 24563 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:49.845425 26126 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:49.872520 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:49.874696 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:49.912899 24004 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:49.906363 24000 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:49.914837 23996 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:49.915005 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:49.917079 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:49.907584 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:49.922930 23920 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:49.923517 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:49.931670 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:49.932858 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:49.933051 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:49.933867 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:49.910486 24554 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:49.945232 23966 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:49.950316 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:49.998261 25872 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:20:50.043629 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 75551.4us
W20260709 12:20:50.045715 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 120380us
I20260709 12:20:50.047258 25886 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.943367 25816 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:50.043754 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:49.948758 25852 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.043215 25403 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
W20260709 12:20:50.063076 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 102345us
I20260709 12:20:50.047598 25872 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:20:50.065239 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.057245 25886 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:50.065492 26128 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.114s	user 0.001s	sys 0.002s
I20260709 12:20:50.066329 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:50.067512 26137 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:20:50.068102 23800 auto_rebalancer.cc:893] Removing replace marker failed: Op aborted by new leader
W20260709 12:20:50.090888 23800 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 729f7490c64342bebf0188dd2f975e39 already in progress
W20260709 12:20:50.091271 23800 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 729f7490c64342bebf0188dd2f975e39 already in progress
I20260709 12:20:50.092721 23848 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:50.093742 25886 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:50.094257 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:50.094938 23847 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:50.095126 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:50.095723 23849 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:50.096261 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:50.096833 23849 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:50.071355 26131 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:50.070097 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 123862us
I20260709 12:20:50.097470 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:50.097581 26131 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:50.099176 23846 raft_consensus.cc:2410] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:20:50.093767 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:50.058008 25816 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.102106 25816 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:50.102264 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:50.104192 26135 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 12:20:50.064369 25852 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:50.088304 26058 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:50.098680 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:50.107221 26058 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:50.077893 25872 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:50.110301 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:50.115170 26058 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:50.116999 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:50.117815 25852 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:50.122666 23853 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:50.124035 23850 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:50.096969 23854 raft_consensus.cc:2368] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7.
I20260709 12:20:50.098673 26131 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:50.062768 25456 consensus_queue.cc:1059] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:20:50.126828 25456 raft_consensus.cc:3055] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:50.127245 25456 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:50.128221 25456 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:50.129554 25456 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:50.079041 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.128437 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:50.134721 25894 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:50.136732 26057 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:20:50.137977 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 73425.5us
I20260709 12:20:50.139113 23817 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.140055 25894 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:50.141304 24001 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:50.141664 23996 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:50.143316 25815 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:50.152477 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.155745 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:50.141588 23893 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:50.166608 23997 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:50.168008 24001 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:50.168056 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.169730 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:50.133289 25872 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:50.191077 23818 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.192914 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:50.193825 23847 raft_consensus.cc:2393] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:50.195010 24524 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:50.195953 25904 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:50.200793 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.204510 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:50.208528 23966 leader_election.cc:400] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7.
I20260709 12:20:50.208951 23966 leader_election.cc:403] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:20:50.209932 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:50.210871 25198 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:50.218415 23892 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:50.219796 23925 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:20:50.220353 23925 pending_rounds.cc:85] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 1
I20260709 12:20:50.220409 26132 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:50.221493 26132 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7.
I20260709 12:20:50.222889 25770 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:20:50.223140 25816 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:50.225808 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:50.180934 25969 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:20:50.229105 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:50.213785 26085 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:50.230356 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:50.219808 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:50.231801 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:50.232506 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 69959.3us
I20260709 12:20:50.229115 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:50.219937 25771 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:50.233672 24524 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.220779 23925 pending_rounds.cc:107] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:50.234848 23925 raft_consensus.cc:2889] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:50.216168 25854 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:50.236040 25771 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.238495 25865 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:50.239951 25823 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:50.242542 25816 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:50.246140 25834 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:50.249001 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:50.246377 25854 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.253378 25771 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:50.283092 25811 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:50.284756 25973 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:50.285499 26083 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:50.291215 25872 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:50.295446 26129 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:50.296007 26129 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:50.296475 26129 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:50.280889 25854 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:50.278309 25886 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:20:50.342525 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 130502us
W20260709 12:20:50.355903 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 153890us
W20260709 12:20:50.362861 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 165616us
I20260709 12:20:50.260968 25655 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
W20260709 12:20:50.306039 26095 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:20:50.267108 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:50.388948 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 170637us
I20260709 12:20:50.404918 23995 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:50.405205 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.407182 25198 raft_consensus.cc:993] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
W20260709 12:20:50.410574 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 128526us
W20260709 12:20:50.409036 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 175431us
I20260709 12:20:50.393821 25904 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.414347 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:50.418749 23847 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:50.422224 23999 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:50.427886 25198 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:50.444553 26145 raft_consensus.cc:1081] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:20:50.448735 23966 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.431098 25816 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:50.460491 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.471427 26129 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:50.423851 25848 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:20:50.473173 25854 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:50.454160 25952 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:20:50.463069 25872 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:50.491305 23847 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:20:50.431862 25904 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:50.508023 25198 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:50.509651 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:50.511449 23925 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:20:50.512399 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 51962.4us
I20260709 12:20:50.513485 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.520959 23854 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:50.524691 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:50.525373 23922 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:50.540867 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 120449us
I20260709 12:20:50.467129 25969 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:20:50.548573 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:50.548199 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 127865us
I20260709 12:20:50.552001 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:50.566344 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:50.567406 23847 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 7: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:50.570632 23997 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:50.519505 24560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36552
I20260709 12:20:50.573976 24560 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:50.574512 24560 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:50.537134 26061 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:50.578274 26062 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:50.603758 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 54031.8us
I20260709 12:20:50.573458 26155 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:20:50.627904 26126 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:50.598585 26062 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:50.694945 26163 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:20:50.696205 26154 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260709 12:20:50.654129 26151 consensus_queue.cc:1059] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.176s
I20260709 12:20:50.760969 23922 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
W20260709 12:20:50.953507 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 401568us
W20260709 12:20:50.982443 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 440946us
I20260709 12:20:51.022435 24560 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:50.980043 25854 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:51.045022 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88897.4us
I20260709 12:20:51.047540 24560 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.042618 25994 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:51.042980 25886 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:51.050974 26062 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.052224 24555 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:51.052672 23921 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:51.054791 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:51.055312 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:51.056046 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:51.089586 23923 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:20:51.060472 25771 consensus_meta.cc:287] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.000s
I20260709 12:20:51.018762 25770 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:20:51.062021 26155 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:50.987252 25904 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.032335 26124 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:51.093071 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:51.091272 23923 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:51.035547 25655 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:51.067036 26153 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:51.099783 23923 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.109004 23923 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:51.095521 24556 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:51.105528 26177 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:51.092947 25994 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.134662 26177 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.139636 26177 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.118187 25655 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.117610 26151 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:20:51.123438 26153 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.135219 26026 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:20:51.147583 26153 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.105266 26155 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.156634 26155 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:51.157306 26089 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:51.104204 26124 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.160028 26124 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:51.100584 25886 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.157152 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:51.162263 25886 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:51.162876 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:51.119731 25969 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:51.099146 25771 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.163517 23853 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:20:51.172412 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:51.161533 25655 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:51.121637 26178 raft_consensus.cc:3055] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:51.174384 25966 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.175462 24556 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:20:51.175594 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:51.176285 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:51.181365 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:51.176823 25994 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:51.174432 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:51.176608 26178 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:51.221226 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:51.281224 23927 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:20:51.332134 25771 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.219455 25966 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.336524 25966 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.229442 23969 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:51.374274 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 145009us
I20260709 12:20:51.345532 25655 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.349586 26178 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.283701 26148 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.362109 23923 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:51.362524 26181 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.379154 26131 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:51.382229 26181 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.384837 26181 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.384559 26148 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.382226 25655 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.387142 26148 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.387750 25655 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.389618 26178 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:51.394388 26169 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:51.423241 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.460053 26169 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.460850 26169 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:51.439424 26148 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.462725 26148 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.465042 26148 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.465590 26148 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.474067 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1401) took 1260 ms. Trace:
I20260709 12:20:51.474948 23927 rpcz_store.cc:276] 0709 12:20:50.207668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.207817 (+   149us) service_pool.cc:224] Handling call
0709 12:20:50.208161 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:51.332556 (+1124395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.465947 (+133391us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b5400279cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:51.468294 (+  2347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241343872}
I20260709 12:20:51.499794 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:51.500566 24000 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:51.506302 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:51.509001 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:51.515204 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:51.477428 26131 raft_consensus.cc:697] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:51.527621 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:51.527928 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:51.528584 23922 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:51.529373 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:51.529661 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:51.530306 23926 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:51.531569 26054 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:51.532231 26054 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.532646 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:51.533906 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:51.535238 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:51.479218 26148 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.503278 26192 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:51.541232 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:51.534752 26131 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.552695 26054 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.551321 23999 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:51.538578 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:51.559762 23997 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:51.558492 26178 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.560936 26178 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:51.575122 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.563329 26192 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.596060 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1489) took 1147 ms. Trace:
I20260709 12:20:51.602412 23818 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:51.596650 23849 rpcz_store.cc:276] 0709 12:20:50.448387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.448493 (+   106us) service_pool.cc:224] Handling call
0709 12:20:51.391361 (+942868us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:51.391572 (+   211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:51.395979 (+  4407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:51.396029 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:51.396666 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 12:20:51.495975 (+ 99309us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:51.496018 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.496094 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.595629 (+ 99535us) raft_consensus.cc:1685] finished
0709 12:20:51.595649 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.595958 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4001,"raft.queue_time_us":5205,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2537,"spinlock_wait_cycles":2634112,"thread_start_us":94885,"threads_started":1,"wal-append.queue_time_us":158284}
I20260709 12:20:51.610121 23818 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:51.609221 26054 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:51.612162 26054 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.612421 26148 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.612646 26054 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:51.619416 26124 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:51.619588 26192 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.621618 23818 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:51.623193 23818 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:51.660472 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:51.664422 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:51.659595 26187 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:51.668816 26062 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:51.666687 26148 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.663918 26192 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.674422 26197 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.717571 26148 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.717432 26197 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.719813 26148 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.720556 26197 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.721168 26148 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.668898 26169 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.701524 26062 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.721705 26148 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.733142 26192 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.754134 26178 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.674757 26124 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.697315 25655 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:51.802721 26054 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:51.789973 25823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.189s	user 0.024s	sys 0.045s
I20260709 12:20:51.790331 26193 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.836588 26043 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.836928 26193 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.837436 26043 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.839545 26193 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:51.840276 25823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.025s	sys 0.046s
I20260709 12:20:51.840416 26043 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.841188 26043 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.827575 25655 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.843005 25655 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:51.848338 26129 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.849165 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 549) took 1447 ms. Trace:
I20260709 12:20:51.801994 26062 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:51.784693 25904 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:51.835929 26054 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.787338 26181 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:51.796757 26187 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.849802 24561 rpcz_store.cc:276] 0709 12:20:50.401947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.402090 (+   143us) service_pool.cc:224] Handling call
0709 12:20:50.409120 (+  7030us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:50.759020 (+349900us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:51.128759 (+369739us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.388106 (+259347us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.389246 (+  1140us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:51.389835 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 12:20:51.390020 (+   185us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:51.390059 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.848530 (+458471us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54004cf4d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:51.848607 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.848803 (+   196us) raft_consensus.cc:1685] finished
0709 12:20:51.848829 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.849052 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50062,"prepare.queue_time_us":298320,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":65,"raft.queue_time_us":479595,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":292,"spinlock_wait_cycles":305819904,"thread_start_us":745015,"threads_started":3,"wal-append.queue_time_us":208608}
W20260709 12:20:51.868468 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.863379 26169 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.878304 26148 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:51.841754 26043 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.852125 26124 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:51.886399 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 175373us
I20260709 12:20:51.865031 25904 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:51.887050 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 185603us
I20260709 12:20:51.911669 23966 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:51.868395 26181 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:51.885972 26140 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.464s	user 0.008s	sys 0.035s
I20260709 12:20:51.885829 25823 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.870282 26187 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.937585 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:51.957310 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:51.937981 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:51.884253 26089 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:51.951272 25198 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:51.935680 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:51.956593 26140 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.531s	user 0.008s	sys 0.036s
I20260709 12:20:51.910702 26129 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:51.962045 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:51.963181 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:51.971105 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:51.971892 24000 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:51.961088 25198 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:51.895646 26148 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:51.974643 24562 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 7: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:51.949994 26193 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:51.938090 25848 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:51.992758 25904 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:51.993259 26205 log.cc:927] Time spent T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:20:51.972764 26089 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.993445 26197 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.961673 25823 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.014534 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.025254 26153 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:52.026173 26043 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.003845 25198 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.027910 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.028275 25823 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.990358 26169 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:52.029449 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.034806 23847 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:20:52.029939 23854 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:52.031314 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:52.042862 23845 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.025911 26153 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:51.987987 26167 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.009550 26197 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.053332 26124 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.990193 26148 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.054062 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.054265 26187 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:51.981873 26129 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.055088 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.055727 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:51.999547 26192 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:51.987834 25848 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.078188 25655 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:52.080812 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 129732us
I20260709 12:20:52.033530 26131 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:52.109692 23849 raft_consensus.cc:2393] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:52.035468 26208 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:20:52.076470 26083 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.380s	user 0.019s	sys 0.086s
I20260709 12:20:52.062665 26043 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.079666 26169 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:52.128966 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.130509 23852 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
W20260709 12:20:52.124591 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 171407us
W20260709 12:20:52.123332 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 223120us
I20260709 12:20:52.286871 25994 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.287478 25994 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.289476 26218 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:52.126883 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:52.118621 25655 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.139400 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:52.144790 23998 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:52.293529 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 166794us
I20260709 12:20:52.294445 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:52.102905 26207 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.294945 26217 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.295169 23996 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:52.295277 26207 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.146746 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:52.298183 23997 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:52.137554 26083 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.451s	user 0.019s	sys 0.089s
I20260709 12:20:52.158993 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.303611 23852 raft_consensus.cc:2393] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:20:52.303690 26214 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 12:20:52.136044 25753 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.304931 25753 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.307404 25753 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.098968 26167 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:52.164059 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 226534us
I20260709 12:20:52.130299 26199 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.310192 26199 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.312489 26199 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:52.137164 26192 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.313166 26192 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.178138 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:20:52.178624 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.123741 26131 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.186607 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.187372 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:52.166718 26193 raft_consensus.cc:697] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:52.128970 26208 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.153609 26043 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.331447 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.332206 23995 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:52.216861 26197 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:52.218372 26148 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.334887 26131 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:52.335074 25966 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.218497 25848 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.199115 26181 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.347841 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:52.210034 26160 log.cc:927] Time spent T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 1.258s	user 0.013s	sys 0.011s
I20260709 12:20:52.348354 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.348564 23995 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:52.223743 26227 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.349051 26193 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.349574 26227 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.351425 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.349644 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1486) took 1902 ms. Trace:
I20260709 12:20:52.352813 26167 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.352252 23846 rpcz_store.cc:276] 0709 12:20:50.447493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.447616 (+   123us) service_pool.cc:224] Handling call
0709 12:20:50.453120 (+  5504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:50.466805 (+ 13685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:50.466836 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:50.474616 (+  7780us) log.cc:844] Serialized 26 byte log entry
0709 12:20:50.563452 (+ 88836us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:50.563491 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.563588 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:52.104330 (+1540742us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:20:52.349358 (+245028us) raft_consensus.cc:1685] finished
0709 12:20:52.349385 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.349584 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41039,"raft.queue_time_us":9112,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2480,"spinlock_wait_cycles":13209216,"thread_start_us":88400,"threads_started":1,"wal-append.queue_time_us":200164}
I20260709 12:20:52.225363 23845 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:52.226563 26153 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.227593 26145 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:52.337992 25966 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.355496 26145 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.357452 25966 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.236052 26226 consensus_queue.cc:1059] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:52.236559 26224 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:52.237998 23817 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:52.369489 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.240412 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:52.240507 26223 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.225632 26062 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.379849 26203 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:52.381107 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:52.243307 26069 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.250298 23848 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:52.254999 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:52.381943 26069 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.382547 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:52.384980 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.387588 23851 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:52.387828 26215 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.207s	user 0.000s	sys 0.003s
I20260709 12:20:52.388111 26197 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.388686 26197 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.389097 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1485) took 1941 ms. Trace:
I20260709 12:20:52.248696 25952 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.260643 26237 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:52.364451 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:52.294488 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.390149 26237 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.390990 23998 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:52.275446 26233 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.391891 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.391979 26233 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.392587 23998 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:52.260711 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.297626 26207 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:52.393628 24001 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:20:52.149956 25198 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:52.394402 25198 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.394693 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.315333 26192 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:52.351675 26208 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.395951 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.396376 23852 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:52.330193 25865 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:20:52.215962 26206 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:20:52.332763 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:52.336151 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.332739 26043 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.338181 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.411475 23850 raft_consensus.cc:2410] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:20:52.342836 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.344298 24562 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:52.414258 24001 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:52.211154 26169 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.355018 23853 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:52.230593 24000 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:52.358982 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.359618 26089 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.357275 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.349587 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.312502 26129 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.357545 26145 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.362237 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:20:52.458698 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 96544.6us
I20260709 12:20:52.366495 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.372095 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:52.372761 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 134861us
I20260709 12:20:52.460777 23817 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:52.462255 26043 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:52.462594 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:52.462929 26043 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.463328 26043 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:52.373404 25655 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.378191 26224 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.374030 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.378330 26223 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.390245 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:52.320856 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:52.325357 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.472558 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.472945 24004 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:52.328595 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.473677 26223 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.473968 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.393543 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.403417 23893 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:52.474572 25894 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:52.475191 23998 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:52.475385 25894 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:52.476107 25894 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:52.408573 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.389498 23851 rpcz_store.cc:276] 0709 12:20:50.447218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.448645 (+  1427us) service_pool.cc:224] Handling call
0709 12:20:51.716698 (+1268053us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:51.716905 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.388031 (+671126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.388878 (+   847us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54001b1cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:52.389043 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544503040}
I20260709 12:20:52.351753 26227 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:52.475379 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 72064us
I20260709 12:20:52.484323 23893 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:52.418423 25865 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.474000 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:52.487430 24004 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:20:52.487771 26224 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.419605 26203 raft_consensus.cc:3055] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:52.487999 26145 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:52.488358 26203 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:52.488509 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.405241 23997 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:52.389658 25994 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.490345 26232 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.489701 26203 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.490877 26232 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.491473 26203 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.412309 25952 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.494496 26197 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:52.488535 26145 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:52.495438 25952 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.451226 26238 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.495926 26145 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.496322 26238 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.462111 25778 consensus_queue.cc:1059] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:52.463567 26226 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.498634 26240 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:52.498629 26226 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:52.381296 23922 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:52.499287 26240 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:52.455896 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:52.464570 23854 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
W20260709 12:20:52.500150 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44342.2us
I20260709 12:20:52.500303 26240 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.502061 26224 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:52.502259 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:52.502542 26224 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.503024 26224 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:52.475607 25823 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:52.504372 25823 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.504804 25823 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:52.501799 26240 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:52.416612 23996 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:52.484920 25848 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:52.510251 25848 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.484370 24561 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:52.503674 26227 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:52.513162 25848 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:52.465298 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:52.514430 24000 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:52.514657 25655 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:52.515713 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 50519.5us
I20260709 12:20:52.500083 25198 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.499466 26226 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.488116 25865 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:52.499159 26238 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.519845 23817 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:52.526304 25655 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:52.527925 25823 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.529191 26223 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:52.529673 26223 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.530097 26223 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:52.531651 23818 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:52.533012 23818 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:52.533792 26153 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:52.534794 26153 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.535439 26153 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.541687 26237 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:52.542738 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:52.543728 26233 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.474663 23995 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:52.547449 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:52.551051 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:52.553354 25824 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:52.554163 25824 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.554555 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:52.555743 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.556463 25824 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.556715 25198 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:52.557291 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.557242 25198 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.557541 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.558442 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.558784 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.556499 23922 raft_consensus.cc:2368] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:20:52.559559 23926 raft_consensus.cc:2410] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:20:52.560608 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:52.572250 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 52467.4us
I20260709 12:20:52.573521 23817 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:52.582911 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 50008.1us
I20260709 12:20:52.584477 23818 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:52.587180 23818 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:52.553419 25778 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:20:52.588119 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.599964 23923 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:52.588614 25952 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:52.589020 25994 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:52.589668 25198 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.541762 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:20:52.608374 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 66681.6us
I20260709 12:20:52.609376 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:52.600899 25952 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.647192 25848 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:52.647775 25848 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:52.648162 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.649137 23920 raft_consensus.cc:2410] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:20:52.648790 25848 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.601163 26124 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.650168 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:52.650815 23996 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:52.650192 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.647423 25952 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:52.653254 24003 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:52.649399 25894 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.657217 26226 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:52.590145 26233 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:20:52.660301 25894 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.597412 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:52.597486 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.600965 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.596505 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:52.666464 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 57213.1us
I20260709 12:20:52.661504 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.271798 26213 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.776119 26223 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.282231 26213 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.663005 26197 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:53.268947 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:53.084966 24004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.012s	sys 0.031s
W20260709 12:20:52.792101 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.667138 25994 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:52.696245 25886 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.775817 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.228771 26193 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:52.782051 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.733548 26210 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:52.689556 26126 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.690513 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:52.693751 26226 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:52.687878 26237 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:52.907357 25865 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.851204 26224 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:52.688385 23926 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:53.274667 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:53.286098 24004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.017s	sys 0.033s
I20260709 12:20:53.333918 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:53.267822 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 680719us
I20260709 12:20:53.289155 23922 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:20:53.301151 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.289358 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:53.112571 23925 consensus_meta.cc:287] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 12:20:53.289674 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.290583 23846 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:53.290099 23928 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:20:53.292495 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:52.748071 23966 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:53.324051 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.337093 23847 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:53.338035 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.299795 23996 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:20:53.290798 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:53.335661 23818 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:53.290056 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.336155 23925 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:53.332727 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1560) took 1170 ms. Trace:
I20260709 12:20:53.348443 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.350456 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:53.351681 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 603688us
I20260709 12:20:53.353329 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:53.354137 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.346482 24004 rpcz_store.cc:276] 0709 12:20:52.162150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.489747 (+327597us) service_pool.cc:224] Handling call
0709 12:20:52.497987 (+  8240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.498219 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:52.498862 (+   643us) log.cc:844] Serialized 14 byte log entry
0709 12:20:53.332348 (+833486us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:53.332408 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:53.332463 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.332535 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.332665 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":160,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":833130,"threads_started":1,"wal-append.queue_time_us":771859}
I20260709 12:20:53.359681 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1572) took 1025 ms. Trace:
I20260709 12:20:53.361666 24004 rpcz_store.cc:276] 0709 12:20:52.334250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.358797 (+1024547us) service_pool.cc:224] Handling call
0709 12:20:53.359131 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.359324 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.359361 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:53.359410 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:53.359460 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.359520 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.359629 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:53.278132 25848 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.280855 26089 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.366711 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.287782 26213 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:53.292164 26237 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:52.847791 25823 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:53.284060 26223 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:53.385591 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.370468 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.070995 26233 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:53.356153 26153 consensus_meta.cc:287] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.820s	user 0.010s	sys 0.000s
I20260709 12:20:53.367969 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.355166 25865 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:53.367596 26169 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:52.948133 26043 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.366312 25894 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:53.386389 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:53.386363 23928 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:20:53.288529 25886 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.397418 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.290771 26210 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.400476 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1397) took 1113 ms. Trace:
I20260709 12:20:53.401391 25198 consensus_queue.cc:1059] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:53.289189 26193 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.370360 26240 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:53.386770 26211 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:53.418536 23847 raft_consensus.cc:2368] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7.
I20260709 12:20:53.418277 26240 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.418596 26211 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:53.404801 26247 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:53.404930 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.405587 26237 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.395926 26153 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.408335 26043 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:53.410434 26145 consensus_meta.cc:287] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.914s	user 0.011s	sys 0.000s
I20260709 12:20:53.413578 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 210) took 1264 ms. Trace:
I20260709 12:20:53.413946 25823 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:53.414484 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 1833) took 1087 ms. Trace:
I20260709 12:20:53.440659 23927 rpcz_store.cc:276] 0709 12:20:52.327551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.327706 (+   155us) service_pool.cc:224] Handling call
0709 12:20:52.328078 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.360538 (+ 32460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.360567 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.360607 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:52.360639 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.414235 (+1053596us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b5400374bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:53.414285 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.414424 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74201344}
I20260709 12:20:53.287935 25994 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.442201 26211 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:53.417223 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.392163 26065 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:53.420624 26240 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:53.420735 25952 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.767s	user 0.005s	sys 0.004s
I20260709 12:20:53.426601 26247 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:53.409459 26233 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.401260 23997 rpcz_store.cc:276] 0709 12:20:52.286798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.505556 (+218758us) service_pool.cc:224] Handling call
0709 12:20:52.505816 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.584773 (+ 78957us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:52.602049 (+ 17276us) log.cc:844] Serialized 14 byte log entry
0709 12:20:53.400152 (+798103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:53.400201 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:53.400258 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.400319 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.400424 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60652,"prepare.queue_time_us":17495,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":132067,"threads_started":1}
I20260709 12:20:53.404387 26169 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:53.436111 24559 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:53.437237 23846 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:53.427018 25778 raft_consensus.cc:3055] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:53.399219 26223 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:53.437608 23998 rpcz_store.cc:276] 0709 12:20:52.149157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.475983 (+326826us) service_pool.cc:224] Handling call
0709 12:20:52.476299 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.483737 (+  7438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.483767 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.483828 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:52.483864 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.413337 (+929473us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b540034b054. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:53.413387 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.413516 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16655104}
I20260709 12:20:53.454424 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:53.402489 25894 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:53.446869 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 209) took 1299 ms. Trace:
I20260709 12:20:53.430186 26220 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:53.383764 26089 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:53.466909 23924 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:20:53.456821 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1402) took 1093 ms. Trace:
I20260709 12:20:53.469987 24003 rpcz_store.cc:276] 0709 12:20:52.146976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.148794 (+  1818us) service_pool.cc:224] Handling call
0709 12:20:52.164436 (+ 15642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.653673 (+489237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.444068 (+790395us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540009b5d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:53.446824 (+  2756us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122387712}
I20260709 12:20:53.473304 23997 rpcz_store.cc:276] 0709 12:20:52.359233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.451635 (+1092402us) service_pool.cc:224] Handling call
0709 12:20:53.451834 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.451944 (+   110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.451958 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:53.451983 (+    25us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:53.452001 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.452031 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.452100 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:53.451332 25778 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:53.447758 26247 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:53.444424 26145 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.447554 25952 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.447873 26065 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.471745 25894 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:53.467015 25886 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:53.459362 26193 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:53.483919 23923 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:53.486099 23851 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:53.489660 26065 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:53.477257 26220 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:53.536525 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 125386us
I20260709 12:20:53.488180 26224 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:53.565423 23892 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:53.544970 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 188557us
I20260709 12:20:53.545550 26250 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:53.548331 26210 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:53.556409 26145 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:53.571938 26065 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:53.569351 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:53.584669 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:53.570873 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:53.591710 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:53.588492 26261 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:53.592669 25886 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:53.593240 25886 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:53.583608 26250 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.585312 26065 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.594502 26065 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:53.594318 25886 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.585150 25848 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.591482 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:53.583336 25865 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:53.598775 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 245503us
W20260709 12:20:53.602537 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.572557 26169 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:53.606165 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:53.610827 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.615032 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:53.499385 25778 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.638756 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.635965 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:53.657191 24525 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:20:53.652745 26263 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:20:53.598867 26145 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.669106 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.603258 26233 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:53.678505 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.678781 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.679180 23924 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:20:53.659166 26250 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:53.723255 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.728308 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.673672 26169 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:53.676703 26145 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:53.733119 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:53.740938 26237 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:53.742830 26264 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:20:53.744231 26145 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:53.745554 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.733713 26233 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:53.750277 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.750706 26233 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.751224 23849 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:53.753185 26233 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:53.754930 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1558) took 1606 ms. Trace:
I20260709 12:20:53.758085 26089 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:53.713485 26126 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:53.732115 26250 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:53.761844 26247 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:53.780534 26245 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.509s	user 0.005s	sys 0.000s
I20260709 12:20:53.762337 26126 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:53.781317 26126 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.784580 26247 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:53.786285 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 53231.2us
I20260709 12:20:53.787089 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:53.787721 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:53.788282 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:53.766484 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1495) took 1558 ms. Trace:
W20260709 12:20:53.789314 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 171174us
I20260709 12:20:53.768978 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1556) took 1621 ms. Trace:
I20260709 12:20:53.768460 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 1935) took 1421 ms. Trace:
I20260709 12:20:53.789839 24000 rpcz_store.cc:276] 0709 12:20:52.147992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.421077 (+273085us) service_pool.cc:224] Handling call
0709 12:20:52.514140 (+ 93063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.515027 (+   887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.768772 (+1253745us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b54002477d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:53.768914 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130579840}
I20260709 12:20:53.789098 23848 rpcz_store.cc:276] 0709 12:20:52.208631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.209166 (+   535us) service_pool.cc:224] Handling call
0709 12:20:52.250063 (+ 40897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.382292 (+132229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.766220 (+1383928us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5400073d50. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:53.766406 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58883328}
I20260709 12:20:53.790043 23852 rpcz_store.cc:276] 0709 12:20:52.347012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.347589 (+   577us) service_pool.cc:224] Handling call
0709 12:20:52.347896 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.396892 (+ 48996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.768177 (+1371285us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b54001e55d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:53.768394 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110466432}
I20260709 12:20:53.794657 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:53.795683 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.755489 24001 rpcz_store.cc:276] 0709 12:20:52.148553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.452316 (+303763us) service_pool.cc:224] Handling call
0709 12:20:52.452787 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.473163 (+ 20376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.473197 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.473244 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:52.473286 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.754620 (+1281334us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b5400410fd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:53.754681 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.754857 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46314240}
I20260709 12:20:53.788909 23998 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:20:53.793576 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:53.796203 23852 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:20:53.804848 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.805639 23852 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:20:53.806564 23998 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:53.809749 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:53.813010 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:53.813596 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:53.815719 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:53.815771 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:53.813097 24524 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.519s (SENT) [suppressed 2 similar messages]
I20260709 12:20:53.822353 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:53.802892 25778 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.735409 26169 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:53.824280 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:53.786331 26153 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:53.772320 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 559) took 1455 ms. Trace:
I20260709 12:20:53.808743 25894 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.862893 24555 rpcz_store.cc:276] 0709 12:20:52.326425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.330659 (+  4234us) service_pool.cc:224] Handling call
0709 12:20:52.330992 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.487369 (+156377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.487407 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.487473 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:52.487510 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.771971 (+1284461us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54005a46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:53.772054 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.772235 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359186816}
I20260709 12:20:53.864533 25894 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:53.866062 26239 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 1.012s	user 0.002s	sys 0.012s
I20260709 12:20:53.793738 26232 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:53.855683 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:53.856226 26065 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:53.856166 25865 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:53.773540 26250 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:53.868482 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 252852us
I20260709 12:20:53.803421 26247 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:53.872778 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:53.862337 26062 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:53.824175 26237 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:53.826256 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:53.885002 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:20:53.885521 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 59258us
I20260709 12:20:53.887910 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:53.812858 26233 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.891321 26187 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:53.892072 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:53.824066 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:53.896917 26250 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:53.898452 26260 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:53.873178 26259 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:53.899250 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:53.867920 26169 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.908607 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:53.911092 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:53.911831 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 307406us
I20260709 12:20:53.913398 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:53.931557 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.900261 26232 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:53.950984 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 133705us
I20260709 12:20:53.952025 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:53.939127 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:53.963821 24000 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:53.956346 23966 leader_election.cc:400] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:20:53.964372 23966 leader_election.cc:403] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:53.966337 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:53.967118 23928 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:20:53.929984 26227 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.925031 26262 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:53.929853 26255 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:53.989768 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:53.879617 25865 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:53.989168 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:53.947679 26259 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:53.909235 26224 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:20:53.994609 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:53.948271 26260 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.998754 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:54.008208 24000 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:20:54.013486 25655 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:53.967736 26250 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:53.999698 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 88877.9us
I20260709 12:20:54.014019 25655 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:54.013872 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:54.015700 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:54.008970 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 136290us
I20260709 12:20:54.011706 24525 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:53.929651 26187 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:54.017067 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:54.018185 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.016285 23854 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:20:54.022342 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:54.192739 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1401) took 1834 ms. Trace:
I20260709 12:20:54.193491 24004 rpcz_store.cc:276] 0709 12:20:52.358144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.362679 (+1004535us) service_pool.cc:224] Handling call
0709 12:20:53.362943 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.477017 (+114074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.477057 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:53.477099 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:53.477133 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.192364 (+715231us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001c75d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:54.192433 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.192661 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259667840}
I20260709 12:20:54.194912 26126 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:54.197270 26126 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:54.050102 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:54.042344 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:54.024994 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.204150 23922 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:20:54.208256 23850 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:54.192641 26268 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:20:54.074873 25655 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:53.994590 26233 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:54.023031 24003 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:54.009747 26259 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:54.227578 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:54.021203 24002 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:54.043324 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:54.009316 26193 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:54.234997 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:54.009250 26260 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:54.518860 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 475613us
I20260709 12:20:54.067055 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:54.527449 25198 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.314039 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:54.018287 26232 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:54.294340 25865 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:54.393208 23923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 1851) took 1704 ms (client timeout 1668 ms). Trace:
W20260709 12:20:54.274492 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 262884us
I20260709 12:20:54.305122 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:54.295419 26269 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:54.293717 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.382575 25655 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:54.546831 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1569) took 2246 ms. Trace:
I20260709 12:20:54.547192 23996 rpcz_store.cc:276] 0709 12:20:52.300798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.276351 (+975553us) service_pool.cc:224] Handling call
0709 12:20:53.276623 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:53.338996 (+ 62373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.546597 (+1207601us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b54001a81d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:54.546777 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52301568}
I20260709 12:20:54.546859 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:54.294974 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1570) took 1972 ms. Trace:
I20260709 12:20:54.006120 26262 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:54.013289 26223 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:54.057567 24556 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:54.465817 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:54.556609 23995 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:54.199046 26240 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:54.314858 23920 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:54.238715 26089 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:54.297375 26155 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:54.524686 23817 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:54.528080 25198 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:54.531415 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 516706us
W20260709 12:20:54.570577 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 48673.6us
I20260709 12:20:54.571177 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:54.571729 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.574779 26248 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:54.527570 26250 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:54.542557 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:54.583175 24004 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:54.584502 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:54.585300 24004 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:54.394332 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:54.543331 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:20:54.531616 23923 rpcz_store.cc:269] 0709 12:20:52.601499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.601643 (+   144us) service_pool.cc:224] Handling call
0709 12:20:54.238500 (+1636857us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54003cf854. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:54.305409 (+ 66909us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911182080}
I20260709 12:20:54.545007 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.548355 25848 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:54.547663 24559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 508) took 1278 ms. Trace:
I20260709 12:20:54.549474 24002 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:54.546540 25655 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:54.551286 23999 rpcz_store.cc:276] 0709 12:20:52.322142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.227333 (+1905191us) service_pool.cc:224] Handling call
0709 12:20:54.294428 (+ 67095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.294622 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.294650 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:54.294712 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:54.294748 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.294804 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.294915 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:54.598335 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:54.527420 25886 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:54.295908 26255 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:54.586498 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:54.588598 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.570418 26089 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:54.545172 23818 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:54.592829 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:54.596252 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:54.581709 25778 consensus_meta.cc:287] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.731s	user 0.007s	sys 0.003s
W20260709 12:20:54.654565 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 109504us
I20260709 12:20:54.655635 23818 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:54.657234 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:54.658660 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:54.622300 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.552268 25865 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:54.661314 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:54.552512 26193 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:54.626446 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.559217 26065 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:54.569921 26155 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:54.581844 25966 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:54.648783 25655 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:54.649988 24004 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:54.595953 24559 rpcz_store.cc:276] 0709 12:20:53.269656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.269808 (+   152us) service_pool.cc:224] Handling call
0709 12:20:53.270195 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.451255 (+181060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.547417 (+1096162us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400466c54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:54.547601 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365757696}
I20260709 12:20:54.661715 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.623935 25198 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:54.595732 25848 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:54.669464 23922 raft_consensus.cc:2393] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:54.575378 26248 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:54.678179 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:54.678403 25198 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:54.672232 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:54.578334 26240 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:54.670603 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:20:54.671681 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 210706us
I20260709 12:20:54.599571 26250 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:54.562220 26269 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:54.818683 23892 leader_election.cc:400] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7.
I20260709 12:20:54.787302 23845 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:54.815201 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 506) took 1546 ms. Trace:
I20260709 12:20:54.813783 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:54.811106 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 190304us
I20260709 12:20:54.820787 23892 leader_election.cc:403] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:54.822160 23848 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:54.679518 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 162664us
I20260709 12:20:54.823590 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:54.726205 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:54.820955 24561 rpcz_store.cc:276] 0709 12:20:53.268865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.269118 (+   253us) service_pool.cc:224] Handling call
0709 12:20:53.347160 (+ 78042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:53.558264 (+211104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.558312 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:53.561852 (+  3540us) log.cc:844] Serialized 26 byte log entry
0709 12:20:53.963627 (+401775us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:53.964107 (+   480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.544422 (+580315us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54006e0fd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:54.544482 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:54.814830 (+270348us) raft_consensus.cc:1685] finished
0709 12:20:54.814859 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.815113 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65099,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":119,"spinlock_wait_cycles":301613952,"thread_start_us":478132,"threads_started":2,"wal-append.queue_time_us":1249742}
I20260709 12:20:54.743876 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:54.683099 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.820511 25198 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:54.747637 23996 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:54.825147 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 1860) took 1107 ms. Trace:
I20260709 12:20:54.826941 23923 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:20:54.655202 26089 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:54.683874 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:54.735463 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:54.830037 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:54.829988 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:54.831019 23996 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:54.823935 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:54.816277 25848 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:54.835057 26223 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:54.835711 26223 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:54.836369 26240 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:54.673920 26069 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:54.677091 25886 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:54.662370 26288 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:54.831257 23998 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:54.827169 23922 rpcz_store.cc:276] 0709 12:20:53.717704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.725908 (+1008204us) service_pool.cc:224] Handling call
0709 12:20:54.825090 (+ 99182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:54.839095 23850 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:54.842774 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.843438 23929 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
W20260709 12:20:54.840533 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 245076us
I20260709 12:20:54.847958 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:54.806797 26278 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 12:20:54.806257 26282 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 12:20:54.852200 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.838069 26288 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:54.853168 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:20:54.740679 26273 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:20:54.852191 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 1853) took 1197 ms. Trace:
I20260709 12:20:54.859536 23926 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:54.876611 23924 rpcz_store.cc:276] 0709 12:20:53.654981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.851389 (+1196408us) service_pool.cc:224] Handling call
0709 12:20:54.851731 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.851910 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.851931 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:54.851968 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:54.852004 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.852053 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.852140 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:54.865818 25198 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:54.867616 23929 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:54.878886 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 1854) took 1223 ms. Trace:
I20260709 12:20:54.879134 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1443) took 1203 ms. Trace:
I20260709 12:20:54.879612 23924 rpcz_store.cc:276] 0709 12:20:53.676171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.878318 (+1202147us) service_pool.cc:224] Handling call
0709 12:20:54.878635 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.878815 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.878840 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:54.878882 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:54.878913 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.878966 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.879073 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:54.857110 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.881938 23848 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:20:54.882227 23923 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:54.857129 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:54.684175 26275 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:54.754340 26231 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 2.416s	user 0.017s	sys 0.035s
I20260709 12:20:54.677512 25778 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:54.676496 26261 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:54.883248 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:54.859019 26289 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:54.815701 26285 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:20:54.662082 26255 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:54.885089 23922 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:54.682914 25865 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:54.879390 23929 rpcz_store.cc:276] 0709 12:20:53.659364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.866710 (+1207346us) service_pool.cc:224] Handling call
0709 12:20:54.867179 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.878566 (+ 11387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.878816 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:54.887774 26269 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:54.888742 26211 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:54.889721 26250 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:54.893555 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1444) took 1183 ms. Trace:
W20260709 12:20:54.894702 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 126109us
W20260709 12:20:54.916648 24527 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.004s
I20260709 12:20:54.752815 26187 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:54.897367 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:54.804636 26291 consensus_queue.cc:1059] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:20:54.903198 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 1861) took 1184 ms. Trace:
I20260709 12:20:54.856665 26223 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:54.910351 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 253203us
I20260709 12:20:54.914784 23924 rpcz_store.cc:276] 0709 12:20:53.710400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.891826 (+1181426us) service_pool.cc:224] Handling call
0709 12:20:54.892353 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.892561 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.892584 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:54.892626 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:54.892658 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.893346 (+   688us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.893489 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:54.917095 24527 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.000s	sys 0.004s
I20260709 12:20:54.810416 26281 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:20:54.876436 26292 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:54.787523 26155 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:54.971083 24524 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:55.020917 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.043087 23922 rpcz_store.cc:276] 0709 12:20:53.718427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.884406 (+1165979us) service_pool.cc:224] Handling call
0709 12:20:54.884739 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.902919 (+ 18180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.903140 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:55.043892 23818 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:55.045300 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 74292.1us
I20260709 12:20:55.000934 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1502) took 1727 ms. Trace:
I20260709 12:20:55.046314 23851 rpcz_store.cc:276] 0709 12:20:53.273278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.273961 (+   683us) service_pool.cc:224] Handling call
0709 12:20:53.274259 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.486967 (+212708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.000715 (+1513748us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001e41d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:55.000874 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486755200}
I20260709 12:20:54.929719 23929 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:20:55.047474 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1452) took 1090 ms. Trace:
I20260709 12:20:54.994176 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 1945) took 1287 ms. Trace:
I20260709 12:20:55.047842 23929 rpcz_store.cc:276] 0709 12:20:53.957245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.929047 (+971802us) service_pool.cc:224] Handling call
0709 12:20:54.929415 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:55.047199 (+117784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.047417 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:55.048957 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:54.995566 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:55.003048 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1429) took 2351 ms. Trace:
I20260709 12:20:55.056067 23995 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:55.056975 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1582) took 1146 ms. Trace:
I20260709 12:20:55.028824 24003 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:55.006459 24001 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:54.897480 26293 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:55.048058 23849 rpcz_store.cc:276] 0709 12:20:53.706589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.851798 (+145209us) service_pool.cc:224] Handling call
0709 12:20:53.872819 (+ 21021us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:53.883514 (+ 10695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.883546 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:53.891047 (+  7501us) log.cc:844] Serialized 52 byte log entry
0709 12:20:53.994235 (+103188us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:54.035359 (+ 41124us) log.cc:844] Serialized 14 byte log entry
0709 12:20:54.057980 (+ 22621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.058068 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:54.993940 (+935872us) raft_consensus.cc:1685] finished
0709 12:20:54.993962 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.994102 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41516,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":101,"raft.queue_time_us":31687,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":133022,"thread_start_us":102735,"threads_started":1,"wal-append.queue_time_us":306992}
I20260709 12:20:55.049835 23920 rpcz_store.cc:276] 0709 12:20:52.651667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.651827 (+   160us) service_pool.cc:224] Handling call
0709 12:20:54.305434 (+1653607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.560869 (+255435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.002856 (+441987us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54003cf850. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:55.002972 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3792550656}
I20260709 12:20:55.081211 23924 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:20:55.066047 23925 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:20:55.066691 23928 consensus_meta.cc:287] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.093s	user 0.011s	sys 0.000s
I20260709 12:20:55.083077 23928 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:20:55.073451 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.080035 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:55.084685 24561 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:20:54.902702 26275 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:55.057430 23995 rpcz_store.cc:276] 0709 12:20:53.910618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.465448 (+554830us) service_pool.cc:224] Handling call
0709 12:20:55.056896 (+591448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:55.084336 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1451) took 1129 ms. Trace:
W20260709 12:20:55.091692 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 47924.6us
I20260709 12:20:55.092995 23818 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:55.094344 23818 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:55.092089 23928 rpcz_store.cc:276] 0709 12:20:53.956839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.966021 (+  9182us) service_pool.cc:224] Handling call
0709 12:20:55.084267 (+1118246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:55.103677 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:55.089439 26065 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7.
I20260709 12:20:55.117202 23818 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:55.118456 23818 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:55.097759 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:54.958511 26289 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:55.001919 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 562) took 1215 ms. Trace:
I20260709 12:20:55.011482 26233 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:20:55.014930 25865 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.015514 26193 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:54.970041 26304 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:55.135290 23846 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:55.019076 26220 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.127648 26155 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:55.139439 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 282369us
I20260709 12:20:55.006455 26237 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 12:20:55.145265 26213 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:20:55.127970 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.141069 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.183671 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:55.138275 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 76816.7us
I20260709 12:20:54.968194 24555 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:55.089661 26301 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:54.902904 25778 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.024406 26248 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.161520 26193 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:55.008737 26262 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:55.147161 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 184806us
I20260709 12:20:55.212347 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.104880 26153 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:55.156886 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:55.186733 25865 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:55.220615 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.221421 23995 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
W20260709 12:20:55.090327 26260 consensus_meta.cc:287] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.538s	user 0.004s	sys 0.005s
I20260709 12:20:55.160676 23853 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:20:55.008118 26259 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.161700 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:54.997586 25952 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:55.165234 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 144922us
I20260709 12:20:55.155834 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 200) took 2212 ms. Trace:
I20260709 12:20:55.170920 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:54.931046 26211 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.171365 23966 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:55.142132 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 265377us
I20260709 12:20:55.142134 26261 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:55.139575 23854 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:55.177089 26069 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:55.177438 26294 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:55.179242 26220 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:55.144426 26240 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.184396 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:55.185053 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 81526.3us
I20260709 12:20:55.144676 26287 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:55.236419 26294 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.231830 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.236057 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:55.240620 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.171747 26304 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.141094 24556 rpcz_store.cc:276] 0709 12:20:53.786897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.792300 (+  5403us) service_pool.cc:224] Handling call
0709 12:20:55.001697 (+1209397us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54006e0354. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:55.001816 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244423424}
I20260709 12:20:55.187203 23849 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:55.160980 26043 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:55.004838 26255 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.160988 26285 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:55.262300 26220 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:54.969817 26267 consensus_queue.cc:1059] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.223s
I20260709 12:20:55.182068 26213 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:55.207553 26226 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:20:55.263590 26213 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.264482 26226 raft_consensus.cc:3055] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:55.264835 26226 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:55.219758 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:55.220553 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.266182 23997 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.266268 23998 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:55.266299 23999 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:55.224568 23995 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:55.159248 26292 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:55.243500 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:55.200058 26301 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:55.272570 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:55.238651 23927 rpcz_store.cc:276] 0709 12:20:52.943541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.441794 (+498253us) service_pool.cc:224] Handling call
0709 12:20:53.444578 (+  2784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.444785 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:53.557708 (+112923us) log.cc:844] Serialized 14 byte log entry
0709 12:20:54.982644 (+1424936us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b180033af00. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287
0709 12:20:55.155291 (+172647us) log.cc:844] Serialized 14 byte log entry
0709 12:20:55.155510 (+   219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:55.155557 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:55.155599 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.155658 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.155779 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58208,"prepare.queue_time_us":342025,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":308596,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":31411,"spinlock_wait_cycles":37878656,"thread_start_us":945248,"threads_started":4,"wal-append.queue_time_us":893738}
W20260709 12:20:55.256698 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 85395.5us
I20260709 12:20:55.257359 24563 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:55.259027 23850 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:55.262452 26287 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.262708 26285 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.003429 26288 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:55.269907 26169 consensus_meta.cc:287] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 1.315s	user 0.012s	sys 0.001s
I20260709 12:20:55.268039 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:55.265565 26226 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.283985 26226 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.284041 26286 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:20:55.269493 26294 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.267879 26069 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.244565 26240 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.287441 26259 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:55.287822 26069 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.288642 26240 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.288426 26169 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.275233 26255 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:55.231647 26260 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.289726 24562 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:55.290616 26169 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.200670 26275 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.291326 26260 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.224251 26083 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:20:55.226058 25865 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.225482 26249 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.293664 26287 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.294700 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1578) took 1414 ms. Trace:
W20260709 12:20:55.275362 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 75651.9us
I20260709 12:20:55.295109 24004 rpcz_store.cc:276] 0709 12:20:53.880044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.678281 (+798237us) service_pool.cc:224] Handling call
0709 12:20:54.678526 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.986483 (+307957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.986517 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:54.986558 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:54.986588 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.294457 (+307869us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540009c9d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:55.294501 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.294625 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707752192}
I20260709 12:20:55.275292 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:55.225409 26223 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:55.278837 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.244944 26261 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:55.263525 26306 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:55.305295 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.303882 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:20:55.278710 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 95172.5us
I20260709 12:20:55.293411 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.296818 23895 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:55.303539 26233 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:55.277266 26301 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.219169 26193 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.309018 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.291920 26260 raft_consensus.cc:3055] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:55.320000 26261 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.278437 26220 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.293668 25865 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.323799 26248 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:55.324887 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.325675 23849 raft_consensus.cc:2393] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:55.321547 23846 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
W20260709 12:20:55.315492 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.298501 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.318595 23997 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:55.329715 23995 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:55.330116 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.319504 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.330488 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.331452 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.331984 23995 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:55.332700 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.334821 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.339851 24000 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:55.326954 26240 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.342445 26240 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.343405 26193 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.322065 26237 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:55.344105 26237 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.344486 26237 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.344658 26240 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.346419 26316 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:55.275851 26291 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:20:55.346814 26211 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.348768 26284 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:55.349375 26284 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.350996 26304 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.351593 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:55.352154 26083 raft_consensus.cc:3055] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:55.352588 26083 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:55.353022 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:55.354143 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.354475 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.354770 23999 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:55.355552 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.285760 26302 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
W20260709 12:20:55.356859 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 60168.5us
I20260709 12:20:55.357834 26319 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:55.321826 26145 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:20:55.358975 26319 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:55.359362 26319 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.359520 26145 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:55.359933 26145 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:55.360769 26145 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.302330 25952 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:55.360176 23995 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:55.320889 26233 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:55.354176 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.322253 26223 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.362344 26233 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.363265 26303 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:55.364480 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.365178 24002 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:55.333456 26260 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:20:55.371447 26089 consensus_meta.cc:287] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.005s
I20260709 12:20:55.429025 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:55.430540 24555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36558 (request call id 511) took 1408 ms (client timeout 1676 ms). Trace:
I20260709 12:20:55.365643 25952 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:55.439827 26284 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.442054 26307 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:55.353505 26083 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.475117 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:55.442421 24029 heartbeater.cc:646] Failed to heartbeat to 127.22.43.126:38021 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.43.126:38021 timed out after 15.000s (SENT)
I20260709 12:20:55.443066 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.410020 26240 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:55.443712 26193 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.444236 26260 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.483551 26260 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.446274 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:55.486861 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:55.488474 26306 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:55.489229 26306 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:55.489629 26306 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:55.489974 26306 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.490298 26240 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.455444 25778 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.496786 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.478303 26307 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.498013 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.499074 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:55.499405 26307 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:55.448601 23849 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:20:55.460340 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 95558.5us
I20260709 12:20:55.500089 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.501228 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.503695 26213 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.506448 26213 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.423251 26304 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:55.526238 26304 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.527899 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:55.528365 26304 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.528512 23920 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:55.462404 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1460) took 1446 ms. Trace:
I20260709 12:20:55.530222 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:55.530939 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:55.470984 25952 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.427376 26287 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:55.481019 23847 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
W20260709 12:20:55.466550 24555 rpcz_store.cc:269] 0709 12:20:54.021680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.022424 (+   744us) service_pool.cc:224] Handling call
0709 12:20:55.430350 (+1407926us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54005f0d54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:55.430480 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833824128}
I20260709 12:20:55.467859 26303 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:55.494098 26193 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.495872 26249 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:55.495976 26227 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:55.346901 26316 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.424116 26248 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:20:55.458985 26089 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.508100 26223 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.512259 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:55.515843 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.519659 26319 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.521528 26233 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.453287 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:20:55.584326 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 342653us
W20260709 12:20:55.661345 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 208168us
W20260709 12:20:55.576889 24003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1419) took 1699 ms (client timeout 1770 ms). Trace:
I20260709 12:20:55.524358 26306 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.476691 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.530114 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:55.622224 23893 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:55.460534 26145 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.657343 26284 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:55.658263 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:55.650503 23892 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:55.617092 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1447) took 1791 ms. Trace:
I20260709 12:20:55.655555 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:55.662655 24003 rpcz_store.cc:269] 0709 12:20:53.877748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.938862 (+ 61114us) service_pool.cc:224] Handling call
0709 12:20:55.576631 (+1637769us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b540020eed4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:55.576800 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135096192}
I20260709 12:20:55.664753 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.604419 23995 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:55.665696 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.550246 23921 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:55.673319 26287 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.704957 24004 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:55.705068 23921 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:55.510540 26240 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.706076 23921 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.668963 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:55.670953 23998 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:20:55.510294 26083 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.706485 25778 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:55.707746 23928 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:55.530586 23926 rpcz_store.cc:276] 0709 12:20:54.016290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.999396 (+983106us) service_pool.cc:224] Handling call
0709 12:20:54.999641 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.999946 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:55.183048 (+183102us) log.cc:844] Serialized 14 byte log entry
0709 12:20:55.462060 (+279012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:55.462114 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:55.462170 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.462234 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.462346 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22532,"prepare.queue_time_us":240887,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":58290,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":4775,"thread_start_us":461275,"threads_started":3,"wal-append.queue_time_us":129408}
I20260709 12:20:55.707546 23923 rpcz_store.cc:276] 0709 12:20:53.825684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.894425 (+1068741us) service_pool.cc:224] Handling call
0709 12:20:54.896142 (+  1717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.932759 (+ 36617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.932806 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:54.932864 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:54.932920 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.616852 (+683932us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b540018bad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:55.616897 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.617003 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83577728}
W20260709 12:20:55.715993 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 65593.2us
I20260709 12:20:55.637598 25886 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.713052 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.707582 23845 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:55.668891 26294 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:20:55.671941 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49845.3us
I20260709 12:20:55.717314 24560 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:55.717031 23921 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.705760 26287 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.719214 26240 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:55.727705 25886 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.661242 26316 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.728406 26220 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:20:55.728833 26318 consensus_queue.cc:1059] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:55.508939 26301 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.729578 26220 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:55.730001 26220 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:55.730577 24562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 566) took 1907 ms. Trace:
I20260709 12:20:55.732122 24561 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:55.717694 25778 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:55.725957 26124 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:55.734601 26124 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.734675 25778 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.735967 25778 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.737514 26294 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.730962 24562 rpcz_store.cc:276] 0709 12:20:53.822929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.823112 (+   183us) service_pool.cc:224] Handling call
0709 12:20:53.824547 (+  1435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:55.290168 (+1465621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.730332 (+440164us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540052c6d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:55.730499 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3369182464}
I20260709 12:20:55.740101 26318 raft_consensus.cc:3055] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:55.737025 26124 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.731808 26284 consensus_queue.cc:1059] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:55.741539 26286 consensus_queue.cc:1059] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:55.725944 26250 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:55.742482 26250 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:55.742621 26284 raft_consensus.cc:3055] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:55.742745 26286 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:55.743028 26284 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:55.645987 26320 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:20:55.743274 26286 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:55.744204 26320 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:55.744030 26284 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.744575 26320 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:55.743321 26250 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.748313 26250 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:55.744444 26286 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.740518 26318 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:55.751688 26318 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.752987 26318 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:55.753594 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.753707 25886 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.755218 26294 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.731830 26301 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:55.730947 26220 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.745554 26320 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.716770 26323 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:55.760437 26320 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.760914 26285 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.761004 26323 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:55.761986 26220 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:55.765070 25823 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.765607 25823 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.766412 23922 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
W20260709 12:20:55.766781 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.767982 25823 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.760393 26316 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.768748 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:55.771512 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:55.772214 24557 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
W20260709 12:20:55.773347 24000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1579) took 1893 ms (client timeout 2005 ms). Trace:
I20260709 12:20:55.773700 23895 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:55.773846 24000 rpcz_store.cc:269] 0709 12:20:53.880319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.015226 (+134907us) service_pool.cc:224] Handling call
0709 12:20:55.773190 (+1757964us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540014b254. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:55.773286 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2512542976}
I20260709 12:20:55.774986 26285 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:55.775362 26285 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.776175 26306 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:55.775722 26285 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.637108 26126 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:55.780709 26316 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.780776 26126 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:55.782219 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 57462.4us
I20260709 12:20:55.784407 23922 pending_rounds.cc:85] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 3
I20260709 12:20:55.793931 23922 pending_rounds.cc:107] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:20:55.794210 23922 raft_consensus.cc:2889] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:55.784185 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:55.750607 26286 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.751632 23751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59378 (request call id 139) took 9532 ms. Trace:
I20260709 12:20:55.726941 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:55.785794 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:55.796847 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:55.796960 23921 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:55.720306 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1519) took 2131 ms. Trace:
I20260709 12:20:55.773495 26319 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:55.791252 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:55.793406 25778 consensus_queue.cc:1059] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:20:55.803252 25778 raft_consensus.cc:3055] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:55.803668 25778 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:20:55.805758 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 145679us
I20260709 12:20:55.805795 23923 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
W20260709 12:20:55.792598 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.797734 25198 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 12:20:55.798892 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 72032.1us
I20260709 12:20:55.807894 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:55.808137 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.798614 23852 rpcz_store.cc:276] 0709 12:20:53.588767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.811567 (+222800us) service_pool.cc:224] Handling call
0709 12:20:53.811899 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.812137 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:53.826082 (+ 13945us) log.cc:844] Serialized 14 byte log entry
0709 12:20:55.497467 (+1671385us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18003d2f40. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a 00007fa287456a2a
0709 12:20:55.719970 (+222503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:55.720026 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:55.720072 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.720147 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.720256 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14835,"prepare.queue_time_us":13698,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":21150,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":3993856,"thread_start_us":207409,"threads_started":1,"wal-append.queue_time_us":1877727}
W20260709 12:20:55.810708 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 322649us
I20260709 12:20:55.811376 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:20:55.811813 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.673385 26213 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:55.777712 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:55.653717 26237 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.814399 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.815188 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.824781 23848 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:55.825670 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:55.826735 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.827286 23848 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:55.827785 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:55.827512 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:55.828689 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:55.829289 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:55.829515 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:55.815904 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.817552 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.819648 23966 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:55.832158 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:55.813820 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.795560 23751 rpcz_store.cc:276] 0709 12:20:46.218964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.222444 (+  3480us) service_pool.cc:224] Handling call
0709 12:20:46.382740 (+160296us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54003129d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b6090 00007fa287454f3a 00007fa28d20ae9c 00007fa28d30904e 00007fa28b7ca2a4 00007fa28b7ca232 00007fa28b7ca161 00007fa28b7ca0dc 00007fa28b7c9392 00007fa28578748c 00007fa2857868c6
0709 12:20:55.751565 (+9368825us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:49.513033 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:49.513946 (+   913us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:49.514015 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:20:49.514045 (+    30us) tablet.cc:662] Decoding operations
0709 12:20:49.515674 (+  1629us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:49.515816 (+   142us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:49.515859 (+    43us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:20:49.535986 (+ 20127us) tablet.cc:701] Row locks acquired
0709 12:20:49.536040 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:20:49.536224 (+   184us) write_op.cc:270] Start()
0709 12:20:49.536373 (+   149us) write_op.cc:276] Timestamp: P: 1783599649536152 usec, L: 0
0709 12:20:49.536395 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:20:49.537145 (+   750us) log.cc:844] Serialized 4742 byte log entry
0709 12:20:50.388041 (+850896us) op_driver.cc:464] REPLICATION: finished
0709 12:20:51.715447 (+1327406us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa2843420ac 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa28ae82ef0
0709 12:20:51.992726 (+277279us) write_op.cc:301] APPLY: starting
0709 12:20:51.992827 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:52.117745 (+124918us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:52.136260 (+ 18515us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:52.235824 (+ 99564us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:52.236101 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:20:52.236145 (+    44us) write_op.cc:312] APPLY: finished
0709 12:20:52.236534 (+   389us) log.cc:844] Serialized 89 byte log entry
0709 12:20:52.340087 (+103553us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:52.365416 (+ 25329us) write_op.cc:454] Released schema lock
0709 12:20:52.371719 (+  6303us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:52.447961 (+ 76242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:52.448014 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":166496,"reported_tablets":25,"spinlock_wait_cycles":257516928,"child_traces":[["op",{"apply.queue_time_us":1595591,"apply.run_cpu_time_us":27019,"apply.run_wall_time_us":427744,"num_ops":12,"prepare.queue_time_us":26988,"prepare.run_cpu_time_us":9809,"prepare.run_wall_time_us":84853,"raft.queue_time_us":191586,"raft.run_cpu_time_us":48161,"raft.run_wall_time_us":1667278,"replication_time_us":828481,"spinlock_wait_cycles":12906880,"thread_start_us":1813616,"threads_started":5,"wal-append.queue_time_us":250583,"wal-append.run_cpu_time_us":46447,"wal-append.run_wall_time_us":2581918}]]}
I20260709 12:20:55.833338 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:55.822827 23818 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:55.834105 23928 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.834379 23852 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:55.790009 26323 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.833304 23846 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:55.835870 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:55.836839 23925 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:20:55.675900 26261 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.800489 25823 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.804534 25778 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:55.838871 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:55.674192 26303 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:55.903142 24001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1413) took 2027 ms (client timeout 1939 ms). Trace:
W20260709 12:20:55.872329 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 52743.9us
W20260709 12:20:55.903699 24001 rpcz_store.cc:269] 0709 12:20:53.875982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.012173 (+136191us) service_pool.cc:224] Handling call
0709 12:20:55.902891 (+1890718us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400099cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:55.903048 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1855028992}
W20260709 12:20:55.893940 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 71232.8us
I20260709 12:20:55.905733 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:55.903156 23996 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:20:55.902195 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1500) took 2629 ms. Trace:
I20260709 12:20:55.902428 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:55.909755 23853 rpcz_store.cc:276] 0709 12:20:53.272640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.272806 (+   166us) service_pool.cc:224] Handling call
0709 12:20:53.273211 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:55.225611 (+1952400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.901914 (+676303us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54002d46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:55.902131 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4328188800}
I20260709 12:20:55.836460 23845 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:55.942664 23969 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:55.821533 26306 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:55.823330 26213 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:20:55.950414 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44778.2us
W20260709 12:20:55.951398 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 46942.6us
I20260709 12:20:55.952091 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:55.946710 23928 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
W20260709 12:20:55.950121 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 111330us
I20260709 12:20:55.825057 26248 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:55.968573 23851 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:55.985458 23818 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:55.968529 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:55.961112 26306 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:55.992556 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f65f9b948cd4a8d88db397a8232dace with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52308
I20260709 12:20:55.993336 26306 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:55.994416 26298 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:55.994920 26298 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.995275 26298 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:55.998036 26315 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:20:55.848155 26124 consensus_queue.cc:1059] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 12:20:56.002261 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:56.002624 26211 raft_consensus.cc:3055] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:56.002895 26306 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:56.003108 26211 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:56.003808 26324 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:56.004320 26324 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:56.004156 26211 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.005496 25198 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.006131 25198 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.008129 26261 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:56.011410 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.005630 26211 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.943841 26294 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.025919 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:56.040954 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 55623.2us
I20260709 12:20:56.034909 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.042987 24560 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:56.034919 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.004824 26324 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.894668 26223 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:55.955078 26213 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.948828 26299 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:55.963811 26210 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:55.956547 26155 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:56.041975 23818 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:55.892827 26069 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 12:20:56.052035 23922 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:20:56.090502 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 270810us
I20260709 12:20:56.050580 26261 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:56.179072 24563 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:20:55.990301 26248 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:56.102756 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.103344 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.104235 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:56.049122 26223 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:56.108955 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 1953) took 1437 ms. Trace:
I20260709 12:20:56.109910 23893 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:56.198593 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 88799.4us
I20260709 12:20:56.076033 26155 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.063594 26299 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:56.176968 23922 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:56.082348 26275 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:56.197185 23847 rpcz_store.cc:276] 0709 12:20:54.671855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.671976 (+   121us) service_pool.cc:224] Handling call
0709 12:20:56.108809 (+1436833us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b5400073854. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:56.108900 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1520224512}
I20260709 12:20:56.081908 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:56.230671 25198 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:56.230997 24563 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:56.232676 25655 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.233215 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.233153 25655 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.092636 26210 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:56.245019 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.246279 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.247519 23893 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:56.247536 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.243033 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:56.250252 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.250572 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:56.253340 26281 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:56.176357 26089 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:56.262986 25655 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:56.230263 26248 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:56.223431 26155 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.265527 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.265658 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:56.266687 23998 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:56.178351 26261 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:56.222352 26305 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:20:56.268353 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.102030 26233 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:56.222568 26223 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:56.250488 26260 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.274348 26261 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.249142 26304 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:56.295840 25198 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:56.303968 25198 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:56.304152 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 352088us
I20260709 12:20:56.304446 25198 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.305392 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.306910 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.248709 26275 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:56.273072 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.324998 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:20:56.302856 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.275134 26281 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:56.320216 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:56.326648 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 384051us
W20260709 12:20:56.304804 26320 consensus_meta.cc:287] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.004s
W20260709 12:20:56.305320 26083 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.587s	user 0.014s	sys 0.000s
I20260709 12:20:56.306094 26305 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:56.319799 26126 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:56.281469 26267 consensus_queue.cc:1059] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:20:56.319665 26089 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:56.329185 26193 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:56.330396 25952 consensus_meta.cc:287] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.673s	user 0.004s	sys 0.011s
I20260709 12:20:56.325497 26316 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:56.321952 26232 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.322393 26237 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:56.323228 26303 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:56.327119 26307 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:20:56.355629 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 108208us
I20260709 12:20:56.330794 25823 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:56.326440 26306 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:56.328727 26289 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.351997 26298 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:56.360848 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:56.412282 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.367938 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:56.365535 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.413914 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:56.367139 25952 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.426864 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:56.427241 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:56.428884 25952 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:56.429026 26298 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:56.417062 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 51599.2us
I20260709 12:20:56.430106 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.432260 26289 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:56.435487 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.436305 26331 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:56.436730 26331 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:56.437115 26331 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.438989 23925 raft_consensus.cc:2368] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:20:56.439769 23848 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:56.440600 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.364403 26316 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:20:56.405222 26285 consensus_meta.cc:287] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
W20260709 12:20:56.441011 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 73160.1us
I20260709 12:20:56.453022 23893 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:20:56.410233 26220 consensus_meta.cc:287] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.004s
I20260709 12:20:56.444619 24525 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.445590 26333 tablet_replica.cc:333] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:20:56.446302 25952 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:56.534602 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 90051us
I20260709 12:20:56.534446 25952 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.535557 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.537020 25952 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:56.449465 26261 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.538378 26293 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:56.539149 26293 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:56.404282 26233 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.136s
I20260709 12:20:56.539973 26261 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:56.450616 26267 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:56.455879 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:56.456769 26285 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:56.413177 26318 consensus_meta.cc:287] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.007s
I20260709 12:20:56.438261 26237 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:56.459707 26248 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.551247 26248 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:56.553073 23923 raft_consensus.cc:2368] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8.
W20260709 12:20:56.554821 26211 consensus_meta.cc:287] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.540s	user 0.017s	sys 0.011s
I20260709 12:20:56.462462 25823 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:56.574167 25823 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:56.574824 25823 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:56.463181 26083 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:56.411504 26306 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.580605 26306 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:56.327250 26299 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.487754 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:56.489933 23893 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.610807 26299 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:56.611299 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 121460us
I20260709 12:20:56.612135 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.613288 23893 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:20:56.613483 26322 consensus_queue.cc:1175] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" responder_term: 6 status { last_received { term: 6 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 6 index: 7 } }
I20260709 12:20:56.615335 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.616499 23893 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.356880 26210 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.492415 26331 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.618819 26331 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:56.495563 26323 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.004s
I20260709 12:20:56.499588 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:56.424893 26250 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.006s
I20260709 12:20:56.502256 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:56.502982 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:56.627853 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 362247us
I20260709 12:20:56.504395 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:56.505133 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:56.629499 23853 raft_consensus.cc:1813] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Handling vote request from an unknown peer 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.629976 23893 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.508698 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.511533 23995 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:56.512135 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:56.631479 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:56.631851 24003 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.509600 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:56.516005 24000 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:56.633641 23893 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:56.518744 26304 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:56.634374 23820 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:56.637199 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 137680us
I20260709 12:20:56.520150 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:56.520913 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:56.521694 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:56.524268 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:56.526783 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1540) took 1349 ms. Trace:
I20260709 12:20:56.526837 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:56.444208 26262 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.529780 26062 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:56.402834 26089 raft_consensus.cc:697] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:56.541224 23847 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:56.548605 26285 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:56.555406 26237 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:56.364089 26275 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.537647 24525 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.569047 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:56.463860 26316 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:56.583132 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:56.584007 26083 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:56.680886 23969 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:56.586107 26284 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:56.589550 26324 consensus_meta.cc:287] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.000s
I20260709 12:20:56.630266 23853 raft_consensus.cc:2368] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:20:56.501470 26213 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.514743 25778 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.637063 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:56.690009 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 53029.3us
I20260709 12:20:56.691076 23820 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.645761 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:56.691985 23997 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.640903 23851 rpcz_store.cc:276] 0709 12:20:55.177628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.242170 (+ 64542us) service_pool.cc:224] Handling call
0709 12:20:55.271061 (+ 28891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:56.014564 (+743503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.526557 (+511993us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54001f40d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:56.526724 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1603674368}
I20260709 12:20:56.642763 23854 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:56.639700 23893 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.696245 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:56.693761 23820 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.649981 25198 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.654254 23850 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:56.655170 24003 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
W20260709 12:20:56.656080 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 405553us
I20260709 12:20:56.660043 23848 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:56.706323 23848 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:56.665395 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:56.619679 26323 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.708647 23920 raft_consensus.cc:2393] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:56.709167 26323 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:56.629078 26287 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:56.710566 23928 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:56.710868 25198 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:56.637981 26305 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:56.674432 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:56.713376 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:56.677897 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 140294us
I20260709 12:20:56.643451 26255 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.638196 26269 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:56.714980 26269 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:56.715587 26269 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:56.638475 26318 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:56.644830 26240 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:56.684171 23969 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:56.655225 26320 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:56.718926 26320 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:56.719359 26320 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.719527 23969 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:56.722112 26193 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:56.723129 26193 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.655433 26250 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.638208 26304 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:56.725831 26304 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.727705 26304 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.660272 26261 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:56.688352 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:56.730271 26261 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.731488 23845 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:56.733428 26261 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:56.735675 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:56.739404 24525 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.741441 26322 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.743757 26269 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.746235 24525 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.747148 26269 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:56.747362 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:56.753288 24525 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:56.754796 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 61120us
W20260709 12:20:56.755427 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 115873us
I20260709 12:20:56.689007 25952 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:56.687052 24555 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:56.688378 26267 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.779073 23854 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:20:56.782124 23997 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:56.756784 23893 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:56.759378 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:56.697218 26281 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:56.660789 26262 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.685916 26306 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:56.767290 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60017us
I20260709 12:20:56.791365 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:56.783381 24525 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:56.752081 26187 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.662678 26062 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.785838 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.757581 26220 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:56.685822 26233 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:20:56.788851 23820 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.761610 26336 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:56.750473 26320 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.792853 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.784369 26294 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.685935 26331 consensus_queue.cc:1059] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 12:20:56.793792 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 262173us
I20260709 12:20:56.794059 23893 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.795301 25198 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:56.796175 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.765913 26083 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.787966 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:56.689580 26324 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.793860 26089 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.796829 26306 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.806892 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.843854 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:56.810282 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:56.844858 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.812675 26324 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:56.846087 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:56.846220 24554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 448) took 1936 ms. Trace:
I20260709 12:20:56.813342 26338 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:56.846894 24003 raft_consensus.cc:2393] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:56.810307 23750 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 2 to 4, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 4 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.847963 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:56.766351 25865 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:56.762336 25966 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:56.797093 24559 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:56.795897 26281 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:56.786728 26145 consensus_meta.cc:287] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.069s	user 0.012s	sys 0.005s
I20260709 12:20:56.756659 26339 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:56.751313 26332 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 12:20:56.846706 24554 rpcz_store.cc:276] 0709 12:20:54.910056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.914429 (+  4373us) service_pool.cc:224] Handling call
0709 12:20:55.432539 (+518110us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327eee 000000000036eb39 00007fa28c39b1e0 00007fa28c4640c4 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:20:55.432705 (+   166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:56.087025 (+654320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.103276 (+ 16251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:56.112525 (+  9249us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:56.221051 (+108526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.845908 (+624857us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54003ef654. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:56.845974 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.846158 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494781184}
I20260709 12:20:56.854074 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:56.821815 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:56.823923 23996 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:56.863168 23928 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:20:56.863675 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:56.841476 23922 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:56.864497 24562 raft_consensus.cc:2410] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:56.788796 24524 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.866526 23927 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:20:56.865828 25198 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:56.867421 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 78709.4us
I20260709 12:20:56.867743 23817 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:56.819275 25886 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:20:56.871395 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 75319.4us
I20260709 12:20:56.871523 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:56.871791 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1468) took 1345 ms. Trace:
I20260709 12:20:56.797871 26240 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:56.873828 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:56.873682 23927 rpcz_store.cc:276] 0709 12:20:55.526903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.529895 (+  2992us) service_pool.cc:224] Handling call
0709 12:20:56.871633 (+1341738us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400106154. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:56.871724 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2749238528}
I20260709 12:20:56.805218 26169 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:56.875578 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:20:56.820101 26286 consensus_meta.cc:287] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.019s	user 0.013s	sys 0.002s
I20260709 12:20:56.877422 23820 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.880255 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:56.881536 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:56.882637 24524 leader_election.cc:400] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8.
I20260709 12:20:56.880859 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:56.890137 24524 leader_election.cc:403] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:20:56.805044 26126 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:56.802794 26336 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:56.839646 26213 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:56.823698 26306 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:56.842453 26223 consensus_meta.cc:287] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.520s	user 0.004s	sys 0.004s
I20260709 12:20:56.872942 25865 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:56.886997 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:56.940122 23846 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.887594 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:56.821570 26248 raft_consensus.cc:3055] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:56.890902 24561 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:56.892048 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:20:56.884768 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 90796.7us
I20260709 12:20:56.893203 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:56.845468 24556 raft_consensus.cc:1813] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Handling vote request from an unknown peer 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:56.888476 25886 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.942740 26248 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:56.955199 26248 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.955880 25886 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:56.815623 26062 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:56.956698 26248 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:56.850994 26294 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.897147 23966 leader_election.cc:400] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:20:56.958141 23966 leader_election.cc:403] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:56.958662 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 61667us
I20260709 12:20:56.876060 26290 consensus_queue.cc:1059] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:20:56.959515 26286 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.960294 26290 raft_consensus.cc:3055] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:56.960754 26290 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:56.818751 26302 consensus_queue.cc:1059] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:20:56.962040 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:56.961724 26290 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.871869 25848 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:56.962930 25848 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.963210 26306 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.963380 25848 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.892854 26145 consensus_queue.cc:1059] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:20:56.893824 26240 raft_consensus.cc:697] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:56.876303 26260 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:20:56.898775 26211 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:56.965234 26240 consensus_queue.cc:237] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.966456 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:56.967206 23997 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.888079 26285 consensus_queue.cc:1059] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:20:56.876173 26249 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:20:56.908818 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:56.819042 26043 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:56.907346 26339 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:56.909947 26155 consensus_meta.cc:287] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.001s
I20260709 12:20:56.970774 26043 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.970956 26155 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.907872 25952 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:56.910697 23969 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:56.896510 26336 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:56.916981 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.918481 23853 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:56.975075 23850 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:20:56.975914 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 65310.8us
I20260709 12:20:56.888257 26338 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:56.919548 23817 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:56.977334 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 57893.3us
I20260709 12:20:56.977836 26332 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.924494 23920 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:56.979954 26062 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:56.980464 26062 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:56.981078 24001 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:56.980971 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:56.872669 26331 raft_consensus.cc:3055] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:56.929955 23927 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:20:56.981997 26331 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:56.982139 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:56.980873 26062 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:56.982911 26331 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.983655 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:56.886188 23923 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:56.876418 26187 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:56.986325 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:56.942668 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:56.987160 23928 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:20:56.944020 23921 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:56.944097 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:56.945436 23750 catalog_manager.cc:5697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 3 to 4, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 4 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:56.947391 23996 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:56.948107 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:56.942610 26223 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:56.949631 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:56.889016 26233 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:56.951376 26262 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:56.804512 26237 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.954036 24556 raft_consensus.cc:2410] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 4 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:20:56.959360 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:56.999030 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:20:56.834657 26343 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:20:56.960039 26286 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:56.893639 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:56.899524 23820 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:56.962392 26302 raft_consensus.cc:3055] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:56.897358 26169 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:56.965718 24003 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:56.918670 26320 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:56.988379 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:56.988869 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:56.989732 23846 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:56.994246 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 215) took 1167 ms. Trace:
I20260709 12:20:56.994414 24004 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:56.984293 26331 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:57.003607 23997 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:57.009930 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:57.012035 23928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:20:56.965229 26260 raft_consensus.cc:3055] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:56.986370 26187 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:20:57.017313 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 117863us
I20260709 12:20:57.025367 23921 rpcz_store.cc:276] 0709 12:20:55.826712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.827156 (+   444us) service_pool.cc:224] Handling call
0709 12:20:56.994096 (+1166940us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002e5754. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:56.994195 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2565391616}
I20260709 12:20:57.017859 23966 leader_election.cc:400] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:20:56.942004 26316 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.030568 23966 leader_election.cc:403] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:57.019070 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.031294 23925 raft_consensus.cc:1813] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Handling vote request from an unknown peer 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.027009 23924 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:57.026479 23928 raft_consensus.cc:606] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:20:57.035427 23925 raft_consensus.cc:2368] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:20:57.040098 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.040562 23818 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.041338 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.041975 23928 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:57.011472 26324 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:20:57.046409 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.016187 26267 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:57.044704 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.015570 26332 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:57.049069 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:57.044818 26169 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.033269 26187 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.015799 26303 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:57.046217 26286 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.049911 23893 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.028587 26260 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:57.024037 26250 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.023116 26290 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.020522 26294 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.081640 24001 raft_consensus.cc:1240] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:57.053361 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:57.024112 26249 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:57.015950 26302 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:57.059806 23926 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:57.060441 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.060992 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:57.005354 26233 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.081493 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.028507 26193 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:20:57.043175 25994 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.087807 23893 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:57.089702 23921 raft_consensus.cc:2393] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:57.099655 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:57.086927 26286 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:57.056677 26281 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.062191 26299 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:57.063058 26267 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.359668 26211 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.369930 26293 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:57.353128 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:57.371078 26293 raft_consensus.cc:3055] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:57.371481 26293 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:57.323201 24560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 585) took 1028 ms. Trace:
I20260709 12:20:57.372007 24560 rpcz_store.cc:276] 0709 12:20:56.294671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.294807 (+   136us) service_pool.cc:224] Handling call
0709 12:20:57.322927 (+1028120us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400466c54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:57.323116 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740021632}
I20260709 12:20:57.372481 26293 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.362795 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:57.375135 23895 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.284215 26043 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.165220 25994 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.290863 25848 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.369694 26211 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:57.378188 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.126494 24555 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:20:57.223176 26316 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:57.401337 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53641.8us
I20260709 12:20:57.376777 26145 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:57.303884 23926 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:57.103067 26272 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:57.402140 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.402467 26272 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.402909 26272 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:57.404800 26316 raft_consensus.cc:993] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:57.405289 26316 raft_consensus.cc:1081] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:20:57.382763 23924 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:57.407450 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.408159 23925 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:20:57.402989 26211 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.350135 26351 consensus_queue.cc:1059] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:20:57.189615 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.108119 26294 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.078724 26303 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.411000 26294 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.412770 26303 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:57.089157 26261 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:57.413399 26294 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:57.178493 26193 raft_consensus.cc:3055] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:57.414693 26193 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:57.410996 26351 raft_consensus.cc:3055] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:57.415388 26351 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:57.415652 26193 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.417011 26193 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.417448 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.086355 26250 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.418689 26267 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:57.307479 25952 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:20:57.085089 26249 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.420044 26249 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:57.119964 23928 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:57.421073 26226 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:57.421523 26226 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:57.293046 26155 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.422034 26250 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:57.384754 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.182317 26260 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.422467 26272 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.422676 26226 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.424057 26226 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.428323 26260 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:57.265465 26187 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.429946 23927 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:57.253717 24561 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:20:57.089676 26332 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:20:57.220227 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:57.431113 24557 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
W20260709 12:20:57.303313 26220 consensus_meta.cc:287] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.000s
I20260709 12:20:57.432206 26220 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:57.299265 26062 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.301155 26339 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.304792 26336 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.436452 26336 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:57.179409 25823 consensus_meta.cc:287] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.604s	user 0.003s	sys 0.011s
W20260709 12:20:57.100728 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 83011us
I20260709 12:20:57.440662 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.441762 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:57.442061 26286 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.442517 23850 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:20:57.442454 26193 consensus_queue.cc:1059] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:57.442734 23969 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:57.437209 25823 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.444025 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:57.444885 24560 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:20:57.445290 25823 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.446053 23929 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:57.446240 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:57.228893 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:57.266183 26233 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:57.308488 26083 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:57.448048 26233 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:57.448316 26083 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:57.447057 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:57.390820 26301 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8.
I20260709 12:20:57.222080 26356 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:57.378578 26293 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.449644 23846 raft_consensus.cc:2410] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:57.238694 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:57.391927 23895 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:57.450810 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 58976.6us
I20260709 12:20:57.447109 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:57.392446 25994 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.101545 26283 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:57.449656 26356 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.452389 26283 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:57.100492 23923 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:57.453286 26283 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.454937 26356 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:57.251019 25778 consensus_meta.cc:287] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 12:20:57.455631 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:57.456143 25778 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:57.456660 25778 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:57.457167 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:57.299127 26350 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:20:57.226336 26306 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
W20260709 12:20:57.459017 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.458546 26332 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:57.096124 26285 consensus_queue.cc:1059] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.303s
I20260709 12:20:57.177260 25198 raft_consensus.cc:3055] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:20:57.216562 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 132690us
I20260709 12:20:57.101274 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.310832 26223 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:57.416812 26294 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:57.090976 23750 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.171164 26240 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:57.416409 26351 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.419252 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.428977 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:57.430562 23852 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:57.459534 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:57.463384 24555 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:57.433130 23854 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:57.463915 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 362715us
I20260709 12:20:57.467149 26294 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:57.467564 26294 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.467916 26294 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:57.463384 25198 raft_consensus.cc:740] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:57.459066 23928 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:20:57.448642 26233 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:57.475361 26285 raft_consensus.cc:3055] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:57.475282 26233 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.475889 26285 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:57.476181 23818 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.476833 26285 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.477445 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.450174 23847 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:57.332345 26324 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:20:57.209873 26284 consensus_meta.cc:287] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.522s	user 0.003s	sys 0.004s
I20260709 12:20:57.455545 26356 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:57.099416 26318 consensus_queue.cc:1059] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.276s
I20260709 12:20:57.490634 26324 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.490929 26319 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.501487 26319 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.384703 25848 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.459698 26332 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:57.387411 26299 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.470036 23922 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:57.432617 26187 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:57.471820 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:57.472442 26240 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.527240 26299 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:57.527071 26083 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.472905 25198 consensus_queue.cc:260] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.528131 26240 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:57.528687 25198 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:57.528746 23926 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:57.529167 26336 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:57.529608 26336 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:57.530004 26336 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.531601 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:57.532369 24561 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
W20260709 12:20:57.119943 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.457468 25778 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.478524 25886 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:57.479547 23996 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: []
W20260709 12:20:57.480021 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 71327.9us
I20260709 12:20:57.519032 26332 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.478736 26210 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:57.483860 26316 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:57.484133 25952 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:57.484489 26334 consensus_queue.cc:1175] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "22996f888daf435398b693481171c18c" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260709 12:20:57.485590 26351 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.459908 26333 raft_consensus.cc:2243] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:57.459455 26306 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.487751 25966 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:57.487972 26272 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.476040 26062 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.489953 23818 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.495203 23854 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:20:57.441570 26211 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:20:57.550376 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 60525.7us
I20260709 12:20:57.179901 26302 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.482728 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:57.500882 23923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:20:57.559494 23923 raft_consensus.cc:606] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:20:57.559496 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 76846.4us
I20260709 12:20:57.560075 23923 raft_consensus.cc:614] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:57.520810 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 49054.1us
I20260709 12:20:57.479435 25823 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:20:57.534456 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.502049 26285 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.508936 26301 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.542423 23892 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.481761 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.551332 24558 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:20:57.551152 23818 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.555716 26333 raft_consensus.cc:2272] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:57.556389 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.565371 23817 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:57.556665 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.556941 25886 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:57.561983 26261 consensus_queue.cc:1059] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 12:20:57.557215 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.547964 24555 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:57.583470 26250 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:57.584064 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:57.584259 26250 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:57.584784 26250 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.585340 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:57.565448 26301 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.587651 26193 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:57.588166 26193 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.591122 26187 raft_consensus.cc:3055] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:57.583501 26211 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:20:57.586668 26272 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:57.592778 26272 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:57.592948 26211 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:57.593335 26211 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:57.593453 23923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:20:57.593658 26272 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.595014 26272 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:57.595212 26124 consensus_queue.cc:1175] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260709 12:20:57.594146 23923 raft_consensus.cc:606] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.596376 26237 raft_consensus.cc:3055] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:57.596743 26193 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:57.596948 26237 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:57.596524 23923 raft_consensus.cc:614] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:57.598827 25994 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:57.599360 25994 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:57.600471 25994 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.568168 26334 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:57.562600 25966 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:57.566488 23892 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:57.604133 23923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:20:57.608791 23923 raft_consensus.cc:606] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:57.609261 23923 raft_consensus.cc:614] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:57.591552 26187 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:20:57.612367 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 61308.9us
I20260709 12:20:57.599435 26302 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:57.567281 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 85624.4us
I20260709 12:20:57.626188 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:57.626824 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.619206 23893 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.627884 26306 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.626205 26249 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.629527 23966 leader_election.cc:400] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:20:57.629871 26319 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.630002 26193 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.630607 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.630566 26193 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.614439 23818 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.631388 26333 ts_tablet_manager.cc:1916] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:57.615991 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:57.632326 23818 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.633095 24004 raft_consensus.cc:2410] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:20:57.623690 24001 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:57.633837 23818 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.624517 26336 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:57.624382 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.634673 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.649243 26306 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:57.649724 25886 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:57.650249 26261 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:57.651194 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:57.651957 23854 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:57.652555 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:57.653182 23852 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
W20260709 12:20:57.635023 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 68557.2us
I20260709 12:20:57.638540 26124 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.654076 26332 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.654469 26284 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:57.639801 26250 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:57.640400 25952 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:57.642755 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:57.642846 26083 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:57.606279 26211 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.673960 23849 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:20:57.646814 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 81553.9us
I20260709 12:20:57.653993 26334 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:57.638988 26210 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:57.656692 23923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:20:57.683241 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:57.683632 23923 raft_consensus.cc:606] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.657573 26294 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.657856 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:57.655117 26319 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:57.658969 26284 raft_consensus.cc:3055] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:57.692720 26233 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:57.662568 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:57.663930 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:57.694206 24003 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:57.565078 26324 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:57.664696 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:57.698071 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:57.699003 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:57.699200 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.665479 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:57.669626 23998 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:57.700579 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.701478 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:57.702788 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:57.703718 23998 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:57.661310 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:57.671232 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:57.622049 25966 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.704797 23999 raft_consensus.cc:2410] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:20:57.675266 23817 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:57.677307 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:57.678429 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.706111 23995 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:57.706667 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:57.671125 26301 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:57.650023 26306 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:57.682545 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.712446 23922 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:57.684212 23923 raft_consensus.cc:614] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:57.700480 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.684759 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:57.685577 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:57.714020 23927 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:20:57.686187 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.689584 23851 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:57.689949 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:57.691592 24004 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:20:57.692162 23853 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:57.692274 26248 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.692371 26319 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.692855 26284 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:57.661202 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:57.695107 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:57.664006 23854 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:57.706800 23924 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:57.706907 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:57.675851 26332 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:57.679322 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:57.706717 23925 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:57.710855 23845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:20:57.719523 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:57.681708 26250 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:57.720080 26319 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.734162 26250 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:57.735213 26250 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.720661 23852 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:57.690881 26187 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.738554 26249 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:57.708045 25966 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.730487 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:57.721597 23995 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:57.732159 24000 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:20:57.740723 24000 pending_rounds.cc:85] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 6
I20260709 12:20:57.740962 24000 pending_rounds.cc:107] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:20:57.741182 24000 raft_consensus.cc:2889] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:57.727234 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.646697 26237 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.732961 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.733630 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:57.750370 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.751089 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:57.752035 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:57.722257 23846 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:57.723013 23845 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:57.755923 23845 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:57.745591 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 70442.7us
I20260709 12:20:57.746393 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:57.925057 24558 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:57.722110 23847 raft_consensus.cc:2368] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8.
I20260709 12:20:57.929831 23924 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:57.930449 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:57.931238 23926 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:57.932085 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:57.890955 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.932675 23921 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:57.932766 23920 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:20:57.680972 26318 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:20:57.872879 23849 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:57.887262 23995 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:57.693387 26233 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.726558 26223 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:57.814073 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:57.938827 24558 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:57.862648 26299 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:20:57.805102 25886 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:57.710934 26324 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.813977 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:57.941053 23926 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:57.941824 23851 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:57.808401 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.843321 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:57.749339 26211 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.749570 26334 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:57.749251 26285 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:57.747519 26193 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:57.749447 26248 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.862555 26237 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:57.845264 26249 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:20:57.680542 26351 consensus_queue.cc:1059] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:20:57.915849 23845 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.829349 24524 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:57.944370 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 101192us
I20260709 12:20:57.944877 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:57.945595 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 137277us
I20260709 12:20:57.946002 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:57.946635 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:57.955085 23854 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:20:57.956959 23818 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:57.959620 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 130365us
I20260709 12:20:57.959781 24001 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.962232 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:20:57.964098 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.964743 23924 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:57.965723 23851 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:20:57.948280 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 135702us
I20260709 12:20:57.955127 23925 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:20:57.940181 26223 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.973448 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.974074 26223 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:57.975891 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.976969 26303 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.964828 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:57.967713 23845 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.978525 23927 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:57.947639 26043 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.979007 26043 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:57.981158 26043 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:57.981695 26043 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.985060 23925 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:20:57.986636 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:57.947343 26283 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.947492 26155 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:57.988651 23997 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:20:57.947899 26334 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.949714 26336 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:57.992409 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:57.950218 25886 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:58.017189 23926 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
W20260709 12:20:58.062456 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 70113.4us
I20260709 12:20:57.968436 26301 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:58.078936 24001 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:20:58.084615 26373 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:58.136654 26373 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.086360 26284 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.139874 26373 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:58.088423 23850 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:20:58.088832 26303 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:57.957746 26285 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:57.959455 26338 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:20:58.018791 26334 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:58.022459 26294 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:57.997462 26155 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.127934 23921 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:58.130831 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:57.998750 26145 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.134s
I20260709 12:20:58.143031 24558 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:58.144212 26368 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:20:58.167585 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:57.969398 26286 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 12:20:58.178743 26373 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:58.145455 26303 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:58.179667 26303 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:58.184288 26124 consensus_meta.cc:287] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.004s
I20260709 12:20:58.184732 26124 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:58.169425 26155 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:58.188699 26223 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.191187 26248 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:58.198854 24000 raft_consensus.cc:1240] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:58.199795 26223 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:58.200030 23999 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:58.193977 26319 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.201901 26319 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:58.172003 26193 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:58.202564 26193 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:58.202983 26193 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:58.212333 26187 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:58.158695 26339 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:58.225638 23848 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
W20260709 12:20:58.229956 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 260726us
W20260709 12:20:58.237470 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 269376us
I20260709 12:20:58.252843 23820 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:20:58.240728 23818 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:58.256683 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:58.252566 24524 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:58.254828 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:58.257334 23847 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:20:58.257951 24561 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:58.229331 26332 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.261168 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:58.234916 26299 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:58.253613 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.282852 23818 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:58.289242 23854 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:58.290176 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:58.289593 23817 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:58.252892 26338 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.252614 26285 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:58.252110 26233 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:58.280928 26124 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:58.331573 26376 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:58.334113 26293 raft_consensus.cc:3055] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:58.351162 26293 raft_consensus.cc:740] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:58.352093 26293 consensus_queue.cc:260] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.259680 26336 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:20:58.266319 26351 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:58.238893 26339 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.336272 26155 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.290560 25886 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.340428 26260 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:58.341393 26284 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:58.340458 26261 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:58.343470 26303 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.345392 26124 raft_consensus.cc:697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:58.286381 25994 consensus_queue.cc:1059] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:20:58.346601 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:20:58.393630 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 131287us
I20260709 12:20:58.350723 26376 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.394124 23921 raft_consensus.cc:3055] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:58.291791 26294 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:58.303421 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:58.362504 23892 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:58.410553 23926 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
W20260709 12:20:58.410960 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 65175.6us
I20260709 12:20:58.267356 26333 ts_tablet_manager.cc:1929] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:58.299522 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:58.260177 26301 consensus_queue.cc:1059] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:20:58.325955 26211 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:58.353056 26293 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:58.404614 26376 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:58.394136 26261 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:58.421957 25994 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:58.422422 25994 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:58.406641 26334 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.422784 26261 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.423508 25994 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.424898 26334 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:58.425319 25994 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:58.394577 23850 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:20:58.426246 23920 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:58.394989 23921 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:58.427497 23921 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.428862 23921 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:58.431915 26124 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:58.308036 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:58.434314 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.434947 26303 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:58.435657 26211 raft_consensus.cc:697] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:20:58.395365 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.436621 26318 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.436544 26211 consensus_queue.cc:237] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.437184 26318 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.437242 25198 consensus_queue.cc:1059] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:58.438314 25198 raft_consensus.cc:3055] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:58.438709 25198 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:58.439008 26155 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:58.439563 25198 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.417503 26319 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:58.440871 26319 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:58.441977 26319 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.444109 26301 raft_consensus.cc:3055] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:58.444500 26301 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:20:58.397866 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.445325 26301 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.446560 26301 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:58.411867 23892 leader_election.cc:400] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8.
I20260709 12:20:58.449182 23892 leader_election.cc:403] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:58.450071 26233 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.450552 26233 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.451251 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:58.451431 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:58.452548 26233 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:58.453083 26233 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.453303 26250 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:58.339326 26338 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.453830 26250 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.454849 23999 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:58.455653 26338 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:58.455969 26250 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:58.392123 26379 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:58.456871 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:58.457470 23925 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:58.457131 26379 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.451823 23996 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:58.457768 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:58.388309 25823 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:58.422510 26333 log.cc:1199] T 9f65f9b948cd4a8d88db397a8232dace P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/9f65f9b948cd4a8d88db397a8232dace
I20260709 12:20:58.463258 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:58.468473 24563 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:20:58.463547 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:58.464449 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:58.287050 26324 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:58.352954 24556 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:58.287452 26332 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.481040 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:58.321712 26299 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.405350 26193 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:58.465503 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 166055us
I20260709 12:20:58.477403 23921 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:58.482159 24562 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:58.497457 23818 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:58.500664 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:20:58.467136 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 299604us
I20260709 12:20:58.502797 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:58.492473 24559 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:20:58.472504 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:58.504653 23996 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:20:58.470261 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:58.491199 24561 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:20:58.506356 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:58.506414 23851 raft_consensus.cc:2410] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:58.491895 25198 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:58.507324 24002 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:58.464545 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:20:58.515125 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.516573 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:58.522861 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 58429.3us
I20260709 12:20:58.453476 26233 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.525089 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:58.527891 24004 raft_consensus.cc:2410] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:58.460343 25823 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.469354 26249 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.539316 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:58.539520 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:58.529114 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:58.540583 23924 raft_consensus.cc:2393] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:58.512707 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:58.468014 25848 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8.
I20260709 12:20:58.529671 24001 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:20:58.528363 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:58.530143 24000 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:58.531469 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:58.531379 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:58.532243 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:58.468197 26336 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:58.552492 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:58.533850 23846 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:58.492508 26272 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:58.526933 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:58.563503 23848 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:58.468758 26379 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:58.492581 26355 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:58.497406 26338 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:58.554948 23922 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:58.492862 26283 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:20:58.555001 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:58.574019 23929 raft_consensus.cc:2410] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:58.554080 23924 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:58.560364 26333 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52308 (request call id 77) took 2753 ms. Trace:
I20260709 12:20:58.524338 26324 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.540334 23969 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:58.555608 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:58.577824 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:58.578454 23923 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:20:58.561587 23847 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:20:58.526531 26155 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:58.513804 26240 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:20:58.536099 25966 consensus_meta.cc:287] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.003s
I20260709 12:20:58.566100 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:58.580410 26272 raft_consensus.cc:697] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:58.532663 26385 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:58.654037 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:58.577975 23969 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:20:58.634475 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:58.635299 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:58.532368 26286 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:20:58.638538 23846 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:20:58.644708 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 117326us
I20260709 12:20:58.570053 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:58.573854 26294 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:58.533704 26145 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:20:58.543365 26210 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:58.568022 26302 consensus_queue.cc:1059] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
W20260709 12:20:58.635668 26364 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:20:58.635730 26351 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.552762 26249 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.637742 26237 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:58.692637 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 114759us
I20260709 12:20:58.694514 23996 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:58.687929 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:20:58.695708 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 115666us
I20260709 12:20:58.631891 26155 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:58.572506 26223 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:58.708462 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:58.573659 26336 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.680840 26240 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.720463 23924 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:20:58.717442 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:58.699632 26387 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:58.700904 26210 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.697224 26220 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.681823 25966 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.772040 23846 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:58.705986 26339 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:58.708367 26248 raft_consensus.cc:2764] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:20:58.660701 26324 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:58.784898 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 149996us
I20260709 12:20:58.787973 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:58.692570 26373 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:58.696668 26303 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:58.784618 24562 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:58.759323 26155 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:58.716929 26383 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.717298 26385 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.713510 26294 raft_consensus.cc:697] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:58.756816 26356 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 12:20:58.891220 26187 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.792286 26220 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.757025 26375 raft_consensus.cc:3055] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:58.712715 26338 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:20:58.887118 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 178737us
I20260709 12:20:58.717921 26237 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:58.975445 23893 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:58.977026 23893 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:20:58.887734 23845 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:58.756335 26318 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:58.772977 26223 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.891022 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:58.914247 26394 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:58.714862 26351 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.791484 26379 raft_consensus.cc:3055] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:58.993667 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:58.793462 26210 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:58.954516 26193 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:58.954807 26381 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 12:20:58.979485 26237 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:58.983676 26240 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:58.984592 26293 consensus_meta.cc:287] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.000s
I20260709 12:20:58.985220 26394 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:58.985582 26375 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:20:58.979698 26145 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:58.986742 25966 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:58.902714 26393 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:20:58.987473 26294 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.981546 26249 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:58.983067 26223 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:58.956532 26385 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.586560 26333 rpcz_store.cc:276] 0709 12:20:55.847792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.992235 (+144443us) service_pool.cc:224] Handling call
0709 12:20:56.412146 (+419911us) ts_tablet_manager.cc:1151] Deleting tablet 9f65f9b948cd4a8d88db397a8232dace
0709 12:20:56.445301 (+ 33155us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:20:57.555156 (+1109855us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002463d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa287454362 00007fa28ae3f34c 00007fa28c46260a 00007fa28c4932d0 00007fa28c47983d 00007fa28c4797e9 00007fa28c479779 00007fa28c479741 00007fa28c47896d 0000000000388634
0709 12:20:58.084829 (+529673us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:58.252708 (+167879us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:58.560270 (+307562us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":837791,"spinlock_wait_cycles":250760448,"tablet-delete.queue_time_us":371341,"thread_start_us":306478,"threads_started":1}
I20260709 12:20:58.989694 26338 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.881533 26373 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.894251 26303 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:58.882488 26272 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:58.880633 26233 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:59.003402 25848 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:59.006253 26351 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:58.962987 26334 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.008733 26324 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:58.756510 26260 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:58.982189 26392 log.cc:927] Time spent T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:20:59.014845 26376 consensus_meta.cc:287] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.002s
I20260709 12:20:58.993572 26379 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:20:59.057286 26299 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.057416 26193 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:58.921595 26383 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.039835 26382 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.016599 26336 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.200294 26387 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:20:59.230983 26193 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.245405 26303 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.247195 26193 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.203599 26260 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.204284 26334 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.211632 26376 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.272114 26376 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.274363 26383 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.239214 26382 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.199641 26375 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.291469 26260 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.294572 26385 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.264462 26379 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.296043 26379 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:59.292593 26387 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.239575 26394 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.307163 26334 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.288841 26375 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:59.310345 26301 consensus_meta.cc:287] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.863s	user 0.005s	sys 0.007s
W20260709 12:20:59.311439 26284 consensus_meta.cc:287] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.923s	user 0.005s	sys 0.007s
W20260709 12:20:59.049855 23925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.009s	sys 0.004s
W20260709 12:20:59.350317 23925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.010s	sys 0.004s
W20260709 12:20:59.054071 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 128758us
I20260709 12:20:59.065936 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:20:59.367264 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:20:59.002902 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 288554us
I20260709 12:20:59.066109 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.368930 24000 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:59.370582 23995 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:20:59.063994 23999 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:20:59.062815 24002 consensus_meta.cc:287] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.000s
I20260709 12:20:59.371981 24002 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:20:59.118100 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.374902 24004 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:20:59.375289 25886 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.064891 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:58.973666 26187 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.382560 24554 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:59.385066 26187 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:59.387873 25198 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:59.358238 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1485) took 1608 ms. Trace:
I20260709 12:20:59.398382 24003 rpcz_store.cc:276] 0709 12:20:57.749667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.749800 (+   133us) service_pool.cc:224] Handling call
0709 12:20:57.750148 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:57.798440 (+ 48292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:57.799039 (+   599us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:57.799844 (+   805us) log.cc:844] Serialized 52 byte log entry
0709 12:20:58.390190 (+590346us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:58.418082 (+ 27892us) log.cc:844] Serialized 14 byte log entry
0709 12:20:58.418475 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 12:20:58.491804 (+ 73329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.491885 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:59.357504 (+865619us) raft_consensus.cc:1685] finished
0709 12:20:59.357554 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.357955 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43423,"prepare.queue_time_us":35450,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":82336,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":74646,"thread_start_us":497498,"threads_started":1,"wal-append.queue_time_us":683463}
I20260709 12:20:59.376516 25886 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.300329 26373 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.389066 25198 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.415002 26220 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.431839 26250 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:59.437209 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 350437us
I20260709 12:20:59.438257 26283 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.438901 26248 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:59.438309 25848 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:59.439801 26324 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.439743 26303 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.429136 25886 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:59.450029 26248 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:20:59.454855 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.454530 25848 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.455907 26283 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.454584 26324 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.464200 26303 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:59.467995 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.465705 25848 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.467643 26193 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:20:59.470125 26193 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.472016 26248 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:20:59.474220 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:59.476320 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.484432 26324 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.489096 26284 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:59.492337 26301 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.503146 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1637) took 1055 ms. Trace:
I20260709 12:20:59.546952 24001 rpcz_store.cc:276] 0709 12:20:58.447140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.456637 (+  9497us) service_pool.cc:224] Handling call
0709 12:20:59.497124 (+1040487us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b54001a8bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:59.502930 (+  5806us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165887232}
I20260709 12:20:59.547106 26301 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.503791 26324 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.550181 26301 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.550266 26324 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.481518 26283 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.514174 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:20:59.518687 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.522287 26303 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.526614 23920 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:59.527953 25823 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:59.528975 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:59.530076 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:59.530318 25198 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:59.531770 23928 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:20:59.532480 26286 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:59.534758 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.561659 24003 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
W20260709 12:20:59.535650 23845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1582) took 1279 ms (client timeout 1634 ms). Trace:
I20260709 12:20:59.535835 23851 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:59.537251 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.537539 26223 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.538236 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.569860 23999 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:59.539091 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.458940 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet 9f65f9b948cd4a8d88db397a8232dace (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
W20260709 12:20:59.540369 26390 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.769s	user 0.039s	sys 0.078s
I20260709 12:20:59.540737 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.540923 26383 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:59.541606 26233 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:59.544696 23929 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:59.545719 26334 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.541178 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:20:59.551369 26284 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.564254 23922 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:20:59.565327 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:59.566768 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:59.567077 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 238) took 1068 ms. Trace:
I20260709 12:20:59.567553 24002 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:59.568290 26324 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.568382 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:59.570744 23995 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
W20260709 12:20:59.564316 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 56610.2us
W20260709 12:20:59.562633 23845 rpcz_store.cc:269] 0709 12:20:58.255959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.258062 (+  2103us) service_pool.cc:224] Handling call
0709 12:20:59.535140 (+1277078us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400215a54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:59.535412 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372042112}
W20260709 12:20:59.572463 23737 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 113715us
I20260709 12:20:59.578040 26233 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.580610 26233 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:59.581305 26383 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.582072 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:59.582176 23924 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:59.583299 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:59.583814 26383 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.583997 23924 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:59.572527 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:59.585119 23920 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:59.578277 24559 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:59.575400 23921 rpcz_store.cc:276] 0709 12:20:58.498713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.500162 (+  1449us) service_pool.cc:224] Handling call
0709 12:20:58.534026 (+ 33864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.884035 (+350009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.884083 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:58.884144 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:58.884188 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.566635 (+682447us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540018b5d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:59.566694 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.566883 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804258048}
I20260709 12:20:59.584031 24558 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:59.594442 23996 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:20:59.582093 26223 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.599254 25848 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.603823 25848 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:20:59.604516 26155 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.003s
I20260709 12:20:59.604948 26155 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.606079 23852 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:20:59.608376 25848 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:59.609052 23928 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:59.610184 25823 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:59.610459 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.610793 25823 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.611701 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 1989) took 1090 ms. Trace:
I20260709 12:20:59.612210 23851 rpcz_store.cc:276] 0709 12:20:58.520981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.523845 (+  2864us) service_pool.cc:224] Handling call
0709 12:20:59.535385 (+1011540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:59.574519 (+ 39134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.611366 (+ 36847us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400215a50. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:59.611596 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2325434752}
I20260709 12:20:59.612977 25823 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.613588 25823 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.613979 26316 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:59.614392 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:59.614888 26316 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.615293 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:59.591990 26286 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.617271 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:59.617380 26316 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.580650 26284 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.617579 26286 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.618811 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:59.619699 23922 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:20:59.612527 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:59.620865 23929 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:59.620988 24563 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:59.621848 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:59.622367 26334 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.592270 26303 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:59.594297 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:20:59.626693 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36570 (request call id 482) took 1165 ms. Trace:
I20260709 12:20:59.618829 24559 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:59.627153 24555 rpcz_store.cc:276] 0709 12:20:58.461762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.468079 (+  6317us) service_pool.cc:224] Handling call
0709 12:20:59.592657 (+1124578us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327eee 000000000036eb39 00007fa28c39b1e0 00007fa28c4640c4 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:59.626602 (+ 33945us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16601984}
I20260709 12:20:59.627811 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.624442 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.633737 23893 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:59.634455 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 1901) took 1106 ms. Trace:
I20260709 12:20:59.634927 23926 rpcz_store.cc:276] 0709 12:20:58.528010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.528136 (+   126us) service_pool.cc:224] Handling call
0709 12:20:59.634087 (+1105951us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54003746d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:59.634257 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881940352}
I20260709 12:20:59.635803 23893 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:59.639331 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:59.641238 26324 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:59.608492 26155 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.636723 23893 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:59.645725 26210 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.006s
I20260709 12:20:59.648382 26043 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.648645 26385 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:59.648509 26210 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.649469 26385 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.650005 26261 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:59.652661 25198 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:59.653088 25198 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.653411 25198 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:59.658018 25994 consensus_meta.cc:287] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.109s	user 0.011s	sys 0.010s
I20260709 12:20:59.658089 26285 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:59.659096 26285 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.659466 26285 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:59.652141 25848 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:59.662405 25848 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:59.663058 25952 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.665321 26284 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:59.665334 25848 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:59.666042 26284 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.666585 26302 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.667308 26302 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.648629 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:20:59.668742 23928 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:20:59.669824 24524 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:59.670287 26233 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:59.670724 26233 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.671089 26233 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:59.671165 26383 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:59.663926 26223 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.649369 26043 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.674965 26301 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:59.676774 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.677119 26301 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.677548 23996 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:20:59.677580 26301 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:59.677781 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.665719 25952 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.679102 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.664415 25823 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.680132 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.680287 23920 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:20:59.680892 23995 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:20:59.682159 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.681774 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.686594 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.687593 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.688032 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.688282 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:20:59.688519 23848 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:20:59.688962 23853 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:59.681773 26385 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.647997 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.690114 26124 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.690263 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.690861 26124 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.693756 26193 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:20:59.694610 26334 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:59.696475 26210 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.696703 23927 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:59.696655 26376 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.697605 26376 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.698945 23846 raft_consensus.cc:2393] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:59.700798 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 602) took 1151 ms. Trace:
I20260709 12:20:59.702997 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:59.704412 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:59.705025 24558 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:59.706226 26316 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:59.707396 26316 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.707916 26316 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:59.710448 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 1991) took 1179 ms. Trace:
I20260709 12:20:59.710855 23849 rpcz_store.cc:276] 0709 12:20:58.531106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.531257 (+   151us) service_pool.cc:224] Handling call
0709 12:20:59.710095 (+1178838us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400216454. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:59.710253 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2672473344}
I20260709 12:20:59.714852 25952 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.716068 26332 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:59.713677 25823 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:59.722607 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.723294 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.724910 26382 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:20:59.726019 26405 log.cc:927] Time spent T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.528s	user 0.004s	sys 0.009s
I20260709 12:20:59.728502 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:59.729283 24558 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:20:59.731530 23893 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:59.733705 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.698056 26385 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.737764 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.738035 24002 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:20:59.738474 23847 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:20:59.722455 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:20:59.738612 26385 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.701220 24561 rpcz_store.cc:276] 0709 12:20:58.549028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.549236 (+   208us) service_pool.cc:224] Handling call
0709 12:20:58.549496 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.700231 (+150735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.700264 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:58.700306 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:58.700336 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.700334 (+999998us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54005a46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:20:59.700428 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.700614 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346192128}
I20260709 12:20:59.739650 23924 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:59.716069 26376 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:20:59.744752 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 91700.4us
I20260709 12:20:59.746728 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:59.745827 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:59.747768 24562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 600) took 1227 ms. Trace:
I20260709 12:20:59.748019 24561 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:20:59.748232 24562 rpcz_store.cc:276] 0709 12:20:58.520635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.521144 (+   509us) service_pool.cc:224] Handling call
0709 12:20:58.539156 (+ 18012us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:20:59.747387 (+1208231us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54005f0d54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:59.747561 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571674624}
I20260709 12:20:59.750958 26043 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.745635 23895 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:59.754557 23895 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:59.756093 26334 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:59.756659 26334 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:59.757194 26334 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.758739 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 1993) took 1219 ms. Trace:
I20260709 12:20:59.759086 26286 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:59.759739 26286 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:20:59.760288 26286 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:59.721473 25198 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.767198 24558 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:59.768441 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:20:59.745508 26379 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.745904 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:20:59.773340 25198 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.759150 23852 rpcz_store.cc:276] 0709 12:20:58.539144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.539266 (+   122us) service_pool.cc:224] Handling call
0709 12:20:59.758501 (+1219235us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001e46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:20:59.758654 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2450815872}
W20260709 12:20:59.748047 26415 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:20:59.673735 26383 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:20:59.780689 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49242.3us
I20260709 12:20:59.782667 24559 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:59.790362 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:59.791002 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.791553 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:20:59.794485 23853 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:20:59.793649 24002 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:20:59.811930 24563 raft_consensus.cc:2410] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:20:59.812882 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 67124.8us
I20260709 12:20:59.815912 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.819361 26260 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.819595 26377 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:59.792209 26383 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:59.819967 26260 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.831732 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:59.841436 23924 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:20:59.850301 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.824210 26376 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:59.799196 26379 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.859184 23847 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:20:59.819375 26062 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:20:59.887128 26083 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.887961 26083 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.888728 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:20:59.887215 26356 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:59.890551 26356 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:20:59.887269 26338 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:59.898537 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 239) took 1373 ms. Trace:
I20260709 12:20:59.900574 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:20:59.908080 23847 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:59.910656 26226 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.910799 25823 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:20:59.911471 26226 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.911623 25823 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.914510 25823 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.918810 26356 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.927634 26284 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:59.932602 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 160084us
I20260709 12:20:59.933722 23895 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:20:59.940712 23892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.634s (SENT) [suppressed 12 similar messages]
I20260709 12:21:00.523375 26387 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.987821 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:00.526793 26387 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:00.092942 26301 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:00.516516 26211 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:20:59.995631 26429 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.529582 26387 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:00.530146 26301 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:00.530040 26429 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:20:59.990293 25823 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:00.000214 26226 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:00.529271 26211 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.987200 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:00.531910 23852 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:00.532440 26429 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:00.168931 26285 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:00.077404 24560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 485) took 1028 ms. Trace:
I20260709 12:21:00.336822 26383 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:00.090862 25848 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:00.533483 24560 rpcz_store.cc:276] 0709 12:20:59.048748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.048885 (+   137us) service_pool.cc:224] Handling call
0709 12:21:00.045383 (+996498us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:21:00.075578 (+ 30195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.076864 (+  1286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.076910 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:00.076967 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:00.077021 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.077096 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.077230 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4491648}
I20260709 12:20:59.904106 23925 rpcz_store.cc:276] 0709 12:20:58.525121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.525617 (+   496us) service_pool.cc:224] Handling call
0709 12:20:58.525941 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:59.355786 (+829845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:59.355842 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:59.357111 (+  1269us) log.cc:844] Serialized 26 byte log entry
0709 12:20:59.446772 (+ 89661us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:59.446809 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.452519 (+  5710us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:59.886147 (+433628us) raft_consensus.cc:1685] finished
0709 12:20:59.886164 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.898454 (+ 12290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2844,"raft.queue_time_us":17321,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":910924,"threads_started":2,"wal-append.queue_time_us":117388}
I20260709 12:20:59.989084 23851 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:00.534814 26285 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:00.081646 25198 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:00.486819 26286 consensus_meta.cc:287] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.005s
I20260709 12:20:59.993620 26233 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:00.535727 25198 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.531111 25823 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.536391 25198 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:00.536650 25823 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:00.220697 26316 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:00.077455 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 69892.6us
I20260709 12:21:00.538667 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:00.539461 26316 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.897639 26338 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.075237 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:00.540450 26338 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:00.037166 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:00.541538 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 654741us
I20260709 12:20:59.994314 26083 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:20:59.988783 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:20:59.992057 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 58466.1us
W20260709 12:21:00.184295 26391 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.960s	user 0.006s	sys 0.006s
I20260709 12:21:00.542459 26437 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:00.545446 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1634) took 2099 ms. Trace:
I20260709 12:21:00.546283 26336 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:00.547223 26336 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:00.546011 23997 rpcz_store.cc:276] 0709 12:20:58.446071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.452429 (+  6358us) service_pool.cc:224] Handling call
0709 12:20:58.452844 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:58.453252 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.453282 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:58.453761 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:20:58.573595 (+119834us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:58.573630 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.573688 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:00.093172 (+1519484us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:00.544873 (+451701us) raft_consensus.cc:1685] finished
0709 12:21:00.544903 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.545220 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3884,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":49687424,"thread_start_us":119428,"threads_started":1,"wal-append.queue_time_us":526803}
I20260709 12:21:00.082584 26260 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:00.550611 26260 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:00.551263 26260 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:20:59.995002 26379 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:20:59.956568 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 126109us
I20260709 12:21:00.553606 26260 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:00.532985 26211 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:20:59.991734 26284 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:00.555066 26397 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 1.348s	user 0.014s	sys 0.009s
I20260709 12:21:00.534291 26383 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:00.001152 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.562525 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:00.590273 23847 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:00.536026 26286 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:00.557798 23845 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:00.537534 26233 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:00.055925 26237 consensus_meta.cc:287] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.000s	user 0.009s	sys 0.012s
I20260709 12:21:00.555279 25823 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:00.589314 26356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.004s	sys 0.019s
W20260709 12:21:00.493781 26334 consensus_meta.cc:287] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.002s
W20260709 12:21:01.114471 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 199949us
I20260709 12:21:01.030385 23997 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:01.191959 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:00.778044 25198 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.029417 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:01.030800 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:00.981123 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:01.029089 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:01.216804 24004 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:00.621009 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 578010us
I20260709 12:21:00.979612 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:01.145741 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:01.183125 23750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43186 (request call id 243) took 21588 ms (client timeout 15000 ms). Trace:
I20260709 12:21:00.614777 24000 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:01.222949 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1510) took 1185 ms. Trace:
W20260709 12:21:00.621807 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 78100.3us
I20260709 12:21:01.086547 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1584) took 2545 ms. Trace:
W20260709 12:21:00.702837 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 101986us
I20260709 12:21:01.029785 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:01.028642 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:00.984747 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:00.935966 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:00.702682 24525 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:01.192441 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:01.230330 24002 raft_consensus.cc:2368] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8.
I20260709 12:21:01.223584 24000 rpcz_store.cc:276] 0709 12:21:00.037622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.567766 (+530144us) service_pool.cc:224] Handling call
0709 12:21:00.614207 (+ 46441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.222552 (+608345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.222859 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.609336 26435 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:01.230109 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 248) took 1613 ms. Trace:
I20260709 12:21:00.609186 26301 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:01.235570 23854 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:01.230113 24001 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:01.228305 23851 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:01.089022 23995 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:01.239694 23895 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:01.240569 23996 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:01.230827 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1609) took 1242 ms. Trace:
W20260709 12:21:01.214270 26356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.035s	sys 0.045s
W20260709 12:21:01.136662 26338 consensus_meta.cc:287] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.596s	user 0.001s	sys 0.011s
I20260709 12:21:00.719516 26316 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.611598 25823 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.244514 23848 rpcz_store.cc:276] 0709 12:20:59.988030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.988239 (+   209us) service_pool.cc:224] Handling call
0709 12:21:00.979354 (+991115us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:21:01.230755 (+251401us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89003904}
I20260709 12:21:00.704034 26393 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:01.254855 23846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1611) took 1266 ms (client timeout 1661 ms). Trace:
I20260709 12:21:00.621549 26083 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:01.268554 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:01.278178 23846 rpcz_store.cc:269] 0709 12:20:59.988729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.087171 (+ 98442us) service_pool.cc:224] Handling call
0709 12:21:00.984537 (+897366us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:21:01.254753 (+270216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88711040}
I20260709 12:21:00.726589 26429 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.169112 26376 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.797583 26394 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.263710 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:00.702716 26437 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:21:01.246850 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 645348us
I20260709 12:21:00.974967 26302 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:00.767849 26336 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:00.622300 26427 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:00.872231 26285 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:00.879432 25966 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:01.119933 26448 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:01.283453 26376 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:01.288853 26448 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.289124 25966 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.291283 26448 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.013525 26450 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:01.291915 26427 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.292073 26450 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.294062 26294 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:01.294406 26450 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:01.119402 26286 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.071501 26385 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:01.072505 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:01.295936 24556 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:00.811961 25848 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.297962 26316 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.298246 26436 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:01.004438 26438 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.297215 26437 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.299144 26436 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.299475 26438 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.300477 26316 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:01.005304 26441 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.275s
I20260709 12:21:01.302062 26226 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:00.678447 26237 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.304286 26285 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.306500 26237 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.274842 26447 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:01.236997 23922 rpcz_store.cc:276] 0709 12:20:59.616855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.624087 (+  7232us) service_pool.cc:224] Handling call
0709 12:20:59.626388 (+  2301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:59.626800 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:20:59.775142 (+148342us) log.cc:844] Serialized 14 byte log entry
0709 12:21:00.884727 (+1109585us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18003a8580. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287 00007fa287467208
0709 12:21:01.229604 (+344877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.229674 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:01.229746 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.229902 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.230043 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10000,"prepare.queue_time_us":176401,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":9066,"raft.queue_time_us":64866,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":24661,"spinlock_wait_cycles":26433792,"thread_start_us":489595,"threads_started":2}
I20260709 12:21:01.236208 26334 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:00.605803 26211 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:00.618695 26233 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.265774 25198 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.278656 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:01.278873 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:00.819252 26124 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.278069 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:01.279619 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:01.144254 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:01.280402 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:00.624511 26379 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:00.609508 26284 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.282821 23996 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:01.274573 26338 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.225252 23850 rpcz_store.cc:276] 0709 12:20:58.468962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.470746 (+  1784us) service_pool.cc:224] Handling call
0709 12:20:58.525016 (+ 54270us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:58.529088 (+  4072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.529123 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:58.538633 (+  9510us) log.cc:844] Serialized 52 byte log entry
0709 12:20:58.887778 (+349145us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:58.887827 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.887899 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:00.554172 (+1666273us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:00.611761 (+ 57589us) raft_consensus.cc:1685] finished
0709 12:21:00.611784 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.014174 (+402390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12666,"raft.queue_time_us":4230,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":16810,"spinlock_wait_cycles":10627328,"thread_start_us":235166,"threads_started":1,"wal-append.queue_time_us":466114}
I20260709 12:21:01.291342 25966 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:01.294534 26394 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:00.624852 26283 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.307377 23998 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:01.294416 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:01.335508 23997 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:01.276057 23853 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:01.279778 26442 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:01.309798 26438 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:01.286173 26429 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.310081 26286 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:01.311019 23817 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:01.306788 26285 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.318338 23851 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:01.325605 23852 raft_consensus.cc:2393] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:01.286878 26430 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:01.317679 24000 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:01.328229 23999 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:01.283620 26356 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.286917 26445 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:01.330176 24001 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:01.330701 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:01.362510 24004 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:01.294472 26427 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:01.278003 26301 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.338722 26442 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.341483 26429 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:01.369351 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 81595.4us
I20260709 12:21:01.316829 26237 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:21:01.343374 26334 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.343945 26283 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.332772 26336 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:01.345649 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:01.329006 26447 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:01.221308 23750 rpcz_store.cc:269] 0709 12:20:39.701021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.307987 (+606966us) service_pool.cc:224] Handling call
0709 12:21:01.182599 (+20874612us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:57.523741 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:57.524364 (+   623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:57.524400 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:20:57.524412 (+    12us) tablet.cc:662] Decoding operations
0709 12:20:57.524808 (+   396us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:57.524865 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:57.524881 (+    16us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:20:57.525091 (+   210us) tablet.cc:701] Row locks acquired
0709 12:20:57.525102 (+    11us) write_op.cc:260] PREPARE: finished
0709 12:20:57.525202 (+   100us) write_op.cc:270] Start()
0709 12:20:57.525282 (+    80us) write_op.cc:276] Timestamp: P: 1783599657525165 usec, L: 0
0709 12:20:57.525295 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 12:20:57.583669 (+ 58374us) log.cc:844] Serialized 1303 byte log entry
0709 12:20:58.210562 (+626893us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b54003129d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa287447e28 00007fa28ae82581 00007fa28ae81d58 00007fa28ae869f1 00007fa28ae869a9 00007fa28ae86939 00007fa28ae86901 00007fa28ae85b2d 0000000000388634 0000000000388479
0709 12:20:58.421954 (+211392us) op_driver.cc:464] REPLICATION: finished
0709 12:20:59.028510 (+606556us) write_op.cc:301] APPLY: starting
0709 12:20:59.042013 (+ 13503us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:59.055360 (+ 13347us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:59.057837 (+  2477us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:59.118690 (+ 60853us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:59.118883 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:20:59.118927 (+    44us) write_op.cc:312] APPLY: finished
0709 12:20:59.119148 (+   221us) log.cc:844] Serialized 35 byte log entry
0709 12:20:59.119362 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:59.119488 (+   126us) write_op.cc:454] Released schema lock
0709 12:20:59.119532 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:59.119885 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:59.119920 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":739392,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":480170,"apply.run_cpu_time_us":2357,"apply.run_wall_time_us":217453,"num_ops":3,"prepare.queue_time_us":31866,"prepare.run_cpu_time_us":31428,"prepare.run_wall_time_us":687002,"raft.queue_time_us":448201,"raft.run_cpu_time_us":28363,"raft.run_wall_time_us":214207,"replication_time_us":896493,"spinlock_wait_cycles":30589824,"thread_start_us":676214,"threads_started":4,"wal-append.queue_time_us":356018,"wal-append.run_cpu_time_us":30253,"wal-append.run_wall_time_us":2301310}]]}
I20260709 12:21:01.294739 26294 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.348968 26436 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.332724 24554 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:01.286456 26393 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.370556 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:01.329365 26439 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:01.371735 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:01.372535 23817 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:01.371603 26260 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:01.378980 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:01.375293 26438 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:01.282341 26435 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.361326 26445 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:01.385391 23998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1652) took 1704 ms (client timeout 1878 ms). Trace:
W20260709 12:21:01.398208 23998 rpcz_store.cc:269] 0709 12:20:59.676079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.678867 (+  2788us) service_pool.cc:224] Handling call
0709 12:21:01.378307 (+1699440us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540034ba54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:01.380907 (+  2600us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3743026944}
I20260709 12:21:01.385864 23995 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:01.390412 24001 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:01.391583 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 137786us
W20260709 12:21:01.392342 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 152711us
I20260709 12:21:01.344930 26338 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:01.394623 24000 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:01.377111 26356 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.389866 23854 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:01.403214 23895 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:01.403483 23892 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:01.382889 26387 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:01.370137 26379 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:01.385664 26211 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:01.413434 26211 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.416033 26211 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.416700 26302 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:01.418107 26436 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:01.418586 26436 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.419005 26436 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:01.377023 25966 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:21:01.399122 26438 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.423128 23817 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:01.409811 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:01.431845 23999 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:01.425554 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:01.427685 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:01.400025 26445 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:01.433004 23995 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:01.381011 26233 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.404175 23751 catalog_manager.cc:5697] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:01.435832 24004 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:01.437263 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:01.433519 26443 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:01.399622 26439 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.375443 26430 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.440379 26393 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.440511 26387 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.444203 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:01.445736 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:01.446631 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:01.447317 26283 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:01.447847 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:01.448519 26284 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:01.406092 26260 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.451181 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:01.452430 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:01.434839 26383 consensus_meta.cc:287] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.794s	user 0.010s	sys 0.004s
I20260709 12:21:01.411414 26124 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.386479 26336 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.456310 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:01.456357 26438 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:01.440433 26447 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:01.457774 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:01.434031 26338 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:01.458410 24003 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:01.464587 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:01.466740 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:01.417469 26302 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:01.466714 23848 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:01.531487 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 102499us
I20260709 12:21:01.813031 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1607) took 1825 ms. Trace:
W20260709 12:21:01.533138 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 99839us
I20260709 12:21:01.533433 23997 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
W20260709 12:21:02.011432 24000 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.605s	user 0.016s	sys 0.012s
I20260709 12:21:01.669440 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:02.010905 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 598777us
I20260709 12:21:02.010586 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:02.009915 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.033658 24002 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
W20260709 12:21:01.811846 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 526765us
I20260709 12:21:02.032505 23998 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:21:02.019910 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:02.032840 23850 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:02.043895 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:01.462689 23922 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:02.032400 23854 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
W20260709 12:21:01.634109 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 81729us
I20260709 12:21:02.052163 24004 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:02.044072 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:02.035195 23924 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:02.032541 24000 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:02.074460 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:01.471839 23751 catalog_manager.cc:5697] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:01.554759 26385 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.081314 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:02.081758 23925 raft_consensus.cc:2393] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:01.680518 25966 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.080148 23995 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:02.156078 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:02.156849 23995 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:02.057081 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.081729 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:02.158239 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.114768 23923 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:02.158914 23924 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:02.082152 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.133476 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:02.161744 23997 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:02.161921 24002 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:02.162299 23927 raft_consensus.cc:2410] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:21:01.680727 26435 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:02.171962 23929 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:02.174229 24563 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:01.440449 26379 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.129356 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:01.460474 26452 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:01.460529 26448 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.619s
I20260709 12:21:02.157094 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.081549 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.132580 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:02.009004 23849 rpcz_store.cc:276] 0709 12:20:59.987353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.025701 (+ 38348us) service_pool.cc:224] Handling call
0709 12:21:00.882069 (+856368us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:21:00.882364 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.295940 (+413576us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:01.361364 (+ 65424us) log.cc:844] Serialized 14 byte log entry
0709 12:21:01.670060 (+308696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.670141 (+    81us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:01.670221 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.812681 (+142460us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54001b1cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:01.812760 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.812946 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115825,"prepare.queue_time_us":116182,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":67,"raft.queue_time_us":126280,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"spinlock_wait_cycles":1017716864,"thread_start_us":232284,"threads_started":2}
I20260709 12:21:02.171905 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:01.535092 26301 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.081849 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.130023 26429 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:01.871320 26376 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.007s
I20260709 12:21:02.176625 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.145747 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:02.178659 24000 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:21:02.242311 23998 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:01.554445 26237 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.601s
I20260709 12:21:01.682298 26294 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.181655 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.182497 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.184724 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:02.185398 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 141599us
I20260709 12:21:01.828471 26455 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:02.186538 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.186753 23751 catalog_manager.cc:5697] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 2, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 2 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:02.173167 26385 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:02.083926 26447 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:02.081240 26226 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:02.188653 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.189986 26393 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.170311 26442 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.192417 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.193500 23923 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:02.193783 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1517) took 1028 ms. Trace:
I20260709 12:21:02.195753 26430 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:02.196038 26439 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:02.201463 26436 consensus_meta.cc:287] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.782s	user 0.008s	sys 0.000s
I20260709 12:21:02.203326 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:02.207475 23999 consensus_meta.cc:287] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.772s	user 0.008s	sys 0.000s
I20260709 12:21:02.082276 26462 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:02.209920 23996 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.820s	user 0.012s	sys 0.000s
I20260709 12:21:01.586788 25823 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.621s
I20260709 12:21:01.680823 26456 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:02.209319 24559 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:02.211263 23920 raft_consensus.cc:2368] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:21:02.208600 23852 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
W20260709 12:21:02.150556 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 343280us
I20260709 12:21:02.214159 23921 raft_consensus.cc:2410] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:21:01.617352 26334 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.294647 23996 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:02.216361 23893 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:02.176474 23846 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
W20260709 12:21:02.214991 26446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.025s	sys 0.015s
I20260709 12:21:02.219406 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.132122 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:01.870839 26356 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:02.343569 26445 consensus_meta.cc:287] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.892s	user 0.012s	sys 0.000s
I20260709 12:21:02.206431 26233 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:02.217155 25848 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.262089 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:02.262893 23853 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 2.
I20260709 12:21:02.378422 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.378307 25848 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:02.378450 23995 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:02.379133 23927 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:02.269332 23848 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:02.278172 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:02.284945 23751 catalog_manager.cc:5697] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 5, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 5 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:02.380174 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.265336 23924 raft_consensus.cc:2410] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:21:02.381297 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.381363 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.291390 23929 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 2.
I20260709 12:21:02.313221 26456 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.292259 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.267375 26394 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.272081 26302 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:01.435181 26211 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.740s
I20260709 12:21:02.219910 26301 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:02.341545 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.341799 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.297529 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:02.309837 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 93576.6us
I20260709 12:21:02.341034 26334 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:02.344094 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.184376 25966 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:02.297147 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:02.290232 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:02.288623 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:02.299000 24001 consensus_meta.cc:287] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.895s	user 0.019s	sys 0.001s
I20260709 12:21:02.351768 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.290131 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:02.298425 26462 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:02.421085 25966 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:02.422160 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.422859 26462 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:02.423576 23926 raft_consensus.cc:2393] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:02.424536 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.404002 26338 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:02.264547 23850 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:02.050673 26443 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:02.180330 26452 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.293241 26436 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:02.244361 26435 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:02.050724 26124 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:02.288017 26447 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:02.288779 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:02.273401 26336 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:02.377784 26356 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.286793 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:02.291029 26442 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:02.382185 23924 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:02.292438 24003 rpcz_store.cc:276] 0709 12:21:01.165681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.165933 (+   252us) service_pool.cc:224] Handling call
0709 12:21:01.166428 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:02.008263 (+841835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.193560 (+185297us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b540012bbd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:02.193722 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":670493952}
I20260709 12:21:02.294384 23999 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:02.280889 26260 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.383236 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:02.380954 23751 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 4, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 4 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:02.382573 23923 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:02.411119 23893 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:02.362963 26446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.032s	sys 0.019s
I20260709 12:21:02.343025 26294 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.390604 23927 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:02.415144 24001 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:02.416900 23922 raft_consensus.cc:2393] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:02.413954 24560 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:02.417560 23920 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:21:02.287063 26385 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.425851 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:02.533696 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 236233us
I20260709 12:21:02.290657 26393 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:02.289455 26226 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:02.261535 26376 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:02.315033 26429 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:02.492234 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:02.426167 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:02.426497 23851 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:02.467080 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.541531 23929 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:21:02.467947 23848 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:21:02.531713 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1669) took 1243 ms. Trace:
I20260709 12:21:02.542465 23848 pending_rounds.cc:85] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 4
I20260709 12:21:02.542614 24001 rpcz_store.cc:276] 0709 12:21:01.288374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.366813 (+ 78439us) service_pool.cc:224] Handling call
0709 12:21:01.377615 (+ 10802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:02.529831 (+1152216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.531458 (+  1627us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:02.536966 23820 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:02.265763 23925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:21:02.545496 23925 raft_consensus.cc:606] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:02.531839 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1672) took 1131 ms. Trace:
W20260709 12:21:02.534941 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 123933us
I20260709 12:21:02.546650 23893 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:02.545899 23925 raft_consensus.cc:614] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:02.550487 23923 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:21:02.560066 23893 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:02.548712 23999 rpcz_store.cc:276] 0709 12:21:01.400445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.400631 (+   186us) service_pool.cc:224] Handling call
0709 12:21:02.531783 (+1131152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:02.404196 26456 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:02.536139 26437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.003s	sys 0.019s
W20260709 12:21:02.535960 26450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.003s	sys 0.018s
I20260709 12:21:02.561362 23893 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:02.427136 26338 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.428963 26443 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:02.467528 26124 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.565749 23848 pending_rounds.cc:107] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:21:02.405679 26445 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:02.418090 26301 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:02.431794 26435 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:02.672449 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:02.621053 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 74130.9us
I20260709 12:21:02.717301 23848 raft_consensus.cc:2889] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:02.620718 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:02.718343 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:02.593609 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.467202 26436 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:02.711860 23969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.029s	sys 0.064s
W20260709 12:21:02.743359 23969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.030s	sys 0.064s
I20260709 12:21:02.661582 24555 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:02.545018 26283 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:02.468266 26233 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:02.534193 26383 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:02.721345 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:02.693476 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 156607us
W20260709 12:21:02.732419 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 387228us
I20260709 12:21:02.801728 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:02.582784 23927 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:21:02.731410 26437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.003s	sys 0.025s
I20260709 12:21:02.599349 23751 catalog_manager.cc:5697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 2 to 5, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 5 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:02.735443 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.738198 24563 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:02.429198 26452 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:02.739269 24560 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:02.738766 23924 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:02.739899 26338 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:02.747628 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:02.747926 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.576376 26394 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:02.717024 26211 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.750830 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:02.751080 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.582965 26446 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:02.556537 26294 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:02.752627 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:02.837494 23925 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:02.752913 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:02.838804 24558 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:02.839133 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:02.754251 26275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.009s	sys 0.008s
I20260709 12:21:02.754925 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:02.849215 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.844285 26394 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:02.850483 26445 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.714787 26302 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:02.712785 26226 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.671331 26284 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:02.758322 25848 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.558338 26356 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:02.761305 26429 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.768234 26376 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.768810 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.866618 23853 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:02.769698 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:02.770649 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.771481 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:02.869495 23846 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:02.772330 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:02.870601 23854 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:02.773198 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:02.774577 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:02.718472 26450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.009s	sys 0.018s
I20260709 12:21:02.780776 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.742374 26387 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:02.783475 26334 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:02.784698 26438 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.728s	user 0.004s	sys 0.005s
I20260709 12:21:02.787153 24557 raft_consensus.cc:2368] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:21:02.787412 26301 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:02.791458 26435 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:02.794070 23998 consensus_meta.cc:287] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.002s
I20260709 12:21:02.955329 23998 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:02.956012 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1677) took 1057 ms. Trace:
I20260709 12:21:02.956391 23998 rpcz_store.cc:276] 0709 12:21:01.898676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.080867 (+182191us) service_pool.cc:224] Handling call
0709 12:21:02.955936 (+875069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:02.799078 26393 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.800191 24554 raft_consensus.cc:2410] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:21:02.810585 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.737375 24524 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:02.813365 24559 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
W20260709 12:21:02.965245 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 227952us
I20260709 12:21:02.965956 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:02.966113 23895 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:02.816642 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:02.565984 26442 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:02.825989 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:02.747609 26283 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.834348 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.975845 24563 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:02.975919 23850 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:02.976399 24524 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:02.843304 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.848268 23921 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:02.582525 26455 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.241s
I20260709 12:21:02.820572 25823 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:02.856422 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 295138us
I20260709 12:21:02.826793 25966 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:02.844909 26275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.009s	sys 0.009s
I20260709 12:21:02.876080 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.897471 23845 raft_consensus.cc:2368] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:21:02.853497 26302 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:02.853435 26233 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.903369 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:02.905457 26294 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.906217 26284 raft_consensus.cc:697] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:02.839855 26211 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:02.915652 26356 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:02.916184 26462 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:02.916404 26456 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:02.864562 26446 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:02.851004 26394 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:02.923943 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 173193us
I20260709 12:21:02.925252 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:02.856673 23818 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:02.876951 23852 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:02.868736 23847 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:02.941318 24560 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:02.944365 23925 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:02.943509 23817 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:02.961297 23849 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
W20260709 12:21:02.814723 23928 consensus_meta.cc:287] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.004s
I20260709 12:21:02.970191 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:02.972224 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 155724us
I20260709 12:21:02.783577 26447 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:02.977624 23924 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:02.986550 23893 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:02.946998 26338 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:03.186897 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 282903us
W20260709 12:21:03.573721 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 630259us
W20260709 12:21:03.574018 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:02.976478 23892 connection.cc:256] RPC call timeout handler was delayed by -2.4019606320000548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
I20260709 12:21:03.574790 24560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 621) took 1395 ms. Trace:
W20260709 12:21:03.575404 23892 connection.cc:256] RPC call timeout handler was delayed by -2.0347606320001432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
I20260709 12:21:03.102502 24562 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:02.993707 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:03.576339 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:02.993968 23927 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:03.579502 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:03.139400 23846 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:03.581993 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:03.580047 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:03.582937 23928 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:03.372630 23854 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
W20260709 12:21:03.583590 23928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 1913) took 1544 ms (client timeout 1585 ms). Trace:
I20260709 12:21:03.583796 24562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36558 (request call id 543) took 1050 ms. Trace:
I20260709 12:21:02.985145 26481 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:03.576937 23848 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:03.576073 23923 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.008s	sys 0.002s
W20260709 12:21:03.421196 26483 log.cc:927] Time spent T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:21:03.591847 23966 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:02.983062 26283 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:02.976643 26334 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:03.584126 23928 rpcz_store.cc:269] 0709 12:21:02.039310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.039450 (+   140us) service_pool.cc:224] Handling call
0709 12:21:03.583530 (+1544080us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:03.592087 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 605605us
I20260709 12:21:03.604410 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:03.591536 23923 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.008s	sys 0.002s
I20260709 12:21:03.586362 26481 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:03.604909 26284 consensus_queue.cc:237] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:03.605480 26481 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:03.605995 23922 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:02.982915 26301 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:03.606539 26301 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.606930 26301 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:03.609334 26338 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:03.609642 25848 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.610132 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:03.610230 25848 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:03.611877 26211 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:03.606037 23892 connection.cc:256] RPC call timeout handler was delayed by -1.7347449910000705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 12:21:03.248920 26484 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 12:21:03.599733 23820 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:03.618611 26387 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:03.618884 23892 connection.cc:256] RPC call timeout handler was delayed by -1.5961449910000738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 12:21:03.619298 23892 connection.cc:256] RPC call timeout handler was delayed by -1.348609862000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 12:21:03.619576 23892 connection.cc:256] RPC call timeout handler was delayed by -1.1596449910000501s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 12:21:03.584263 24562 rpcz_store.cc:276] 0709 12:21:02.533108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.660546 (+127438us) service_pool.cc:224] Handling call
0709 12:21:03.583608 (+923062us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5400468554. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:03.583724 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837102464}
I20260709 12:21:03.619810 26387 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:03.620330 26387 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:02.987946 26393 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.604619 23895 leader_election.cc:400] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
W20260709 12:21:03.620685 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 764061us
I20260709 12:21:03.620977 23895 leader_election.cc:403] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:21:03.591508 26485 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:03.621950 26455 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:03.622045 26485 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:03.612178 26294 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:03.612388 25848 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:02.983574 26478 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.645s
I20260709 12:21:03.623241 26430 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:21:03.623911 26226 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:03.624440 26485 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:03.624279 26478 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:03.575583 24560 rpcz_store.cc:276] 0709 12:21:02.179644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.538662 (+359018us) service_pool.cc:224] Handling call
0709 12:21:03.574710 (+1036048us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:02.993317 25966 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.582185 26233 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:03.625635 23895 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:03.623274 26448 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:03.626361 26448 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:03.626778 26485 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:03.599504 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:03.627408 26485 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:03.627519 26233 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:03.627800 23852 raft_consensus.cc:2410] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:03.353688 25823 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.613992 26447 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:03.614681 26356 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:03.580866 26275 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:03.591867 26474 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:02.995023 26445 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.623s
I20260709 12:21:02.964794 26438 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:03.577520 26436 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.644994 26436 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:03.645797 26481 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:03.647289 26436 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:03.648592 26393 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:03.649488 26481 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:03.636482 26334 raft_consensus.cc:697] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:03.651536 26393 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:03.651381 26334 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:03.654356 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 546) took 1097 ms. Trace:
I20260709 12:21:03.654455 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:03.622432 26455 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:03.655741 26455 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:03.654855 24556 rpcz_store.cc:276] 0709 12:21:02.557458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.849350 (+291892us) service_pool.cc:224] Handling call
0709 12:21:02.849732 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:02.850169 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:02.850204 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:02.850720 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:21:03.585954 (+735234us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:03.592474 (+  6520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.618441 (+ 25967us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:03.654112 (+ 35671us) raft_consensus.cc:1685] finished
0709 12:21:03.654130 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.654292 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2829,"raft.queue_time_us":4277,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":19112,"thread_start_us":102518,"threads_started":1,"wal-append.queue_time_us":781056}
I20260709 12:21:03.655411 26456 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:03.622462 26429 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.987793 26376 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:03.613449 26446 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:03.601511 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:03.630496 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:03.603137 23929 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:03.419840 26452 consensus_meta.cc:287] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.000s
W20260709 12:21:03.619844 23892 connection.cc:256] RPC call timeout handler was delayed by -1.1424115100001018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
I20260709 12:21:03.632879 23893 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:03.129987 26437 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.578019 26302 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:03.361860 26442 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:03.625897 25966 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:03.626794 26448 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:03.636479 26430 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:03.666921 26430 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:03.667869 26430 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:03.660612 26376 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:03.671310 26376 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:03.661960 26429 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:03.639375 26275 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.674351 26275 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:03.665968 26452 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:03.640971 26474 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:03.676983 26474 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:03.644356 26438 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:03.681502 26448 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:03.688030 26448 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:03.692652 26455 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:03.693818 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:03.659245 23851 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:03.634370 25823 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:03.662817 23892 connection.cc:256] RPC call timeout handler was delayed by -1.0408348630001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260709 12:21:03.662884 24560 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:21:03.663477 23893 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:03.682340 26429 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:03.628507 26485 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:03.602573 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 505) took 1439 ms. Trace:
I20260709 12:21:03.720793 24561 rpcz_store.cc:276] 0709 12:21:02.163232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.828189 (+664957us) service_pool.cc:224] Handling call
0709 12:21:02.970306 (+142117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:02.970505 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:02.994300 (+ 23795us) log.cc:844] Serialized 14 byte log entry
0709 12:21:03.341379 (+347079us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b18003fcee0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a 00007fa287456a2a
0709 12:21:03.578948 (+237569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:03.579000 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:03.579047 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.579111 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.598889 (+ 19778us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54004e3750. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:03.602501 (+  3612us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23592,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":75,"raft.queue_time_us":80,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6178,"spinlock_wait_cycles":447570176,"thread_start_us":237324,"threads_started":1,"wal-append.queue_time_us":671260}
I20260709 12:21:03.722824 25848 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:03.723246 25848 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.723583 25848 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:03.718750 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 55353.3us
I20260709 12:21:03.728715 23893 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:03.697438 23848 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:03.719859 23895 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:03.719924 23892 connection.cc:256] RPC call timeout handler was delayed by -1.0178637840001556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 12:21:03.733902 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:03.734418 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:03.734884 23926 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:03.735154 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:03.734436 26393 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:03.735697 26393 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:03.735811 23925 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:03.736121 26393 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:03.736728 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:03.737838 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:03.738409 23924 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:03.729952 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:03.743194 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:03.743522 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:03.744716 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:03.678601 26452 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:03.697978 26456 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:03.742530 23893 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:03.764173 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:03.769788 23924 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:03.776057 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:03.725515 26275 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:03.776944 23924 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:03.779460 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:03.791945 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 200315us
I20260709 12:21:03.699599 26455 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:03.745767 26429 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:03.665699 26301 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:03.746275 26338 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:03.794863 23892 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:03.794625 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:03.812611 24560 raft_consensus.cc:2410] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:03.695587 26437 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:03.763703 26456 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.834580 26498 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:03.835566 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:03.838619 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 216989us
I20260709 12:21:03.840721 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:03.842944 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 1925) took 1171 ms. Trace:
I20260709 12:21:03.736137 25966 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:03.848017 24561 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:03.850502 24560 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:03.805554 26429 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:03.808318 26338 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:03.843029 26456 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:03.852583 24562 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:03.857497 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 277515us
I20260709 12:21:03.842096 26294 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:03.860191 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 117707us
I20260709 12:21:03.860983 23850 raft_consensus.cc:2368] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4.
I20260709 12:21:03.845842 26455 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:03.843842 26498 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:03.843645 23923 rpcz_store.cc:276] 0709 12:21:02.671825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.756692 (+ 84867us) service_pool.cc:224] Handling call
0709 12:21:02.757080 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:02.757492 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:02.757522 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:02.758159 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 12:21:02.944279 (+186120us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:03.605351 (+661072us) log.cc:844] Serialized 14 byte log entry
0709 12:21:03.842484 (+237133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.842593 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:03.842653 (+    60us) raft_consensus.cc:1685] finished
0709 12:21:03.842674 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.842861 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17447,"prepare.queue_time_us":670477,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":19712,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"thread_start_us":1038614,"threads_started":3,"wal-append.queue_time_us":967856}
W20260709 12:21:03.862818 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 68080us
I20260709 12:21:03.865124 23893 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:03.882522 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:03.884147 23892 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:03.884763 24563 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:03.883541 23817 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:03.846920 26506 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:03.892856 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:03.891521 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:03.856698 26429 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:03.897662 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:03.858826 26338 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:03.863539 26498 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:03.906786 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:03.907488 23999 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:03.909951 23997 raft_consensus.cc:2393] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:03.911402 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:03.912127 23999 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:03.913203 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:03.913323 26438 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:03.913895 23998 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
W20260709 12:21:03.914812 26496 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:03.916082 24558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 542) took 1400 ms. Trace:
I20260709 12:21:03.916167 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1625) took 1120 ms. Trace:
I20260709 12:21:03.916613 23850 rpcz_store.cc:276] 0709 12:21:02.795471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.985355 (+189884us) service_pool.cc:224] Handling call
0709 12:21:03.915975 (+930620us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400403654. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:03.916108 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647136000}
I20260709 12:21:03.916479 24558 rpcz_store.cc:276] 0709 12:21:02.515815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.839516 (+323701us) service_pool.cc:224] Handling call
0709 12:21:02.926694 (+ 87178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:02.942554 (+ 15860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:02.942606 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:02.971098 (+ 28492us) log.cc:844] Serialized 26 byte log entry
0709 12:21:03.637400 (+666302us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:03.638111 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.638176 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:03.915883 (+277707us) raft_consensus.cc:1685] finished
0709 12:21:03.915905 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.916027 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15282,"raft.queue_time_us":15408,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":18707,"thread_start_us":373600,"threads_started":1,"wal-append.queue_time_us":767245}
I20260709 12:21:03.918182 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:03.918886 24004 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:03.919847 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:03.923877 23818 leader_election.cc:400] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8.
I20260709 12:21:03.924312 23818 leader_election.cc:403] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:21:03.907307 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:03.928637 24562 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:03.929088 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:03.911461 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:03.932668 23997 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:03.902297 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:03.934651 23893 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:03.935632 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:03.936482 23999 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:03.941568 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:03.892872 26485 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:03.942219 24002 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:03.942700 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:03.944541 23999 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:21:03.945667 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:03.946775 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:03.918895 26491 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 12:21:03.946727 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 44504.4us
W20260709 12:21:03.946367 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60178.1us
I20260709 12:21:03.974285 23996 raft_consensus.cc:2410] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:21:03.960819 23997 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:03.977039 23817 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:03.951968 23893 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:03.900818 26452 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:03.885680 26394 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:21:03.892266 26356 consensus_queue.cc:1059] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:21:03.988360 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:04.013274 24563 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
W20260709 12:21:03.999734 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 57111.3us
I20260709 12:21:03.899471 26507 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:04.001456 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:03.945330 26447 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.997911 23895 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:04.015789 26430 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:03.948343 26481 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:04.016404 23892 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:03.951186 26506 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:03.931627 26446 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:21:03.946884 26485 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:04.025357 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 407107us
I20260709 12:21:04.035837 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:04.028429 24555 raft_consensus.cc:2368] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4.
I20260709 12:21:03.974027 26284 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:21:04.025242 26452 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:04.029111 26430 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.051508 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:04.032058 26506 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:04.049925 26448 consensus_queue.cc:1059] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:21:04.037966 26485 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:04.029322 26499 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:04.085487 26430 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:04.094040 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 79221.8us
I20260709 12:21:04.094648 26526 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:04.095458 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 66587.7us
W20260709 12:21:04.094537 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 78238us
I20260709 12:21:04.097988 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:04.051879 26452 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.117692 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:04.120816 23892 leader_election.cc:400] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6.
I20260709 12:21:04.086001 24002 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
W20260709 12:21:04.126868 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 70264.4us
I20260709 12:21:04.129432 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:04.130434 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:04.072981 26506 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:04.091415 26387 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.067663 26514 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:04.069674 26301 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.070034 25966 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:04.072717 26437 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.133590 26387 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.092242 26455 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:04.036864 26447 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.031755 26504 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
W20260709 12:21:04.138864 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 186983us
I20260709 12:21:04.087461 26275 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.136620 23892 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:04.092736 26499 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:04.140370 24525 leader_election.cc:336] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.707s (SENT)
W20260709 12:21:04.142458 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 106639us
I20260709 12:21:04.030555 26294 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.126595 26452 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:04.126430 26356 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:04.131644 26226 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:04.071434 25848 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.155079 23893 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:04.157554 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59690.4us
I20260709 12:21:04.157734 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:04.073589 26474 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.139250 26514 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.149354 26488 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:04.148093 26507 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:04.180544 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:04.185513 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1589) took 1437 ms. Trace:
I20260709 12:21:04.189000 24555 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:04.139693 26519 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:21:04.173203 25966 raft_consensus.cc:2764] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:04.159050 26499 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:04.171648 26356 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:04.186138 23921 rpcz_store.cc:276] 0709 12:21:02.748453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.068324 (+319871us) service_pool.cc:224] Handling call
0709 12:21:03.068713 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:03.069161 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.069200 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:03.262819 (+193619us) log.cc:844] Serialized 26 byte log entry
0709 12:21:03.602320 (+339501us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:03.950609 (+348289us) log.cc:844] Serialized 14 byte log entry
0709 12:21:04.185082 (+234473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.185186 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.185248 (+    62us) raft_consensus.cc:1685] finished
0709 12:21:04.185267 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.185438 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23035,"prepare.queue_time_us":12656,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":85398,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":41848,"thread_start_us":823556,"threads_started":3,"wal-append.queue_time_us":344253}
I20260709 12:21:04.203629 26334 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:21:04.170925 26226 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:04.177668 26514 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:04.177541 26438 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:04.184172 26515 raft_consensus.cc:2764] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:21:04.223161 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:04.223862 26500 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:21:04.180707 26517 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:04.223923 24557 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:04.214103 26356 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:04.208833 26455 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:04.226722 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:04.260336 26508 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:21:04.260596 26226 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:04.239955 26376 consensus_meta.cc:287] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.006s
I20260709 12:21:04.224189 26447 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:04.271708 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 45077.8us
W20260709 12:21:04.279408 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 96616.7us
I20260709 12:21:04.272188 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:04.271881 24525 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.839s (SENT)
W20260709 12:21:04.274175 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 101391us
W20260709 12:21:04.262657 26518 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:04.188256 26488 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.223989 26531 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:21:04.210453 26505 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:21:04.279487 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:04.302740 23818 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:04.280617 24561 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
W20260709 12:21:04.284868 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 148365us
I20260709 12:21:04.270789 26526 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:04.309149 26226 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:04.311147 26455 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.313329 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1634) took 1503 ms. Trace:
I20260709 12:21:04.267831 26522 raft_consensus.cc:2764] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:21:04.324340 23854 rpcz_store.cc:276] 0709 12:21:02.809941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.608948 (+799007us) service_pool.cc:224] Handling call
0709 12:21:03.609268 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:03.996539 (+387271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.996595 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:04.015351 (+ 18756us) log.cc:844] Serialized 26 byte log entry
0709 12:21:04.108484 (+ 93133us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:04.108524 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.108606 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.313046 (+204440us) raft_consensus.cc:1685] finished
0709 12:21:04.313067 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.313247 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2299,"raft.queue_time_us":2590,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":477211,"threads_started":2,"wal-append.queue_time_us":136309}
I20260709 12:21:04.272825 26530 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:04.332343 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 177382us
I20260709 12:21:04.315613 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:04.315335 26511 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:21:04.302740 26447 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:04.342813 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:04.283838 26529 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:04.346899 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 66593.1us
I20260709 12:21:04.283859 26376 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.352278 26474 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:04.352816 26284 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:04.353654 23892 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:04.356019 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 53401.8us
W20260709 12:21:04.342311 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 62913.2us
I20260709 12:21:04.276988 26516 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 12:21:04.374645 24524 leader_election.cc:336] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.814s (SENT)
I20260709 12:21:04.338411 26233 raft_consensus.cc:3055] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:04.354527 23893 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:04.378616 23818 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:04.381101 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:04.347911 26447 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.349727 26526 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:04.384510 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:04.385133 24559 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:04.356505 26531 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:04.355916 26529 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:04.398518 24525 leader_election.cc:336] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.965s (SENT)
I20260709 12:21:04.357786 26530 raft_consensus.cc:697] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:04.404496 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.404731 24525 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:04.414278 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.415000 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.416783 24002 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:04.339274 26498 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.419823 23850 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:04.420982 26522 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:04.421082 26523 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:04.428647 26512 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.287s	user 0.002s	sys 0.000s
I20260709 12:21:04.429369 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.429689 26532 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:04.381935 26233 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:04.401374 26531 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.428534 26523 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:04.404292 26283 consensus_meta.cc:287] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.762s	user 0.013s	sys 0.008s
I20260709 12:21:04.401736 26447 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:04.428453 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:04.439428 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.490806 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.491294 24002 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:04.425200 26522 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.450819 26477 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:04.450389 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 71876.3us
I20260709 12:21:04.501104 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.455547 26376 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:04.426700 26284 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:04.456068 26393 consensus_meta.cc:287] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.000s
W20260709 12:21:04.458925 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 60456.4us
I20260709 12:21:04.483865 26523 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:04.422640 25848 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.494329 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.501915 23995 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:04.514600 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.515586 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.502684 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.503046 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.517920 23854 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:04.503508 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.504307 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.519053 23997 raft_consensus.cc:2376] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 6. Re-sending same reply.
I20260709 12:21:04.430938 26526 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:04.449630 26516 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:04.409729 26529 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:04.507881 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 124878us
I20260709 12:21:04.349229 26507 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.462400 26531 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:04.407310 24524 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.845s (SENT)
I20260709 12:21:04.513016 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.519162 23996 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:04.505245 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.532361 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.532689 24001 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:04.521060 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.523249 23995 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 3: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:04.523463 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.514585 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.525326 24002 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:04.535351 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.490258 26283 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.541677 23818 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:04.527218 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.496061 26522 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:04.544461 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 137202us
I20260709 12:21:04.530295 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:04.544922 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.526355 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.508801 26474 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:21:04.541945 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.542960 24000 raft_consensus.cc:2393] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:04.524628 23893 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:04.544972 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.545262 23854 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:04.533105 23999 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
W20260709 12:21:04.536857 26429 consensus_meta.cc:287] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.000s
W20260709 12:21:04.546784 24525 leader_election.cc:336] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.113s (SENT)
W20260709 12:21:04.545792 24524 leader_election.cc:336] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.920s (SENT)
I20260709 12:21:04.522809 26516 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:04.543737 24557 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:04.562851 23920 raft_consensus.cc:2368] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7.
W20260709 12:21:04.563009 24525 leader_election.cc:336] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.797s (SENT)
I20260709 12:21:04.553833 23996 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:04.554886 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.568918 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.569702 23996 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:04.557951 24002 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:04.570493 23854 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:21:04.570741 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.571235 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.571547 23996 raft_consensus.cc:2393] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:04.516321 26393 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.569674 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.580132 26547 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.580775 26547 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:04.581444 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 56909.1us
I20260709 12:21:04.583640 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:04.584012 26539 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:04.584383 23921 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:04.584522 26539 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:04.543051 26284 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:04.591151 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.556171 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.591832 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.555183 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.594175 23996 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:04.594755 23998 raft_consensus.cc:2410] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:21:04.595077 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.565425 26275 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:04.559324 26338 consensus_meta.cc:287] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.003s
I20260709 12:21:04.596951 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:04.574672 25823 consensus_meta.cc:287] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.827s	user 0.012s	sys 0.000s
I20260709 12:21:04.586261 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:04.587275 24000 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:21:04.595732 23996 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:04.592689 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.601593 23997 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:21:04.596406 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:04.597293 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:04.563222 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:04.598672 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:04.566892 26516 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:04.606006 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.606671 23921 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:04.606786 23998 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:04.604579 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.605741 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:04.594455 26488 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:04.607488 23927 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:04.604938 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:04.571848 24002 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:04.524274 26233 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.564321 26429 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.622895 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:04.625125 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.597030 26275 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:04.618269 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.638857 23998 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: [7.4-8.5]
I20260709 12:21:04.630740 23997 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
W20260709 12:21:04.635933 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 252222us
W20260709 12:21:04.640020 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 94244.1us
I20260709 12:21:04.640288 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:04.642264 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 100724us
I20260709 12:21:04.614807 26543 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:04.632041 26477 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:04.615387 26334 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:04.646879 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:04.646801 24524 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:04.601223 26338 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.605227 25823 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.656173 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.649621 26284 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:04.650529 26302 consensus_meta.cc:287] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.975s	user 0.015s	sys 0.000s
I20260709 12:21:04.644678 26275 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:04.534729 26530 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.672638 26543 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:04.673273 26393 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:04.674055 26393 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:04.673718 26543 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.678494 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.670044 26302 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.681090 23851 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:04.695700 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 48948.7us
I20260709 12:21:04.697178 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:04.694166 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.699177 23996 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:04.693732 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53539.6us
I20260709 12:21:04.701134 23892 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:04.670295 26294 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:04.600694 26526 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.714102 23893 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:04.723667 23818 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:04.725857 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.660133 26334 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.729972 24000 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:04.727766 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:04.733045 23818 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:04.688395 26283 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.741375 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.693663 26547 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:04.710172 26294 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.748370 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.752115 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.730134 26536 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:04.754174 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.699695 26447 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.755884 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.740898 26551 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:04.759917 24000 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:04.760710 23996 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:04.744609 26533 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:04.764580 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 67517.9us
I20260709 12:21:04.766196 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.751670 26294 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:04.756935 26485 consensus_meta.cc:287] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.628s	user 0.015s	sys 0.007s
I20260709 12:21:04.746392 26552 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:04.753327 26283 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:04.694386 26539 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.774204 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.746711 26211 consensus_queue.cc:1059] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:21:04.763659 26551 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:04.786041 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 72058.1us
I20260709 12:21:04.768566 26533 raft_consensus.cc:697] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:04.784456 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.789515 23996 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:04.790329 26456 consensus_meta.cc:287] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.898s	user 0.008s	sys 0.004s
W20260709 12:21:04.791608 26506 consensus_meta.cc:287] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.660s	user 0.000s	sys 0.011s
I20260709 12:21:04.771799 26302 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:04.800834 26429 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:04.801467 26560 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:04.808817 24000 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:04.778649 26338 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:04.814625 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 113785us
I20260709 12:21:04.785135 26552 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:04.813225 26560 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.818498 26560 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:04.811264 26456 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.820930 26456 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.811419 26506 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.821797 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.821560 26533 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:04.822624 23999 raft_consensus.cc:2393] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:04.823431 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.823625 26506 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.824786 23999 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:04.828583 26523 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:04.829977 26430 consensus_meta.cc:287] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.727s	user 0.021s	sys 0.007s
I20260709 12:21:04.830447 26430 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.831487 23922 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:04.787747 26551 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:04.836001 23927 raft_consensus.cc:2410] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:21:04.813125 26554 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:21:04.847899 26334 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:04.848404 26481 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.813s	user 0.012s	sys 0.000s
I20260709 12:21:04.848863 26481 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8.
W20260709 12:21:04.851634 26452 consensus_meta.cc:287] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.669s	user 0.019s	sys 0.004s
I20260709 12:21:04.852316 26550 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:04.852670 26514 consensus_meta.cc:287] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.015s
I20260709 12:21:04.852912 26550 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.853130 26514 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.805797 26275 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:04.854100 26545 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:21:04.825697 26561 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:04.855132 26550 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:04.855953 26226 consensus_meta.cc:287] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.524s	user 0.013s	sys 0.003s
I20260709 12:21:04.856851 26447 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:04.857832 26283 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:04.858039 26523 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.774832 26485 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.846237 25823 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.778092 26474 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:21:04.838930 23892 leader_election.cc:400] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4.
I20260709 12:21:04.847463 26552 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.845223 23927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:21:04.869692 23927 raft_consensus.cc:606] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:04.860487 23925 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:04.868518 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.894802 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:04.949527 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:04.912379 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:04.887805 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 138737us
W20260709 12:21:04.952792 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 114081us
I20260709 12:21:04.952687 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.848778 26522 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.955554 23996 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:04.919963 23925 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
W20260709 12:21:04.948798 24524 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.773s (SENT) [suppressed 33 similar messages]
I20260709 12:21:04.956090 23854 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:04.860466 26452 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:04.957049 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.958547 26452 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.954710 24558 raft_consensus.cc:2410] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:21:04.960919 23923 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:04.958647 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.855945 26275 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.963680 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.964349 23996 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:04.968667 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:04.945408 26499 consensus_meta.cc:287] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.000s
I20260709 12:21:04.855135 26430 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.962636 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.989743 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.991436 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:04.992179 24000 raft_consensus.cc:2393] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:04.977895 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:04.981766 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.982512 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.993110 23852 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:04.989074 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.994055 23848 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:21:04.994424 26566 consensus_queue.cc:1059] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:04.995399 26566 raft_consensus.cc:3055] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:04.995738 26566 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:04.996356 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:04.996384 23854 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:04.945060 26485 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:04.999070 24525 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:05.001788 23847 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:04.998687 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.000423 24004 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:05.008368 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:05.011225 23966 connection.cc:256] RPC call timeout handler was delayed by -3.5948069749999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 12:21:05.012179 23966 connection.cc:256] RPC call timeout handler was delayed by -3.5903069749999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 12:21:05.012677 23966 connection.cc:256] RPC call timeout handler was delayed by -3.5786069749999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 12:21:05.013602 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.014917 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.018471 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.019196 23999 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.019886 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:05.020426 23996 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:05.022138 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.022727 24000 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:05.013088 23966 connection.cc:256] RPC call timeout handler was delayed by -3.5615069749999293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 12:21:05.023692 23966 connection.cc:256] RPC call timeout handler was delayed by -3.5264069749998725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 12:21:05.024142 23966 connection.cc:256] RPC call timeout handler was delayed by -3.5219069749998653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 12:21:05.024550 23966 connection.cc:256] RPC call timeout handler was delayed by -3.4895069749998129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 12:21:05.024932 23966 connection.cc:256] RPC call timeout handler was delayed by -3.4418069749999631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 12:21:05.025333 23966 connection.cc:256] RPC call timeout handler was delayed by -3.4193069749999268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 12:21:05.025714 23966 connection.cc:256] RPC call timeout handler was delayed by -3.2969069749999562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 12:21:05.006963 26376 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:05.027053 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:05.006680 26526 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:04.996296 26499 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:05.028322 23966 connection.cc:256] RPC call timeout handler was delayed by -3.1988069749997976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 12:21:05.028972 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:05.032979 23966 connection.cc:256] RPC call timeout handler was delayed by -3.167306974999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 12:21:05.033372 23966 connection.cc:256] RPC call timeout handler was delayed by -3.1295069749999129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 12:21:05.033547 23966 connection.cc:256] RPC call timeout handler was delayed by -3.1034069749998707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 12:21:05.033702 23966 connection.cc:256] RPC call timeout handler was delayed by -3.0908069749998504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 12:21:05.033854 23966 connection.cc:256] RPC call timeout handler was delayed by -2.9864069749999089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 12:21:05.034108 23966 connection.cc:256] RPC call timeout handler was delayed by -1.124306974999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4254s for a response
I20260709 12:21:05.034474 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:05.036197 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.036442 24557 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:05.046618 26447 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:05.046903 26565 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:21:05.047112 26447 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:05.047593 26447 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.037261 26561 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:05.031453 26566 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:05.050576 26566 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.051083 26514 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:05.072628 23850 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:05.059098 24000 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:05.037016 26526 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:05.086201 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.091300 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:05.119468 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 66639.8us
I20260709 12:21:05.121279 23966 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.100181 23854 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:21:05.119117 23998 raft_consensus.cc:2393] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:05.122498 23996 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:05.073324 23999 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:05.124125 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.124562 23818 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:05.126291 26515 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:05.127455 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.084568 26499 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:05.130616 26570 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:05.131264 26570 raft_consensus.cc:697] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:05.131484 25966 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:05.132081 25966 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:05.132225 26570 consensus_queue.cc:237] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.133124 25966 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.081791 26567 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.140439 26567 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.143103 26567 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:05.095115 26522 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:05.127736 26529 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.594s	user 0.005s	sys 0.004s
I20260709 12:21:05.144181 26529 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.146528 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.146873 23924 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:05.147881 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.148415 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.149288 23924 raft_consensus.cc:2410] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:05.149258 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.150390 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.151614 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.152349 23924 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:05.135929 26356 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.856s	user 0.026s	sys 0.002s
W20260709 12:21:05.097787 26528 log.cc:927] Time spent T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.983s	user 0.008s	sys 0.000s
I20260709 12:21:05.153579 26356 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.089368 26516 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.154804 24001 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:05.138190 26531 consensus_meta.cc:287] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.590s	user 0.003s	sys 0.008s
I20260709 12:21:05.166199 26531 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.167431 23995 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:05.138278 26551 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.153993 26527 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:05.169051 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.169399 26527 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:05.169417 24001 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:05.170266 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.138851 26560 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:05.170555 26527 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:05.156184 23846 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:05.176178 26527 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:05.176306 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.177157 23928 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:05.146565 26529 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:05.089061 26526 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:05.146054 26294 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.161259 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:05.153115 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.163555 26516 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:05.236234 24003 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
W20260709 12:21:05.164762 23920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1591) took 2350 ms (client timeout 1928 ms). Trace:
W20260709 12:21:05.173192 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 49145.9us
I20260709 12:21:05.175652 26462 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:05.178597 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.181787 23818 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:05.248142 23924 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:05.206651 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:05.193607 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.163679 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.246971 23966 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.248708 24003 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
W20260709 12:21:05.245532 23920 rpcz_store.cc:269] 0709 12:21:02.814278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.848870 (+ 34592us) service_pool.cc:224] Handling call
0709 12:21:05.164522 (+2315652us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400329e54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:05.164659 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3939047296}
W20260709 12:21:05.249899 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.248837 23998 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:05.248756 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 67043.5us
I20260709 12:21:05.253497 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.178577 26531 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:05.268510 23966 leader_election.cc:400] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5.
I20260709 12:21:05.179453 26551 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:05.271443 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.272140 23920 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:05.268469 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.177826 26560 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:05.269030 23818 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:05.269865 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.287226 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:05.288218 26531 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:05.287241 23920 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:05.291349 23893 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:05.294127 23998 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:05.181145 26356 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:05.284744 26521 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:05.285848 26233 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:05.298368 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 299798us
I20260709 12:21:05.298554 23928 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:05.299847 23921 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:05.300547 26455 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:05.267778 26515 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:05.307989 23969 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:05.308480 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.352399 24001 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:05.353804 26572 consensus_queue.cc:1059] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:21:05.300810 26529 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:21:05.301584 26478 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:05.301374 26550 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:05.365864 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.367511 26550 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:05.385833 26550 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.391830 23920 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:05.355293 26455 raft_consensus.cc:697] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:05.356714 26527 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:05.355242 26521 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:05.401454 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:05.412652 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 107224us
I20260709 12:21:05.402472 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.366118 26478 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.420748 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.469359 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:05.470837 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49947.5us
I20260709 12:21:05.470893 24524 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.384750 26560 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:05.474280 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.473621 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:05.472376 26546 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.022s	sys 0.051s
I20260709 12:21:05.480314 23921 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:05.387982 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:05.370455 26456 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 12:21:05.407667 26527 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:05.491989 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 69512.4us
I20260709 12:21:05.494995 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.468900 26478 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:05.489231 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:05.507613 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.508504 24001 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:05.484210 26546 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.023s	sys 0.051s
I20260709 12:21:05.519706 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1623) took 2725 ms. Trace:
W20260709 12:21:05.520849 24524 leader_election.cc:336] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.113s (SENT)
I20260709 12:21:05.539209 24524 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:05.549046 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.553110 24001 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:05.526166 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.495499 26442 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:05.529417 26455 consensus_queue.cc:237] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.505949 26527 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:05.520279 23849 rpcz_store.cc:276] 0709 12:21:02.794781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.602914 (+808133us) service_pool.cc:224] Handling call
0709 12:21:03.603197 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.610334 (+  7137us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:03.884512 (+274178us) log.cc:844] Serialized 14 byte log entry
0709 12:21:04.099058 (+214546us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:04.099122 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:04.099194 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:05.519451 (+1420257us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b5400403154. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:05.519504 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:05.519635 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2459,"prepare.queue_time_us":418535,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":9649,"raft.queue_time_us":8948,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":15932160,"thread_start_us":481846,"threads_started":3,"wal-append.queue_time_us":126904,"wal-append.run_cpu_time_us":8678,"wal-append.run_wall_time_us":1341165}
W20260709 12:21:05.566216 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 279040us
I20260709 12:21:05.521483 26506 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:05.512046 26338 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.474478 26584 consensus_queue.cc:1059] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.100s
W20260709 12:21:05.568389 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 260514us
I20260709 12:21:05.568481 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.552567 23820 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:05.483554 26485 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:05.569482 26481 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:05.569392 26485 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.569864 23969 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:05.570263 26356 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:05.570719 26515 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:05.571343 26356 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:05.571605 26485 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:05.560580 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:05.572122 26356 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:05.554960 23928 raft_consensus.cc:2393] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:05.572549 26356 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:05.572901 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.573201 26356 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:05.573338 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.573627 24001 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:05.542490 26560 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:05.543272 26294 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:05.574586 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:05.543970 26514 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:05.568018 26583 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:21:05.585590 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.586989 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.587459 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.588188 24001 raft_consensus.cc:2393] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:05.538462 26521 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:05.593412 26582 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:21:05.576866 26506 raft_consensus.cc:697] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:05.596554 24001 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:21:05.600461 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.601346 26586 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:21:05.606694 24524 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:05.587977 26514 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.610680 26514 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:05.615104 26447 consensus_meta.cc:287] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.567s	user 0.015s	sys 0.000s
I20260709 12:21:05.615700 26477 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:05.615571 26447 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.586627 26515 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:05.617058 26515 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:05.617535 26515 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.591485 26356 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:05.619248 23996 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:21:05.619633 23996 pending_rounds.cc:85] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 2
I20260709 12:21:05.619848 23996 pending_rounds.cc:107] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:21:05.619915 23999 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:05.620074 23996 raft_consensus.cc:2889] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.620572 26538 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:05.622769 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1597) took 1046 ms. Trace:
I20260709 12:21:05.622926 23999 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:05.623229 23922 rpcz_store.cc:276] 0709 12:21:04.576401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.576512 (+   111us) service_pool.cc:224] Handling call
0709 12:21:04.596613 (+ 20101us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:04.831872 (+235259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:05.622528 (+790656us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540039ab54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:05.622710 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539632896}
I20260709 12:21:05.624403 23999 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:05.624651 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.627274 26302 raft_consensus.cc:3055] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:05.627715 26302 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:05.628144 26550 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.628516 26302 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.630550 26506 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:05.575605 26338 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:05.634258 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.635965 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.636857 23928 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:05.637723 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.640358 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:05.638857 23853 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:05.637349 23851 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:05.643011 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:05.638146 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.644965 23845 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.645541 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.646535 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.657588 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.658150 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.661518 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.662374 23851 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:05.657289 26356 raft_consensus.cc:2764] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:21:05.642264 26588 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:05.636250 26478 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.665123 26550 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:05.617703 26447 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:05.666630 26478 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:05.636861 26527 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:05.629781 26302 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.657588 26452 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:05.670157 26452 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.670523 26452 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.673281 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.674401 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.675334 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.621249 26538 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:05.664233 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.675860 23926 raft_consensus.cc:2376] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5. Re-sending same reply.
I20260709 12:21:05.676214 23853 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:05.679487 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.671751 26527 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:05.684614 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.684966 24004 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:05.686261 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.686847 24004 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:05.688763 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 259) took 1128 ms. Trace:
I20260709 12:21:05.689118 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1606) took 1090 ms. Trace:
I20260709 12:21:05.636689 26338 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:05.703521 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:05.695845 23927 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:05.702600 24555 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:05.708950 24558 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 2.
I20260709 12:21:05.701592 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:05.709301 23996 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:05.709712 24561 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.700925 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.711149 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.704449 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:05.703430 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.704156 23998 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:05.689592 23923 rpcz_store.cc:276] 0709 12:21:04.599254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.641350 (+ 42096us) service_pool.cc:224] Handling call
0709 12:21:04.645915 (+  4565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:04.961403 (+315488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:05.688900 (+727497us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54003755d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:05.689061 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723916544}
I20260709 12:21:05.707279 24562 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:21:05.686390 23922 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:05.712510 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.721148 23852 raft_consensus.cc:2368] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7.
I20260709 12:21:05.722002 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.722564 23852 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:05.701040 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:05.723425 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.724478 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.724578 26539 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:05.725476 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.713495 24562 pending_rounds.cc:85] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 5
I20260709 12:21:05.726212 24562 pending_rounds.cc:107] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:21:05.726445 24562 raft_consensus.cc:2889] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.726997 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.727753 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.728133 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.728780 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.729133 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.731025 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:05.731781 24555 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
W20260709 12:21:05.733913 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.735438 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.735843 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:05.736600 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.737000 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.737275 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.736685 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.737848 23851 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:05.738770 23926 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:21:05.740978 23921 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:05.741380 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.742195 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.743046 23927 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:05.743677 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:05.744352 24557 raft_consensus.cc:2368] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4.
I20260709 12:21:05.745675 24559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 629) took 2164 ms. Trace:
I20260709 12:21:05.746121 24559 rpcz_store.cc:276] 0709 12:21:03.581376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.582111 (+   735us) service_pool.cc:224] Handling call
0709 12:21:03.611617 (+ 29506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:04.388206 (+776589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:05.745452 (+1357246us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54005a46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:05.745615 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778449792}
I20260709 12:21:05.748381 26514 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:05.729764 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.750352 23895 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:05.751299 23926 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:05.714113 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.754882 26497 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:05.755582 23848 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:05.754204 23924 raft_consensus.cc:2393] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:05.756776 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:05.756966 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:05.757090 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:05.757715 26497 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:05.712352 23845 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:05.758917 24524 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.737500 23846 raft_consensus.cc:2393] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:05.759915 23845 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.760560 23846 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:21:05.760923 23846 pending_rounds.cc:85] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 2
I20260709 12:21:05.761121 23846 pending_rounds.cc:107] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:21:05.717028 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:05.758155 26497 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:05.763082 26497 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:05.764249 26566 raft_consensus.cc:3055] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:05.764681 26566 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:05.765229 23847 raft_consensus.cc:2410] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:21:05.699621 26538 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:05.689206 24002 rpcz_store.cc:276] 0709 12:21:04.560105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.650253 (+ 90148us) service_pool.cc:224] Handling call
0709 12:21:04.650664 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:04.668108 (+ 17444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:04.668138 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:04.680142 (+ 12004us) log.cc:844] Serialized 26 byte log entry
0709 12:21:04.945575 (+265433us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:04.947174 (+  1599us) log.cc:844] Serialized 14 byte log entry
0709 12:21:04.947987 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.948082 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:05.686672 (+738590us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b18001388e0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:05.688462 (+  1790us) raft_consensus.cc:1685] finished
0709 12:21:05.688565 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:05.688703 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1725,"prepare.queue_time_us":886,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":6776,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":36282,"spinlock_wait_cycles":16629504,"thread_start_us":206995,"threads_started":1,"wal-append.queue_time_us":286077}
I20260709 12:21:05.765815 26566 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:05.761394 26576 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.758s	user 0.000s	sys 0.002s
I20260709 12:21:05.758134 23852 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:05.717272 24558 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.780916 26514 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:05.781805 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1601) took 1194 ms. Trace:
I20260709 12:21:05.781031 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1544) took 1265 ms. Trace:
I20260709 12:21:05.761323 23846 raft_consensus.cc:2889] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.782199 23925 rpcz_store.cc:276] 0709 12:21:04.587568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.593070 (+  5502us) service_pool.cc:224] Handling call
0709 12:21:05.781629 (+1188559us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540039b054. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:05.781746 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543388928}
I20260709 12:21:05.782198 23895 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:05.768563 24561 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:05.714498 23853 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
W20260709 12:21:05.784533 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.786147 23820 leader_election.cc:400] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4.
I20260709 12:21:05.786481 23820 leader_election.cc:403] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:21:05.789122 23852 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:05.650451 26578 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:05.761281 23845 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:05.790318 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:05.792807 24524 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:05.818760 23851 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:05.794878 23854 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:21:05.782469 23995 rpcz_store.cc:276] 0709 12:21:04.515207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.541685 (+ 26478us) service_pool.cc:224] Handling call
0709 12:21:05.780812 (+1239127us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54001d2c54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:05.780967 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422732672}
I20260709 12:21:05.816821 24004 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:05.714244 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:05.821955 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 116108us
I20260709 12:21:05.823176 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.781596 26514 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:05.825839 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 43762.2us
I20260709 12:21:05.827412 24524 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.769697 26566 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:05.830816 26477 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:05.829587 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:05.859392 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.862800 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.862876 23895 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:05.865356 24002 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:05.840870 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.839571 23846 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:05.866514 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:05.831051 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:05.832221 23853 raft_consensus.cc:1240] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:05.852039 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.868785 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.831372 26544 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:05.873013 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:05.816056 26584 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:05.864163 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:05.883854 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:05.950425 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 86321.3us
I20260709 12:21:05.951193 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.952696 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:05.955199 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:05.974406 26233 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:05.975013 26233 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.975394 26233 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:05.977020 23852 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:05.978068 26356 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:05.978574 23852 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.979080 26356 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:05.979519 26356 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:05.979918 26356 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:05.984103 26452 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.985219 26233 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.985728 24525 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:05.989403 24525 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.828776 26531 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:05.922302 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:05.991180 24561 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 9: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:05.922623 26552 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:05.923616 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:06.005791 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 82286.8us
W20260709 12:21:05.924412 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 51414.2us
I20260709 12:21:05.921314 26515 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:05.845112 26538 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:05.832037 26560 consensus_queue.cc:1059] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:21:06.010502 26510 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:06.016355 26522 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.016983 26522 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.017584 26515 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:06.019598 26522 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:06.005040 26584 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:05.931902 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 102398us
W20260709 12:21:05.932796 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 146769us
I20260709 12:21:05.933310 26578 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:05.831377 26498 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:05.884675 26505 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.884116 26456 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:05.871268 26462 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:06.054039 23854 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.867400 25848 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:21:05.872181 26497 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:05.935141 26516 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4.
I20260709 12:21:05.872272 26529 consensus_queue.cc:1059] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:21:05.870162 26442 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:05.872628 26455 consensus_queue.cc:1059] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:21:05.866920 26527 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:05.946254 23920 raft_consensus.cc:3055] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:05.947212 26580 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:05.947450 26448 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:05.831686 26514 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:05.947249 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 78522.1us
I20260709 12:21:06.232982 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.986419 24558 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.831432 26477 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:05.992336 24525 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:05.880893 23921 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:06.011250 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:06.013612 23850 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:06.014729 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.004522 26550 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:06.005306 26552 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.227388 26580 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:06.247920 26477 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.248765 26580 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:06.250569 26550 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:06.251665 26550 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.254827 23817 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.255564 26539 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:06.258400 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:06.258762 26570 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:06.245513 26552 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:06.259828 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:06.260008 26570 consensus_queue.cc:1059] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:06.260938 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:06.261137 26570 consensus_queue.cc:1059] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:06.262081 26448 raft_consensus.cc:3055] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:06.257577 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.262657 26448 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:06.195746 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 137946us
I20260709 12:21:06.263507 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.263561 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:06.264495 23853 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 9: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:06.264782 26275 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:06.265069 26533 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:06.245023 26462 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.272244 23817 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.273173 26570 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:06.263566 26448 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.059598 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:06.276441 23854 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:06.192735 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:06.218267 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.191985 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:06.047008 26584 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:06.054275 26560 raft_consensus.cc:3055] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:21:06.226496 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 363740us
I20260709 12:21:06.226366 23920 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:06.063541 26474 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.180s
W20260709 12:21:06.218817 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.237766 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 245582us
I20260709 12:21:06.299167 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:06.044875 26506 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.176s
I20260709 12:21:06.058329 26578 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:06.238793 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 224160us
I20260709 12:21:06.305155 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.262108 26536 raft_consensus.cc:3055] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:06.246513 26456 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:06.063999 26572 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 12:21:06.056890 26505 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.219049 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:06.319033 23852 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:06.282971 23849 raft_consensus.cc:2393] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:06.282863 24002 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:06.321133 24002 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:06.284829 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:06.322330 23995 raft_consensus.cc:2393] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 4: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:06.287652 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:06.323796 23998 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:06.325055 23998 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:06.289678 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:06.292934 23920 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.303175 24525 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.275161 26448 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:06.308475 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.280930 23817 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.292271 26560 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:06.309351 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:06.335254 23999 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:06.314934 24555 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:06.336470 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 55619.4us
I20260709 12:21:06.338451 23920 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:06.342831 26602 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:06.342929 26456 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.343915 26284 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:06.344655 26284 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.354487 26452 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:06.355459 26578 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.358497 26560 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.360016 26560 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:06.313333 26498 raft_consensus.cc:3055] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:06.362330 26498 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:06.363222 26498 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.364454 26498 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.327983 26517 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:06.307025 26584 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:06.366257 26584 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:06.366551 23893 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:06.366647 26584 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:06.368355 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1714) took 1074 ms. Trace:
I20260709 12:21:06.369009 26505 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:06.370342 26233 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:06.305222 26570 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:21:06.371659 26552 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.333977 23995 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:06.373456 26521 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:06.307379 26536 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:06.374151 24557 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:06.374629 26536 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:06.282024 26302 consensus_queue.cc:1175] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:06.375641 24562 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:21:06.376044 24562 pending_rounds.cc:85] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 5
I20260709 12:21:06.376094 26536 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:06.337563 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.376362 24562 pending_rounds.cc:107] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:21:06.385385 24562 raft_consensus.cc:2889] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:06.368789 24001 rpcz_store.cc:276] 0709 12:21:05.293735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.612684 (+318949us) service_pool.cc:224] Handling call
0709 12:21:05.612959 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:05.747777 (+134818us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:06.053070 (+305293us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.298588 (+245518us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.304159 (+  5571us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:06.304220 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:06.304287 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.361550 (+ 57263us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b180018b260. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:06.368110 (+  6560us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54001c7ad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:06.368165 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.368292 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17650,"prepare.queue_time_us":550466,"raft.queue_time_us":8932,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":6036,"spinlock_wait_cycles":330908160,"thread_start_us":531789,"threads_started":2}
I20260709 12:21:06.373301 24563 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:06.388144 23998 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:21:06.393780 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 56349.7us
I20260709 12:21:06.317843 26515 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:06.398458 26499 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:06.340049 26535 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:21:06.399636 26284 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:06.400604 26552 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:06.401228 25848 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:06.395059 23817 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:06.373351 26478 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:06.403162 26478 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:06.403786 26436 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:06.404340 26436 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:06.404436 26534 raft_consensus.cc:3055] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:06.404182 26478 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.404983 26534 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:06.405560 26478 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:06.405969 26338 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:06.406538 26538 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:06.407174 26517 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:06.407351 24524 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:06.405352 26436 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.429636 23751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59378 (request call id 140) took 8371 ms. Trace:
I20260709 12:21:06.353729 26462 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:06.382043 26590 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:06.418341 26534 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.455610 26539 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.465380 23998 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:06.468365 23893 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:06.420051 25848 raft_consensus.cc:697] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:06.410953 26356 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.458750 26602 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:06.476209 23893 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:06.439522 26552 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:21:06.462559 26284 raft_consensus.cc:3055] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:06.483431 24002 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:06.485069 23893 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:06.485921 23920 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:06.447978 23751 rpcz_store.cc:276] 0709 12:20:58.070406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.070568 (+   162us) service_pool.cc:224] Handling call
0709 12:21:06.429513 (+8358945us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:03.736493 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:03.737164 (+   671us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:03.737210 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:21:03.737228 (+    18us) tablet.cc:662] Decoding operations
0709 12:21:03.738322 (+  1094us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:03.738401 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:03.738427 (+    26us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:21:03.739074 (+   647us) tablet.cc:701] Row locks acquired
0709 12:21:03.739120 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:21:03.739292 (+   172us) write_op.cc:270] Start()
0709 12:21:03.739436 (+   144us) write_op.cc:276] Timestamp: P: 1783599663739232 usec, L: 0
0709 12:21:03.739462 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:21:03.793129 (+ 53667us) log.cc:844] Serialized 2434 byte log entry
0709 12:21:04.662727 (+869598us) op_driver.cc:464] REPLICATION: finished
0709 12:21:05.136737 (+474010us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa2843420ac 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa28ae82ef0
0709 12:21:05.510101 (+373364us) write_op.cc:301] APPLY: starting
0709 12:21:05.521801 (+ 11700us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:05.537118 (+ 15317us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:05.537172 (+    54us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:05.591137 (+ 53965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:05.599650 (+  8513us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:21:05.599703 (+    53us) write_op.cc:312] APPLY: finished
0709 12:21:05.600081 (+   378us) log.cc:844] Serialized 53 byte log entry
0709 12:21:05.860987 (+260906us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:05.871869 (+ 10882us) write_op.cc:454] Released schema lock
0709 12:21:05.937945 (+ 66076us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:05.938502 (+   557us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:05.938538 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":748960,"apply.run_cpu_time_us":15495,"apply.run_wall_time_us":452208,"num_ops":6,"prepare.queue_time_us":390459,"prepare.run_cpu_time_us":20209,"prepare.run_wall_time_us":194911,"raft.queue_time_us":174935,"raft.run_cpu_time_us":75831,"raft.run_wall_time_us":903655,"replication_time_us":894965,"spinlock_wait_cycles":4083072,"thread_start_us":1449428,"threads_started":5,"wal-append.queue_time_us":694666,"wal-append.run_cpu_time_us":18905,"wal-append.run_wall_time_us":1484700}]]}
I20260709 12:21:06.477733 26544 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:06.480863 26302 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:06.465309 26455 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:21:06.466730 26539 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.532970 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:06.542670 23999 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:06.480456 26504 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:21:06.494158 26534 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.489674 26284 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:06.516479 26552 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:06.517964 25848 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.474874 26543 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:21:06.474294 26580 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.475139 26529 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:21:06.477967 26510 consensus_queue.cc:1059] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:21:06.527846 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1554) took 1784 ms. Trace:
I20260709 12:21:06.592314 23997 rpcz_store.cc:276] 0709 12:21:04.743829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.827789 (+ 83960us) service_pool.cc:224] Handling call
0709 12:21:04.828071 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:04.828399 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:04.828425 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:05.604945 (+776520us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b2c0011d7e8. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa285d45a11 00007fa285d55372 00007fa287487a01 00007fa28744c43a 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2
0709 12:21:05.605434 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:21:05.817773 (+212339us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:06.309312 (+491539us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.527332 (+218020us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18003b05c0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa284361a40 00007fa28435c4e4 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287 00007fa287467208
0709 12:21:06.527534 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.527611 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.527652 (+    41us) raft_consensus.cc:1685] finished
0709 12:21:06.527664 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.527793 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87342,"prepare.queue_time_us":507709,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":3770,"raft.queue_time_us":225533,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":15848,"spinlock_wait_cycles":145018880,"thread_start_us":659643,"threads_started":2,"wal-append.queue_time_us":614422}
I20260709 12:21:06.527704 26584 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.597018 26584 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:06.493670 26517 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:06.513495 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:21:06.599594 24563 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:06.533178 26462 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.504937 26544 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.532593 26514 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.529755 26356 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:06.532742 26537 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:06.590421 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.599695 23920 raft_consensus.cc:606] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:21:06.532151 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:06.614022 23920 raft_consensus.cc:614] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:06.615445 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 604230us
I20260709 12:21:06.622608 23892 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:06.600695 26477 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.630898 24001 raft_consensus.cc:2393] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:06.603870 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 339392us
I20260709 12:21:06.586153 26539 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:06.632398 23892 leader_election.cc:400] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7.
I20260709 12:21:06.544811 26302 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.633026 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.577446 26338 consensus_queue.cc:1059] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:21:06.641691 23892 leader_election.cc:403] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:21:06.609477 26544 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:06.610387 26517 raft_consensus.cc:3055] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:06.613340 26537 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.693321 26514 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:06.694058 26514 raft_consensus.cc:3055] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:06.694408 26514 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:06.684115 26448 consensus_queue.cc:1059] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:21:06.695439 26448 raft_consensus.cc:3055] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:06.695245 26514 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.695842 26448 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:06.696497 26514 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.696723 26448 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.653081 26477 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.698149 26448 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:06.699119 26302 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:06.699263 26477 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:06.693357 26497 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:06.686717 26537 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:06.609870 26462 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:06.704216 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
W20260709 12:21:06.704464 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 72246.5us
I20260709 12:21:06.706295 23997 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:21:06.703909 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 364552us
I20260709 12:21:06.732404 23892 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:06.640565 26552 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:06.736377 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:06.737138 23998 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:06.663678 26539 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:06.728349 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 419914us
W20260709 12:21:06.735443 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.741894 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:06.743081 23966 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:06.743320 24558 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:06.744093 24557 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:06.640345 26510 consensus_queue.cc:1059] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:21:06.745433 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:06.661794 26517 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:06.752887 23892 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:06.731503 26536 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.725736 26566 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:06.663570 23818 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.705262 26504 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7.
I20260709 12:21:06.750145 26455 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:06.783974 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:06.769126 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:06.704731 26532 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:21:06.794716 23920 raft_consensus.cc:606] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:06.817528 23920 raft_consensus.cc:614] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:06.795158 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.816648 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:06.820344 23850 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:06.822216 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:06.822220 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:06.751577 26543 consensus_queue.cc:1059] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:21:06.772226 26580 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:06.768991 26356 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:06.793982 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 130515us
I20260709 12:21:06.765269 26572 consensus_queue.cc:1059] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:21:06.794755 26233 raft_consensus.cc:2764] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:21:06.837900 24559 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:21:06.841228 23997 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:06.842903 23995 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:21:06.835834 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.825855 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.794682 24554 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:06.846732 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:06.850033 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:06.851073 23997 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:06.824234 26578 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:06.825644 26522 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:06.780403 26602 raft_consensus.cc:697] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:06.891867 23996 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:06.893271 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:06.773102 26536 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:06.908987 26612 log.cc:927] Time spent T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:21:06.909361 26609 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:21:06.910781 26606 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:21:06.910979 26536 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:06.908990 26602 consensus_queue.cc:237] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.816864 26515 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:21:06.916636 26550 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:06.917076 26550 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:06.917936 26550 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.919404 26550 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.841053 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.900661 23995 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:06.826018 26477 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:06.922880 26477 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:06.925335 26477 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:06.830647 26504 consensus_queue.cc:1059] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:21:06.926066 26498 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:06.926791 26504 raft_consensus.cc:3055] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:06.927202 26504 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:06.927520 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:06.828006 26538 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:06.928228 23851 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:06.902364 23997 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
W20260709 12:21:06.934219 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 93229.8us
I20260709 12:21:06.921669 23850 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:06.960740 26430 raft_consensus.cc:3055] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:06.961378 26430 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:06.963791 24525 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.014s (SENT)
I20260709 12:21:06.965148 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:06.825440 26535 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:21:06.832474 26436 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 12:21:06.991490 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:06.995105 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 242323us
I20260709 12:21:06.996100 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:06.997150 26338 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:06.997481 23892 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:06.998003 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.987778 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:06.949486 26527 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:07.007994 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:07.026022 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 79014.4us
I20260709 12:21:07.019532 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:06.967325 26522 consensus_queue.cc:1059] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:21:07.049521 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:06.992065 26233 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:07.016784 26533 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.015409 26578 raft_consensus.cc:697] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:07.058302 23921 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:07.017575 26615 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:07.066265 23925 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:21:07.066665 23925 pending_rounds.cc:85] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 5
I20260709 12:21:07.066984 23925 pending_rounds.cc:107] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:21:07.062629 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:07.065678 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:07.067246 23925 raft_consensus.cc:2889] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:07.067951 23922 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:07.017161 26514 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:07.069504 23929 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:06.976537 26544 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.083069 23924 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:07.002672 26590 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 12:21:07.137295 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 51207.1us
I20260709 12:21:07.138707 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:07.028628 26338 consensus_queue.cc:1059] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:21:07.019876 26527 consensus_queue.cc:1059] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:21:07.019711 26515 consensus_queue.cc:1059] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:21:07.018989 26536 consensus_queue.cc:1059] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:21:07.060374 26552 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:07.167373 23850 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:07.169369 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:07.170315 23854 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:07.085157 26550 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:07.184047 23849 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:07.185966 26485 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.186486 26611 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:07.066731 26539 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:21:07.156910 26498 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.142051 25848 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 12:21:07.190588 26616 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:21:07.200559 26514 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:07.264081 23927 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:21:07.175697 26455 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:21:07.203230 26578 consensus_queue.cc:237] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:07.205305 26623 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:21:07.206569 26625 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:21:07.215032 26618 log.cc:927] Time spent T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:21:07.218341 23851 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:07.227687 23892 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:07.231129 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 144459us
I20260709 12:21:07.277624 23817 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:07.277851 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 50301.4us
W20260709 12:21:07.234826 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 92809.2us
I20260709 12:21:07.003750 26504 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:07.059653 26567 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 12:21:07.073567 26534 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 12:21:07.070856 26521 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 12:21:07.152500 26462 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:07.187919 23845 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:07.292713 23848 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:07.050354 26430 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.060953 26533 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.070379 26233 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:07.271534 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:07.273792 23853 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:21:07.301134 23853 pending_rounds.cc:85] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 4
I20260709 12:21:07.301407 23853 pending_rounds.cc:107] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:21:07.142566 26474 consensus_queue.cc:1059] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 12:21:07.301688 23853 raft_consensus.cc:2889] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:07.232204 26535 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.286242 23846 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:21:07.186010 26621 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:21:07.294974 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:07.163163 26630 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 12:21:07.309088 23849 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:07.265412 26610 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:07.285516 26552 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:07.250669 26485 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:07.286324 26436 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:21:07.354080 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:07.193745 26284 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:07.355391 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 335898us
I20260709 12:21:07.356012 26284 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:07.358047 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.359728 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:07.293577 26510 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:21:07.281023 26514 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:07.369043 26506 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:07.369859 26506 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:07.256161 26611 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.372442 24560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 645) took 1507 ms. Trace:
I20260709 12:21:07.379913 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:07.368083 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:07.312507 25848 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:21:07.375998 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:07.378824 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:07.331979 26552 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:07.381032 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:07.398121 23853 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:07.394897 23997 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:07.399513 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:07.362869 26504 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:07.391228 24560 rpcz_store.cc:276] 0709 12:21:05.864932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.865077 (+   145us) service_pool.cc:224] Handling call
0709 12:21:05.865353 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:06.279921 (+414568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:06.279951 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:06.301812 (+ 21861us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.723653 (+421841us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:06.723710 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.723831 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:07.372223 (+648392us) raft_consensus.cc:1685] finished
0709 12:21:07.372245 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:07.372377 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1212,"raft.queue_time_us":6608,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":62529,"thread_start_us":728275,"threads_started":2,"wal-append.queue_time_us":612780}
I20260709 12:21:07.382252 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:07.334784 26455 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 12:21:07.403259 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 49296.3us
I20260709 12:21:07.396708 24003 raft_consensus.cc:2376] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4. Re-sending same reply.
I20260709 12:21:07.364966 26527 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.410172 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:07.412370 24003 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:21:07.412930 24003 pending_rounds.cc:85] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 5
I20260709 12:21:07.413218 24003 pending_rounds.cc:107] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:21:07.413519 24003 raft_consensus.cc:2889] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:07.413915 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:07.393286 26566 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:07.361357 26543 consensus_queue.cc:1175] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "22996f888daf435398b693481171c18c" responder_term: 9 status { last_received { term: 7 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:07.426206 23853 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
W20260709 12:21:07.419368 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 114928us
I20260709 12:21:07.311683 26535 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.397747 26552 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:07.447803 24525 leader_election.cc:336] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.684s (SENT)
I20260709 12:21:07.417906 23854 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:07.402658 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 651) took 1030 ms. Trace:
I20260709 12:21:07.493287 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:07.497938 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:07.422689 26553 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:07.499271 26553 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:07.500214 26553 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.501116 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1723) took 1220 ms. Trace:
I20260709 12:21:07.392972 26452 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:21:07.502120 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 55773.8us
I20260709 12:21:07.333611 26610 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:07.521853 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:21:07.523974 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 76214.4us
I20260709 12:21:07.501542 24000 rpcz_store.cc:276] 0709 12:21:06.280865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.285518 (+  4653us) service_pool.cc:224] Handling call
0709 12:21:06.308709 (+ 23191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:06.312670 (+  3961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:06.312704 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:06.341785 (+ 29081us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.659073 (+317288us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b18002a9880. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec0d1 00007fa287407a0f
0709 12:21:06.939363 (+280290us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:06.939425 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.939522 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:07.500793 (+561271us) raft_consensus.cc:1685] finished
0709 12:21:07.500815 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:07.501042 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3470,"raft.queue_time_us":3598,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":18027,"spinlock_wait_cycles":14026496,"thread_start_us":279608,"threads_started":1,"wal-append.queue_time_us":1133774}
W20260709 12:21:07.447834 26627 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 12:21:07.501521 26553 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:07.515775 26638 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:21:07.429769 26630 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:21:07.524287 26633 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.288s	user 0.001s	sys 0.001s
I20260709 12:21:07.527110 24003 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:07.524397 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:07.416473 26527 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.490150 26632 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:21:07.501514 26631 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 12:21:07.540264 26626 log.cc:927] Time spent T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:21:07.504153 26643 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.415187 26566 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:07.564406 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 284704us
I20260709 12:21:07.517724 23847 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:07.530526 26620 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:07.577396 23854 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:07.577239 23997 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:07.578788 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:07.546514 26628 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.280s	user 0.000s	sys 0.003s
I20260709 12:21:07.548413 26515 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:07.575114 26580 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:07.589673 24562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 654) took 1082 ms. Trace:
I20260709 12:21:07.594482 24562 rpcz_store.cc:276] 0709 12:21:06.507455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.507620 (+   165us) service_pool.cc:224] Handling call
0709 12:21:06.507994 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:06.756879 (+248885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:06.756931 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:06.757518 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.983443 (+225925us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:06.983501 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.983635 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:07.589442 (+605807us) raft_consensus.cc:1685] finished
0709 12:21:07.589467 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:07.589619 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73749,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":473831,"threads_started":2,"wal-append.queue_time_us":336989}
I20260709 12:21:07.592183 24560 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:07.580277 26544 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:07.582244 26620 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:07.540728 26649 consensus_queue.cc:1059] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:21:07.600028 26514 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:07.600464 26641 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:21:07.606465 23854 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:07.595322 26515 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:07.611922 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 86829.6us
I20260709 12:21:07.615422 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:07.619798 26233 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:07.605844 26646 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:07.620520 26646 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:07.620901 26646 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:07.620940 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:07.621711 24562 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:07.622014 26622 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:21:07.623349 26537 consensus_meta.cc:287] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.921s	user 0.007s	sys 0.004s
I20260709 12:21:07.623799 26537 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:07.625049 23926 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:21:07.629921 26610 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:07.583583 26643 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:07.631942 26652 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:07.632238 26643 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:07.632615 26652 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:07.603490 26620 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:07.633491 26652 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.636410 26535 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:07.637286 26611 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:07.639369 26527 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:07.641062 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:07.641602 23854 raft_consensus.cc:1240] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:07.619552 26656 consensus_queue.cc:1059] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:07.642765 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:07.643536 26619 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:07.495285 24556 rpcz_store.cc:276] 0709 12:21:06.372530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.376680 (+  4150us) service_pool.cc:224] Handling call
0709 12:21:06.377059 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:06.377489 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:06.377520 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:06.378117 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.803728 (+425611us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:06.816235 (+ 12507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.828921 (+ 12686us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:07.372604 (+543683us) raft_consensus.cc:1685] finished
0709 12:21:07.389264 (+ 16660us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:07.398878 (+  9614us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1192,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10898,"thread_start_us":392171,"threads_started":1,"wal-append.queue_time_us":675167}
I20260709 12:21:07.644400 26619 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:07.646193 26442 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:07.646847 26608 raft_consensus.cc:3055] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:07.647303 26608 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:07.648125 26608 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:07.649185 26608 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:07.598227 26533 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:07.654119 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1736) took 1065 ms. Trace:
I20260709 12:21:07.654845 23999 rpcz_store.cc:276] 0709 12:21:06.588390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.588568 (+   178us) service_pool.cc:224] Handling call
0709 12:21:06.588931 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:06.589322 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:06.589352 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:06.589897 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.791318 (+201421us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:06.791363 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.791430 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:07.653757 (+862327us) raft_consensus.cc:1685] finished
0709 12:21:07.653790 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:07.654020 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2560,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":5650,"thread_start_us":201022,"threads_started":1,"wal-append.queue_time_us":676607}
I20260709 12:21:07.613427 26485 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:07.601408 26580 raft_consensus.cc:697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:07.660622 23969 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:07.640645 26635 log.cc:927] Time spent T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:21:07.618860 26515 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:07.681958 26338 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:07.682660 26338 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:07.688328 26448 consensus_meta.cc:287] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.989s	user 0.013s	sys 0.000s
I20260709 12:21:07.672659 26233 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:07.701843 26233 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:07.702399 26233 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:07.705685 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45224 (request call id 13) took 1001 ms. Trace:
I20260709 12:21:07.683800 26338 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.706305 23920 rpcz_store.cc:276] 0709 12:21:06.703955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.704092 (+   137us) service_pool.cc:224] Handling call
0709 12:21:07.705439 (+1001347us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b540039b054. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa287446853 00007fa28c41460a 00007fa28599a7d4 00007fa28599a762 00007fa28599a691 00007fa28599a60c 00007fa2859998c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:07.705593 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145700224}
I20260709 12:21:07.707361 26338 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:07.707935 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:07.708946 23920 raft_consensus.cc:2368] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6.
I20260709 12:21:07.711179 26462 raft_consensus.cc:3055] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:07.711764 26462 raft_consensus.cc:740] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:07.712019 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 653) took 1238 ms. Trace:
I20260709 12:21:07.715312 26656 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.713603 26580 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:07.715812 26656 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.718693 26640 raft_consensus.cc:3055] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:21:07.718999 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.719126 26640 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:07.719797 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.719961 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:07.721333 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:07.722129 24563 raft_consensus.cc:2393] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:07.712427 24555 rpcz_store.cc:276] 0709 12:21:06.473933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.474166 (+   233us) service_pool.cc:224] Handling call
0709 12:21:06.487683 (+ 13517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:06.759453 (+271770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:06.759483 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:06.770308 (+ 10825us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.033258 (+262950us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:07.033297 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.033363 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:07.711812 (+678449us) raft_consensus.cc:1685] finished
0709 12:21:07.711831 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:07.711960 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5078,"raft.queue_time_us":58426,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":7089,"thread_start_us":470849,"threads_started":2,"wal-append.queue_time_us":620407}
I20260709 12:21:07.724594 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:07.719980 26640 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.725945 26640 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.727449 26656 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:07.728477 23747 catalog_manager.cc:5697] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 3 to 6, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 6 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.730652 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:07.731315 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:07.739204 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 329371us
I20260709 12:21:07.741446 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:07.748004 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:07.748824 23920 raft_consensus.cc:2393] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:07.712945 26462 consensus_queue.cc:260] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.749670 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:07.751421 23920 raft_consensus.cc:2393] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:07.751766 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 141553us
I20260709 12:21:07.752231 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:07.753165 23920 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:07.755982 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 112726us
I20260709 12:21:07.756973 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:07.756884 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:07.757695 23927 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:07.758718 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:07.759145 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:07.764844 23998 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:07.741554 23747 catalog_manager.cc:5697] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 5, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 5 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.767937 23747 catalog_manager.cc:5697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 4 to 6, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 6 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:07.771325 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 176599us
W20260709 12:21:07.772409 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.773178 23998 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:21:07.773519 24562 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:07.772181 23818 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:07.770391 23747 catalog_manager.cc:5697] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 4, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 4 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:07.783385 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:07.783612 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:07.762018 26619 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.765079 26602 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:07.789615 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:07.789623 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:07.790961 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:07.767025 26462 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.791996 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:07.766292 26570 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.792028 23998 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:07.794797 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:07.795666 23924 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:21:07.796562 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 135060us
I20260709 12:21:07.798779 23851 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 7 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:07.798971 23920 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:07.799619 23845 raft_consensus.cc:2393] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 3: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:07.803515 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:07.804322 23924 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:07.805028 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:07.808913 26620 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:07.810088 26651 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:07.810959 26552 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:07.812192 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.812865 23927 raft_consensus.cc:2393] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:07.777998 26537 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:07.767387 26284 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:21:07.815243 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:07.899259 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:07.919448 24002 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:07.929435 23999 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:07.933441 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:07.799818 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:07.816969 23747 catalog_manager.cc:5697] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 3 to 4, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 4 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:21:07.855181 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 83066.8us
I20260709 12:21:07.936113 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:07.936872 23920 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:07.939190 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:07.939589 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 143503us
I20260709 12:21:07.962852 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:07.891330 26527 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:07.977468 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:07.811995 26570 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:07.947597 23747 catalog_manager.cc:5697] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c reported cstate change: term changed from 3 to 4, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 4 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:21:07.966548 26498 consensus_meta.cc:287] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.000s
I20260709 12:21:07.990187 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:07.988759 23924 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:07.992856 23924 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:07.994714 23924 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:21:07.990386 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.010084 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:08.010888 23920 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:08.018394 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:08.020373 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:08.022246 24000 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:07.931494 26656 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:08.025521 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 62767.1us
I20260709 12:21:08.026916 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:08.026934 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.792372 26619 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:08.032703 23848 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:08.053036 24525 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:08.058557 23998 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:08.013713 26474 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.013178 26498 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:08.082930 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 303961us
I20260709 12:21:08.083570 23747 catalog_manager.cc:5697] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 2 to 3, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 3 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:08.090021 23747 catalog_manager.cc:5697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:08.092602 23747 catalog_manager.cc:5697] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 3, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:08.033670 26578 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.034502 26659 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:08.025226 26602 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:08.106506 23925 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:08.030328 26527 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:08.114338 23747 catalog_manager.cc:5697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 5, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 5 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:08.116297 23747 catalog_manager.cc:5697] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 4, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 4 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:08.070389 26608 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:08.125830 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1636) took 1076 ms. Trace:
I20260709 12:21:07.981135 26660 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 12:21:08.126284 23926 rpcz_store.cc:276] 0709 12:21:07.049422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.050828 (+  1406us) service_pool.cc:224] Handling call
0709 12:21:07.065827 (+ 14999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.625511 (+559684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.125553 (+500042us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54003cee54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:08.125750 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285637632}
I20260709 12:21:08.037509 26656 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:08.159265 23928 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:08.128549 23747 catalog_manager.cc:5697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:08.096765 26474 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:08.122865 26662 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:08.182629 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 147754us
I20260709 12:21:08.149726 26552 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:08.085351 26646 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:08.231932 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 179016us
I20260709 12:21:08.150065 26527 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:08.213995 23747 catalog_manager.cc:5697] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:08.108244 26578 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:08.247174 26663 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:08.220118 26553 consensus_meta.cc:287] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.000s
I20260709 12:21:08.172170 26671 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:08.347298 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:08.172168 26672 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.385685 23747 catalog_manager.cc:5697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:08.387025 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 284) took 1095 ms. Trace:
I20260709 12:21:08.393580 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:08.394081 23747 catalog_manager.cc:5697] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:08.212404 26662 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.173743 26661 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:08.394331 23926 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:08.407869 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 317745us
I20260709 12:21:08.393589 23924 rpcz_store.cc:276] 0709 12:21:07.291855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.996334 (+704479us) service_pool.cc:224] Handling call
0709 12:21:07.996740 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:07.997006 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:08.130898 (+133892us) log.cc:844] Serialized 14 byte log entry
0709 12:21:08.386249 (+255351us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:08.386366 (+   117us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:08.386448 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.386623 (+   175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.386894 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15170,"thread_start_us":345851,"threads_started":2}
I20260709 12:21:08.230120 26620 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:08.430491 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:08.260623 26302 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.431250 23924 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:08.418447 23920 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:21:08.453864 23920 pending_rounds.cc:85] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 4
I20260709 12:21:08.454180 23920 pending_rounds.cc:107] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:21:08.454450 23920 raft_consensus.cc:2889] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:08.416709 23747 catalog_manager.cc:5697] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c reported cstate change: term changed from 3 to 4, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 4 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:08.217046 26284 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.202s
I20260709 12:21:08.318171 26527 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.466220 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:08.520920 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 308193us
I20260709 12:21:08.525430 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:08.420475 26662 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:08.671002 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 149232us
W20260709 12:21:08.573338 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.671869 23817 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:08.668359 23921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.033s	sys 0.039s
W20260709 12:21:08.697222 23921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.034s	sys 0.040s
I20260709 12:21:08.733708 23747 catalog_manager.cc:5697] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:08.520026 26620 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:21:08.736639 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 64852.2us
I20260709 12:21:08.737789 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:08.469774 26302 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:08.459990 26671 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:08.744482 26676 log.cc:927] Time spent T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:21:08.746356 26671 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:08.669072 26643 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.751624 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1648) took 1230 ms. Trace:
I20260709 12:21:08.719798 26570 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:08.792868 26570 consensus_queue.cc:1059] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:08.723196 26590 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:08.776322 23921 rpcz_store.cc:276] 0709 12:21:07.521194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.124126 (+602932us) service_pool.cc:224] Handling call
0709 12:21:08.124452 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:08.149742 (+ 25290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:08.149776 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:08.150269 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:21:08.697794 (+547525us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:08.697840 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.697937 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:08.751318 (+ 53381us) raft_consensus.cc:1685] finished
0709 12:21:08.751350 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.751538 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55959,"raft.queue_time_us":222378,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":33984,"thread_start_us":547182,"threads_started":1,"wal-append.queue_time_us":598390}
I20260709 12:21:08.803086 26302 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:08.429838 26602 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:08.770154 26499 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:08.826691 26517 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:08.827565 26474 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:08.827965 26517 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:08.828675 26578 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:08.777109 26608 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:08.829540 26608 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.829967 26608 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:08.839315 23926 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:08.654531 26527 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:08.822696 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:08.845057 23921 raft_consensus.cc:2393] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:08.789471 26515 consensus_meta.cc:287] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.089s	user 0.011s	sys 0.000s
I20260709 12:21:08.777494 26619 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:08.875077 26648 raft_consensus.cc:3055] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:08.875780 26648 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:08.466512 26672 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:08.888233 26667 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.755s	user 0.001s	sys 0.000s
I20260709 12:21:08.888635 26668 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.138s
I20260709 12:21:08.778863 26683 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.170s
I20260709 12:21:08.811487 26620 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:08.788522 26643 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:08.915398 26669 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.920728 26656 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:08.921867 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1643) took 1867 ms. Trace:
I20260709 12:21:08.960201 23925 rpcz_store.cc:276] 0709 12:21:07.054144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.141822 (+ 87678us) service_pool.cc:224] Handling call
0709 12:21:07.182881 (+ 41059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.108020 (+925139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.921522 (+813502us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b540018a1d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:08.921781 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2123710848}
I20260709 12:21:08.923659 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1646) took 1403 ms. Trace:
I20260709 12:21:08.850631 26590 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:08.932896 26233 consensus_meta.cc:287] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.230s	user 0.006s	sys 0.006s
W20260709 12:21:08.935673 26338 consensus_meta.cc:287] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.228s	user 0.010s	sys 0.002s
W20260709 12:21:08.936668 26462 consensus_meta.cc:287] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.134s	user 0.014s	sys 0.000s
I20260709 12:21:08.866998 26515 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:08.961661 23920 rpcz_store.cc:276] 0709 12:21:07.520687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.013865 (+493178us) service_pool.cc:224] Handling call
0709 12:21:08.014129 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.465552 (+451423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.923341 (+457789us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54003746d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:08.923579 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928995072}
I20260709 12:21:08.918126 26615 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:08.884491 26619 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:08.966833 26640 consensus_meta.cc:287] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.236s	user 0.006s	sys 0.008s
I20260709 12:21:08.976503 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:09.014801 23925 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:08.977336 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:08.977630 26646 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:08.978078 26669 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:09.019279 23996 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:21:08.904661 26536 raft_consensus.cc:3055] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:09.016112 23923 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:09.031775 26681 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.977869 26643 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:08.978828 26620 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:09.032491 26681 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:09.039932 26674 log.cc:927] Time spent T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:21:09.007448 26615 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:08.980446 26233 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:08.876729 26648 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:09.168439 23922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.114s	sys 0.188s
W20260709 12:21:09.492699 23922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.127s	sys 0.243s
W20260709 12:21:09.240217 23995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.460s	user 0.064s	sys 0.088s
I20260709 12:21:09.017822 26572 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:09.497447 23995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.717s	user 0.075s	sys 0.118s
I20260709 12:21:09.055876 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1681) took 1280 ms. Trace:
I20260709 12:21:09.018117 26659 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:09.317162 23928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.004s	sys 0.008s
I20260709 12:21:09.496089 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:09.289011 23846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.349s	user 0.064s	sys 0.103s
W20260709 12:21:09.502868 23846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.563s	user 0.073s	sys 0.105s
I20260709 12:21:09.017606 26578 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:09.506726 23925 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:09.013909 26683 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:09.507994 23928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.007s	sys 0.008s
I20260709 12:21:09.499823 23853 rpcz_store.cc:276] 0709 12:21:07.775714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.776059 (+   345us) service_pool.cc:224] Handling call
0709 12:21:07.776334 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.793810 (+ 17476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.793843 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.798437 (+  4594us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.928062 (+129625us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:07.928132 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.928233 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:09.055566 (+1127333us) raft_consensus.cc:1685] finished
0709 12:21:09.055599 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.055783 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96428,"raft.queue_time_us":17206,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14419,"thread_start_us":129111,"threads_started":1,"wal-append.queue_time_us":251473}
I20260709 12:21:09.514887 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:09.515123 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:09.515965 23925 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:09.517182 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:09.518018 23921 raft_consensus.cc:2393] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:09.520188 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:09.505916 26643 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:09.524081 26643 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:09.030755 26536 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:09.554826 26662 consensus_meta.cc:287] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.822s	user 0.010s	sys 0.002s
I20260709 12:21:09.561347 26550 raft_consensus.cc:3055] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:09.039978 26521 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:09.034629 26462 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:09.222674 26682 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.324539 26692 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:09.045071 26590 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:09.216239 26672 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:09.029662 26619 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:09.584733 26515 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:09.594722 26550 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:09.606097 26521 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:09.532902 26578 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:09.608196 26658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.008s	sys 0.010s
I20260709 12:21:09.529163 26572 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:09.858831 26572 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:09.830555 26658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.364s	user 0.008s	sys 0.010s
I20260709 12:21:09.616221 26462 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.048990 26462 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:09.955580 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1679) took 2180 ms. Trace:
I20260709 12:21:10.050001 23852 rpcz_store.cc:276] 0709 12:21:07.775089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.777955 (+  2866us) service_pool.cc:224] Handling call
0709 12:21:07.793175 (+ 15220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.931503 (+138328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.931544 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.947459 (+ 15915us) log.cc:844] Serialized 26 byte log entry
0709 12:21:08.156249 (+208790us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:08.156304 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.156401 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:09.954457 (+1798056us) raft_consensus.cc:1685] finished
0709 12:21:09.954583 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.955198 (+   615us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180220,"raft.queue_time_us":146524,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":27611,"thread_start_us":166740,"threads_started":1,"wal-append.queue_time_us":254956}
W20260709 12:21:09.970157 23893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.509s	user 0.009s	sys 0.007s
W20260709 12:21:09.976395 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:10.053413 23893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.592s	user 0.014s	sys 0.007s
W20260709 12:21:10.053930 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:10.054072 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 1.5928e+06us
I20260709 12:21:09.976779 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1653) took 2252 ms. Trace:
W20260709 12:21:09.989843 23967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.025s	sys 0.008s
W20260709 12:21:09.989851 23968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.106s	user 0.064s	sys 0.219s
I20260709 12:21:10.057577 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:09.990964 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1742) took 2235 ms. Trace:
W20260709 12:21:10.058320 23967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.026s	sys 0.008s
W20260709 12:21:09.991631 23997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.071s	user 0.008s	sys 0.028s
W20260709 12:21:10.059937 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.058142 23928 rpcz_store.cc:276] 0709 12:21:07.724077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.220490 (+496413us) service_pool.cc:224] Handling call
0709 12:21:08.348505 (+128015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:08.385488 (+ 36983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:08.385533 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:08.425076 (+ 39543us) log.cc:844] Serialized 26 byte log entry
0709 12:21:09.509738 (+1084662us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:09.509804 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.509923 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:09.975981 (+466058us) raft_consensus.cc:1685] finished
0709 12:21:09.976048 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.976463 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36479,"raft.queue_time_us":116967,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":20794,"thread_start_us":1058922,"threads_started":1,"wal-append.queue_time_us":1444553}
W20260709 12:21:10.058420 23968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.064s	sys 0.220s
I20260709 12:21:10.060160 26462 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:10.024598 24525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.361s	user 0.012s	sys 0.024s
W20260709 12:21:10.061981 24525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.399s	user 0.012s	sys 0.025s
I20260709 12:21:10.062143 26462 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.043808 26233 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:09.954056 23818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.770s	user 0.008s	sys 0.011s
W20260709 12:21:10.064152 23818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.880s	user 0.008s	sys 0.012s
W20260709 12:21:10.064610 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 1.88086e+06us
W20260709 12:21:10.025256 24526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.340s	user 0.015s	sys 0.029s
W20260709 12:21:10.066152 24526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.381s	user 0.015s	sys 0.029s
W20260709 12:21:10.042167 25848 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.230s	user 0.015s	sys 0.024s
W20260709 12:21:10.067757 25848 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.256s	user 0.015s	sys 0.025s
I20260709 12:21:10.058673 23995 rpcz_store.cc:276] 0709 12:21:07.755325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.755866 (+   541us) service_pool.cc:224] Handling call
0709 12:21:07.756179 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.756539 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.756566 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.756998 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:21:09.498945 (+1741947us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:09.499007 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.499101 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:09.990287 (+491186us) raft_consensus.cc:1685] finished
0709 12:21:09.990324 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.990656 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":5295,"thread_start_us":1718207,"threads_started":1,"wal-append.queue_time_us":2137461}
W20260709 12:21:10.060240 23997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.140s	user 0.008s	sys 0.028s
I20260709 12:21:10.075520 26462 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.089380 26505 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.097388 26505 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.093413 26506 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.101167 26506 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.103801 26506 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.104578 26506 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.802380 26515 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:10.106778 26515 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.095082 26521 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.111479 26521 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:09.829658 26522 raft_consensus.cc:3055] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:10.114256 26522 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:10.116207 26522 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.119288 26505 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.120163 26515 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:10.121096 26515 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:10.121958 26515 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.124518 26515 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.125241 26515 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:10.132303 26515 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:10.140987 26580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.379s	user 0.028s	sys 0.034s
I20260709 12:21:10.105409 26506 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:09.829515 26536 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.137322 26538 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.142717 26538 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.144495 26578 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.137593 26543 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:10.145557 26543 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.146883 26538 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.147099 26506 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.147552 26538 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:10.147920 26602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.001s
W20260709 12:21:10.148454 26602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.007s	sys 0.001s
I20260709 12:21:10.148365 26538 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.149792 26602 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.150758 26602 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.151667 26538 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.152366 26538 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.625358 26590 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.153208 26538 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.153932 26590 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.157209 26590 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:10.139626 26550 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.159396 26550 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:10.131327 26505 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:10.141582 26580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.387s	user 0.028s	sys 0.034s
I20260709 12:21:10.148327 26543 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.169345 26543 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:09.831409 26608 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.001s	user 0.013s	sys 0.000s
I20260709 12:21:10.169613 26580 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:10.170461 26543 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.170775 26580 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.170835 26608 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:09.629509 26615 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.173534 26615 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.174343 26608 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:09.871310 26643 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.184531 26620 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.185564 26620 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.186949 26620 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.190272 26619 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.191174 26619 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:09.898996 26651 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.088s	user 0.080s	sys 0.116s
W20260709 12:21:10.192585 26651 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.381s	user 0.081s	sys 0.116s
I20260709 12:21:10.192180 26619 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.194365 26658 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:09.523077 26659 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.203269 26659 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:09.594229 26662 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.208935 26662 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:10.212997 26662 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:10.216764 26543 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.224651 26543 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:10.230352 26543 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:10.168993 26505 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:10.240051 26665 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 2.436s	user 0.008s	sys 0.013s
I20260709 12:21:10.240365 26442 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:10.219020 23892 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:10.138864 26462 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.242563 26462 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:10.235095 24527 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.271s	user 0.023s	sys 0.022s
W20260709 12:21:10.246335 24527 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.299s	user 0.023s	sys 0.023s
W20260709 12:21:10.247179 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:10.248607 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.248744 26462 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.221952 26515 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:10.238492 26620 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.238999 26619 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.255357 26619 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.256251 26619 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.257297 26510 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:10.239760 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.241228 26442 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.254554 26620 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:10.157227 26538 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.278875 26620 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.281534 26622 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:10.264822 26619 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:10.282558 26619 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:10.283701 26619 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.216220 26662 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:09.529395 26683 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:09.924399 26711 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:10.282449 26622 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.276434 26611 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:10.267236 26566 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:10.260012 26534 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:10.360651 26670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.460s	user 0.003s	sys 0.022s
W20260709 12:21:10.361407 26670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.557s	user 0.003s	sys 0.022s
I20260709 12:21:10.360745 26534 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.265308 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:10.323056 23892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.856s (SENT) [suppressed 16 similar messages]
I20260709 12:21:10.265349 26505 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.263299 26506 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.245736 26485 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.195458 26658 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:10.350420 26687 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.816s	user 0.000s	sys 0.002s
I20260709 12:21:09.628679 26692 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.352605 26681 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:10.353847 26675 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.858s	user 0.002s	sys 0.000s
W20260709 12:21:10.359591 26694 log.cc:927] Time spent T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.431s	user 0.000s	sys 0.000s
I20260709 12:21:10.337136 26662 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:10.374245 26514 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.404s	user 0.046s	sys 0.065s
I20260709 12:21:10.375813 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1684) took 2599 ms. Trace:
I20260709 12:21:10.278635 26510 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.354754 26711 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.379242 26620 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:10.385358 26514 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.447s	user 0.046s	sys 0.066s
I20260709 12:21:10.410657 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:10.410984 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1605) took 2393 ms. Trace:
I20260709 12:21:10.412194 26683 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.378333 23850 rpcz_store.cc:276] 0709 12:21:07.776535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.778339 (+  1804us) service_pool.cc:224] Handling call
0709 12:21:07.790598 (+ 12259us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:07.931149 (+140551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.931197 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:07.966033 (+ 34836us) log.cc:844] Serialized 52 byte log entry
0709 12:21:08.038401 (+ 72368us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:08.038461 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.038555 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:10.375251 (+2336696us) raft_consensus.cc:1685] finished
0709 12:21:10.375312 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:10.375577 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162169,"raft.queue_time_us":148530,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":14596,"thread_start_us":47739,"threads_started":1,"wal-append.queue_time_us":1333830}
I20260709 12:21:10.414485 24001 rpcz_store.cc:276] 0709 12:21:08.017421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.023436 (+  6015us) service_pool.cc:224] Handling call
0709 12:21:08.052532 (+ 29096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:08.070681 (+ 18149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:08.070730 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:08.094691 (+ 23961us) log.cc:844] Serialized 26 byte log entry
0709 12:21:08.408679 (+313988us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:08.408718 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.408792 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:10.410417 (+2001625us) raft_consensus.cc:1685] finished
0709 12:21:10.410462 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:10.410736 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":28285,"thread_start_us":253111,"threads_started":1,"wal-append.queue_time_us":1205895}
I20260709 12:21:10.418941 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:10.419536 26506 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.419901 23851 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:10.414593 23845 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:09.625567 26682 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.419028 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1683) took 2600 ms. Trace:
I20260709 12:21:10.428678 26534 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.432760 26510 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:10.442813 23966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.930s	user 0.059s	sys 0.101s
W20260709 12:21:10.446296 23966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.933s	user 0.059s	sys 0.101s
I20260709 12:21:10.434484 26622 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.422056 23846 rpcz_store.cc:276] 0709 12:21:07.776270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.776390 (+   120us) service_pool.cc:224] Handling call
0709 12:21:07.776681 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.801312 (+ 24631us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:07.801347 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.801854 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:21:09.504169 (+1702315us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:09.504206 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.504284 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:10.344364 (+840080us) raft_consensus.cc:1685] finished
0709 12:21:10.358792 (+ 14428us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:10.376930 (+ 18138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58117,"raft.queue_time_us":25506,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":77769,"thread_start_us":1563950,"threads_started":1,"wal-append.queue_time_us":2060493}
I20260709 12:21:10.423816 26485 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:10.459131 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:10.478991 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.485894 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1650) took 2914 ms. Trace:
I20260709 12:21:10.480876 26711 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:10.478683 26614 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.446537 23852 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 12:21:10.478864 23969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.007s	sys 0.015s
I20260709 12:21:10.482687 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 294) took 2583 ms. Trace:
W20260709 12:21:10.494022 23969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.007s	sys 0.015s
I20260709 12:21:10.479090 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:10.479259 24524 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.875s	user 0.031s	sys 0.044s
W20260709 12:21:10.495443 24524 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.907s	user 0.031s	sys 0.044s
W20260709 12:21:10.496137 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 1.90785e+06us
I20260709 12:21:10.494068 23997 rpcz_store.cc:276] 0709 12:21:07.899141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.899297 (+   156us) service_pool.cc:224] Handling call
0709 12:21:07.899722 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.919408 (+ 19686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.919456 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.920085 (+   629us) log.cc:844] Serialized 26 byte log entry
0709 12:21:10.070431 (+2150346us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:10.070543 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:10.070727 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:10.482406 (+411679us) raft_consensus.cc:1685] finished
0709 12:21:10.482431 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:10.482610 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19188,"raft.queue_time_us":30547,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":22690,"thread_start_us":2149728,"threads_started":1,"wal-append.queue_time_us":2556001}
I20260709 12:21:10.493052 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:10.493721 26614 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.470495 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:10.498063 26692 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.498312 23850 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:10.487429 26442 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.498849 26692 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:10.494976 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.495033 23849 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:10.493738 23852 pending_rounds.cc:85] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 3
I20260709 12:21:10.449589 26619 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.501212 23852 pending_rounds.cc:107] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:21:10.469856 23854 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:10.492420 26506 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:10.446352 26436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.213s	user 0.048s	sys 0.094s
I20260709 12:21:10.504524 23852 raft_consensus.cc:2889] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:10.472916 26658 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.478488 26682 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.502210 26692 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.492343 23922 rpcz_store.cc:276] 0709 12:21:07.555513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.124375 (+568862us) service_pool.cc:224] Handling call
0709 12:21:08.153829 (+ 29454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:08.234012 (+ 80183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:08.234056 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:08.234647 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:21:09.497760 (+1263113us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:09.497808 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.497905 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:10.442950 (+945045us) raft_consensus.cc:1685] finished
0709 12:21:10.446735 (+  3785us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:10.469774 (+ 23039us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79651,"raft.queue_time_us":304309,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":45008,"thread_start_us":1262739,"threads_started":1,"wal-append.queue_time_us":1678730}
I20260709 12:21:10.461750 26681 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.528246 23850 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:21:10.504884 26711 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:10.531710 26436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.302s	user 0.048s	sys 0.095s
I20260709 12:21:10.529371 26550 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:10.570158 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.577865 26710 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.578115 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:10.584898 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.590312 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:10.594926 23846 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:10.599913 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 276903us
I20260709 12:21:10.563621 26615 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:10.603973 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:10.604166 23818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.014s	sys 0.012s
I20260709 12:21:10.604897 23849 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:10.604835 23818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.014s	sys 0.013s
I20260709 12:21:10.563912 26515 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:10.578822 26710 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.611910 26658 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.612658 26658 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.613788 26710 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:10.614521 26529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.752s	user 0.009s	sys 0.021s
W20260709 12:21:10.614928 26529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.823s	user 0.009s	sys 0.021s
I20260709 12:21:10.618330 24560 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:10.619827 26550 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.554272 26681 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.624691 26550 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.627740 26462 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:10.632164 26643 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.635811 26590 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.638394 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:10.640594 23966 connection.cc:256] RPC call timeout handler was delayed by -1.744352998000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 12:21:10.662443 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.642494 23847 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:10.644688 26658 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.646672 26485 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.659888 26515 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.660607 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:10.663033 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:10.662638 23966 connection.cc:256] RPC call timeout handler was delayed by -1.6606529980001596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 12:21:10.668377 23966 connection.cc:256] RPC call timeout handler was delayed by -1.6201529980003215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 12:21:10.668804 23966 connection.cc:256] RPC call timeout handler was delayed by -1.6120529980003084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 12:21:10.669270 23966 connection.cc:256] RPC call timeout handler was delayed by -1.2274711899999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 12:21:10.669634 23966 connection.cc:256] RPC call timeout handler was delayed by -1.2274711899999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 12:21:10.670014 23966 connection.cc:256] RPC call timeout handler was delayed by -1.1026529980001669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 12:21:10.670336 23966 connection.cc:256] RPC call timeout handler was delayed by -1.059816874000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 12:21:10.670629 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0490168740002446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
I20260709 12:21:10.600003 25848 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.605072 26642 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:10.670794 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:10.667665 23999 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:10.674871 23851 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.674984 26462 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.676657 23846 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:10.677539 26462 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.604212 26711 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.680238 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:10.687567 23847 raft_consensus.cc:2393] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:10.688097 23892 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:10.688318 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:10.688628 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:10.689090 24563 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:10.691075 24561 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:10.691733 26580 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.692804 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:10.693665 24555 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:10.694240 26698 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.694625 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:10.694924 26698 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.695428 24560 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:10.622871 26615 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:10.686311 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 628983us
I20260709 12:21:10.685465 23849 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:10.704754 26718 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.698761 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:10.807195 24524 connection.cc:256] RPC call timeout handler was delayed by -1.7176139210000656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
I20260709 12:21:10.708648 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:10.872085 24524 connection.cc:256] RPC call timeout handler was delayed by -1.6395875570001408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
I20260709 12:21:10.821849 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:10.807058 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:10.826098 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:10.914851 24001 raft_consensus.cc:2410] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:21:10.815714 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:10.820847 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:10.924238 24000 raft_consensus.cc:2410] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:10.761795 26720 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.783352 26692 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.940742 23999 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:10.940858 26720 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.847815 26681 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.762180 26550 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.180s
I20260709 12:21:10.940614 24563 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:10.823036 26711 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.943403 26720 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:10.940126 23998 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:10.685567 26710 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:10.836493 26538 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:10.707495 26615 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:10.820611 26510 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.959929 26538 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.971936 26538 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:10.972644 26710 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.836433 26651 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.706770 26721 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:10.762813 26614 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:10.707664 26698 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:10.709942 26515 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:10.977556 26651 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:11.003446 26710 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:11.006956 26510 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:10.699470 26643 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.786566 26642 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:11.008924 26436 raft_consensus.cc:3055] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:21:11.010246 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.797550 26485 consensus_queue.cc:1059] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.164s
I20260709 12:21:10.779451 25848 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:10.705089 26590 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:11.014413 26610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.805s	user 0.011s	sys 0.025s
I20260709 12:21:10.950925 26718 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:11.022490 26728 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:11.021358 26610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.902s	user 0.012s	sys 0.026s
I20260709 12:21:11.026554 25848 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:11.026818 26642 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:11.019104 26436 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:11.034329 26663 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.035107 26567 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:11.035075 26663 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:11.035844 26567 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:11.038261 26567 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:11.026547 26651 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:11.027674 26669 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:11.044543 26643 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:11.044214 26718 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:11.031059 26728 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:11.050203 26590 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:11.050890 26663 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:11.055534 26728 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:11.062206 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:11.063902 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:11.065306 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:11.064174 23818 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:11.129856 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 65847.1us
I20260709 12:21:11.185829 26728 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:11.186686 26728 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.187261 26728 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:11.755777 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.756402 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.892968 26728 consensus_meta.cc:287] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.001s
I20260709 12:21:11.893661 26728 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:11.896847 26728 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:11.897614 26728 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.898259 26728 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:11.901033 26728 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:11.903148 26728 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:11.903302 26614 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.903998 26614 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:11.903882 26728 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:11.907137 26728 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:11.911617 26614 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:11.922246 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 1.3227e+06us
W20260709 12:21:11.928884 23817 connection.cc:256] RPC call timeout handler was delayed by -1.1335864499999388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260709 12:21:11.929381 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.932022 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:11.932674 23845 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:11.941689 23845 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:11.945664 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:10.821377 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:11.949489 23922 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:11.950163 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1655) took 1134 ms. Trace:
I20260709 12:21:11.950480 23922 rpcz_store.cc:276] 0709 12:21:10.816354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.820902 (+  4548us) service_pool.cc:224] Handling call
0709 12:21:11.950069 (+1129167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:11.951809 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:11.952380 26535 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:11.953367 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:11.955547 23922 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 2.
I20260709 12:21:11.956620 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:11.961143 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:11.961897 23922 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:11.961283 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:11.966096 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:11.966830 23922 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
W20260709 12:21:11.970280 24560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.014s	sys 0.003s
W20260709 12:21:11.970717 24560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.014s	sys 0.003s
I20260709 12:21:11.970791 23817 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:11.971539 24560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 672) took 1270 ms. Trace:
I20260709 12:21:11.972383 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:11.973554 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:11.974452 23922 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:11.977186 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:11.978055 23922 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:11.984658 23925 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:11.977315 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:11.988116 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2064) took 1342 ms. Trace:
I20260709 12:21:11.988171 23922 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:11.988684 23849 rpcz_store.cc:276] 0709 12:21:10.645601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.707805 (+ 62204us) service_pool.cc:224] Handling call
0709 12:21:11.988018 (+1280213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:11.990082 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:11.990358 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:11.991065 23922 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
W20260709 12:21:11.989517 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 1.20704e+06us
I20260709 12:21:11.993017 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:11.993474 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:11.991257 23925 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:11.994796 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:11.995407 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:11.996069 23849 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:11.997279 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:11.997860 23747 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.056s	user 0.030s	sys 0.030s
I20260709 12:21:11.998286 23849 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:11.998378 23747 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.057s	user 0.033s	sys 0.030s
I20260709 12:21:11.996165 23925 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:11.971938 24560 rpcz_store.cc:276] 0709 12:21:10.701611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.702004 (+   393us) service_pool.cc:224] Handling call
0709 12:21:10.710402 (+  8398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:10.761689 (+ 51287us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:10.917392 (+155703us) log.cc:844] Serialized 14 byte log entry
0709 12:21:11.971131 (+1053739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:11.971199 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:11.971252 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.971322 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:11.971452 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":182343,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":1145940,"threads_started":2,"wal-append.queue_time_us":75619}
I20260709 12:21:11.999421 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:12.043286 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:12.044425 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:12.045499 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:12.046085 23849 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:11.993005 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:12.010308 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:12.012678 24004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.244s	user 0.021s	sys 0.020s
I20260709 12:21:12.025841 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 667) took 1409 ms. Trace:
I20260709 12:21:12.030766 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:12.060614 24004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.024s	sys 0.020s
I20260709 12:21:12.010223 26745 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:12.062495 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:12.063448 23922 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:12.016789 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:12.000765 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:12.064989 23925 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:12.066066 26745 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.067001 26745 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.070153 23924 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:12.037015 26527 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:12.074841 26649 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:12.075536 26649 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.076205 26649 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:12.075634 23926 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:12.060716 24556 rpcz_store.cc:276] 0709 12:21:10.616348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.616967 (+   619us) service_pool.cc:224] Handling call
0709 12:21:11.980477 (+1363510us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:21:11.980713 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:11.981003 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:12.012097 (+ 31094us) log.cc:844] Serialized 14 byte log entry
0709 12:21:12.025303 (+ 13206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:12.025367 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:12.025432 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.025509 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.025655 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30450,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":6234,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":13729152,"thread_start_us":43077,"threads_started":3,"wal-append.queue_time_us":7079}
I20260709 12:21:12.020717 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1602) took 4004 ms. Trace:
W20260709 12:21:12.004313 26719 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 1.574s	user 0.011s	sys 0.015s
W20260709 12:21:12.107600 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 1.44108e+06us
I20260709 12:21:12.113011 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:12.104693 24002 rpcz_store.cc:276] 0709 12:21:08.016266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.023911 (+  7645us) service_pool.cc:224] Handling call
0709 12:21:12.019560 (+3995649us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:21:12.019890 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.020167 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:12.020200 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:12.020254 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:12.020293 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.020358 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.020515 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16137984}
I20260709 12:21:12.125479 26748 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:12.126148 26751 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:21:12.128441 23997 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.321s	user 0.025s	sys 0.085s
W20260709 12:21:12.128948 23997 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.323s	user 0.025s	sys 0.085s
I20260709 12:21:12.129030 26751 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:12.130728 23922 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:12.129559 26751 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:12.126174 26748 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:12.133242 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 123161us
I20260709 12:21:12.135040 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:12.135347 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:12.136034 23817 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:12.136101 26749 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:12.136687 26749 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.137130 26749 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.141026 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.141379 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:12.142143 24556 raft_consensus.cc:2410] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:12.143364 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 303) took 1632 ms. Trace:
I20260709 12:21:12.144549 26745 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.136109 23925 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:12.145257 26649 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.143833 23854 rpcz_store.cc:276] 0709 12:21:10.526113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.528189 (+  2076us) service_pool.cc:224] Handling call
0709 12:21:10.540052 (+ 11863us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.579065 (+ 39013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.579101 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:10.597076 (+ 17975us) log.cc:844] Serialized 26 byte log entry
0709 12:21:10.728076 (+131000us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:10.728151 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:10.728263 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:12.143121 (+1414858us) raft_consensus.cc:1685] finished
0709 12:21:12.143140 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.143276 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":201,"raft.queue_time_us":399,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":30352,"thread_start_us":130143,"threads_started":1,"wal-append.queue_time_us":378081,"wal-append.run_cpu_time_us":2075,"wal-append.run_wall_time_us":1029694}
W20260709 12:21:12.154502 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 1.35049e+06us
I20260709 12:21:12.150134 26647 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:12.155176 26647 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:12.155660 26647 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:12.157071 23929 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:21:12.157517 23929 pending_rounds.cc:85] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 3
I20260709 12:21:12.157753 23929 pending_rounds.cc:107] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:21:12.154698 26649 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:12.158039 23929 raft_consensus.cc:2889] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:12.158567 26649 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:12.159029 26649 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.159412 26649 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.150460 26745 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:12.161165 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:12.172205 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:12.173532 23925 raft_consensus.cc:2410] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:21:12.167838 26751 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.174541 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:12.178674 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.179091 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.179936 24556 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:12.182336 23925 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:12.187317 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.188670 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.189455 24562 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:21:12.181118 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.191847 24561 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:12.193311 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:12.146629 26748 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.194206 23925 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:12.195689 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:12.198235 23783 debug-util.cc:398] Leaking SignalData structure 0x7b08000369a0 after lost signal to thread 22701
W20260709 12:21:12.198741 23783 debug-util.cc:398] Leaking SignalData structure 0x7b08003923a0 after lost signal to thread 22704
I20260709 12:21:12.198686 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.199673 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.201467 24560 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:12.201736 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.208910 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.209563 24560 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:12.210374 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.210915 24560 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:12.211715 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:12.213348 23848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1685) took 4436 ms (client timeout 2219 ms). Trace:
I20260709 12:21:12.209559 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:12.213820 23848 rpcz_store.cc:269] 0709 12:21:07.776806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.778041 (+  1235us) service_pool.cc:224] Handling call
0709 12:21:12.213002 (+4434961us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54004286d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:12.213147 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555828480}
I20260709 12:21:12.214673 24556 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:12.215677 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.216902 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.220289 26747 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:12.226966 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.227449 23925 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:21:12.228540 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.228806 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1692) took 1972 ms. Trace:
I20260709 12:21:12.226261 24556 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:12.229456 24561 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:12.231961 26749 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.235169 26747 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:12.235785 26747 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.229223 23853 rpcz_store.cc:276] 0709 12:21:10.256685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.256847 (+   162us) service_pool.cc:224] Handling call
0709 12:21:10.257339 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.411882 (+154543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.411916 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:10.412537 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 12:21:10.603332 (+190795us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:10.603373 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.228297 (+1624924us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54004295d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:12.228343 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:12.228384 (+    41us) raft_consensus.cc:1685] finished
0709 12:21:12.228398 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.228636 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1374,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":223,"spinlock_wait_cycles":353975168,"thread_start_us":190293,"threads_started":1,"wal-append.queue_time_us":367184,"wal-append.run_cpu_time_us":2024,"wal-append.run_wall_time_us":1005855}
I20260709 12:21:12.239267 24562 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:12.245236 26749 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:12.243646 26747 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:12.251202 24560 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
W20260709 12:21:12.252615 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 55635.4us
I20260709 12:21:12.258136 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:12.260047 23925 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:21:12.262881 26533 consensus_queue.cc:1059] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:12.267030 23820 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:12.268113 26533 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:12.268600 26533 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.269057 26533 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:12.274060 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 101357us
I20260709 12:21:12.275295 23817 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:12.276750 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:12.278620 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:12.277449 26755 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:12.284873 26757 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:12.285368 26757 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:12.285749 26757 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:12.293037 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 48066.7us
I20260709 12:21:12.302793 26533 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.291441 26747 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:12.304296 26747 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:12.305552 26747 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.320039 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:12.332996 23925 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:12.298008 26755 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.332165 26751 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:12.354375 26533 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:12.337668 26756 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:12.355975 26533 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:12.356750 26756 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:12.357090 23996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1751) took 4427 ms (client timeout 2221 ms). Trace:
I20260709 12:21:12.357219 26756 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.358704 26748 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.365449 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:12.357519 23996 rpcz_store.cc:269] 0709 12:21:07.929401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.933112 (+  3711us) service_pool.cc:224] Handling call
0709 12:21:12.356724 (+4423612us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54004114d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:12.356894 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2495102336}
W20260709 12:21:12.368119 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.366636 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1614) took 1732 ms. Trace:
I20260709 12:21:12.371349 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:12.372115 24554 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:12.351902 26752 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:12.368810 23995 rpcz_store.cc:276] 0709 12:21:10.629806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.633450 (+  3644us) service_pool.cc:224] Handling call
0709 12:21:10.633846 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:10.634207 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:10.870305 (+236098us) log.cc:844] Serialized 14 byte log entry
0709 12:21:12.304713 (+1434408us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b18001adca0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a 00007fa287456a2a
0709 12:21:12.361727 (+ 57014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:12.361805 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:12.361903 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.361998 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.362150 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":225863,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":5400,"raft.queue_time_us":9097,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":19718528,"thread_start_us":95877,"threads_started":2,"wal-append.queue_time_us":1396591}
I20260709 12:21:12.379842 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:10.762252 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 53187.7us
I20260709 12:21:12.401496 26648 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.409529 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:12.376164 26752 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.423148 26752 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:12.412339 26765 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.423839 26765 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.424636 26430 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:12.419479 26755 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:12.415764 26763 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:12.420047 26649 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.430630 26748 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:12.422174 26761 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:12.376978 26647 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.430682 24003 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:12.432866 26765 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:12.433344 26761 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.435035 26647 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:12.428933 26649 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:12.435319 26761 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:12.445942 26757 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.447213 26647 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:12.450740 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:12.451406 23921 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:12.444505 26649 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:12.454134 26649 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.454504 26649 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:12.456898 26756 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.460012 23850 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
W20260709 12:21:12.461843 23850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 304) took 1918 ms (client timeout 1693 ms). Trace:
W20260709 12:21:12.462284 23850 rpcz_store.cc:269] 0709 12:21:10.549277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.549450 (+   173us) service_pool.cc:224] Handling call
0709 12:21:12.461662 (+1912212us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54002fb2d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:12.461767 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4325947264}
I20260709 12:21:12.467561 26485 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:12.468236 26485 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:12.470896 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:10.719388 23851 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
W20260709 12:21:12.471923 23851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2059) took 1835 ms (client timeout 1852 ms). Trace:
I20260709 12:21:12.471999 26764 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:12.472298 23851 rpcz_store.cc:269] 0709 12:21:10.636214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.638041 (+  1827us) service_pool.cc:224] Handling call
0709 12:21:12.471859 (+1833818us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:12.472640 26764 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:12.473176 26764 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:12.556704 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 79135.1us
I20260709 12:21:12.448194 26757 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:12.486166 26751 raft_consensus.cc:697] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:12.568809 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 182525us
W20260709 12:21:12.569509 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.572992 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:12.576202 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:12.572108 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:12.582125 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:12.582295 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:12.583117 23854 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:12.584771 24560 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:12.586364 23853 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:12.588150 23851 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:12.588804 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:12.589558 23848 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:12.590194 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:12.594085 24562 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.565680 24554 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:12.597795 23846 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:12.599222 26751 consensus_queue.cc:237] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.568969 26763 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:12.603466 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:12.605470 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:12.567627 26485 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.606832 26485 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:12.608600 26756 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:12.600769 26763 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.623615 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:12.626466 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:12.627431 23846 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:12.628103 26436 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.629431 26436 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:12.633009 26763 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:12.635615 26752 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:12.637991 26765 consensus_queue.cc:1175] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" responder_term: 7 status { last_received { term: 4 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.6-6.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:12.641108 26649 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.644948 23845 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:12.646171 26747 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:12.646826 26747 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:12.647596 26747 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.639587 26752 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:12.675097 26436 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.684068 26436 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.691663 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1612) took 2062 ms. Trace:
I20260709 12:21:12.697669 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:12.698096 26436 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:12.698379 23922 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.705816 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.708528 26649 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:12.710875 24003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1622) took 1930 ms (client timeout 2025 ms). Trace:
I20260709 12:21:12.711115 26761 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:12.711325 24003 rpcz_store.cc:269] 0709 12:21:10.780802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.786328 (+  5526us) service_pool.cc:224] Handling call
0709 12:21:12.710648 (+1924320us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54000997d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:12.710785 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3481616640}
I20260709 12:21:12.713330 26761 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:12.714818 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.715749 26645 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.716260 26645 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.719965 26522 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.723224 26645 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:12.725448 23847 raft_consensus.cc:2410] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:21:12.726194 23847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2066) took 2079 ms (client timeout 2094 ms). Trace:
W20260709 12:21:12.726711 23847 rpcz_store.cc:269] 0709 12:21:10.646367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.689729 (+ 43362us) service_pool.cc:224] Handling call
0709 12:21:12.726108 (+2036379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:12.737167 26356 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.737797 26356 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.741021 23922 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:12.744346 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:11.049167 26510 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:12.749135 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:12.750926 23922 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.759527 24562 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:12.761050 26752 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:12.761801 26752 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:12.762990 26752 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.773313 26764 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.775930 26764 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:12.776598 23927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 1950) took 5586 ms (client timeout 2064 ms). Trace:
I20260709 12:21:12.692312 23997 rpcz_store.cc:276] 0709 12:21:10.628945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.632785 (+  3840us) service_pool.cc:224] Handling call
0709 12:21:10.633180 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:10.785215 (+152035us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:12.129355 (+1344140us) log.cc:844] Serialized 14 byte log entry
0709 12:21:12.132851 (+  3496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:12.132898 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:12.132952 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.691294 (+558342us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54003d7cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:12.691369 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.691575 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":205835,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":121,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":1951,"spinlock_wait_cycles":231968640,"thread_start_us":1326256,"threads_started":2,"wal-append.queue_time_us":71222}
W20260709 12:21:12.806169 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 182644us
I20260709 12:21:12.809348 26775 consensus_queue.cc:1059] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:12.813361 23922 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:12.816565 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:12.777418 23927 rpcz_store.cc:269] 0709 12:21:07.189503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.758929 (+569426us) service_pool.cc:224] Handling call
0709 12:21:12.776030 (+5017101us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b540032a354. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:12.776328 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121929984}
I20260709 12:21:12.841161 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:12.854094 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.855037 23927 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:12.861611 26533 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.861646 23847 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:12.862077 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:12.880020 23846 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:12.863880 26776 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:21:12.873703 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.881963 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:12.882550 23922 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:12.880388 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:12.883450 23927 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:12.878973 26761 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:12.895813 26761 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:12.898236 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:12.898844 23924 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.884258 26533 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.903923 23845 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:12.911568 23927 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:12.915376 26533 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:12.897210 26761 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.919052 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:12.920804 23924 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:12.921388 23817 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:12.922188 23846 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:12.923632 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:10.761622 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 51534.2us
I20260709 12:21:12.922307 26650 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:12.928687 26650 raft_consensus.cc:697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:12.929622 26650 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.946461 26543 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.946787 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:12.947113 26543 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.947667 23995 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:12.949431 23924 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.912889 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:12.926999 23922 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:12.922699 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:12.934362 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:12.942759 26776 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:12.943117 26747 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:12.900940 26775 consensus_queue.cc:1059] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:21:12.986245 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:12.990900 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 68279.6us
I20260709 12:21:12.991572 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:12.992159 23927 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:12.992012 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:12.993014 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:12.993551 23927 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:12.993607 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.994470 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:12.990356 23997 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:12.999312 26778 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:13.000001 26778 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:12.995319 26533 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:13.000957 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.001544 26533 raft_consensus.cc:697] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:13.001739 23995 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:13.000984 26778 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:13.005317 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.006026 23996 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:13.002556 26533 consensus_queue.cc:237] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:12.987407 26543 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:13.012076 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1615) took 2381 ms. Trace:
I20260709 12:21:13.012156 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.010915 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.012614 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.018412 23995 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:13.017105 23996 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:13.019632 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.020787 24001 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:13.024771 23924 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:12.997740 23817 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.026543 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.030362 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:13.014889 24004 rpcz_store.cc:276] 0709 12:21:10.630268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.634982 (+  4714us) service_pool.cc:224] Handling call
0709 12:21:10.635434 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:12.061329 (+1425895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:12.061487 (+   158us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:12.072239 (+ 10752us) log.cc:844] Serialized 26 byte log entry
0709 12:21:12.106277 (+ 34038us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:12.106338 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.011670 (+905332us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b54003f5cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:13.011725 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:13.011777 (+    52us) raft_consensus.cc:1685] finished
0709 12:21:13.011795 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.012014 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24466,"raft.queue_time_us":235224,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":137,"spinlock_wait_cycles":143404416,"thread_start_us":1321401,"threads_started":2,"wal-append.queue_time_us":34895}
I20260709 12:21:13.032009 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.032861 23999 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:13.027163 24000 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:13.033823 24003 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:13.036504 23998 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:13.036667 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.037537 23997 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:13.039796 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:13.010567 26761 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:13.040612 23922 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.027750 23817 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.043495 26474 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:13.043956 26474 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.044350 26474 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:13.047690 26761 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:13.048712 26761 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:13.049453 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1690) took 2799 ms. Trace:
I20260709 12:21:13.050882 23852 rpcz_store.cc:276] 0709 12:21:10.249992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.330468 (+ 80476us) service_pool.cc:224] Handling call
0709 12:21:10.335744 (+  5276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:10.543184 (+207440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.049125 (+2505941us) spinlock_profiling.cc:243] Waited 85.6 ms on lock 0x7b5400215554. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:13.049383 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196793600}
I20260709 12:21:13.060475 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:13.061326 23924 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:13.065351 26691 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 4.276s	user 0.018s	sys 0.027s
W20260709 12:21:13.071440 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 43771.7us
I20260709 12:21:13.080505 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.081353 23997 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:13.088497 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:13.088343 26448 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:13.089745 26448 raft_consensus.cc:697] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:13.090269 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.090932 24002 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:13.090828 26448 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:13.097692 23852 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:13.100450 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:13.104900 23927 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:13.106441 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.107134 24002 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:13.107913 23817 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.107256 26474 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:13.107962 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:13.134500 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.115808 26778 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:13.141602 26778 raft_consensus.cc:697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:13.143392 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.143163 26778 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:13.144097 24003 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:13.144876 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.145043 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.145335 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.145516 24002 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:13.145874 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.146231 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.146433 24001 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:13.146835 24004 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:13.145536 23999 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:13.147168 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.147835 23998 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:13.147940 23920 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:13.148757 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.149355 24000 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:13.151147 23997 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:13.152086 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:13.152663 23927 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:13.149789 23920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 1967) took 3635 ms (client timeout 1648 ms). Trace:
I20260709 12:21:13.145355 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:13.154201 23920 rpcz_store.cc:269] 0709 12:21:09.514769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.514891 (+   122us) service_pool.cc:224] Handling call
0709 12:21:13.149587 (+3634696us) spinlock_profiling.cc:243] Waited 3.63 s on lock 0x7b54000e6854. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:13.149716 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8351430912}
I20260709 12:21:13.109200 23924 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:13.150177 26474 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:13.157646 23922 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:13.160478 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.159902 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:13.163419 23920 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:13.162473 26233 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:13.141500 26650 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:13.168915 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.184068 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:13.184757 23922 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:13.185365 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:13.186019 23924 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:13.195672 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 50399.1us
I20260709 12:21:13.200996 23927 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:13.202387 23817 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.181788 26448 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:13.167256 26650 raft_consensus.cc:697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:13.206022 26448 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:13.206838 26474 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:13.206557 26650 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:13.207432 26474 raft_consensus.cc:697] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:13.208371 26474 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:13.211746 26356 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:13.207067 26448 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:13.216033 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.234297 23922 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:13.235761 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:13.240046 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.245220 23924 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:13.250870 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:13.221956 26765 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:13.261543 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.260426 26356 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.262120 26614 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:13.265676 26765 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:13.272281 26769 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:13.288321 26769 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:13.295862 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 62154.6us
I20260709 12:21:13.282821 26614 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:13.315901 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:13.319808 23922 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:13.327898 26233 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:13.328263 26744 raft_consensus.cc:3055] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:13.328768 26744 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:13.331066 26744 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:13.332088 26744 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.332406 23922 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:21:13.347573 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:13.349431 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1657) took 1408 ms. Trace:
I20260709 12:21:13.349849 23923 rpcz_store.cc:276] 0709 12:21:11.941336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.320773 (+1379437us) service_pool.cc:224] Handling call
0709 12:21:13.349338 (+ 28565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:13.354043 26765 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:13.354772 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:13.357589 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.357501 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:13.357945 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:13.358211 24557 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:13.357607 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:13.359498 24563 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
W20260709 12:21:13.359885 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.360626 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:13.362433 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:13.366328 23969 connection.cc:256] RPC call timeout handler was delayed by -2.3458010980000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:21:13.366775 23969 connection.cc:256] RPC call timeout handler was delayed by -2.265701098000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 12:21:13.367156 23969 connection.cc:256] RPC call timeout handler was delayed by -1.504416744000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 12:21:13.367511 23969 connection.cc:256] RPC call timeout handler was delayed by -1.3658167440000852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 12:21:13.367789 23969 connection.cc:256] RPC call timeout handler was delayed by -1.1577542800000629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 12:21:13.368075 23969 connection.cc:256] RPC call timeout handler was delayed by -1.1484934940001494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 12:21:13.368366 23969 connection.cc:256] RPC call timeout handler was delayed by -1.1100542799999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 12:21:13.368636 23969 connection.cc:256] RPC call timeout handler was delayed by -1.1070934940000825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 12:21:13.368903 23969 connection.cc:256] RPC call timeout handler was delayed by -1.0971934940000665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 12:21:13.369200 23969 connection.cc:256] RPC call timeout handler was delayed by -1.086393494000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 12:21:13.324740 26780 raft_consensus.cc:3055] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:13.370170 26780 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:13.371300 26649 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:13.372135 26602 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:13.373127 26614 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:13.371090 26780 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:13.374759 26663 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:13.375408 26780 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.376595 23969 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:13.380728 23922 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:13.391028 26639 raft_consensus.cc:3055] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:13.391415 23922 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:21:13.391521 26639 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:13.393136 26639 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:13.393983 26754 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:13.395087 26639 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.398461 23922 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:21:13.402101 23783 debug-util.cc:398] Leaking SignalData structure 0x7b0800345a00 after lost signal to thread 23786
I20260709 12:21:13.406632 26747 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:13.410959 23848 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:13.411614 23846 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:13.414216 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:13.415544 26747 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:13.415715 26654 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:21:13.416900 26791 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
I20260709 12:21:13.419854 26764 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:13.420456 26764 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:13.421578 26764 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:13.423319 26764 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:13.383591 26233 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:13.434429 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 118666us
W20260709 12:21:13.439349 26799 log.cc:927] Time spent T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 12:21:13.376821 26769 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:13.441355 26802 log.cc:927] Time spent T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:21:13.443563 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.386704 26535 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:21:13.442636 26233 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:13.496454 24559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 664) took 2895 ms. Trace:
I20260709 12:21:13.496206 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:13.497562 24559 rpcz_store.cc:276] 0709 12:21:10.614999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.617078 (+  2079us) service_pool.cc:224] Handling call
0709 12:21:13.427788 (+2810710us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:21:13.430592 (+  2804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.430845 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:13.447115 (+ 16270us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.495884 (+ 48769us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:13.495935 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:13.495985 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.496051 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.496215 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13473,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"spinlock_wait_cycles":13806976,"thread_start_us":27806,"threads_started":1}
I20260709 12:21:13.498935 24558 raft_consensus.cc:2410] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:13.499630 24558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36570 (request call id 563) took 1319 ms. Trace:
I20260709 12:21:13.469238 26233 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:13.500826 26233 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:13.501252 26233 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:13.501677 26233 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.488073 26356 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:13.546976 26233 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:13.551034 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 1.5587e+06us
I20260709 12:21:13.532761 23920 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
W20260709 12:21:13.582378 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 1.42698e+06us
I20260709 12:21:13.594094 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:13.583237 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 1.18671e+06us
I20260709 12:21:13.583839 26552 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:13.590186 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.607353 23895 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.613202 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1689) took 1653 ms. Trace:
I20260709 12:21:13.610085 23817 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.622485 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:13.623422 24561 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:13.613713 23925 rpcz_store.cc:276] 0709 12:21:11.960065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.352188 (+392123us) service_pool.cc:224] Handling call
0709 12:21:12.353232 (+  1044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.359953 (+  6721us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:12.598452 (+238499us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.612766 (+1014314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:13.612819 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:13.612882 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.612966 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.613132 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":938288,"prepare.queue_time_us":206811,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2882,"thread_start_us":269192,"threads_started":2,"wal-append.queue_time_us":55647}
I20260709 12:21:13.679863 24004 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:21:13.751114 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 374554us
I20260709 12:21:13.752367 23969 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:13.755628 23969 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:13.742331 26801 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 12:21:13.791335 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:13.830950 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 75398.9us
W20260709 12:21:13.833988 23783 debug-util.cc:398] Leaking SignalData structure 0x7b08002c27e0 after lost signal to thread 23878
W20260709 12:21:13.835096 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.499982 24558 rpcz_store.cc:276] 0709 12:21:12.180571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.495750 (+1315179us) service_pool.cc:224] Handling call
0709 12:21:13.499565 (+  3815us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:13.872478 23783 debug-util.cc:398] Leaking SignalData structure 0x7b08002d54e0 after lost signal to thread 23953
W20260709 12:21:13.874207 23783 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9b80 after lost signal to thread 24028
W20260709 12:21:13.875944 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:13.875243 23783 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9440 after lost signal to thread 24029
W20260709 12:21:13.876000 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:13.875967 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 406096us
I20260709 12:21:13.866214 23969 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:13.883975 23783 debug-util.cc:398] Leaking SignalData structure 0x7b08003adae0 after lost signal to thread 24587
I20260709 12:21:13.885360 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:13.885757 23783 debug-util.cc:398] Leaking SignalData structure 0x7b0800371be0 after lost signal to thread 26442
W20260709 12:21:13.886149 23783 debug-util.cc:398] Leaking SignalData structure 0x7b0800349740 after lost signal to thread 26478
W20260709 12:21:13.887348 23783 debug-util.cc:398] Leaking SignalData structure 0x7b0800337100 after lost signal to thread 26499
I20260709 12:21:13.888309 23997 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:13.891427 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:13.892722 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1692) took 1928 ms. Trace:
W20260709 12:21:13.893355 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.893116 23929 rpcz_store.cc:276] 0709 12:21:11.963858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.473624 (+509766us) service_pool.cc:224] Handling call
0709 12:21:12.473985 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.474308 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:12.579831 (+105523us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.892377 (+1312546us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:13.892439 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:13.892489 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.892556 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.892663 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1287295,"prepare.queue_time_us":125632,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"thread_start_us":105126,"threads_started":1}
I20260709 12:21:13.895754 26654 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.896327 26654 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:13.899065 24000 raft_consensus.cc:2393] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:13.898983 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1691) took 1935 ms. Trace:
W20260709 12:21:13.899438 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.885636 26462 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:13.900329 26462 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:13.900796 26462 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.891458 26233 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:13.902144 26485 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:13.902653 26485 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.902804 26233 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:13.903079 26485 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:13.903290 26233 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:13.903426 23893 connection.cc:256] RPC call timeout handler was delayed by -3.9245718680001573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
W20260709 12:21:13.901896 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 306625us
I20260709 12:21:13.904616 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:13.905004 23895 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.903803 26233 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:13.908113 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 298133us
I20260709 12:21:13.917402 26543 raft_consensus.cc:2764] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:21:13.925289 26536 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:13.926350 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 332362us
I20260709 12:21:13.927062 26538 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:13.927096 23892 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.928951 23892 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.927524 26538 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.929778 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.899534 23921 rpcz_store.cc:276] 0709 12:21:11.963565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.453485 (+489920us) service_pool.cc:224] Handling call
0709 12:21:12.453827 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.465690 (+ 11863us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:12.562952 (+ 97262us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.898593 (+1335641us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:13.898651 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:13.898713 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.898783 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.898909 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1303155,"prepare.queue_time_us":134031,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":1306225,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":106873,"threads_started":2,"wal-append.queue_time_us":55539,"wal-append.run_cpu_time_us":1367,"wal-append.run_wall_time_us":1012477}
I20260709 12:21:13.933749 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:13.940966 24561 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:13.915288 26474 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:13.944000 24525 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.552s (SENT)
I20260709 12:21:13.944377 23847 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:13.944069 23969 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:13.944603 24525 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:13.946455 23925 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:13.946898 26768 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:13.947540 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:13.948173 24558 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:13.950708 26543 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:13.951186 26803 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.639s	user 0.003s	sys 0.001s
I20260709 12:21:13.951332 26543 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:13.952487 26543 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:13.953789 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.954604 24003 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:13.933297 26696 raft_consensus.cc:2764] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:21:13.966125 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.935971 26538 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.966071 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:13.936806 25848 raft_consensus.cc:2764] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:21:13.970408 24524 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.552s (SENT)
W20260709 12:21:13.973567 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 43860.1us
I20260709 12:21:13.972656 23895 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:13.988514 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:13.989353 24003 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:13.977339 26510 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.980298 26723 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:13.970578 26474 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:14.003444 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.004241 24003 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:13.977977 26552 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:21:14.008622 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.009553 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:14.009917 23997 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:14.013175 26811 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.013792 26811 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:14.014285 26811 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:14.014467 26812 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.141s	user 0.000s	sys 0.002s
I20260709 12:21:13.939512 23929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:21:13.993173 26654 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:14.021458 23929 raft_consensus.cc:606] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:21:14.023761 23929 raft_consensus.cc:614] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:13.991518 26696 raft_consensus.cc:2764] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:21:14.027478 24524 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.805s (SENT)
I20260709 12:21:14.028105 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:14.005679 26723 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:14.044009 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:14.082690 24525 leader_election.cc:336] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.690s (SENT)
W20260709 12:21:14.104581 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 102394us
I20260709 12:21:14.105959 23921 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:14.057397 25848 raft_consensus.cc:2764] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:14.057794 26723 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:14.109922 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 165938us
I20260709 12:21:14.009320 26510 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:14.092718 26764 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:21:14.111426 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:14.105762 26812 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:21:14.114390 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:14.113860 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 213807us
W20260709 12:21:14.182281 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 71877.9us
I20260709 12:21:14.103230 26610 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:14.172583 24525 leader_election.cc:336] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.779s (SENT)
I20260709 12:21:14.182322 24003 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
W20260709 12:21:14.184376 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 156946us
W20260709 12:21:14.118739 26814 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.245s	user 0.004s	sys 0.000s
W20260709 12:21:14.191638 24525 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.797s (SENT)
I20260709 12:21:14.187019 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:14.185060 24524 leader_election.cc:336] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.681s (SENT)
W20260709 12:21:14.189343 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 223678us
I20260709 12:21:14.198770 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.199661 23995 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
W20260709 12:21:14.240607 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53859.7us
W20260709 12:21:14.267833 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.275842 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.277551 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:14.298434 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:14.114615 26474 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:14.304723 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:14.306646 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:14.305621 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:14.308414 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:14.309065 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 417668us
I20260709 12:21:14.309448 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:14.310815 23849 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:14.187999 26610 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:14.247284 26552 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:21:14.320859 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.322057 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:14.318499 23995 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:14.324927 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:14.265442 26535 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:21:14.326948 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:14.334750 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 81215.8us
W20260709 12:21:14.336510 24525 leader_election.cc:336] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.871s (SENT)
I20260709 12:21:14.336861 23925 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:14.337157 24525 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:14.338475 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:14.346953 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.349603 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:14.350898 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:14.351675 23846 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:21:14.353811 24003 raft_consensus.cc:2410] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:21:14.320416 26514 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.350498 23853 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:14.316155 26831 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:14.365974 23847 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:14.369513 24525 leader_election.cc:336] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.928s (SENT)
I20260709 12:21:14.370132 24525 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:14.320209 26553 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:14.334376 26356 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.374367 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:14.374354 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 189512us
I20260709 12:21:14.379992 23969 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:14.368597 26831 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.349305 26780 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.403568 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:14.381618 26817 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
W20260709 12:21:14.426757 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49309.7us
I20260709 12:21:14.431041 23995 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:14.382989 26764 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:14.422679 26462 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.002s
I20260709 12:21:14.382584 26831 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.462165 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:14.461630 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.470700 23998 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:14.407323 26823 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:14.461558 26819 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
W20260709 12:21:14.493312 23818 leader_election.cc:336] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.555s (SENT)
I20260709 12:21:14.517273 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:14.517716 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 195856us
I20260709 12:21:14.520146 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.520771 23998 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:14.515300 23818 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:14.528373 23921 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:14.529037 23818 leader_election.cc:336] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.561s (SENT)
W20260709 12:21:14.530135 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:14.530323 23818 leader_election.cc:336] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.622s (SENT)
I20260709 12:21:14.530725 23818 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:14.532451 23818 leader_election.cc:336] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.937s (SENT)
I20260709 12:21:14.403098 26553 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:14.535048 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:14.535840 24525 leader_election.cc:336] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.996s (SENT)
I20260709 12:21:14.543066 24525 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:14.543296 23921 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:14.538468 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:14.538954 23820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.005s	sys 0.009s
W20260709 12:21:14.543678 23818 leader_election.cc:336] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.025s (SENT)
I20260709 12:21:14.544744 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:14.551694 23921 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.551184 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:14.552313 24525 leader_election.cc:336] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.153s (SENT)
I20260709 12:21:14.555166 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.521867 26510 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:14.534628 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:14.429013 26514 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:14.557659 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:14.553571 23820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.005s	sys 0.009s
I20260709 12:21:14.547483 23893 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:14.472070 26462 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:14.535939 26744 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:14.626974 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 79572.1us
I20260709 12:21:14.541831 26535 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:14.576215 24525 leader_election.cc:336] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.995s (SENT)
W20260709 12:21:14.650569 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 74421.3us
W20260709 12:21:14.651423 24525 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.169s (SENT)
I20260709 12:21:14.634037 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1705) took 2003 ms. Trace:
I20260709 12:21:14.527921 26840 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:14.605020 23818 leader_election.cc:336] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.223s (SENT)
I20260709 12:21:14.647320 23893 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:14.652134 23924 rpcz_store.cc:276] 0709 12:21:12.630363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.252636 (+622273us) service_pool.cc:224] Handling call
0709 12:21:13.253140 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:13.668737 (+415597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.668787 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:13.872082 (+203295us) log.cc:844] Serialized 26 byte log entry
0709 12:21:13.958504 (+ 86422us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:13.958553 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.958624 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.633761 (+675137us) raft_consensus.cc:1685] finished
0709 12:21:14.633782 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.633972 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":538323,"raft.queue_time_us":427539,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":62955,"spinlock_wait_cycles":84864,"thread_start_us":85973,"threads_started":1,"wal-append.queue_time_us":136793}
I20260709 12:21:14.657343 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1690) took 2695 ms. Trace:
I20260709 12:21:14.658080 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:14.552521 26764 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:14.681919 26553 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:14.682606 26430 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:14.683034 26430 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:14.683405 26430 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:14.683802 26514 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:14.690379 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:14.691627 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:21:14.668891 26808 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.794s	user 0.004s	sys 0.009s
W20260709 12:21:14.696686 26536 consensus_meta.cc:287] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.000s
I20260709 12:21:14.697434 23852 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:14.683831 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:14.656852 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:14.662393 23893 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:14.666916 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.668937 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:14.669476 26825 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:21:14.670095 24004 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:14.671053 26462 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:14.677583 26821 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:14.649735 26510 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.674284 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:14.678423 26815 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.589s	user 0.000s	sys 0.002s
W20260709 12:21:14.678500 26827 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.295s	user 0.000s	sys 0.000s
W20260709 12:21:14.679298 26826 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:21:14.679965 26829 log.cc:927] Time spent T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
W20260709 12:21:14.680653 26822 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 12:21:14.681396 26830 log.cc:927] Time spent T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 12:21:14.703864 23925 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:14.556965 26823 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:14.724146 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 119186us
W20260709 12:21:14.658210 26820 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.391s	user 0.000s	sys 0.001s
I20260709 12:21:14.728631 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:14.729168 26233 consensus_meta.cc:287] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.810s	user 0.011s	sys 0.000s
I20260709 12:21:14.733762 26510 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:14.698624 26567 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.734959 23998 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:14.556787 26834 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:14.736192 23929 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:14.824023 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:14.656738 26840 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.657845 23926 rpcz_store.cc:276] 0709 12:21:11.961915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.436425 (+474510us) service_pool.cc:224] Handling call
0709 12:21:12.436808 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:13.584583 (+1147775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.584612 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:13.585109 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:21:13.829669 (+244560us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:13.829754 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.829868 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.657109 (+827241us) raft_consensus.cc:1685] finished
0709 12:21:14.657128 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.657270 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1452501,"raft.queue_time_us":1148447,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":12656,"thread_start_us":158012,"threads_started":1,"wal-append.queue_time_us":392982}
I20260709 12:21:14.669018 26610 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:14.734885 23893 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:14.830776 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 95996.5us
I20260709 12:21:14.831727 23893 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:14.670939 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.727421 26514 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:14.771910 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.730370 26535 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:14.792711 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:14.835070 23997 raft_consensus.cc:2410] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:21:14.801360 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.730516 26821 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:14.810994 23818 leader_election.cc:336] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.645s (SENT)
I20260709 12:21:14.812772 26233 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:14.634038 26837 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:14.738926 26848 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:14.819850 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:14.793428 26845 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:21:14.834940 24002 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.794706 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1758) took 1114 ms. Trace:
I20260709 12:21:14.840260 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:14.818810 26510 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.870388 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.871574 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.872129 24003 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:14.844364 23925 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:14.839721 23995 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:14.825374 26567 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:14.854691 26537 raft_consensus.cc:2764] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:14.843991 26764 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.839466 26821 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.834404 26514 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:14.867370 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:14.896216 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1656) took 4079 ms. Trace:
I20260709 12:21:14.896422 23998 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.843137 26837 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:14.868422 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.901187 23996 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:14.833851 26553 raft_consensus.cc:2764] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:14.872942 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.844405 24001 rpcz_store.cc:276] 0709 12:21:13.680532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.741707 (+ 61175us) service_pool.cc:224] Handling call
0709 12:21:13.884865 (+143158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.885114 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:14.188072 (+302958us) log.cc:844] Serialized 14 byte log entry
0709 12:21:14.793856 (+605784us) log.cc:844] Serialized 14 byte log entry
0709 12:21:14.794256 (+   400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:14.794321 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:14.794391 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.794474 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.794627 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86180,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":24359,"raft.queue_time_us":188235,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":29986,"spinlock_wait_cycles":32625024,"thread_start_us":754676,"threads_started":3,"wal-append.queue_time_us":406562}
I20260709 12:21:14.874872 26233 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:14.886871 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:14.888597 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.885795 26834 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.891456 24002 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:14.892766 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:14.893867 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:14.896788 23928 rpcz_store.cc:276] 0709 12:21:11.941005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.771298 (+830293us) service_pool.cc:224] Handling call
0709 12:21:12.771639 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:13.634367 (+862728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.634394 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:13.890149 (+255755us) log.cc:844] Serialized 26 byte log entry
0709 12:21:14.119512 (+229363us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:14.119573 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.119665 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.895885 (+776220us) raft_consensus.cc:1685] finished
0709 12:21:14.895917 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.896115 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1112474,"raft.queue_time_us":871596,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"thread_start_us":228911,"threads_started":1,"wal-append.queue_time_us":460168}
I20260709 12:21:14.898824 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:14.830577 26840 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.903616 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1725) took 1485 ms. Trace:
W20260709 12:21:14.912235 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.941090 23995 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:14.936968 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1726) took 1418 ms. Trace:
I20260709 12:21:14.900596 26514 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:14.964398 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:14.965129 24002 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.944166 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.890614 26535 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.940474 23922 rpcz_store.cc:276] 0709 12:21:13.418611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.418825 (+   214us) service_pool.cc:224] Handling call
0709 12:21:13.419163 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:13.875430 (+456267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.875473 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:13.885303 (+  9830us) log.cc:844] Serialized 26 byte log entry
0709 12:21:14.111837 (+226534us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:14.111874 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.111943 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.903336 (+791393us) raft_consensus.cc:1685] finished
0709 12:21:14.903363 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.903537 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":399085,"raft.queue_time_us":414073,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":42768,"thread_start_us":165436,"threads_started":1,"wal-append.queue_time_us":414108}
I20260709 12:21:14.945262 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1693) took 2466 ms. Trace:
W20260709 12:21:14.901927 26485 consensus_meta.cc:287] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.998s	user 0.014s	sys 0.000s
I20260709 12:21:14.960122 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.967883 23927 rpcz_store.cc:276] 0709 12:21:12.478902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.223610 (+744708us) service_pool.cc:224] Handling call
0709 12:21:13.224335 (+   725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:13.650381 (+426046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.650436 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:13.874056 (+223620us) log.cc:844] Serialized 26 byte log entry
0709 12:21:14.118196 (+244140us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:14.120602 (+  2406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.120718 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.944953 (+824235us) raft_consensus.cc:1685] finished
0709 12:21:14.944974 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.945184 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":545278,"raft.queue_time_us":429402,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":60824,"thread_start_us":185289,"threads_started":1,"wal-append.queue_time_us":407710}
I20260709 12:21:14.960587 23920 rpcz_store.cc:276] 0709 12:21:13.518388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.615843 (+ 97455us) service_pool.cc:224] Handling call
0709 12:21:13.644513 (+ 28670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:13.919083 (+274570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.919128 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:13.941118 (+ 21990us) log.cc:844] Serialized 26 byte log entry
0709 12:21:14.108299 (+167181us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:14.108348 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.108410 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.936688 (+828278us) raft_consensus.cc:1685] finished
0709 12:21:14.936714 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.936890 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":262996,"raft.queue_time_us":273822,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6264,"thread_start_us":161505,"threads_started":1,"wal-append.queue_time_us":371785}
W20260709 12:21:14.946962 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 48248.2us
I20260709 12:21:14.970551 23929 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:14.975543 23850 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.048s	sys 0.102s
I20260709 12:21:14.902141 26837 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.975747 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.979178 24003 raft_consensus.cc:2410] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:21:14.976004 23850 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.048s	sys 0.102s
I20260709 12:21:14.976311 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:14.977509 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:14.982012 26712 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.007s	sys 0.018s
I20260709 12:21:14.895982 26764 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:14.980684 24001 raft_consensus.cc:2376] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 4. Re-sending same reply.
I20260709 12:21:14.963544 26537 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.986603 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:14.991552 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 453142us
I20260709 12:21:14.991997 23928 raft_consensus.cc:2368] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 5. Current term is 6.
I20260709 12:21:14.993857 23995 raft_consensus.cc:2410] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:14.998966 26233 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:15.003732 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.003976 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.004400 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.005162 23997 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:15.004449 24003 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:15.007838 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:14.991004 26712 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.007s	sys 0.019s
I20260709 12:21:15.011982 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.017351 23996 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:14.986356 26610 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.990379 25848 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:15.021697 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:15.022141 25848 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:15.022735 26854 log.cc:927] Time spent T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:21:15.023182 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:15.024497 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:15.025264 26855 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:14.968510 26834 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:15.026553 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.027143 23995 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:15.027346 26834 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:15.027972 25848 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:15.030220 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:15.020547 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:14.993630 26537 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.021109 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.019582 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.032263 24003 raft_consensus.cc:2410] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:15.025694 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:15.025738 26855 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:15.021821 26610 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:14.977152 26485 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:15.047668 23818 leader_election.cc:336] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.872s (SENT)
I20260709 12:21:15.050350 23998 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:15.051327 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.031004 23928 raft_consensus.cc:2376] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9. Re-sending same reply.
I20260709 12:21:15.031812 24001 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:15.054203 24002 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:15.055200 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.055794 24002 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.034380 26233 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.059041 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.059223 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.062882 23927 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:15.061575 23998 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:14.975706 26535 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:15.057633 26723 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.866s	user 0.013s	sys 0.000s
I20260709 12:21:15.077808 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.082314 23998 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:15.083305 23924 raft_consensus.cc:2393] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:15.078125 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.084275 24003 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.033805 26537 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.061913 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:15.077265 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 51651.7us
I20260709 12:21:15.086138 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.086721 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.083505 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.089058 23998 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:15.091032 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.092140 23997 raft_consensus.cc:2410] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:15.045837 26855 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:15.058866 26834 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.095991 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.095527 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:15.095047 26813 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Append to log took a long time: real 1.223s	user 0.010s	sys 0.006s
I20260709 12:21:15.097440 23928 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:15.098270 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.099717 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.099819 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.059482 26860 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.094774 26723 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:15.066782 26769 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:15.014185 26823 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:15.394559 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.127343 23928 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:15.108709 23922 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:15.153241 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.107991 23921 raft_consensus.cc:2410] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:15.113631 24003 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:15.066619 26850 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:15.126678 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.159133 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.109692 23998 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:15.475175 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:15.131634 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.475876 23998 raft_consensus.cc:2376] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 4. Re-sending same reply.
I20260709 12:21:15.450901 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:15.450838 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.478122 23927 raft_consensus.cc:2410] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:15.403649 24002 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:15.104974 23995 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:15.474524 24001 raft_consensus.cc:2376] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 4. Re-sending same reply.
I20260709 12:21:15.477654 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.474658 23996 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:15.100847 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:15.448181 23818 leader_election.cc:336] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.970s (SENT)
I20260709 12:21:15.479346 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:15.315196 26856 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 12:21:15.481667 26356 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:15.482318 26356 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.481943 26837 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:15.467294 26430 consensus_meta.cc:287] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.783s	user 0.006s	sys 0.006s
I20260709 12:21:15.481184 24559 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:15.369803 26510 consensus_meta.cc:287] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.500s	user 0.005s	sys 0.005s
I20260709 12:21:15.487097 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:15.152272 26780 consensus_meta.cc:287] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.000s
I20260709 12:21:15.482007 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.481714 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:15.490576 23997 raft_consensus.cc:2410] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:21:15.480163 23995 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
W20260709 12:21:15.485841 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 390415us
I20260709 12:21:15.491952 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.490916 23922 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 3: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:15.281970 25848 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:15.160635 26831 consensus_meta.cc:287] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.002s
I20260709 12:21:15.478231 23925 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:15.495275 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.147835 26485 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:15.156333 26811 consensus_meta.cc:287] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.141s	user 0.011s	sys 0.000s
I20260709 12:21:15.487210 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.479404 23998 raft_consensus.cc:2376] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 5. Re-sending same reply.
W20260709 12:21:15.480437 23966 connection.cc:256] RPC call timeout handler was delayed by -3.259800223999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 12:21:15.500613 23966 connection.cc:256] RPC call timeout handler was delayed by -3.1770002239998121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 12:21:15.501964 23966 connection.cc:256] RPC call timeout handler was delayed by -3.1770002239998121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 12:21:15.502316 23966 connection.cc:256] RPC call timeout handler was delayed by -3.1617002239997873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 12:21:15.499344 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:15.502629 23966 connection.cc:256] RPC call timeout handler was delayed by -3.1617002239997873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:21:15.502944 23966 connection.cc:256] RPC call timeout handler was delayed by -3.1212002239999492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 12:21:15.127243 26514 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:15.506901 26514 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:15.127274 26660 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.422s
I20260709 12:21:15.507589 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.508163 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:15.508347 24000 raft_consensus.cc:2376] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 9. Re-sending same reply.
I20260709 12:21:15.503716 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:15.241932 26553 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:15.494376 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:15.495002 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.350251 26764 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:15.282302 26839 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:15.488308 26538 consensus_meta.cc:287] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.506s	user 0.009s	sys 0.005s
I20260709 12:21:15.494174 26610 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:15.520783 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:15.480333 23818 leader_election.cc:336] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.971s (SENT)
I20260709 12:21:15.493567 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:15.503185 23966 connection.cc:256] RPC call timeout handler was delayed by -3.0816002239998852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 12:21:15.473757 26850 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:15.509358 24558 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 3.
I20260709 12:21:15.475757 26769 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:15.105136 26834 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:15.489145 26430 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:15.512490 24561 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:15.514125 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.499542 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.492141 26510 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:15.518818 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.522289 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:15.508807 24554 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:15.509502 23920 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:15.521441 24000 raft_consensus.cc:2376] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 9. Re-sending same reply.
I20260709 12:21:15.523635 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:15.522506 24001 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
W20260709 12:21:15.522467 23966 connection.cc:256] RPC call timeout handler was delayed by -3.0591002239998488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 12:21:15.538190 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:15.500133 26811 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:15.527235 23927 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:15.558914 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.528796 24003 raft_consensus.cc:2376] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 8. Re-sending same reply.
I20260709 12:21:15.496829 26780 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.528954 23995 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:15.530820 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:15.522897 26552 consensus_queue.cc:1059] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 12:21:15.556438 23966 connection.cc:256] RPC call timeout handler was delayed by -2.94390022399989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 12:21:15.570861 23966 connection.cc:256] RPC call timeout handler was delayed by -2.94390022399989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 12:21:15.571415 23966 connection.cc:256] RPC call timeout handler was delayed by -2.7531002239998088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
I20260709 12:21:15.511581 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:15.571899 23966 connection.cc:256] RPC call timeout handler was delayed by -2.7261002239997651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
I20260709 12:21:15.567227 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:15.572332 23966 connection.cc:256] RPC call timeout handler was delayed by -2.697300223999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 12:21:15.572754 23966 connection.cc:256] RPC call timeout handler was delayed by -2.6946002239999416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 12:21:15.525595 26850 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:15.564268 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.574112 23921 raft_consensus.cc:2368] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10.
W20260709 12:21:15.574404 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 43641us
I20260709 12:21:15.574708 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:15.582050 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 101740us
W20260709 12:21:15.582902 23818 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.106s (SENT) [suppressed 61 similar messages]
W20260709 12:21:15.573060 23966 connection.cc:256] RPC call timeout handler was delayed by -2.6946002239999416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 12:21:15.583986 23966 connection.cc:256] RPC call timeout handler was delayed by -2.6568002239998805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
I20260709 12:21:15.575649 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:15.567811 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 74591.4us
W20260709 12:21:15.545085 26821 consensus_meta.cc:287] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
I20260709 12:21:15.577476 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.580973 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.589282 23920 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:15.535367 26567 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:15.523084 26538 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:15.504585 26831 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:15.581401 23927 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.523394 26764 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:21:15.590037 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.608275 24003 raft_consensus.cc:2410] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:15.609315 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:15.542589 26754 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 12:21:15.591636 23966 connection.cc:256] RPC call timeout handler was delayed by -2.6523002239998732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 12:21:15.581676 26712 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:15.509626 25848 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:15.617127 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:15.559226 26610 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.523105 26553 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:15.598299 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.599210 23921 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:15.634557 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.634729 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.595752 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:15.590174 26552 consensus_queue.cc:1243] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 35a9a1f8b1d847fb8f2063ced2a3c26d log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:15.573130 26837 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:15.610240 24003 raft_consensus.cc:2410] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:21:15.591202 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:15.541990 26533 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:21:15.521728 26839 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:15.613639 23966 connection.cc:256] RPC call timeout handler was delayed by -2.6244002239998281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
W20260709 12:21:15.648499 23966 connection.cc:256] RPC call timeout handler was delayed by -2.5776002239997524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2259s for a response
W20260709 12:21:15.648874 23966 connection.cc:256] RPC call timeout handler was delayed by -2.4390002239997557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2413s for a response
W20260709 12:21:15.534497 26864 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:21:15.539942 26356 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:15.655985 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.657200 23920 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:21:15.618438 23928 raft_consensus.cc:2368] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7.
I20260709 12:21:15.587141 24000 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:15.636391 24001 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.540431 26855 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:15.599924 26535 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:15.661640 23852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 333) took 2235 ms (client timeout 2399 ms). Trace:
W20260709 12:21:15.662199 23852 rpcz_store.cc:269] 0709 12:21:13.410596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.413811 (+  3215us) service_pool.cc:224] Handling call
0709 12:21:15.646161 (+2232350us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400072e54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:15.646312 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2949033856}
W20260709 12:21:15.649223 24524 leader_election.cc:336] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.690s (SENT)
I20260709 12:21:15.663538 24524 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:15.649226 23966 connection.cc:256] RPC call timeout handler was delayed by -2.4390002239997557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2413s for a response
I20260709 12:21:15.617256 26712 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.665812 26712 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.634047 26765 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:15.668895 24002 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:15.672592 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1759) took 1782 ms. Trace:
I20260709 12:21:15.669018 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.673062 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1630) took 1233 ms. Trace:
I20260709 12:21:15.673451 24002 rpcz_store.cc:276] 0709 12:21:14.439879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.651323 (+1211444us) service_pool.cc:224] Handling call
0709 12:21:15.651781 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.672784 (+ 21003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.672999 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:15.673211 24004 rpcz_store.cc:276] 0709 12:21:13.889912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.892653 (+  2741us) service_pool.cc:224] Handling call
0709 12:21:13.892982 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.725281 (+832299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.672275 (+946994us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54001d2254. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:15.672510 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786582272}
I20260709 12:21:15.677362 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:15.671064 23966 connection.cc:256] RPC call timeout handler was delayed by -1.9629002239998954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2942s for a response
W20260709 12:21:15.678471 23966 connection.cc:256] RPC call timeout handler was delayed by -1.9557002239998837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29500000000000004s for a response
W20260709 12:21:15.678812 23966 connection.cc:256] RPC call timeout handler was delayed by -1.6614002239998626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32770000000000005s for a response
W20260709 12:21:15.679087 23966 connection.cc:256] RPC call timeout handler was delayed by -1.6614002239998626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32770000000000005s for a response
W20260709 12:21:15.679350 23966 connection.cc:256] RPC call timeout handler was delayed by -1.5912002239997491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3355s for a response
W20260709 12:21:15.679603 23966 connection.cc:256] RPC call timeout handler was delayed by -1.5912002239997491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3355s for a response
I20260709 12:21:15.683445 24002 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.596966 26821 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:15.747390 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1778) took 1166 ms. Trace:
I20260709 12:21:15.683837 24004 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:21:15.747830 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 161620us
I20260709 12:21:15.748140 24002 rpcz_store.cc:276] 0709 12:21:14.517341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.682805 (+1165464us) service_pool.cc:224] Handling call
0709 12:21:15.683254 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.683921 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.684095 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:15.661796 26552 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.695786 23928 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:21:15.750298 24002 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:15.636638 26614 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 12:21:15.751822 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 102638us
W20260709 12:21:15.753461 24525 leader_election.cc:336] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.187s (SENT)
I20260709 12:21:15.756320 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1779) took 1220 ms. Trace:
I20260709 12:21:15.684083 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.759480 24525 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:15.759414 24004 rpcz_store.cc:276] 0709 12:21:14.535791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.683122 (+1147331us) service_pool.cc:224] Handling call
0709 12:21:15.683529 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.755943 (+ 72414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.756264 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:15.762926 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1639) took 1079 ms. Trace:
I20260709 12:21:15.763419 24002 rpcz_store.cc:276] 0709 12:21:14.683641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.749673 (+1066032us) service_pool.cc:224] Handling call
0709 12:21:15.750084 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.762596 (+ 12512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.762856 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:15.764716 24002 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:15.765365 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1648) took 1077 ms. Trace:
I20260709 12:21:15.765683 24002 rpcz_store.cc:276] 0709 12:21:14.687985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.764233 (+1076248us) service_pool.cc:224] Handling call
0709 12:21:15.764525 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.765137 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.765315 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:15.767652 24002 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:15.635232 26610 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:15.781195 24524 leader_election.cc:336] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.693s (SENT)
I20260709 12:21:15.783138 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:15.781184 24003 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:15.784473 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1632) took 1344 ms. Trace:
I20260709 12:21:15.784891 24003 rpcz_store.cc:276] 0709 12:21:14.440550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.654634 (+1214084us) service_pool.cc:224] Handling call
0709 12:21:15.676670 (+ 22036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.784132 (+107462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.784401 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:15.786954 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 144846us
I20260709 12:21:15.787135 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1652) took 1097 ms. Trace:
I20260709 12:21:15.787709 24003 rpcz_store.cc:276] 0709 12:21:14.689327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.785950 (+1096623us) service_pool.cc:224] Handling call
0709 12:21:15.786398 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.786648 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.786691 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:15.786757 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:15.786817 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.786896 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.787044 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:15.789805 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.792309 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.794194 24003 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:21:15.752493 26864 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:21:15.798494 24524 leader_election.cc:336] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.779s (SENT)
I20260709 12:21:15.799108 24524 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:15.794378 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.794695 24003 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:15.795105 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1651) took 1084 ms. Trace:
I20260709 12:21:15.800161 24002 rpcz_store.cc:276] 0709 12:21:14.688997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.767188 (+1078191us) service_pool.cc:224] Handling call
0709 12:21:15.767487 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.768034 (+   547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.772831 (+  4797us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:15.800806 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 47388.4us
I20260709 12:21:15.802351 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:15.803598 24002 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:15.805469 24002 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:15.807418 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.795554 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.809479 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.781257 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1642) took 1079 ms. Trace:
I20260709 12:21:15.808383 23966 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:15.675482 26535 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 12:21:15.812077 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.815775 23850 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:15.771402 26870 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:15.807386 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.814404 24002 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:15.812837 23853 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 9 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:15.816520 23818 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:15.815788 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.818115 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.811034 24004 rpcz_store.cc:276] 0709 12:21:14.684600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.761578 (+1076978us) service_pool.cc:224] Handling call
0709 12:21:15.763700 (+  2122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.763848 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.763863 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:15.763893 (+    30us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:15.763918 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.763952 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.764093 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:15.822533 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.813512 24003 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:15.828502 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:15.828286 26754 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:15.901683 23920 raft_consensus.cc:2368] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9.
I20260709 12:21:15.902171 24003 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.903015 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:15.828603 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.905067 23846 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
W20260709 12:21:15.905509 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 89061.2us
I20260709 12:21:15.906522 23818 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:15.909227 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 100924us
I20260709 12:21:15.861824 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.913451 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.806685 26744 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:15.914291 23850 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:15.812120 26430 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:15.915318 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.782074 26552 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:15.911404 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.808899 26823 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 12:21:15.914866 23818 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:15.958428 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 48033.3us
I20260709 12:21:16.102164 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:15.961452 23846 raft_consensus.cc:2410] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:15.935843 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:15.962867 23996 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:15.963327 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:16.104314 24560 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:15.815222 26835 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:15.903309 23851 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
W20260709 12:21:15.971071 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 172571us
I20260709 12:21:16.099727 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:16.108505 24524 leader_election.cc:336] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.791s (SENT)
I20260709 12:21:16.108915 23852 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:16.103574 23847 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:16.108981 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:16.034698 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:16.110168 24003 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:21:15.905205 26769 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:16.110404 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:16.174388 23854 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:15.963195 26485 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.111142 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:16.112725 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1657) took 1248 ms. Trace:
I20260709 12:21:16.180173 23996 rpcz_store.cc:276] 0709 12:21:14.856086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.095643 (+239557us) service_pool.cc:224] Handling call
0709 12:21:16.104072 (+1008429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:16.181922 23996 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:16.182556 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1681) took 1198 ms. Trace:
I20260709 12:21:16.182885 23996 rpcz_store.cc:276] 0709 12:21:14.984350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.181201 (+1196851us) service_pool.cc:224] Handling call
0709 12:21:16.181541 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:16.182296 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.182499 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:16.184434 23996 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:16.184998 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1682) took 1182 ms. Trace:
I20260709 12:21:16.185371 23996 rpcz_store.cc:276] 0709 12:21:15.002575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.183677 (+1181102us) service_pool.cc:224] Handling call
0709 12:21:16.184004 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:16.184754 (+   750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.184947 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:16.098519 26744 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:16.190786 24001 consensus_meta.cc:287] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 12:21:16.191334 24001 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:16.192066 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1649) took 1503 ms. Trace:
I20260709 12:21:16.192546 24004 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:21:15.963340 26874 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 12:21:15.912556 26765 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:15.974246 26834 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:15.911878 26723 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:16.115131 26835 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:16.176187 26533 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:15.862279 26837 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:16.177690 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 77298.2us
I20260709 12:21:16.170964 24003 pending_rounds.cc:85] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 4
W20260709 12:21:16.129081 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 214253us
W20260709 12:21:16.178671 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.901717 26754 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.192665 24001 rpcz_store.cc:276] 0709 12:21:14.688314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.573397 (+885083us) service_pool.cc:224] Handling call
0709 12:21:16.191998 (+618601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:15.964898 26811 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:16.207039 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:16.254541 23928 raft_consensus.cc:2410] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:15.942801 26876 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.187738 26538 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:16.220367 23996 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:15.958861 26865 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:16.225608 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 123483us
I20260709 12:21:16.234012 24003 pending_rounds.cc:107] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:21:16.238758 26883 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:15.905763 26870 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:16.180584 26871 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.606s	user 0.000s	sys 0.001s
I20260709 12:21:16.261094 24001 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:16.209362 26765 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.240257 26835 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.295004 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:16.194406 26485 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:16.309059 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:16.304406 26855 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:16.309049 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:16.335510 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 227024us
W20260709 12:21:16.311434 24554 consensus_meta.cc:287] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.730s	user 0.006s	sys 0.003s
I20260709 12:21:16.331554 26811 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:16.267432 24003 raft_consensus.cc:2889] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:16.243863 26754 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.264657 26356 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:16.309314 23924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 286) took 1944 ms (client timeout 2153 ms). Trace:
I20260709 12:21:16.332607 24001 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
W20260709 12:21:16.334273 26840 consensus_meta.cc:287] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.367s	user 0.010s	sys 0.003s
I20260709 12:21:16.337968 24554 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
W20260709 12:21:16.345238 23924 rpcz_store.cc:269] 0709 12:21:14.365123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.728311 (+363188us) service_pool.cc:224] Handling call
0709 12:21:16.271333 (+1543022us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54003ce954. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:16.309251 (+ 37918us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622300544}
I20260709 12:21:16.345860 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:16.346661 24001 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:16.347618 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:16.348229 24001 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:16.349249 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:16.350204 26837 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:16.350819 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:16.337316 24524 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.797s (SENT)
W20260709 12:21:16.341022 23817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.018s	sys 0.025s
W20260709 12:21:16.351886 23817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.018s	sys 0.025s
I20260709 12:21:16.341503 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:16.343395 23996 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
W20260709 12:21:16.352236 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 714436us
I20260709 12:21:16.352473 23996 pending_rounds.cc:85] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 2
I20260709 12:21:16.352690 23928 raft_consensus.cc:2368] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:21:16.352852 23996 pending_rounds.cc:107] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:21:16.353139 23996 raft_consensus.cc:2889] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:16.314443 24560 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:16.353461 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1663) took 1495 ms. Trace:
I20260709 12:21:16.353915 24003 rpcz_store.cc:276] 0709 12:21:14.857957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.789026 (+931069us) service_pool.cc:224] Handling call
0709 12:21:15.793654 (+  4628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:16.353210 (+559556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.353405 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:16.351040 24001 raft_consensus.cc:2376] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 9. Re-sending same reply.
I20260709 12:21:16.231654 26831 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:16.355324 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:16.355965 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:16.356650 24001 raft_consensus.cc:2376] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 5. Re-sending same reply.
I20260709 12:21:16.357868 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:16.327653 26765 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:16.318953 26696 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.358934 24001 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:16.366546 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:16.367360 23924 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:16.359472 24524 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:16.364845 23966 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:16.319193 26723 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:16.288010 26833 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.000s	sys 0.015s
W20260709 12:21:16.374858 24524 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.830s (SENT)
I20260709 12:21:16.400202 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:16.376940 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1693) took 1033 ms. Trace:
I20260709 12:21:16.400890 23996 rpcz_store.cc:276] 0709 12:21:15.343613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.219750 (+876137us) service_pool.cc:224] Handling call
0709 12:21:16.220194 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:16.376595 (+156401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.376865 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:16.401983 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:16.375017 26837 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:16.374331 23895 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:16.378896 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:16.335563 26890 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.407101 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:16.340574 26538 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:16.352053 26553 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:16.413061 24524 connection.cc:256] RPC call timeout handler was delayed by -1.2385946719998628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 12:21:16.410444 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:16.415501 23928 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:16.411584 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:16.416427 23924 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:16.417724 23996 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
I20260709 12:21:16.359639 26764 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.360405 26883 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:21:16.423573 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 47552us
W20260709 12:21:16.405844 26833 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.000s	sys 0.021s
W20260709 12:21:16.425638 23966 leader_election.cc:336] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.724s (SENT)
I20260709 12:21:16.377135 26895 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:16.394582 26811 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:16.404691 26821 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:16.424530 26538 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:16.370728 26840 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:16.374689 26723 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:16.396878 26696 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:16.734733 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 301) took 1771 ms. Trace:
I20260709 12:21:16.414294 26610 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:16.420128 26890 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:16.703500 24524 connection.cc:256] RPC call timeout handler was delayed by -1.0945946719998574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
I20260709 12:21:17.045923 26892 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:17.046572 26892 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.047688 26696 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:16.564679 26811 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.048820 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:17.049027 26892 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.049770 26892 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:17.050428 23995 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:17.050395 26892 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.051463 26840 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:17.068369 24563 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:21:16.727973 24002 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:17.068926 24563 pending_rounds.cc:85] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 6
I20260709 12:21:17.069034 24002 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:16.657197 26537 consensus_meta.cc:287] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.549s	user 0.008s	sys 0.005s
W20260709 12:21:16.738667 26881 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.628s	user 0.005s	sys 0.001s
I20260709 12:21:16.639870 26900 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.430578 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:16.427894 26632 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:16.737352 26430 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:16.589119 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 218251us
I20260709 12:21:16.545434 26883 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:17.056099 26538 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:16.858642 26835 consensus_meta.cc:287] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.002s
I20260709 12:21:16.532135 26889 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:16.544140 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1721) took 3167 ms. Trace:
W20260709 12:21:16.546929 23818 leader_election.cc:336] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 3.121s (SENT)
I20260709 12:21:17.107985 24002 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.126951 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:16.692366 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.436753 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:17.042323 23967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.011s	sys 0.022s
W20260709 12:21:17.131389 23967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.011s	sys 0.022s
W20260709 12:21:17.132170 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.436092 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:17.059530 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:17.135250 24554 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.046954 26890 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:17.062634 23928 raft_consensus.cc:2410] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:21:17.043745 23926 rpcz_store.cc:276] 0709 12:21:14.963398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.975742 (+ 12344us) service_pool.cc:224] Handling call
0709 12:21:14.992785 (+ 17043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.095670 (+102885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.095705 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:15.119928 (+ 24223us) log.cc:844] Serialized 26 byte log entry
0709 12:21:15.468599 (+348671us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:15.468645 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.734146 (+1265501us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b54002e5754. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:16.734218 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:16.734289 (+    71us) raft_consensus.cc:1685] finished
0709 12:21:16.734310 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.734642 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8124,"raft.queue_time_us":5787,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":12438,"spinlock_wait_cycles":202862464,"thread_start_us":179752,"threads_started":1,"wal-append.queue_time_us":346049,"wal-append.run_cpu_time_us":2054,"wal-append.run_wall_time_us":1014911}
W20260709 12:21:16.658932 26875 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.994s	user 0.002s	sys 0.000s
I20260709 12:21:16.433456 26553 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:17.065629 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1757) took 3385 ms. Trace:
I20260709 12:21:16.556977 26744 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:17.069319 24563 pending_rounds.cc:107] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:21:17.149930 24563 raft_consensus.cc:2889] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:16.703816 26850 consensus_meta.cc:287] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.101s	user 0.010s	sys 0.002s
W20260709 12:21:16.650914 26887 log.cc:927] Time spent T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.308s	user 0.003s	sys 0.000s
I20260709 12:21:16.658386 26485 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.052825 26892 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:16.565165 26893 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.070358 24557 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:17.071509 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:17.161309 24560 raft_consensus.cc:2368] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:21:17.160017 23893 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:16.437497 26895 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.071005 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:17.043599 26870 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:16.559499 26552 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:16.434545 26726 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:17.095029 26712 consensus_meta.cc:287] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.428s	user 0.012s	sys 0.000s
I20260709 12:21:16.429677 26884 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.683s
W20260709 12:21:17.109855 26847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.044s	sys 0.019s
I20260709 12:21:17.163527 26895 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:17.166848 26847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.045s	sys 0.019s
I20260709 12:21:17.124874 23923 rpcz_store.cc:276] 0709 12:21:13.376939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.377526 (+   587us) service_pool.cc:224] Handling call
0709 12:21:13.377960 (+   434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:13.777017 (+399057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.777057 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:13.872157 (+ 95100us) log.cc:844] Serialized 52 byte log entry
0709 12:21:13.993123 (+120966us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:13.993180 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.993277 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:16.531128 (+2537851us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b240009d4a8. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa2841e59c4 00007fa2841e3acb 00007fa28439edc9 00007fa28439ea55 00007fa28439dfb0 00007fa287014488 00007fa287014be8 00007fa286fec398 00007fa286fe776a 00007fa286fe6bb6
0709 12:21:16.533340 (+  2212us) raft_consensus.cc:1685] finished
0709 12:21:16.533361 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.544043 (+ 10682us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":302972,"raft.queue_time_us":398955,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":88,"spinlock_wait_cycles":16951936,"thread_start_us":120437,"threads_started":1,"wal-append.queue_time_us":242255}
I20260709 12:21:16.431173 26764 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.140961 24002 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:17.134428 23927 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:17.124284 26430 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.172258 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:17.172528 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:17.173549 23929 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:17.113255 26900 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.153441 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:17.155581 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 608662us
I20260709 12:21:17.146304 23999 rpcz_store.cc:276] 0709 12:21:13.680109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.680801 (+   692us) service_pool.cc:224] Handling call
0709 12:21:13.840422 (+159621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.181703 (+341281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:14.181739 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:15.116625 (+934886us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b2c0011d7e8. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa285d45a11 00007fa285d55372 00007fa287487a01 00007fa28744c43a 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2
0709 12:21:15.117061 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 12:21:15.294995 (+177934us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:15.295032 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.295112 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:17.042723 (+1747611us) raft_consensus.cc:1685] finished
0709 12:21:17.042747 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.065543 (+ 22796us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27145,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":69,"spinlock_wait_cycles":10443648,"thread_start_us":483588,"threads_started":2,"wal-append.queue_time_us":401065}
I20260709 12:21:17.156301 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:17.180632 23929 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 302) took 2195 ms (client timeout 1552 ms). Trace:
I20260709 12:21:17.181002 23928 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
W20260709 12:21:17.181042 23929 rpcz_store.cc:269] 0709 12:21:14.985701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.383570 (+397869us) service_pool.cc:224] Handling call
0709 12:21:17.172394 (+1788824us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:21:17.180561 (+  8167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5709056}
I20260709 12:21:17.181941 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:17.158006 24554 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:17.159524 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:17.183189 23926 raft_consensus.cc:2393] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:17.139480 26821 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:17.164255 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 738582us
I20260709 12:21:17.149483 26553 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.162266 23893 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:17.169147 26907 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.153317 26833 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:17.144337 24001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.015s	sys 0.043s
I20260709 12:21:17.172359 23922 raft_consensus.cc:3055] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:21:17.194839 24001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.016s	sys 0.044s
I20260709 12:21:17.194900 23922 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:17.150820 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:17.118505 26840 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:17.173040 24563 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:17.175460 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:17.176249 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:17.177655 26754 consensus_meta.cc:287] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.773s	user 0.009s	sys 0.001s
I20260709 12:21:17.238497 26754 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.239346 26430 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.178781 24557 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:17.240897 26754 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.241307 26900 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.130654 26632 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.165643 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1734) took 1598 ms. Trace:
I20260709 12:21:17.162102 26903 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.139106 26835 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.187451 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.164758 26485 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:17.186390 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1777) took 2709 ms. Trace:
I20260709 12:21:17.110824 26537 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:17.187116 23966 leader_election.cc:336] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.064s (SENT)
I20260709 12:21:17.191419 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:17.191752 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:17.191926 24002 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:21:17.193117 23893 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:17.189188 26726 raft_consensus.cc:697] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:17.197111 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:17.195755 23922 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.158607 26850 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.167744 26712 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.165902 26893 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.203718 26892 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:21:17.209940 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:17.328850 24559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 680) took 1840 ms. Trace:
I20260709 12:21:17.329267 24562 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:17.251919 23923 raft_consensus.cc:2393] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:17.331246 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:17.332093 23997 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.334023 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:17.204062 24524 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:17.252468 23925 rpcz_store.cc:276] 0709 12:21:15.567103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.573142 (+  6039us) service_pool.cc:224] Handling call
0709 12:21:15.595089 (+ 21947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.662366 (+ 67277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.662399 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:15.662438 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:15.662482 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.165469 (+1502987us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b5400119ed4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:17.165506 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.165597 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154170112}
W20260709 12:21:17.336906 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 132910us
W20260709 12:21:17.266899 26765 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.855s	user 0.008s	sys 0.005s
W20260709 12:21:17.235091 26876 consensus_meta.cc:287] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.961s	user 0.012s	sys 0.001s
I20260709 12:21:17.329384 24559 rpcz_store.cc:276] 0709 12:21:15.488190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.488346 (+   156us) service_pool.cc:224] Handling call
0709 12:21:15.498216 (+  9870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.498449 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:15.590811 (+ 92362us) log.cc:844] Serialized 14 byte log entry
0709 12:21:17.328278 (+1737467us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b1800461980. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287
0709 12:21:17.328403 (+   125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:17.328468 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:17.328537 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.328626 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.328780 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29606,"prepare.queue_time_us":107703,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":152813,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":15717,"spinlock_wait_cycles":113014912,"thread_start_us":442644,"threads_started":3,"wal-append.queue_time_us":206370}
I20260709 12:21:17.306779 23922 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.308429 24000 rpcz_store.cc:276] 0709 12:21:14.478329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.659293 (+1180964us) service_pool.cc:224] Handling call
0709 12:21:15.676217 (+ 16924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.698001 (+ 21784us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:15.799654 (+101653us) log.cc:844] Serialized 14 byte log entry
0709 12:21:16.839227 (+1039573us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b1800183940. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f522 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:17.172558 (+333331us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b1800183940. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287
0709 12:21:17.186074 (+ 13516us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:17.186130 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:17.186175 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.186234 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.186336 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29015,"prepare.queue_time_us":415262,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":204607,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":31526912,"thread_start_us":575489,"threads_started":3,"wal-append.queue_time_us":384926}
I20260709 12:21:17.327060 26485 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:17.307617 23929 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:17.367525 23969 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:17.308013 23928 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.314256 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:17.319803 26723 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.319892 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:17.345216 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:17.320456 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.370684 23923 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:17.371063 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:17.371109 23999 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:17.338157 26900 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:17.322005 26850 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:17.322609 26906 log.cc:927] Time spent T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:21:17.189363 26821 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:17.324131 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.324064 26712 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:17.324774 23920 raft_consensus.cc:2368] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6.
I20260709 12:21:17.325461 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:17.196784 26538 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:17.327471 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 134379us
I20260709 12:21:17.389117 23924 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:17.389722 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1784) took 1940 ms. Trace:
I20260709 12:21:17.357331 24556 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:17.391623 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:17.344786 24524 leader_election.cc:336] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.928s (SENT)
I20260709 12:21:17.344921 26876 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:17.359598 23892 connection.cc:256] RPC call timeout handler was delayed by -1.5018245090000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 12:21:17.368783 23922 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:21:17.397087 23892 connection.cc:256] RPC call timeout handler was delayed by -1.4550245089999407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
I20260709 12:21:17.371858 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 320) took 1002 ms. Trace:
I20260709 12:21:17.397434 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 320) took 1887 ms. Trace:
W20260709 12:21:17.397465 23892 connection.cc:256] RPC call timeout handler was delayed by -1.4316245089999029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 12:21:17.390288 24001 rpcz_store.cc:276] 0709 12:21:15.448962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.366589 (+917627us) service_pool.cc:224] Handling call
0709 12:21:16.366874 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:16.367094 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:16.551083 (+183989us) log.cc:844] Serialized 14 byte log entry
0709 12:21:17.389252 (+838169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:17.389326 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:17.389394 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.389486 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.389646 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":472252,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":126881,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"thread_start_us":1021292,"threads_started":3,"wal-append.queue_time_us":626844}
I20260709 12:21:17.397842 23922 rpcz_store.cc:276] 0709 12:21:15.510049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.510221 (+   172us) service_pool.cc:224] Handling call
0709 12:21:15.510553 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.172266 (+1661713us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54003ca3a0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873c3dc0 00007fa28744e1c0 00007fa28744f231 00007fa28744bd8f 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c
0709 12:21:17.397164 (+224898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.397378 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271555456}
I20260709 12:21:17.343277 26905 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:17.392786 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 204329us
I20260709 12:21:17.261298 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:17.399062 26905 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.399267 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:17.399498 26905 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.399652 23922 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:21:17.399950 24001 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:17.400235 23818 leader_election.cc:336] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.839s (SENT)
I20260709 12:21:17.359884 26910 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.394520 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:17.401078 23926 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:17.400982 26910 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.307554 24002 pending_rounds.cc:85] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 4
W20260709 12:21:17.394593 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 49868.5us
I20260709 12:21:17.369946 26485 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:17.396116 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:17.321072 26632 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.397641 23999 rpcz_store.cc:276] 0709 12:21:16.369242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.306574 (+937332us) service_pool.cc:224] Handling call
0709 12:21:17.371800 (+ 65226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:17.390411 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:17.406270 23924 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
W20260709 12:21:17.402614 24524 leader_election.cc:336] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.995s (SENT)
W20260709 12:21:17.406709 23818 leader_election.cc:336] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.062s (SENT)
I20260709 12:21:17.407073 23925 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:17.407032 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:17.403043 24002 pending_rounds.cc:107] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:21:17.402989 23927 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:17.403568 23892 connection.cc:256] RPC call timeout handler was delayed by -1.3119245089999367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 12:21:17.408269 23892 connection.cc:256] RPC call timeout handler was delayed by -1.3119245089999367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 12:21:17.408434 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:17.409207 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 1988) took 1137 ms. Trace:
I20260709 12:21:17.409637 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1739) took 1841 ms. Trace:
I20260709 12:21:17.409564 23929 rpcz_store.cc:276] 0709 12:21:16.271905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.403988 (+1132083us) service_pool.cc:224] Handling call
0709 12:21:17.409150 (+  5162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:17.410068 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:17.410065 23927 rpcz_store.cc:276] 0709 12:21:15.568408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.399808 (+1831400us) service_pool.cc:224] Handling call
0709 12:21:17.402824 (+  3016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.409402 (+  6578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.409583 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:17.410969 24002 raft_consensus.cc:2889] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.405371 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:17.411198 24001 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:17.411392 24002 pending_rounds.cc:107] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:21:17.388703 26900 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:17.400333 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1738) took 1832 ms. Trace:
I20260709 12:21:17.411823 23999 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:17.408615 23892 connection.cc:256] RPC call timeout handler was delayed by -1.2588245089998509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
I20260709 12:21:17.412151 23922 rpcz_store.cc:276] 0709 12:21:15.568225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.399060 (+1830835us) service_pool.cc:224] Handling call
0709 12:21:17.399346 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.400090 (+   744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.400278 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:17.412606 23892 connection.cc:256] RPC call timeout handler was delayed by -1.0851245089997974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 12:21:17.412964 23892 connection.cc:256] RPC call timeout handler was delayed by -1.0653245089999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 12:21:17.413301 23892 connection.cc:256] RPC call timeout handler was delayed by -1.0140245089999098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 12:21:17.336994 26879 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:17.417435 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 230323us
W20260709 12:21:17.418138 23966 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.126s (SENT)
W20260709 12:21:17.419916 23966 leader_election.cc:336] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.176s (SENT)
I20260709 12:21:17.420323 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:17.415385 26889 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:17.422703 23929 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:17.423449 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1742) took 1065 ms. Trace:
I20260709 12:21:17.423799 23929 rpcz_store.cc:276] 0709 12:21:16.358079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.410435 (+1052356us) service_pool.cc:224] Handling call
0709 12:21:17.422346 (+ 11911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.423172 (+   826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.423394 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28928}
I20260709 12:21:17.425566 26821 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:17.425956 26632 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:17.405031 26850 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.426838 26632 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:17.267238 26903 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.427486 26712 consensus_queue.cc:1059] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:21:17.413692 23924 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:17.428323 26552 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:17.428610 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1740) took 1071 ms. Trace:
I20260709 12:21:17.428732 26552 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:17.429039 23924 rpcz_store.cc:276] 0709 12:21:16.357320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.407029 (+1049709us) service_pool.cc:224] Handling call
0709 12:21:17.407373 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.428367 (+ 20994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.428560 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:17.429728 26552 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.430460 23924 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:17.431031 26552 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.433120 26510 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.392179 26840 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:17.395872 26723 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.433944 26723 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.434792 26893 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:17.415520 26726 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.436018 26723 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.437503 26895 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.438537 23927 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:17.438823 23998 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:17.439137 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1743) took 1065 ms. Trace:
I20260709 12:21:17.439514 23927 rpcz_store.cc:276] 0709 12:21:16.373832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.437942 (+1064110us) service_pool.cc:224] Handling call
0709 12:21:17.438255 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.438907 (+   652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.439086 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:17.440408 26895 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:17.440793 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.441557 23998 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:17.441829 26910 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:17.442991 26537 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.404098 26904 consensus_queue.cc:1059] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:21:17.444880 26904 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:17.445205 26904 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:17.445363 26833 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:17.446033 26744 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:17.446578 26744 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.447117 25848 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:17.448622 26744 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:17.346283 26765 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:17.445223 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.452466 26765 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:17.427205 26632 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:17.454108 26632 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.394902 26538 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:17.455327 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:17.455547 26538 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:17.455869 23893 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:17.455992 23851 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:17.415154 26847 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:17.405920 26868 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:21:17.430262 26553 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.431056 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1745) took 1041 ms. Trace:
I20260709 12:21:17.469915 23924 rpcz_store.cc:276] 0709 12:21:16.390053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.429808 (+1039755us) service_pool.cc:224] Handling call
0709 12:21:17.430138 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.430819 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.431003 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:17.454560 26835 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:17.197579 26907 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:17.460999 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.411966 24002 raft_consensus.cc:2889] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.463445 23928 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:17.491241 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:17.489673 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:17.464709 23999 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:17.492362 23924 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:17.415520 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:17.468479 23926 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:17.472666 26915 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.468292 26833 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.446092 26904 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.473786 26903 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:17.474335 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 54441.4us
I20260709 12:21:17.469532 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:17.475943 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:17.498343 24001 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.481422 23997 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
W20260709 12:21:17.498972 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 83515.4us
I20260709 12:21:17.499735 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.500391 23892 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:17.501046 23997 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:17.413317 26900 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.475214 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:17.495112 23924 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:17.507874 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1749) took 1116 ms. Trace:
I20260709 12:21:17.508229 23924 rpcz_store.cc:276] 0709 12:21:16.391538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.493401 (+1101863us) service_pool.cc:224] Handling call
0709 12:21:17.493865 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.507615 (+ 13750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.507816 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:17.497414 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:17.411198 23818 leader_election.cc:336] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.185s (SENT)
W20260709 12:21:17.512748 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 101572us
W20260709 12:21:17.512849 23966 leader_election.cc:336] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.259s (SENT)
I20260709 12:21:17.513448 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:17.502840 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.491269 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:17.498548 23820 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:17.506887 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1679) took 2533 ms. Trace:
I20260709 12:21:17.455331 26632 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:17.514591 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:17.515190 24002 rpcz_store.cc:276] 0709 12:21:14.973521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.826479 (+852958us) service_pool.cc:224] Handling call
0709 12:21:15.826800 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:16.727829 (+901029us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400261720. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873c3dc0 00007fa28744e1c0 00007fa28744f231 00007fa28744bd8f 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c
0709 12:21:17.506535 (+778706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.506827 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629702912}
W20260709 12:21:17.513527 23818 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.209s (SENT)
I20260709 12:21:17.522780 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.523653 24002 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:17.518252 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.524802 23999 raft_consensus.cc:2393] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:17.501693 23923 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
W20260709 12:21:17.519380 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 44231.8us
W20260709 12:21:17.525204 23818 leader_election.cc:336] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.234s (SENT)
W20260709 12:21:17.526203 23818 leader_election.cc:336] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.245s (SENT)
I20260709 12:21:17.526628 23818 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:17.520624 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 106561us
I20260709 12:21:17.490190 26510 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:17.528414 24524 leader_election.cc:336] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.031s (SENT)
I20260709 12:21:17.529233 23997 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:17.529708 23928 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:17.530503 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.532313 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:17.535681 24001 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:17.537376 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:17.489645 26840 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:17.540122 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:17.532491 24002 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:17.543690 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:17.544450 24002 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:17.540529 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:17.504061 26553 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:17.546842 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 47318.5us
I20260709 12:21:17.514003 26754 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:17.527527 26614 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:17.514169 26723 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:17.553035 24524 leader_election.cc:336] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.153s (SENT)
I20260709 12:21:17.553546 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:17.468163 26474 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:21:17.527684 26847 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:17.554036 23966 connection.cc:256] RPC call timeout handler was delayed by -1.1102057440000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 12:21:17.589758 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1701) took 2112 ms. Trace:
I20260709 12:21:17.563946 24002 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:17.590024 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.556046 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:17.591153 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0958057440000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 12:21:17.591179 23893 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:17.489336 26567 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 12:21:17.591516 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.593184 24001 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
W20260709 12:21:17.611032 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.593400 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.551498 26754 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.530720 26903 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:17.605242 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 52235.8us
W20260709 12:21:17.612239 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0544057439999506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 12:21:17.549377 26904 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:17.612274 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 81232.4us
I20260709 12:21:17.541791 26910 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:17.554801 26915 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:17.614948 24002 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:17.571532 26878 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:17.589821 26847 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.624863 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.555023 26537 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:17.618147 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0544057439999506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 12:21:17.626766 26847 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:17.629215 26567 consensus_queue.cc:1059] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:17.630057 26840 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.630781 26567 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:17.633291 26567 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:17.639084 26567 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:17.640549 26567 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.643908 26907 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:17.645247 26485 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.551927 26614 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.570730 26510 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:17.620884 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:17.613533 26780 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:17.624341 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1741) took 1266 ms. Trace:
I20260709 12:21:17.625814 24001 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
W20260709 12:21:17.634893 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0445057439999346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 12:21:17.617679 26754 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:17.618296 24524 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.169s (SENT)
I20260709 12:21:17.645860 26567 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.613695 23999 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
W20260709 12:21:17.664177 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:17.652436 24525 leader_election.cc:336] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.005s (SENT)
I20260709 12:21:17.622247 26712 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:17.772284 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0445057439999346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 12:21:17.772495 24524 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:17.771628 23925 rpcz_store.cc:276] 0709 12:21:16.357724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.407781 (+1050057us) service_pool.cc:224] Handling call
0709 12:21:17.435323 (+ 27542us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327eee 000000000036eb39 00007fa28c39b1e0 00007fa28c4640c4 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:21:17.435462 (+   139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:17.435850 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.435877 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:17.436369 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:21:17.509241 (+ 72872us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:17.509293 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.509360 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:17.623314 (+113954us) raft_consensus.cc:1685] finished
0709 12:21:17.623336 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.624254 (+   918us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":782,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":105,"spinlock_wait_cycles":26991360,"thread_start_us":72510,"threads_started":1,"wal-append.queue_time_us":72830}
I20260709 12:21:17.779156 24525 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:17.783464 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0337057439999171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 12:21:17.784190 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 131817us
I20260709 12:21:17.784402 23925 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:17.779563 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 158709us
I20260709 12:21:17.784691 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:17.785059 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1755) took 1391 ms. Trace:
I20260709 12:21:17.627785 26537 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.785423 23925 rpcz_store.cc:276] 0709 12:21:16.393726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.783924 (+1390198us) service_pool.cc:224] Handling call
0709 12:21:17.784240 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.784823 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.785003 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:17.649871 26833 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.789610 23926 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:17.793478 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:17.790108 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 171859us
W20260709 12:21:17.800240 24524 leader_election.cc:336] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.247s (SENT)
W20260709 12:21:17.801113 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 274924us
I20260709 12:21:17.795563 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1707) took 1552 ms. Trace:
I20260709 12:21:17.802142 24003 rpcz_store.cc:276] 0709 12:21:16.242978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.354996 (+112018us) service_pool.cc:224] Handling call
0709 12:21:17.795359 (+1440363us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001c75d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:17.795497 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2395132288}
I20260709 12:21:17.792531 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:17.770385 26614 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.804869 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.805979 24001 raft_consensus.cc:2410] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:21:17.803423 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.811440 24003 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:17.812888 23966 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:17.819135 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:17.793074 26537 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:17.788626 26878 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:17.833446 23966 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:17.810075 26895 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:17.832012 26833 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:21:17.788980 26921 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:17.798717 26780 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:17.843477 26895 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:17.846411 26895 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:17.850247 26880 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 1.988s	user 0.011s	sys 0.013s
I20260709 12:21:17.851082 26510 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:17.854511 26891 log.cc:927] Time spent T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 1.519s	user 0.005s	sys 0.005s
I20260709 12:21:17.859105 26485 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:17.860071 26765 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:17.835011 26889 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:21:17.809116 26893 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:17.863943 26893 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:17.809321 26728 consensus_queue.cc:1059] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:21:17.866041 26567 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:17.867714 26567 consensus_queue.cc:1059] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:17.867887 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.868921 23997 raft_consensus.cc:2393] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:17.835171 26876 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:21:17.798389 26712 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:17.872047 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.872525 26712 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:17.835299 26913 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:17.833253 26835 raft_consensus.cc:2764] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:21:17.881067 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.883049 23997 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:17.898667 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.873848 26811 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:17.904300 23997 raft_consensus.cc:2393] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:17.925581 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 1979) took 2177 ms. Trace:
I20260709 12:21:17.926360 23920 rpcz_store.cc:276] 0709 12:21:15.748462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.902652 (+154190us) service_pool.cc:224] Handling call
0709 12:21:17.925263 (+2022611us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540005fad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:17.925490 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3267373952}
I20260709 12:21:17.905079 23966 leader_election.cc:400] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:21:17.873749 26921 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:17.912290 26835 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.878114 26913 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:17.930487 23966 leader_election.cc:403] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:17.945629 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1680) took 2965 ms. Trace:
I20260709 12:21:17.946282 24004 rpcz_store.cc:276] 0709 12:21:14.980012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.903927 (+923915us) service_pool.cc:224] Handling call
0709 12:21:16.192019 (+288092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:16.193287 (+  1268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.941550 (+1748263us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540009a6d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:17.945522 (+  3972us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661649664}
I20260709 12:21:17.921520 26744 raft_consensus.cc:3055] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:17.952908 26839 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:17.907366 26811 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:17.965267 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 89877.4us
I20260709 12:21:17.970500 24004 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:17.975186 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 323) took 1605 ms. Trace:
I20260709 12:21:17.975816 24004 rpcz_store.cc:276] 0709 12:21:16.370133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.968713 (+1598580us) service_pool.cc:224] Handling call
0709 12:21:17.969127 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.973154 (+  4027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.975106 (+  1952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:17.978718 24004 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:17.953231 26847 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:17.981030 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.940337 26921 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:17.961922 26913 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.971130 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:17.964540 26744 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:17.975549 26811 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:17.986284 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1704) took 1744 ms. Trace:
I20260709 12:21:17.972998 26915 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:21:17.988852 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1751) took 1596 ms. Trace:
I20260709 12:21:17.982892 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:17.994589 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 388804us
W20260709 12:21:18.036301 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 53496us
I20260709 12:21:18.037043 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:18.038177 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:17.971809 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 177135us
I20260709 12:21:18.042307 26535 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:18.043066 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.042573 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:18.043030 26535 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:18.046128 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:17.978993 26924 raft_consensus.cc:3055] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:17.964265 26835 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:18.045172 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:18.054984 23849 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:18.056632 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.064826 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.066718 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:18.076331 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 485195us
I20260709 12:21:18.052366 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:18.134109 23851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60686
I20260709 12:21:18.137864 23851 raft_consensus.cc:606] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Received request to transfer leadership
I20260709 12:21:18.054160 26850 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:18.117480 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.044515 26907 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:18.138327 23851 raft_consensus.cc:614] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:18.050711 26840 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:18.059764 26924 raft_consensus.cc:740] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:18.140319 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.032152 26833 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.140859 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:18.170279 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 93003.3us
I20260709 12:21:18.143208 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1754) took 1749 ms. Trace:
I20260709 12:21:18.172618 23923 rpcz_store.cc:276] 0709 12:21:16.393390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.526203 (+1132813us) service_pool.cc:224] Handling call
0709 12:21:17.526594 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.526849 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:17.795954 (+269105us) log.cc:844] Serialized 14 byte log entry
0709 12:21:18.142726 (+346772us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:18.142794 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:18.142859 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.142949 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:18.143123 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43050,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":949,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":14231,"thread_start_us":594969,"threads_started":2}
I20260709 12:21:18.146847 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:18.147668 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:18.177454 23845 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.177814 23849 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:18.179083 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.059979 26839 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:18.171670 23893 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:18.185823 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:18.149942 26870 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.040s	sys 0.075s
I20260709 12:21:18.053360 26537 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:18.188388 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:18.195462 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 377379us
I20260709 12:21:18.193070 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:18.203819 23893 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:18.197187 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 368706us
I20260709 12:21:18.210441 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:18.210952 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:18.212764 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.213506 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:18.214931 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:18.215687 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.215847 23893 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:18.171700 26821 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:18.194657 26870 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.040s	sys 0.076s
I20260709 12:21:18.224530 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:18.225334 24559 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:18.225924 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:18.226248 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:18.226534 24562 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.226924 24557 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:18.218230 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.219920 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.220304 24554 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:18.220551 24558 raft_consensus.cc:2368] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:21:18.189532 26510 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:18.191411 26552 consensus_meta.cc:287] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.003s
I20260709 12:21:18.222206 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.230129 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.231734 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:18.230157 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:18.244653 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:18.231602 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:18.267267 24554 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:18.232328 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:18.270495 24561 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:18.270578 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:18.202183 26907 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.277189 26939 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:18.277768 26939 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.212321 26910 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:18.201906 26893 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:18.277462 26932 log.cc:927] Time spent T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:21:18.295570 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:18.296845 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.264999 26510 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:18.222568 26726 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:18.231002 26923 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:21:18.307260 23849 raft_consensus.cc:2410] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:21:18.303413 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:17.591223 23998 rpcz_store.cc:276] 0709 12:21:15.477701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.442126 (+1964425us) service_pool.cc:224] Handling call
0709 12:21:17.442365 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.442547 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:17.443089 (+   542us) log.cc:844] Serialized 14 byte log entry
0709 12:21:17.589348 (+146259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:17.589413 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:17.589461 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.589539 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.589692 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":37220,"thread_start_us":111547,"threads_started":1}
I20260709 12:21:18.191182 26833 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:18.319118 23845 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:18.320880 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.320961 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:18.308279 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 263158us
I20260709 12:21:18.232888 26610 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:18.321475 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:18.278139 26939 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.224313 26632 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:18.325095 23998 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:18.327478 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.221535 26889 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:21:18.332983 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:18.321909 26882 log.cc:927] Time spent T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 2.145s	user 0.005s	sys 0.005s
I20260709 12:21:18.276345 26474 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:21:18.335722 24560 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:18.350366 23969 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:18.321269 26910 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:18.356205 23969 leader_election.cc:400] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:21:18.335186 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1792) took 1188 ms. Trace:
I20260709 12:21:18.314355 26510 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:18.326333 26610 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:18.343614 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:18.351176 23851 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:18.329347 26632 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:18.352608 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.354065 24560 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:18.364948 24562 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:18.356662 23969 leader_election.cc:403] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:21:18.314146 26726 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.357285 23998 rpcz_store.cc:276] 0709 12:21:17.146500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.324655 (+1178155us) service_pool.cc:224] Handling call
0709 12:21:18.324934 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.333259 (+  8325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.335096 (+  1837us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:18.336015 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 124110us
I20260709 12:21:18.279150 26937 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 12:21:18.310513 26925 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 12:21:18.375293 23995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1685) took 3310 ms (client timeout 3342 ms). Trace:
W20260709 12:21:18.358474 26922 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.380s	user 0.001s	sys 0.001s
I20260709 12:21:18.224627 26744 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:18.378057 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.363533 26610 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.368340 26632 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:18.374610 23820 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:18.382437 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:18.401059 23849 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:18.382465 23995 rpcz_store.cc:269] 0709 12:21:15.057045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.563908 (+506863us) service_pool.cc:224] Handling call
0709 12:21:18.366741 (+2802833us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540034b054. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:18.366890 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3379763456}
I20260709 12:21:18.358780 26840 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:18.397692 23845 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:18.402777 23995 raft_consensus.cc:1240] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:18.359761 26900 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.837s	user 0.015s	sys 0.005s
I20260709 12:21:18.288657 26924 consensus_queue.cc:260] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:18.391866 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 176074us
I20260709 12:21:18.399498 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:18.372189 26726 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:18.385286 26654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.012s	sys 0.004s
I20260709 12:21:18.413317 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:18.381338 26847 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:18.411049 23893 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:18.407828 26535 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:18.434610 26929 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:18.435103 26929 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.435441 26929 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:18.435719 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1756) took 2041 ms. Trace:
W20260709 12:21:18.436424 26614 consensus_meta.cc:287] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.003s
I20260709 12:21:18.436909 26614 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:18.434265 23893 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:18.444864 26552 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:18.445338 26552 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.446076 26903 consensus_queue.cc:1059] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:18.447100 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:18.447741 26538 consensus_meta.cc:287] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.992s	user 0.011s	sys 0.000s
I20260709 12:21:18.448200 26538 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:18.448657 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.449409 23927 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:18.451213 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1746) took 2060 ms. Trace:
W20260709 12:21:18.451356 23996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 321) took 2081 ms (client timeout 2005 ms). Trace:
W20260709 12:21:18.451759 23996 rpcz_store.cc:269] 0709 12:21:16.369527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.401699 (+ 32172us) service_pool.cc:224] Handling call
0709 12:21:18.451194 (+2049495us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b540021a2d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:18.451294 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34721664}
I20260709 12:21:18.453117 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:18.421895 26885 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 2.200s	user 0.012s	sys 0.000s
W20260709 12:21:18.449038 26895 consensus_meta.cc:287] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.602s	user 0.005s	sys 0.005s
W20260709 12:21:18.424671 26938 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:21:18.424738 26840 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:21:18.445744 26552 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:18.425823 26930 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 12:21:18.479815 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:18.439251 26931 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.280s	user 0.003s	sys 0.000s
I20260709 12:21:18.426414 26952 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:21:18.427057 26905 consensus_meta.cc:287] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 1.027s	user 0.012s	sys 0.000s
I20260709 12:21:18.410358 26835 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:18.427798 26833 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:18.428933 26945 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:18.430454 26910 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:18.361959 26915 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:21:18.431805 26937 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:18.447758 24000 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.455833 24558 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:18.451589 23927 rpcz_store.cc:276] 0709 12:21:16.390440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.440246 (+1049806us) service_pool.cc:224] Handling call
0709 12:21:17.440544 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.449826 (+1009282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.450931 (+  1105us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000118d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:18.451150 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319714560}
I20260709 12:21:18.458753 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:18.453720 23996 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:18.463219 24559 raft_consensus.cc:2410] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:21:18.464834 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 128053us
W20260709 12:21:18.423636 26944 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:21:18.468263 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:18.417496 26654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.012s	sys 0.005s
I20260709 12:21:18.436161 23925 rpcz_store.cc:276] 0709 12:21:16.394103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.790345 (+1396242us) service_pool.cc:224] Handling call
0709 12:21:17.790725 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:17.791196 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.791238 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:17.810373 (+ 19135us) log.cc:844] Serialized 52 byte log entry
0709 12:21:18.168337 (+357964us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:18.194376 (+ 26039us) log.cc:844] Serialized 14 byte log entry
0709 12:21:18.194630 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.194715 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:18.435448 (+240733us) raft_consensus.cc:1685] finished
0709 12:21:18.435469 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:18.435635 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":803,"prepare.queue_time_us":33492,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3710,"raft.queue_time_us":8067,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":20185,"thread_start_us":296869,"threads_started":1,"wal-append.queue_time_us":596258}
W20260709 12:21:18.425316 26933 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:21:18.426146 26744 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.466499 26893 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.417197 26900 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:18.447144 26903 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:21:18.475396 26430 consensus_queue.cc:1059] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:21:18.487582 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:18.517030 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 142534us
W20260709 12:21:18.645390 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.466224 26924 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:19.022496 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.655269 24557 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:18.558650 26840 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:19.034206 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:19.034765 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:18.933616 23849 consensus_meta.cc:287] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.001s
W20260709 12:21:18.525444 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 128156us
I20260709 12:21:19.024035 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1752) took 2631 ms. Trace:
I20260709 12:21:18.032433 24001 rpcz_store.cc:276] 0709 12:21:16.241988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.814560 (+1572572us) service_pool.cc:224] Handling call
0709 12:21:17.814993 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.815250 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:17.841146 (+ 25896us) log.cc:844] Serialized 14 byte log entry
0709 12:21:17.985833 (+144687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:17.985909 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:17.985958 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.986038 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.986188 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27189,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":8224,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":42762,"thread_start_us":137847,"threads_started":1}
I20260709 12:21:18.719477 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:18.602733 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:18.680073 23999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.000s	sys 0.008s
W20260709 12:21:18.677466 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 470566us
I20260709 12:21:18.825855 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:18.928479 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:19.016943 23893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.009s	sys 0.006s
I20260709 12:21:18.564163 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:19.023525 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 971210us
I20260709 12:21:18.034554 23924 rpcz_store.cc:276] 0709 12:21:16.392203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.509149 (+1116946us) service_pool.cc:224] Handling call
0709 12:21:17.509503 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.509738 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:17.790318 (+280580us) log.cc:844] Serialized 14 byte log entry
0709 12:21:17.988449 (+198131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:17.988496 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:17.988541 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.988642 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.988786 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59823,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":88,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":42729,"thread_start_us":477879,"threads_started":2}
W20260709 12:21:19.030794 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.475591 26868 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:19.035240 23925 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:19.068913 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.519691 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 346) took 1045 ms. Trace:
I20260709 12:21:19.070040 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:18.850809 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 581) took 1789 ms. Trace:
I20260709 12:21:19.070739 24556 rpcz_store.cc:276] 0709 12:21:17.061261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.062694 (+  1433us) service_pool.cc:224] Handling call
0709 12:21:17.130448 (+ 67754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.395788 (+265340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.850431 (+1454643us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54002c5e54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:18.850704 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492420992}
I20260709 12:21:19.071810 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:19.058351 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:19.072875 23999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.002s	sys 0.019s
I20260709 12:21:19.073135 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2017) took 1026 ms. Trace:
I20260709 12:21:19.073563 23927 rpcz_store.cc:276] 0709 12:21:18.046897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.033232 (+986335us) service_pool.cc:224] Handling call
0709 12:21:19.073072 (+ 39840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.075234 23845 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:19.075414 23849 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:19.038384 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:18.808918 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1750) took 2417 ms. Trace:
W20260709 12:21:19.075479 23893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.010s	sys 0.006s
W20260709 12:21:18.840466 26947 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.420s	user 0.002s	sys 0.000s
I20260709 12:21:19.077610 24559 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:21:19.088899 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.078796 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2013) took 1032 ms. Trace:
I20260709 12:21:19.124506 23925 rpcz_store.cc:276] 0709 12:21:18.046039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.033940 (+987901us) service_pool.cc:224] Handling call
0709 12:21:19.078733 (+ 44793us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.125422 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:19.083827 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:19.096086 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1786) took 1963 ms. Trace:
I20260709 12:21:19.101063 24557 raft_consensus.cc:2410] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:21:19.127681 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:19.079034 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:19.078440 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2014) took 1032 ms. Trace:
I20260709 12:21:19.129019 23924 rpcz_store.cc:276] 0709 12:21:18.046270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.069746 (+1023476us) service_pool.cc:224] Handling call
0709 12:21:19.078383 (+  8637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.130030 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:19.130366 23927 raft_consensus.cc:2410] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:21:19.126829 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2022) took 1078 ms. Trace:
I20260709 12:21:19.130811 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2015) took 1084 ms. Trace:
I20260709 12:21:19.131198 23925 rpcz_store.cc:276] 0709 12:21:18.047954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.125188 (+1077234us) service_pool.cc:224] Handling call
0709 12:21:19.126775 (+  1587us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.131523 23927 rpcz_store.cc:276] 0709 12:21:18.046488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.074461 (+1027973us) service_pool.cc:224] Handling call
0709 12:21:19.130753 (+ 56292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.075467 23852 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:18.667061 26943 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:21:19.132184 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:18.829754 26904 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.207s	user 0.010s	sys 0.002s
I20260709 12:21:19.025393 26937 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.082495 23929 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:19.119556 23926 rpcz_store.cc:276] 0709 12:21:16.391875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.493646 (+1101771us) service_pool.cc:224] Handling call
0709 12:21:17.494055 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.799295 (+305240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.808561 (+1009266us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400328f54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:18.808825 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679261056}
I20260709 12:21:18.515389 26537 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:19.153520 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 72240.2us
I20260709 12:21:19.113654 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:18.558044 26950 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:18.666127 26942 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.169416 26942 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:19.170723 26510 consensus_meta.cc:287] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.799s	user 0.006s	sys 0.004s
I20260709 12:21:19.171180 26510 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.171509 24563 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:19.173563 26510 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:19.175021 26510 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.175618 26510 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:19.119290 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 47527.8us
I20260709 12:21:19.122370 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:19.122859 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:19.130798 23924 raft_consensus.cc:2410] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:18.478858 26934 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:19.126864 23999 rpcz_store.cc:276] 0709 12:21:17.133183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.959693 (+826510us) service_pool.cc:224] Handling call
0709 12:21:17.960118 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.960388 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:17.960778 (+   390us) log.cc:844] Serialized 14 byte log entry
0709 12:21:19.095560 (+1134782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.095653 (+    93us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:19.095731 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.095822 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.096001 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23184,"prepare.queue_time_us":1447,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":1112380,"threads_started":1}
I20260709 12:21:19.211134 23999 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:18.555480 26754 consensus_meta.cc:287] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.001s
W20260709 12:21:19.134560 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 60492.6us
I20260709 12:21:19.068217 23928 rpcz_store.cc:276] 0709 12:21:16.392558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.518289 (+1125731us) service_pool.cc:224] Handling call
0709 12:21:17.527205 (+  8916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.532958 (+  5753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.850202 (+1317244us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b540005f0d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:19.023974 (+173772us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19497728}
I20260709 12:21:19.069725 23853 rpcz_store.cc:276] 0709 12:21:17.474578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.474712 (+   134us) service_pool.cc:224] Handling call
0709 12:21:17.475072 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.475270 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:17.798084 (+322814us) log.cc:844] Serialized 14 byte log entry
0709 12:21:18.518252 (+720168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:18.518314 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:18.518796 (+   482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.519482 (+   686us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:18.519622 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33215,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":268240,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"thread_start_us":1039958,"threads_started":3,"wal-append.queue_time_us":592475}
I20260709 12:21:19.137583 23851 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:19.142285 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:19.143514 23969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.051s	sys 0.054s
I20260709 12:21:18.766749 26892 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:19.026722 26839 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:18.667583 26538 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:19.030339 26905 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:18.603688 26907 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:19.152551 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:19.158943 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:19.162099 23736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 56425.5us
W20260709 12:21:19.163018 26935 log.cc:927] Time spent T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.804s	user 0.001s	sys 0.002s
I20260709 12:21:19.520354 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:19.518556 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 271402us
I20260709 12:21:19.521055 23846 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:19.163206 26884 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:19.085458 26567 consensus_queue.cc:1059] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:21:19.177819 26764 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:19.082587 26921 consensus_meta.cc:287] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.082s	user 0.013s	sys 0.000s
I20260709 12:21:18.475350 26895 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.078102 26868 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:19.194011 24000 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
W20260709 12:21:19.520419 26972 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.221s	user 0.000s	sys 0.002s
I20260709 12:21:19.206257 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:19.560285 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 326) took 1347 ms. Trace:
I20260709 12:21:19.560695 23926 rpcz_store.cc:276] 0709 12:21:18.212967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.145290 (+932323us) service_pool.cc:224] Handling call
0709 12:21:19.560206 (+414916us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.202618 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:19.562630 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:19.186211 23845 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 9 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 12:21:19.564188 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2089) took 1087 ms. Trace:
I20260709 12:21:19.190184 24563 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:18.670351 26929 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.222355 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 322) took 1185 ms. Trace:
I20260709 12:21:19.218313 23925 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
W20260709 12:21:19.566207 23925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2016) took 1519 ms (client timeout 1852 ms). Trace:
W20260709 12:21:19.566679 23925 rpcz_store.cc:269] 0709 12:21:18.046692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.131928 (+1085236us) service_pool.cc:224] Handling call
0709 12:21:19.566140 (+434212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.567862 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:19.568821 23925 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:19.209463 26950 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:18.830811 26610 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.616098 26950 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:18.669275 26939 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.619709 26939 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:19.620321 26939 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.620823 26939 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:19.249361 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:19.609683 26632 consensus_meta.cc:287] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.195s	user 0.010s	sys 0.005s
I20260709 12:21:19.622454 24557 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:18.483071 26811 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:19.623322 23995 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:19.624351 26895 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:19.624958 26811 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:19.250880 23969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.052s	sys 0.054s
I20260709 12:21:19.622474 26632 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.628230 23969 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:19.629400 26983 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.159909 26937 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:19.630191 26610 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:19.629943 26983 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.630930 26610 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:19.631541 26610 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:19.632301 26983 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:19.632849 26983 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.633244 26983 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.247684 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:19.198173 26552 consensus_meta.cc:287] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.001s
I20260709 12:21:19.146258 26614 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:19.033645 26893 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:19.088899 23996 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:19.293290 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 325) took 1255 ms. Trace:
W20260709 12:21:19.302860 24004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.005s	sys 0.032s
W20260709 12:21:19.666970 24004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.006s	sys 0.033s
I20260709 12:21:19.666610 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1814) took 1218 ms. Trace:
W20260709 12:21:19.301179 24002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.008s	sys 0.029s
I20260709 12:21:19.256181 26754 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:19.123476 26840 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:19.691908 26983 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:19.296324 26892 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:19.298319 26839 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.251766 26934 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:19.431531 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:19.458511 26948 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 1.051s	user 0.001s	sys 0.018s
I20260709 12:21:19.461127 26942 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:19.462366 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1710) took 2280 ms. Trace:
I20260709 12:21:19.708846 23998 rpcz_store.cc:276] 0709 12:21:17.182127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.385343 (+1203216us) service_pool.cc:224] Handling call
0709 12:21:18.454015 (+ 68672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.454215 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.454246 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:18.454297 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:18.454334 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.454393 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.462206 (+1007813us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b540021a2d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:19.462311 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105584896}
W20260709 12:21:19.480031 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.666575 26952 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:19.659431 26552 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.722288 26952 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.722728 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1813) took 1275 ms. Trace:
I20260709 12:21:19.723664 26552 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:19.724483 26952 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:19.512446 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.181463 26936 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.236s
I20260709 12:21:19.181494 26904 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.726334 26904 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:19.728098 26840 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:19.728454 26904 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:18.509001 26951 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.728s
I20260709 12:21:19.522874 23852 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:19.730489 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2090) took 1240 ms. Trace:
I20260709 12:21:19.730894 23852 rpcz_store.cc:276] 0709 12:21:18.490899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.767026 (+276127us) service_pool.cc:224] Handling call
0709 12:21:19.730413 (+963387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.526793 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1758) took 3115 ms. Trace:
I20260709 12:21:19.731861 23922 rpcz_store.cc:276] 0709 12:21:16.411263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.888486 (+1477223us) service_pool.cc:224] Handling call
0709 12:21:17.888848 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.889086 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:17.905496 (+ 16410us) log.cc:844] Serialized 14 byte log entry
0709 12:21:18.608037 (+702541us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b18002c6560. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a 00007fa287456a2a
0709 12:21:19.526494 (+918457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.526548 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:19.526600 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.526651 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.526744 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70962,"prepare.queue_time_us":16179,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":8492,"raft.queue_time_us":460068,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":13080,"spinlock_wait_cycles":7989632,"thread_start_us":846914,"threads_started":2,"wal-append.queue_time_us":1553421}
I20260709 12:21:19.734242 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:19.735095 23922 raft_consensus.cc:2368] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 3. Current term is 4.
W20260709 12:21:19.735582 23922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 327) took 1522 ms (client timeout 1997 ms). Trace:
W20260709 12:21:19.736002 23922 rpcz_store.cc:269] 0709 12:21:18.213686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.733906 (+1520220us) service_pool.cc:224] Handling call
0709 12:21:19.735514 (+  1608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.530875 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1760) took 3100 ms. Trace:
W20260709 12:21:19.515683 26913 consensus_meta.cc:287] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.462s	user 0.008s	sys 0.006s
W20260709 12:21:19.553269 24000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1791) took 2407 ms (client timeout 2210 ms). Trace:
I20260709 12:21:19.205232 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:19.554250 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:19.553750 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:19.557410 26968 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.246s	user 0.000s	sys 0.002s
W20260709 12:21:19.530514 26726 consensus_meta.cc:287] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.077s	user 0.017s	sys 0.002s
I20260709 12:21:19.565743 23924 rpcz_store.cc:276] 0709 12:21:18.036662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.129740 (+1093078us) service_pool.cc:224] Handling call
0709 12:21:19.222267 (+ 92527us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:19.579190 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:19.557703 26967 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260709 12:21:19.517079 26850 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:19.593748 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 322) took 3224 ms. Trace:
I20260709 12:21:19.593999 26900 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:19.599462 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 52874.2us
I20260709 12:21:19.600701 26960 consensus_queue.cc:1059] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:19.557842 26764 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:19.602507 26962 log.cc:927] Time spent T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:21:19.603660 26969 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:21:19.610097 26474 consensus_queue.cc:1059] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:19.610805 26868 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:19.612481 26744 consensus_meta.cc:287] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 12:21:19.613292 26977 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.614022 26980 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.615113 26905 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:19.634341 26895 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:19.635759 26929 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:19.637866 26510 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:19.639878 26728 raft_consensus.cc:3055] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:19.540235 26485 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:19.629812 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:19.564631 23845 rpcz_store.cc:276] 0709 12:21:18.477389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.130794 (+653405us) service_pool.cc:224] Handling call
0709 12:21:19.185817 (+ 55023us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:19.563805 (+377988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.564117 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:19.609489 26924 consensus_meta.cc:287] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.000s
I20260709 12:21:19.648672 23928 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:19.653744 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 323) took 1616 ms. Trace:
I20260709 12:21:19.660035 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:19.667548 23996 rpcz_store.cc:276] 0709 12:21:18.448055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.452851 (+  4796us) service_pool.cc:224] Handling call
0709 12:21:19.666544 (+1213693us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:19.667937 24002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.009s	sys 0.029s
I20260709 12:21:19.666759 23927 rpcz_store.cc:276] 0709 12:21:18.037420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.132993 (+1095573us) service_pool.cc:224] Handling call
0709 12:21:19.293193 (+160200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.676586 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1811) took 2086 ms. Trace:
I20260709 12:21:19.691052 26610 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:19.654428 26903 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.013s	sys 0.023s
I20260709 12:21:19.511798 23892 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:19.712199 23848 raft_consensus.cc:2393] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:19.713912 26893 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:19.648650 26833 consensus_queue.cc:1059] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:21:19.715407 26939 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:19.716811 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1759) took 3299 ms. Trace:
I20260709 12:21:19.717916 26892 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:19.718706 24554 raft_consensus.cc:2410] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:21:19.558194 26921 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:19.720824 26839 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:19.725481 26754 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:19.628296 26632 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:19.806493 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1744) took 3417 ms. Trace:
I20260709 12:21:19.723239 24001 rpcz_store.cc:276] 0709 12:21:18.447807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.091524 (+643717us) service_pool.cc:224] Handling call
0709 12:21:19.091903 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.721514 (+629611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.721557 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.721616 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:19.721660 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.722441 (+   781us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54001a81d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:19.722503 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.722664 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447371136}
I20260709 12:21:19.778582 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:19.758610 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 225317us
W20260709 12:21:19.835502 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 372863us
I20260709 12:21:20.107532 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 324) took 2266 ms. Trace:
I20260709 12:21:20.017639 26955 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:20.108489 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:19.740852 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.111338 26764 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:20.112320 23854 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:19.736897 23921 rpcz_store.cc:276] 0709 12:21:16.430506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.940236 (+1509730us) service_pool.cc:224] Handling call
0709 12:21:17.940607 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:17.957992 (+ 17385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.958028 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:17.958563 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.198217 (+239654us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:18.198284 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.198390 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:18.435857 (+237467us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b48002601d8. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28c375aa1 00007fa28c36cb37 00007fa28c36c9ca 00007fa28c46426f 00007fa28c463f37 00007fa28c47855c 00007fa28c478508 00007fa28c478488 00007fa28c478443 00007fa28c4776ec 00007fa28b3a1a96
0709 12:21:18.839980 (+404123us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b240009ae68. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa2841e59c4 00007fa2841e3acb 00007fa28439edc9 00007fa28439ea55 00007fa28439e09d 00007fa286fd010e 00007fa286fe788c 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221
0709 12:21:19.530681 (+690701us) raft_consensus.cc:1685] finished
0709 12:21:19.530701 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.530816 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2178,"raft.run_cpu_time_us":1678,"raft.run_wall_time_us":492822,"spinlock_wait_cycles":84934272,"thread_start_us":239168,"threads_started":1,"wal-append.queue_time_us":455767}
I20260709 12:21:20.113272 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:20.107280 23920 rpcz_store.cc:276] 0709 12:21:16.417586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.927615 (+1510029us) service_pool.cc:224] Handling call
0709 12:21:17.928089 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:17.948467 (+ 20378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.948515 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:17.949174 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.172500 (+223326us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:18.172545 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.172620 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:18.837609 (+664989us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:19.458083 (+620474us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b240009ad48. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa2841e59c4 00007fa2841e3acb 00007fa28439edc9 00007fa28439ea55 00007fa28439e09d 00007fa286fd010e 00007fa286fe788c 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221
0709 12:21:19.716455 (+258372us) raft_consensus.cc:1685] finished
0709 12:21:19.716490 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.716699 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11281,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":18528,"spinlock_wait_cycles":31443200,"thread_start_us":195773,"threads_started":1,"wal-append.queue_time_us":377729}
I20260709 12:21:20.114202 23852 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:20.113529 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:20.114534 26764 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:20.115233 23921 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:20.106613 23925 rpcz_store.cc:276] 0709 12:21:18.036933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.567512 (+1530579us) service_pool.cc:224] Handling call
0709 12:21:19.653624 (+ 86112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:20.115761 26726 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:20.106668 23995 rpcz_store.cc:276] 0709 12:21:17.590151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.403836 (+813685us) service_pool.cc:224] Handling call
0709 12:21:18.418726 (+ 14890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.623725 (+1204999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.669762 (+ 46037us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400099cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:19.676503 (+  6741us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2769890176}
W20260709 12:21:20.104019 26986 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:21:20.109612 24003 rpcz_store.cc:276] 0709 12:21:16.369820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.815449 (+1445629us) service_pool.cc:224] Handling call
0709 12:21:17.815840 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:17.836497 (+ 20657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.836538 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:17.845732 (+  9194us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.141892 (+296160us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:18.148640 (+  6748us) log.cc:844] Serialized 14 byte log entry
0709 12:21:18.168607 (+ 19967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.168695 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:18.844182 (+675487us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b1800246fa0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:19.593434 (+749252us) raft_consensus.cc:1685] finished
0709 12:21:19.593532 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.593681 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":214697,"prepare.queue_time_us":26015,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":14024,"raft.queue_time_us":40518,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":12016,"spinlock_wait_cycles":14598528,"thread_start_us":226467,"threads_started":1,"wal-append.queue_time_us":470203}
I20260709 12:21:20.105756 23929 rpcz_store.cc:276] 0709 12:21:16.389595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.424675 (+1035080us) service_pool.cc:224] Handling call
0709 12:21:17.424975 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.144676 (+1719701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.806135 (+661459us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54003d0754. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:19.806407 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3811536640}
W20260709 12:21:20.122514 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:19.787607 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 55202.3us
I20260709 12:21:20.106748 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 597) took 1783 ms. Trace:
W20260709 12:21:19.737236 24000 rpcz_store.cc:269] 0709 12:21:17.146217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.342931 (+196714us) service_pool.cc:224] Handling call
0709 12:21:18.446906 (+1103975us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:21:19.553178 (+1106272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4390656}
I20260709 12:21:20.114588 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:20.148101 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1788) took 3011 ms. Trace:
I20260709 12:21:19.763187 26942 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:20.133567 23928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 331) took 1917 ms (client timeout 1865 ms). Trace:
W20260709 12:21:20.135219 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 623476us
W20260709 12:21:20.181092 23928 rpcz_store.cc:269] 0709 12:21:18.215770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.247337 (+1031567us) service_pool.cc:224] Handling call
0709 12:21:20.133460 (+886123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:20.181563 23892 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:20.182703 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.136610 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:20.183066 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:20.140043 26980 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:20.137519 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:20.172145 26983 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.184890 23925 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:20.151068 26939 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 12:21:20.186537 26984 log.cc:927] Time spent T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:21:20.141204 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:20.141441 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 511701us
I20260709 12:21:20.141492 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:19.767552 26978 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:20.174250 26975 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.515s	user 0.001s	sys 0.001s
I20260709 12:21:20.172610 23851 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:20.171202 23920 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:20.108206 24002 rpcz_store.cc:276] 0709 12:21:17.841050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.603907 (+762857us) service_pool.cc:224] Handling call
0709 12:21:18.604286 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.604551 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:18.633489 (+ 28938us) log.cc:844] Serialized 14 byte log entry
0709 12:21:20.107179 (+1473690us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:20.107238 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:20.107287 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.107360 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.107475 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28758,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":311432,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":18531,"thread_start_us":1473144,"threads_started":2,"wal-append.queue_time_us":904806}
I20260709 12:21:20.176569 23895 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:19.803583 26985 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.182531 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:20.184180 26537 raft_consensus.cc:3055] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:20.185197 26983 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:20.146781 26895 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:20.138947 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 933691us
I20260709 12:21:20.116811 26728 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:20.137209 23921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2021) took 2089 ms (client timeout 2430 ms). Trace:
I20260709 12:21:20.139532 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:20.236481 24562 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:21:20.236989 23921 rpcz_store.cc:269] 0709 12:21:18.047738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.113293 (+2065555us) service_pool.cc:224] Handling call
0709 12:21:20.137134 (+ 23841us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:20.190894 24525 leader_election.cc:336] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.399s (SENT)
I20260709 12:21:20.191859 23923 raft_consensus.cc:2368] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 10.
I20260709 12:21:20.189980 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:20.195740 24559 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.197973 23925 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:20.238323 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:20.195021 23927 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:20.172283 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:20.144604 26977 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:20.109035 26955 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:20.200376 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 471774us
I20260709 12:21:20.170372 24555 rpcz_store.cc:276] 0709 12:21:18.323137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.323262 (+   125us) service_pool.cc:224] Handling call
0709 12:21:18.337693 (+ 14431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:18.370102 (+ 32409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.370148 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:18.385093 (+ 14945us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.626581 (+241488us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:18.626642 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.626758 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:20.106498 (+1479740us) raft_consensus.cc:1685] finished
0709 12:21:20.106519 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.106681 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3154,"raft.queue_time_us":13472,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9290,"thread_start_us":193363,"threads_started":1,"wal-append.queue_time_us":1385601}
I20260709 12:21:20.248934 24563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 692) took 1785 ms. Trace:
I20260709 12:21:20.148072 26839 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:20.201959 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:20.198593 26879 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:20.147826 26821 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:20.244638 26632 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:20.208372 26978 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:20.218367 26900 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:20.254530 26964 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.270879 26964 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:20.232371 26985 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:20.143474 26893 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:20.274309 26893 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:20.276633 26893 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:20.249346 24563 rpcz_store.cc:276] 0709 12:21:18.450651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.471877 (+ 21226us) service_pool.cc:224] Handling call
0709 12:21:20.235329 (+1763452us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54006be254. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:20.235487 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345669888}
I20260709 12:21:20.263935 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:20.280692 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 598) took 1953 ms. Trace:
I20260709 12:21:20.216960 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2020) took 2169 ms. Trace:
I20260709 12:21:20.217314 23928 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:20.282368 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:20.262769 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 347) took 1152 ms. Trace:
W20260709 12:21:20.269490 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 79615.5us
I20260709 12:21:20.285459 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:20.285586 23924 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:20.281674 23920 rpcz_store.cc:276] 0709 12:21:18.047530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.114244 (+2066714us) service_pool.cc:224] Handling call
0709 12:21:20.216894 (+102650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:20.143354 26892 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:20.179538 26840 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:20.204299 26968 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:21:20.230407 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:19.762843 26913 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:20.192533 26971 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.192785 26850 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.237223 23852 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
W20260709 12:21:20.135425 23922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2019) took 2088 ms (client timeout 2171 ms). Trace:
I20260709 12:21:20.239701 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:20.240355 23927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 324) took 2203 ms (client timeout 2288 ms). Trace:
I20260709 12:21:20.199764 26903 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:20.195725 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:20.242480 24560 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:20.240688 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49816.9us
I20260709 12:21:20.198215 26951 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.246680 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:20.250046 23929 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:20.136853 26610 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:20.218724 26537 raft_consensus.cc:740] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:20.234386 26924 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:21:20.230479 26934 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:20.229549 26654 raft_consensus.cc:3055] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:20.289124 24559 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:20.268236 23850 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:20.290138 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:20.273555 26985 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:20.259827 26950 consensus_meta.cc:287] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.002s
I20260709 12:21:20.294449 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:20.296025 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.283100 23847 rpcz_store.cc:276] 0709 12:21:19.110008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.110187 (+   179us) service_pool.cc:224] Handling call
0709 12:21:19.145678 (+ 35491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:19.207681 (+ 62003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.207730 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:19.208355 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:21:19.665383 (+457028us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:19.665441 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.665541 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:20.262531 (+596990us) raft_consensus.cc:1685] finished
0709 12:21:20.262551 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.262699 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269709,"raft.queue_time_us":62506,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":36815,"thread_start_us":367069,"threads_started":1,"wal-append.queue_time_us":511967}
W20260709 12:21:20.337774 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 52404.6us
I20260709 12:21:20.337286 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:20.310323 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:20.306849 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:20.281288 24561 rpcz_store.cc:276] 0709 12:21:18.326915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.327078 (+   163us) service_pool.cc:224] Handling call
0709 12:21:18.349190 (+ 22112us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:18.355268 (+  6078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.355304 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:18.355838 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.628189 (+272351us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:18.767224 (+139035us) log.cc:844] Serialized 14 byte log entry
0709 12:21:18.767518 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.767630 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:19.398298 (+630668us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b18002d1f00. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f522 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:19.640615 (+242317us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b18002d1f00. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:20.280462 (+639847us) raft_consensus.cc:1685] finished
0709 12:21:20.280487 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.280627 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":162102,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":32350,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":9205,"spinlock_wait_cycles":41405696,"thread_start_us":269518,"threads_started":1,"wal-append.queue_time_us":941816}
I20260709 12:21:20.192268 26942 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:20.342610 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:20.342610 26892 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:20.810001 23928 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 10. Ops: []
I20260709 12:21:20.255327 26895 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:20.810833 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 1998) took 3755 ms. Trace:
I20260709 12:21:20.810947 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:20.811327 23928 rpcz_store.cc:276] 0709 12:21:17.054962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.809458 (+3754496us) service_pool.cc:224] Handling call
0709 12:21:20.809801 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:20.810570 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.810765 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:20.812651 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:20.812971 23928 raft_consensus.cc:1217] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[6.4-8.5]   Dedup: 6.4->[8.5-8.5]
I20260709 12:21:20.345233 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:20.269987 26839 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.867686 23996 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:20.556365 26996 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:20.258836 26921 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:20.814009 26654 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:20.806571 26964 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:20.431995 23997 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
W20260709 12:21:20.957103 23966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.007s	sys 0.048s
I20260709 12:21:20.353679 24003 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:21:20.957521 23966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.007s	sys 0.048s
W20260709 12:21:20.958132 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 727770us
I20260709 12:21:20.958572 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:20.958894 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:20.959232 24003 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:20.625301 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:20.430230 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:20.816931 24524 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.863s (SENT) [suppressed 30 similar messages]
I20260709 12:21:20.963037 23995 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:20.963264 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 146399us
I20260709 12:21:20.818042 24002 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:20.400563 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:20.298184 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:20.818849 23925 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:20.461226 24554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 695) took 2003 ms (client timeout 1985 ms). Trace:
I20260709 12:21:20.256520 26879 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:20.964313 24524 leader_election.cc:336] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.997s (SENT)
W20260709 12:21:20.965394 24554 rpcz_store.cc:269] 0709 12:21:18.458222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.458398 (+   176us) service_pool.cc:224] Handling call
0709 12:21:20.460819 (+2002421us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54005a46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:20.461097 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602474752}
W20260709 12:21:20.978039 23923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2012) took 2932 ms (client timeout 1593 ms). Trace:
W20260709 12:21:20.978680 23923 rpcz_store.cc:269] 0709 12:21:18.045781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.287160 (+241379us) service_pool.cc:224] Handling call
0709 12:21:20.977788 (+2690628us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54002788d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:20.977960 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4293358848}
I20260709 12:21:20.451071 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:20.250200 26990 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:20.268853 26937 consensus_meta.cc:287] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.000s
W20260709 12:21:20.805824 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.858646 26913 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:20.339708 26840 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:20.851445 23927 rpcz_store.cc:269] 0709 12:21:18.037189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.134888 (+2097699us) service_pool.cc:224] Handling call
0709 12:21:20.240296 (+105408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:20.399349 26904 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.459s
I20260709 12:21:20.395418 26971 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:20.268258 26726 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:21.012072 23999 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:21.013379 26971 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:21.014003 26971 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.014405 26977 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:20.872718 23928 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:21:21.015868 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2002) took 3959 ms. Trace:
I20260709 12:21:21.016321 23928 rpcz_store.cc:276] 0709 12:21:17.066712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.812401 (+3745689us) service_pool.cc:224] Handling call
0709 12:21:20.812734 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:21.015501 (+202767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.015797 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:20.880277 23996 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:20.261793 26978 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:20.263381 26955 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:20.833674 24559 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:20.922158 24560 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:21.024158 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:20.514130 26968 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:21:20.817744 26952 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.298507 26510 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:21.038160 23999 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:20.582289 26997 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:20.267112 26980 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:21.010799 26925 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:20.814355 26950 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:20.828078 26900 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:20.832561 26983 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:20.978147 24524 leader_election.cc:336] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.088s (SENT)
I20260709 12:21:20.256892 26821 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:21.002786 24002 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:20.262318 26728 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:20.924070 26839 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:21.014518 26971 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.094352 26942 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:20.831777 26951 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.096730 26840 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:21.097024 26983 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:21.099491 26971 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:21.088151 26925 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:21.099814 26951 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:20.839215 26850 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.100679 26925 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.041903 26939 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:21:21.102376 26850 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:21.103161 26485 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:21.103091 26821 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.104261 26925 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.355453 26910 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:21.022650 26960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.037s	sys 0.029s
W20260709 12:21:21.106382 26960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.038s	sys 0.029s
I20260709 12:21:21.032691 26654 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.109139 26654 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:21.042484 26952 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.025298 26893 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.947753 26996 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.023741 26913 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:21.007155 26537 consensus_queue.cc:260] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.083333 26510 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.093830 26728 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:21.094115 27004 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.010110 26937 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.103775 26485 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:21.006524 26990 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.024953 26905 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:21.093501 26892 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:21.116122 26954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.015s	sys 0.030s
W20260709 12:21:21.126379 26954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.015s	sys 0.030s
I20260709 12:21:21.135432 26996 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:21.133005 26961 raft_consensus.cc:3055] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:21.136224 26961 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:21.136947 26961 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.122073 27004 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.139148 27004 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:21.140337 26990 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:20.555150 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 336142us
W20260709 12:21:20.925736 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 51892us
W20260709 12:21:20.614442 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 479213us
I20260709 12:21:21.175637 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:21.177197 23892 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:21.180538 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:21.184072 23848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1730) took 3050 ms (client timeout 2033 ms). Trace:
W20260709 12:21:21.184800 23848 rpcz_store.cc:269] 0709 12:21:18.133821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.139978 (+  6157us) service_pool.cc:224] Handling call
0709 12:21:21.183353 (+3043375us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400403654. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.183732 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3546598656}
W20260709 12:21:20.914572 23820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.004s	sys 0.012s
W20260709 12:21:21.186553 23820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.004s	sys 0.012s
W20260709 12:21:20.378126 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 83673.4us
W20260709 12:21:21.189242 23850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1725) took 3141 ms (client timeout 2216 ms). Trace:
W20260709 12:21:21.190026 23850 rpcz_store.cc:269] 0709 12:21:18.047864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.182853 (+134989us) service_pool.cc:224] Handling call
0709 12:21:21.188720 (+3005867us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54002fbcd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.188987 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4421887232}
W20260709 12:21:21.191366 23800 auto_rebalancer.cc:893] Removing replace marker failed: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:21:20.924903 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 634792us
W20260709 12:21:21.192325 23800 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:21:21.193013 23800 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:21:21.193974 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 351) took 2005 ms. Trace:
I20260709 12:21:21.194689 23851 rpcz_store.cc:276] 0709 12:21:19.187948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.295713 (+107765us) service_pool.cc:224] Handling call
0709 12:21:19.296077 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:20.205718 (+909641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.193095 (+987377us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b5400403154. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:21.193570 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963777408}
W20260709 12:21:21.192350 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:20.858944 23922 rpcz_store.cc:269] 0709 12:21:18.047333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.778270 (+1730937us) service_pool.cc:224] Handling call
0709 12:21:20.135358 (+357088us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:20.923031 23921 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:21.198051 23920 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:21.199187 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2010) took 3965 ms. Trace:
W20260709 12:21:21.007619 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.987854 23925 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:21.199713 23921 rpcz_store.cc:276] 0709 12:21:17.233371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.847773 (+3614402us) service_pool.cc:224] Handling call
0709 12:21:20.922770 (+ 74997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.198385 (+275615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.198902 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:21.201025 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1784) took 1043 ms. Trace:
I20260709 12:21:21.009248 23927 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:21.201643 23925 rpcz_store.cc:276] 0709 12:21:20.157616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.246339 (+ 88723us) service_pool.cc:224] Handling call
0709 12:21:21.200712 (+954373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:21.203079 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1765) took 3755 ms. Trace:
I20260709 12:21:21.203593 23927 rpcz_store.cc:276] 0709 12:21:17.447665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.005797 (+3558132us) service_pool.cc:224] Handling call
0709 12:21:21.008972 (+  3175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.202298 (+193326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.202853 (+   555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:21.204175 23925 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:21.204452 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 1.00866e+06us
I20260709 12:21:21.205313 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 333) took 1744 ms. Trace:
I20260709 12:21:21.207293 23928 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:21:21.208524 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.086160 23995 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
W20260709 12:21:21.086385 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 108258us
I20260709 12:21:21.210956 23998 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:21.033270 24000 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:21.210989 23996 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:21.214514 24001 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:21.026310 24003 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:21.218576 23969 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:21.209770 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 329) took 2994 ms. Trace:
W20260709 12:21:21.219602 23854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1735) took 3031 ms (client timeout 1506 ms). Trace:
I20260709 12:21:21.213073 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:21.220315 23854 rpcz_store.cc:269] 0709 12:21:18.187580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.203697 (+ 16117us) service_pool.cc:224] Handling call
0709 12:21:21.218608 (+3014911us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54002d4bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.218860 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4244275072}
I20260709 12:21:21.220849 23751 catalog_manager.cc:5697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:21.224152 23751 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 4 to 7, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 7 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:21.220050 23928 rpcz_store.cc:276] 0709 12:21:18.214929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.205707 (+2990778us) service_pool.cc:224] Handling call
0709 12:21:21.206662 (+   955us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.209334 (+  2672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.209689 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:21.227538 23924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 328) took 3012 ms (client timeout 2088 ms). Trace:
W20260709 12:21:21.228199 23924 rpcz_store.cc:269] 0709 12:21:18.214591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.108207 (+1893616us) service_pool.cc:224] Handling call
0709 12:21:21.226943 (+1118736us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400105754. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.227235 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377634560}
W20260709 12:21:21.039053 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 188240us
I20260709 12:21:21.283658 26474 consensus_queue.cc:1059] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:21.238204 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 49159.1us
I20260709 12:21:21.286403 23817 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:21.257162 27004 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.290518 27004 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.124017 26950 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:21.260211 26430 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:21.124533 26905 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:21.262945 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 63015.4us
I20260709 12:21:21.263150 26996 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:21.264182 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 82518.8us
I20260709 12:21:21.265089 26985 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:21.265905 26726 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:21.268522 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.117518 26893 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:21.270255 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 71010.5us
I20260709 12:21:21.271503 27000 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:21.273180 26833 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:21.275657 26936 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:21.275506 26924 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:21.276240 26954 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:21:21.278194 23997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 325) took 3436 ms (client timeout 2399 ms). Trace:
I20260709 12:21:21.279249 26955 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:21.284198 26937 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:21.259548 26510 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:21.205864 23925 rpcz_store.cc:276] 0709 12:21:19.460877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.202995 (+1742118us) service_pool.cc:224] Handling call
0709 12:21:21.203720 (+   725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.204894 (+  1174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.205198 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:21.300294 26474 raft_consensus.cc:3055] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:21.303431 26952 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:21.304913 23817 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:21.306056 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:21.289058 26913 consensus_queue.cc:1059] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:21.309142 23893 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:21.286473 24563 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:21.339231 24000 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:21.342152 26430 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:21.343879 26430 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.346635 26913 raft_consensus.cc:3055] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:21.346942 26950 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:21.347262 26913 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:21.347378 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:21.349427 27001 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:21.350540 27001 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.351677 26660 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:21.352319 26660 raft_consensus.cc:697] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:21.313359 26996 raft_consensus.cc:697] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:20.171132 24004 rpcz_store.cc:276] 0709 12:21:17.141636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.984188 (+842552us) service_pool.cc:224] Handling call
0709 12:21:17.984561 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:17.984854 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:18.204830 (+219976us) log.cc:844] Serialized 14 byte log entry
0709 12:21:18.678468 (+473638us) log.cc:844] Serialized 14 byte log entry
0709 12:21:19.460236 (+781768us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b18003ffd60. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f522 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:19.961691 (+501455us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b18003ffd60. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:20.136047 (+174356us) log.cc:844] Serialized 14 byte log entry
0709 12:21:20.141961 (+  5914us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:20.142021 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:20.142326 (+   305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.142452 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.145153 (+  2701us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5496,"prepare.queue_time_us":56467,"prepare.run_cpu_time_us":8393,"prepare.run_wall_time_us":66557,"raft.queue_time_us":744941,"raft.run_cpu_time_us":456,"raft.run_wall_time_us":48624,"spinlock_wait_cycles":137272832,"thread_start_us":2121071,"threads_started":4,"wal-append.queue_time_us":932329}
W20260709 12:21:21.331188 23997 rpcz_store.cc:269] 0709 12:21:17.841399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.969520 (+128121us) service_pool.cc:224] Handling call
0709 12:21:21.277472 (+3307952us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b54004119d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.277802 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5612472064}
W20260709 12:21:21.372575 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 125433us
W20260709 12:21:21.359315 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 50298.2us
W20260709 12:21:21.363732 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 59084.5us
I20260709 12:21:21.361632 26744 raft_consensus.cc:3055] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:21:21.372278 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 413266us
I20260709 12:21:21.353729 27001 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:21.400822 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:21.336236 26474 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:21.369663 26754 raft_consensus.cc:3055] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:21.362172 26955 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:21.357931 27004 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:21.369009 26985 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:21.356321 26905 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:21.369540 26610 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:21.386641 26744 raft_consensus.cc:740] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:21.364221 26964 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:21.421600 24001 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:21.353497 26660 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.427915 26879 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:21.427512 26474 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.429342 26474 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:21.430558 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 57291.8us
I20260709 12:21:21.432870 23818 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:21.433202 23895 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:21.434635 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:21.435052 27001 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:21.435370 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 45829.3us
I20260709 12:21:21.435678 27001 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.435883 26537 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:21.436203 27001 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:21.437975 26868 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:21.438431 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:21.439334 26929 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:21.439828 26929 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:21.441818 24558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 604) took 2314 ms. Trace:
I20260709 12:21:21.442937 26921 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:21.442343 24558 rpcz_store.cc:276] 0709 12:21:19.127231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.127354 (+   123us) service_pool.cc:224] Handling call
0709 12:21:20.461662 (+1334308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:20.462004 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:20.995715 (+533711us) log.cc:844] Serialized 14 byte log entry
0709 12:21:21.439834 (+444119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:21.439931 (+    97us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:21.440075 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.440190 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.441467 (+  1277us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54005a46d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.441603 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":660898,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":3067839744,"thread_start_us":812861,"threads_started":2,"wal-append.queue_time_us":371226}
I20260709 12:21:21.446735 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1818) took 1112 ms. Trace:
I20260709 12:21:21.446820 26893 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:21.447275 24000 rpcz_store.cc:276] 0709 12:21:20.335906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.336902 (+   996us) service_pool.cc:224] Handling call
0709 12:21:21.446459 (+1109557us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54004114d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.446653 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423542144}
I20260709 12:21:21.439474 24557 raft_consensus.cc:2368] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7.
I20260709 12:21:21.441151 26929 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.454528 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:21.455065 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 334) took 1993 ms. Trace:
I20260709 12:21:21.455719 24560 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:21:21.455950 26929 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:21.454595 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 330) took 3239 ms. Trace:
I20260709 12:21:21.455607 23920 rpcz_store.cc:276] 0709 12:21:19.461125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.297775 (+836650us) service_pool.cc:224] Handling call
0709 12:21:21.454806 (+1157031us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400375ad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.454986 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532042496}
I20260709 12:21:21.457077 23922 rpcz_store.cc:276] 0709 12:21:18.215226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.197664 (+2982438us) service_pool.cc:224] Handling call
0709 12:21:21.198592 (+   928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.263618 (+ 65026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.263677 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:21.264461 (+   784us) log.cc:844] Serialized 26 byte log entry
0709 12:21:21.407948 (+143487us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:21.424334 (+ 16386us) log.cc:844] Serialized 14 byte log entry
0709 12:21:21.454113 (+ 29779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.454211 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:21.454258 (+    47us) raft_consensus.cc:1685] finished
0709 12:21:21.454270 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.454403 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83521,"prepare.queue_time_us":24712,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":40,"raft.queue_time_us":138191,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":368,"thread_start_us":142962,"threads_started":1,"wal-append.queue_time_us":160638}
I20260709 12:21:21.459106 23920 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:21:21.459797 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1775) took 1569 ms. Trace:
I20260709 12:21:21.460091 23920 rpcz_store.cc:276] 0709 12:21:19.890493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.458367 (+1567874us) service_pool.cc:224] Handling call
0709 12:21:21.458784 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.459507 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.459730 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:21.462673 26985 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.373129 26833 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 12:21:21.471717 26839 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.404770 26754 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:21.459812 23922 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:21.444407 26921 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:21.513562 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1770) took 1676 ms. Trace:
I20260709 12:21:21.513937 23998 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:21.519016 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1776) took 1560 ms. Trace:
I20260709 12:21:21.519594 23922 rpcz_store.cc:276] 0709 12:21:19.950091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.459109 (+1509018us) service_pool.cc:224] Handling call
0709 12:21:21.459513 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.509807 (+ 50294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.510105 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:21.421006 26610 raft_consensus.cc:697] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:21.522599 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1768) took 1685 ms. Trace:
I20260709 12:21:21.353840 26996 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.421773 27004 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:21.531304 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 98262.9us
I20260709 12:21:21.514273 23924 rpcz_store.cc:276] 0709 12:21:19.837561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.253502 (+1415941us) service_pool.cc:224] Handling call
0709 12:21:21.287175 (+ 33673us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.359645 (+ 72470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.359691 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:21.360329 (+   638us) log.cc:844] Serialized 26 byte log entry
0709 12:21:21.414825 (+ 54496us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:21.415845 (+  1020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.415934 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:21.513276 (+ 97342us) raft_consensus.cc:1685] finished
0709 12:21:21.513302 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.513485 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41075,"raft.queue_time_us":48674,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":13903,"thread_start_us":50746,"threads_started":1,"wal-append.queue_time_us":150750}
I20260709 12:21:21.401566 26913 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.529052 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:21.538008 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:21.510767 26921 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:21.544632 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.540253 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:21.429649 26744 consensus_queue.cc:260] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.543258 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:21.556269 26973 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:21.557235 26910 consensus_queue.cc:1059] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:21:21.558424 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:21.586339 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:21.618633 26910 raft_consensus.cc:3055] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:21.619081 26910 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:21.619392 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:21.620419 23848 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:21.586344 26955 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.620085 26910 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.559291 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:21.559056 27004 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.587716 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:21.624001 27004 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:21.624140 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:21.624610 23845 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:21.561409 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1762) took 4078 ms. Trace:
I20260709 12:21:21.619522 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:21.625349 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:21.588439 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:21.563633 26610 consensus_queue.cc:237] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.626160 24558 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:21.589843 23849 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:21.590222 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:21.570652 26921 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.544859 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:21.573951 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 141178us
I20260709 12:21:21.523233 23928 rpcz_store.cc:276] 0709 12:21:19.836982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.226663 (+1389681us) service_pool.cc:224] Handling call
0709 12:21:21.227324 (+   661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.227973 (+   649us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:21.228613 (+   640us) log.cc:844] Serialized 14 byte log entry
0709 12:21:21.514284 (+285671us) log.cc:844] Serialized 14 byte log entry
0709 12:21:21.516095 (+  1811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:21.516147 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:21.522212 (+  6065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.522365 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.522515 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54636,"prepare.queue_time_us":26962,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":107,"raft.queue_time_us":7224,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4473,"thread_start_us":266101,"threads_started":2,"wal-append.queue_time_us":196268}
I20260709 12:21:21.575974 26973 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.610873 26839 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:21.616101 23926 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:21.595999 26744 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:21.583220 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:21.585767 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:21.561007 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1763) took 4113 ms. Trace:
I20260709 12:21:21.561755 26754 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.584138 26485 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.625463 23848 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:21:21.602698 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 73270.1us
W20260709 12:21:21.632069 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:21.587888 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.594682 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:21.616711 26913 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:21.621740 26910 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:21.586896 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:21.581493 27019 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:21:21.541294 27001 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.666589 26754 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:21.591969 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:21.625509 23929 rpcz_store.cc:276] 0709 12:21:17.446981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.847858 (+3400877us) service_pool.cc:224] Handling call
0709 12:21:20.852482 (+  4624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:20.852745 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:21.206638 (+353893us) log.cc:844] Serialized 14 byte log entry
0709 12:21:21.402457 (+195819us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:21.412048 (+  9591us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:21.423199 (+ 11151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.508093 (+ 84894us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.525455 (+ 17362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4184,"prepare.queue_time_us":278692,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":2771,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":2887,"thread_start_us":525953,"threads_started":2,"wal-append.queue_time_us":310458}
I20260709 12:21:21.672981 23924 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:21:21.672856 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1821) took 1331 ms. Trace:
I20260709 12:21:21.603619 26840 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.660101 26973 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:21.686257 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:21.603220 27015 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:21.680670 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 86137.6us
I20260709 12:21:21.731681 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1779) took 1648 ms. Trace:
I20260709 12:21:21.732304 23924 rpcz_store.cc:276] 0709 12:21:20.082934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.544297 (+1461363us) service_pool.cc:224] Handling call
0709 12:21:21.663267 (+118970us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.731287 (+ 68020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.731594 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:21.664280 23923 rpcz_store.cc:276] 0709 12:21:17.447216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.979635 (+3532419us) service_pool.cc:224] Handling call
0709 12:21:20.980023 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.980408 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:20.980439 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:20.993541 (+ 13102us) log.cc:844] Serialized 26 byte log entry
0709 12:21:21.379985 (+386444us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:21.404266 (+ 24281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.415146 (+ 10880us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:21.560656 (+145510us) raft_consensus.cc:1685] finished
0709 12:21:21.560675 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.560832 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1516,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":14716,"thread_start_us":114680,"threads_started":1,"wal-append.queue_time_us":209228}
I20260709 12:21:21.698534 26485 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:21.698822 26884 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:21.699681 26904 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:21.701797 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.702606 23969 leader_election.cc:400] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7.
W20260709 12:21:21.702783 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.738986 23969 leader_election.cc:403] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:21:21.739678 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:21.705605 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.707769 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1774) took 1869 ms. Trace:
I20260709 12:21:21.709578 27001 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:21.710765 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1824) took 1357 ms. Trace:
I20260709 12:21:21.711803 24557 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:21.713958 23892 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:21.599869 26900 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:21:21.719244 24001 rpcz_store.cc:276] 0709 12:21:20.341353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.342355 (+  1002us) service_pool.cc:224] Handling call
0709 12:21:21.662962 (+1320607us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54003f6bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.672785 (+  9823us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934860672}
I20260709 12:21:21.725441 24558 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:21.725013 23922 raft_consensus.cc:1240] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:21.742985 23999 rpcz_store.cc:276] 0709 12:21:20.624675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.624898 (+   223us) service_pool.cc:224] Handling call
0709 12:21:21.710384 (+1085486us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b540009abd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.710555 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113998592}
W20260709 12:21:21.751446 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49071.2us
I20260709 12:21:21.758351 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1778) took 1734 ms. Trace:
I20260709 12:21:21.758841 23922 rpcz_store.cc:276] 0709 12:21:20.024217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.530610 (+1506393us) service_pool.cc:224] Handling call
0709 12:21:21.672609 (+141999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.758048 (+ 85439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.758290 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:21.759377 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 332) took 2298 ms. Trace:
I20260709 12:21:21.759927 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.761469 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.752254 23969 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:21.774305 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.777194 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:21.780474 23895 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:21.774397 26921 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:21.783440 23851 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:21.787400 27009 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:21.787503 27010 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:21.788076 27009 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:21.788277 27010 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.780063 26839 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:21.788794 27009 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:21.790995 27010 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:21.788547 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:21.791970 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 49943.9us
I20260709 12:21:21.792793 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:21.758148 26840 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.795265 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:21.796458 26895 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:21.797006 26840 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:21.797266 27004 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:21.797812 27004 raft_consensus.cc:697] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:21.798947 27004 consensus_queue.cc:237] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.797006 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:21.803941 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1766) took 1967 ms. Trace:
I20260709 12:21:21.804659 27010 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:21.808877 24563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 701) took 1587 ms (client timeout 2003 ms). Trace:
I20260709 12:21:21.811278 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:21.811592 23998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1822) took 1469 ms (client timeout 1764 ms). Trace:
W20260709 12:21:21.812155 23998 rpcz_store.cc:269] 0709 12:21:20.341727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.377600 (+ 35873us) service_pool.cc:224] Handling call
0709 12:21:21.767620 (+1390020us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54001c84d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.811500 (+ 43880us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526685952}
I20260709 12:21:21.812620 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.813645 23922 raft_consensus.cc:2410] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:21.814148 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:21.815200 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.816161 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:21.809357 24563 rpcz_store.cc:269] 0709 12:21:20.221305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.280037 (+ 58732us) service_pool.cc:224] Handling call
0709 12:21:21.808625 (+1528588us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54005f14d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.808784 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009212288}
I20260709 12:21:21.787981 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.804517 23927 rpcz_store.cc:276] 0709 12:21:19.836332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.204832 (+1368500us) service_pool.cc:224] Handling call
0709 12:21:21.205382 (+   550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.262337 (+ 56955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.262380 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:21.262454 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:21.262535 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.803577 (+541042us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54002e4354. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:21.803642 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.803857 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129938176}
I20260709 12:21:21.759812 23921 rpcz_store.cc:276] 0709 12:21:19.460539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.200938 (+1740399us) service_pool.cc:224] Handling call
0709 12:21:21.229388 (+ 28450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.306210 (+ 76822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.306251 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:21.317667 (+ 11416us) log.cc:844] Serialized 26 byte log entry
0709 12:21:21.511530 (+193863us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:21.512435 (+   905us) log.cc:844] Serialized 14 byte log entry
0709 12:21:21.512736 (+   301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.512809 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:21.515534 (+  2725us) raft_consensus.cc:1685] finished
0709 12:21:21.515560 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.759186 (+243626us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b5400105750. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.759315 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74927,"prepare.queue_time_us":235,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":44759,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":18086,"spinlock_wait_cycles":64038656,"thread_start_us":101873,"threads_started":1,"wal-append.queue_time_us":131837}
I20260709 12:21:21.740913 23925 rpcz_store.cc:276] 0709 12:21:19.838721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.339797 (+1501076us) service_pool.cc:224] Handling call
0709 12:21:21.340463 (+   666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.370910 (+ 30447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.370944 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:21.371602 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 12:21:21.510423 (+138821us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:21.510472 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.510545 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:21.707507 (+196962us) raft_consensus.cc:1685] finished
0709 12:21:21.707533 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.707700 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29761,"raft.queue_time_us":31343,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":162,"thread_start_us":138249,"threads_started":1,"wal-append.queue_time_us":273414}
I20260709 12:21:21.768556 26904 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:21.837236 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.840838 23893 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:21.787283 27015 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:21.842792 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.797708 26840 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:21.844799 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.856092 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:21.863533 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 85392.2us
I20260709 12:21:21.838229 26884 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:21.844267 26610 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:21.868099 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.872159 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.873090 26961 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:21.873518 23921 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:21.874665 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.876578 27009 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.877269 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.878585 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.879882 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:21.880650 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 46853.7us
I20260709 12:21:21.880851 23927 raft_consensus.cc:2410] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:21.882377 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:21.882511 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:21.883502 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.852902 27001 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:21.886111 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:21.887176 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:21.829641 26833 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:21:21.888576 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:21.886622 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 64001.9us
I20260709 12:21:21.892983 23929 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:21.889334 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.836645 26485 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:21.893813 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:21.908387 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 92387.6us
W20260709 12:21:21.914795 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 200945us
W20260709 12:21:21.905853 23926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2018) took 3858 ms (client timeout 2129 ms). Trace:
I20260709 12:21:21.927201 26904 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.931031 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:21.919994 23926 rpcz_store.cc:269] 0709 12:21:18.047118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.561533 (+1514415us) service_pool.cc:224] Handling call
0709 12:21:21.885615 (+2324082us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400106b54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:21.905699 (+ 20084us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3469157632}
I20260709 12:21:21.935310 23926 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:21.936002 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1782) took 1793 ms. Trace:
I20260709 12:21:21.936349 23926 rpcz_store.cc:276] 0709 12:21:20.142525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.933845 (+1791320us) service_pool.cc:224] Handling call
0709 12:21:21.935001 (+  1156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.935757 (+   756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.935939 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:21.922896 27001 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:21.942030 26537 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:21.942811 26537 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:21.943296 27001 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.943984 26537 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:21.923111 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.948086 23921 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:21.950203 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:21.950945 23924 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:21.950376 27015 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:21.952873 23895 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:21.896225 26840 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:21.953677 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:21.953244 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.957613 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:21.970400 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 46330.3us
I20260709 12:21:21.962991 23966 leader_election.cc:400] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 10.
I20260709 12:21:21.971814 23966 leader_election.cc:403] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:21.973695 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 83023.8us
I20260709 12:21:21.923943 26893 raft_consensus.cc:2764] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:21.981175 23893 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:21.989333 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:21.995839 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 76968.8us
W20260709 12:21:21.999356 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 83433.3us
I20260709 12:21:21.919027 26936 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:21:22.010223 23922 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:21.976907 26895 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:21.999718 26485 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:22.006711 27009 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:21.989283 26954 consensus_queue.cc:1059] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:21:22.012673 26510 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:21:22.044281 27030 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:21:22.046701 23928 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:22.027576 26996 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:22.026624 26485 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.030093 26610 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:22.053112 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1780) took 1947 ms. Trace:
I20260709 12:21:22.064373 23928 rpcz_store.cc:276] 0709 12:21:20.106179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.921484 (+1815305us) service_pool.cc:224] Handling call
0709 12:21:22.008094 (+ 86610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.052812 (+ 44718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.053056 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:22.062316 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 65501.5us
W20260709 12:21:22.050421 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 47108.5us
I20260709 12:21:22.001729 26884 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:21:22.078868 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 153788us
I20260709 12:21:22.081157 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:22.083498 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1777) took 2099 ms. Trace:
I20260709 12:21:22.084004 23920 rpcz_store.cc:276] 0709 12:21:19.984521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.464506 (+1479985us) service_pool.cc:224] Handling call
0709 12:21:21.472993 (+  8487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.473542 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.473583 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:21.525048 (+ 51465us) log.cc:844] Serialized 26 byte log entry
0709 12:21:21.649007 (+123959us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:21.676171 (+ 27164us) log.cc:844] Serialized 14 byte log entry
0709 12:21:21.684911 (+  8740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.684990 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:21.879947 (+194957us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b18003a50a0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f522 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:22.083132 (+203185us) raft_consensus.cc:1685] finished
0709 12:21:22.083254 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.083422 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10838,"prepare.queue_time_us":29984,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":9952,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":27728,"spinlock_wait_cycles":25094528,"thread_start_us":91587,"threads_started":1,"wal-append.queue_time_us":300955}
I20260709 12:21:22.094604 23818 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:22.097486 23928 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:22.069281 26485 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:22.097453 23925 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:22.089799 26868 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:22.112578 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 188744us
I20260709 12:21:22.094914 26510 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:22.131079 26950 consensus_meta.cc:287] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.724s	user 0.005s	sys 0.010s
W20260709 12:21:22.150739 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 69691.5us
I20260709 12:21:22.161500 23892 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:22.169790 26895 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:22.171785 26474 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.705s	user 0.011s	sys 0.003s
W20260709 12:21:22.172788 27038 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 12:21:22.174595 26744 consensus_meta.cc:287] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.006s
W20260709 12:21:22.182392 24525 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.973s (SENT)
W20260709 12:21:22.184062 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.167001 26839 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7.
I20260709 12:21:22.187178 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:22.193387 23929 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:22.149977 26950 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:22.195170 26840 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.195091 26510 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.202067 26840 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:22.204636 26840 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:22.205031 23846 raft_consensus.cc:2410] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:22.145848 26954 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:22.190613 23751 catalog_manager.cc:5697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 2 to 6, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 6 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:22.214684 26996 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 10.
W20260709 12:21:22.215507 27040 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 12:21:22.218412 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 67882.2us
I20260709 12:21:22.240024 26660 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:22.240483 26660 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:22.243526 26913 consensus_meta.cc:287] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.571s	user 0.013s	sys 0.000s
W20260709 12:21:22.250097 26929 consensus_meta.cc:287] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.794s	user 0.010s	sys 0.005s
I20260709 12:21:22.251293 26821 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:22.251744 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.252102 26821 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:22.253017 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 252427us
W20260709 12:21:22.253461 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 90774.4us
I20260709 12:21:22.218662 26567 raft_consensus.cc:3055] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:22.219060 27048 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:22.221990 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.223067 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 61699.8us
W20260709 12:21:22.228161 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.253417 26893 consensus_queue.cc:1059] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:22.241360 26660 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.186584 27009 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.256006 26567 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:22.258854 27009 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:22.260620 26567 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.253634 26988 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:22.265244 26929 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.266086 26929 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.268994 26929 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:22.270756 26821 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:22.272078 23751 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 5, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 5 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.274039 23751 catalog_manager.cc:5697] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 4 to 9, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 9 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.276239 23751 catalog_manager.cc:5697] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:22.277659 23751 catalog_manager.cc:5697] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 7, leader changed from <none> to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 7 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:22.282071 26973 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.530s	user 0.014s	sys 0.000s
I20260709 12:21:22.282699 26973 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:22.284085 23927 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:22.285575 27009 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:22.286235 26988 raft_consensus.cc:697] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:22.281915 26660 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:22.287566 26988 consensus_queue.cc:237] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.262758 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:22.295482 23892 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:22.298331 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.300386 26879 consensus_queue.cc:1059] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:22.302373 23893 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:22.306169 26430 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:22.306336 26985 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:22.307463 26985 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:22.231792 23853 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
W20260709 12:21:22.329244 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 73621us
I20260709 12:21:22.344576 23893 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:22.328244 23751 catalog_manager.cc:5697] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:22.345402 26900 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:22.412185 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 318521us
W20260709 12:21:22.419695 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 75233.4us
W20260709 12:21:22.420820 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 64599.6us
I20260709 12:21:22.387387 26567 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:22.435338 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 173914us
W20260709 12:21:22.436749 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.440291 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.441177 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.442497 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:21:22.445364 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 350886us
I20260709 12:21:22.439097 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1781) took 2305 ms. Trace:
I20260709 12:21:22.438369 23751 catalog_manager.cc:5697] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 4 to 8, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 8 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:22.424757 26537 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:21:22.426354 26900 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:22.454435 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1752) took 1067 ms. Trace:
W20260709 12:21:22.453455 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 145412us
I20260709 12:21:22.458586 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:22.459756 23751 catalog_manager.cc:5697] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.463225 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:22.457423 23853 rpcz_store.cc:276] 0709 12:21:21.423424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.520799 (+ 97375us) service_pool.cc:224] Handling call
0709 12:21:22.454220 (+933421us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400429fd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:22.454366 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293428608}
I20260709 12:21:22.452291 23923 rpcz_store.cc:276] 0709 12:21:20.133581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.932069 (+1798488us) service_pool.cc:224] Handling call
0709 12:21:21.932460 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.932724 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:21.933056 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.244747 (+311691us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b1800321040. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287 00007fa287467208
0709 12:21:22.438725 (+193978us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.438778 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:22.438829 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.438900 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.439022 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1416,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":18921,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":121,"spinlock_wait_cycles":9215360,"thread_start_us":291082,"threads_started":2,"wal-append.queue_time_us":97267}
W20260709 12:21:22.471974 24525 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.160s (SENT)
I20260709 12:21:22.477305 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:22.477578 23924 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:22.480921 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:22.482556 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:22.483395 23852 raft_consensus.cc:2376] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7. Re-sending same reply.
I20260709 12:21:22.485992 27046 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:22.486754 27046 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:22.487820 27046 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.490531 26900 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.457821 26893 consensus_queue.cc:1059] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:21:22.494586 23747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43178 (request call id 253) took 35341 ms (client timeout 15000 ms). Trace:
I20260709 12:21:22.495548 26893 consensus_queue.cc:1059] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:22.499032 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:22.446920 26884 consensus_queue.cc:1059] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:21:22.499855 23998 raft_consensus.cc:2376] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 6. Re-sending same reply.
I20260709 12:21:22.500455 23999 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:22.501022 26884 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:22.501498 26884 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:22.501794 23997 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:21:22.502533 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.503216 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:22.503288 24001 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:22.504225 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:22.505155 24002 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:22.505234 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.506191 23998 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:22.506228 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.504175 24004 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:22.507014 24000 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:22.470333 26985 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:22.507931 26985 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:22.509022 26985 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.502498 26884 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.511380 26884 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:22.511458 26879 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:22.512425 26879 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:22.515985 27049 consensus_queue.cc:1059] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:22.517217 27049 raft_consensus.cc:3055] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:22.513511 26879 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:22.518524 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.517722 27049 raft_consensus.cc:740] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:22.520088 27049 consensus_queue.cc:260] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.522006 27049 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:22.523919 27048 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:22.526400 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 69601.5us
W20260709 12:21:22.495137 23747 rpcz_store.cc:269] 0709 12:20:47.153268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.153962 (+   694us) service_pool.cc:224] Handling call
0709 12:21:22.494266 (+35340304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:10.620510 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:10.621317 (+   807us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:10.621375 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:21:10.621404 (+    29us) tablet.cc:662] Decoding operations
0709 12:21:10.624921 (+  3517us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:10.624992 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:10.625025 (+    33us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:21:10.627184 (+  2159us) tablet.cc:701] Row locks acquired
0709 12:21:10.627249 (+    65us) write_op.cc:260] PREPARE: finished
0709 12:21:13.578970 (+2951721us) spinlock_profiling.cc:243] Waited 2.95 s on lock 0x7b2c001000f8. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa285d45a11 00007fa285d54a0a 00007fa285d54693 00007fa285d54631 00007fa287487902 00007fa2874876dd 00007fa28ae82243 00007fa28ae81d58 00007fa28ae869f1 00007fa28ae869a9 00007fa28ae86939
0709 12:21:13.579132 (+   162us) write_op.cc:270] Start()
0709 12:21:13.579465 (+   333us) write_op.cc:276] Timestamp: P: 1783599673576847 usec, L: 0
0709 12:21:13.579494 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:21:13.580922 (+  1428us) log.cc:844] Serialized 6738 byte log entry
0709 12:21:15.152443 (+1571521us) op_driver.cc:464] REPLICATION: finished
0709 12:21:15.482400 (+329957us) write_op.cc:301] APPLY: starting
0709 12:21:15.482510 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:15.482897 (+   387us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:15.482940 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:15.745283 (+262343us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:15.752967 (+  7684us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:21:15.771363 (+ 18396us) write_op.cc:312] APPLY: finished
0709 12:21:15.900389 (+129026us) log.cc:844] Serialized 119 byte log entry
0709 12:21:15.900631 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:15.900863 (+   232us) write_op.cc:454] Released schema lock
0709 12:21:15.900941 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:15.901444 (+   503us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:15.901478 (+    34us) write_op.cc:454] Released schema lock
0709 12:21:16.736266 (+834788us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b54003129d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744932a 00007fa2873cef14 00007fa2873ceec3 00007fa2873cee38 00007fa2873cedf3 00007fa2873ce0dc 00007fa2873f7e16 00007fa2873dfcbb 00007fa2873ca39d 00007fa2873cdd75
Metrics: {"mutex_wait_us":706389,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":329637,"apply.run_cpu_time_us":7467,"apply.run_wall_time_us":419010,"num_ops":17,"prepare.queue_time_us":1679054,"prepare.run_cpu_time_us":29452,"prepare.run_wall_time_us":3199202,"raft.queue_time_us":205007,"raft.run_cpu_time_us":12887,"raft.run_wall_time_us":1674689,"replication_time_us":1511175,"spinlock_wait_cycles":6805338368,"thread_start_us":3588540,"threads_started":4,"wal-append.queue_time_us":407586,"wal-append.run_cpu_time_us":23293,"wal-append.run_wall_time_us":2920491}]]}
I20260709 12:21:22.527220 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:22.527748 26973 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:22.528687 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 91482.1us
I20260709 12:21:22.530633 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:22.533368 24004 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:22.534008 27043 raft_consensus.cc:3055] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:22.534269 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:22.534507 27043 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:22.535889 27043 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:22.537238 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.537665 27043 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:22.537964 23853 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:22.538230 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:22.538861 23997 raft_consensus.cc:2376] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7. Re-sending same reply.
I20260709 12:21:22.540114 23996 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:22.504253 26485 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:22.528045 26921 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:22.546499 23751 catalog_manager.cc:5697] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 1 to 3, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 3 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:22.548012 23996 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:22.548224 23751 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 6, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 6 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:21:22.556496 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 101311us
I20260709 12:21:22.558816 24001 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:22.497635 26893 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:22.586272 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.585986 23751 catalog_manager.cc:5697] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 8, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 8 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.591928 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:22.593736 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.595335 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.595501 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.596282 24000 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:22.598340 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.599464 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.525738 26430 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:22.602415 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.604544 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.605273 23848 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:22.605811 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.604242 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.616832 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.616686 23751 catalog_manager.cc:5697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 5 to 6, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 6 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.618448 24001 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:22.607524 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:22.595082 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.622126 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:22.624940 27062 raft_consensus.cc:3055] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:22.625530 27062 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:21:22.537264 23736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8630b76482c543a2a08e289b32b13ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 22996f888daf435398b693481171c18c (127.22.43.65:34895) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:22.626581 27062 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:22.627456 23854 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:22.628094 27062 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:22.634253 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.635783 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:22.637049 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.625597 23997 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:22.638379 23995 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:22.643507 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:22.626614 23736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 89599.8us
I20260709 12:21:22.645107 24002 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:21:22.650194 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.653147 23998 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:22.668443 24002 pending_rounds.cc:85] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 6
I20260709 12:21:22.669042 23999 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:22.637854 23996 raft_consensus.cc:2410] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:21:22.646564 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 49336.8us
I20260709 12:21:22.674742 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.651970 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:22.675668 24001 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:22.675681 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.589202 26893 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:22.676383 23847 raft_consensus.cc:2368] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7.
I20260709 12:21:22.654980 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.679925 24003 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:22.616178 26537 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.670800 24002 pending_rounds.cc:107] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:21:22.686288 24002 raft_consensus.cc:2889] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:22.691982 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.700057 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.701160 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:22.702464 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.703547 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.704895 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.706605 24004 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:22.652969 26879 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:22.708540 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 121663us
I20260709 12:21:22.712252 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.712759 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.709231 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:22.709309 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.699012 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.639297 26485 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:22.716579 24003 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:22.717650 23849 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:22.718477 23924 raft_consensus.cc:2368] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:21:22.642639 27059 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:22.720603 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.725270 23999 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:22.726104 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.726500 23845 raft_consensus.cc:2410] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:22.726339 24004 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:22.728308 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:22.672616 26921 consensus_queue.cc:1059] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:21:22.729671 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:22.736737 26553 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.737358 26553 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.739615 26553 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:22.740357 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:22.740998 24554 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:22.739866 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.743209 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.745820 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:22.746737 23927 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:22.748420 23892 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:22.751121 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:22.752578 23998 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:22.722110 26754 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:22.754259 23926 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:22.756608 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.757417 23850 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:22.644575 27060 consensus_queue.cc:1059] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 12:21:22.759874 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.753688 23998 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:22.789037 23995 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:22.790011 23997 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:21:22.792845 24001 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
W20260709 12:21:22.799598 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 65183.5us
I20260709 12:21:22.787096 24004 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:21:22.802877 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59030.1us
I20260709 12:21:22.805096 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.812731 24001 raft_consensus.cc:1240] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:21:22.815486 23893 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:22.720065 26537 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.790973 26485 raft_consensus.cc:2764] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:21:22.823107 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 87348.3us
I20260709 12:21:22.748435 26660 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:21:22.825088 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:22.825788 23998 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:22.826036 23995 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:22.816412 27056 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:22.834607 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.835902 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:22.836952 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.838397 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:22.838717 26660 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:22.839582 26660 consensus_queue.cc:1243] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:22.841207 26660 raft_consensus.cc:3055] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:22.841413 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.842077 26936 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:21:22.842247 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 119843us
I20260709 12:21:22.842527 26936 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:22.843617 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:22.843532 26936 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.844810 23926 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:22.844986 26936 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:22.846395 27043 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:22.837708 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.845337 24524 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:22.848912 23995 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:22.853479 24554 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:22.854763 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.861980 24003 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:22.861413 24004 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:21:22.864521 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.865149 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.841624 26660 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:22.866567 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 70150.2us
I20260709 12:21:22.871951 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:22.873414 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.874266 23850 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:22.877565 23966 connection.cc:256] RPC call timeout handler was delayed by -4.0338810499999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 12:21:22.878111 23966 connection.cc:256] RPC call timeout handler was delayed by -3.9006810500000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260709 12:21:22.878441 23966 connection.cc:256] RPC call timeout handler was delayed by -3.8843542070001149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:21:22.878873 23966 connection.cc:256] RPC call timeout handler was delayed by -3.2348403410001083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 12:21:22.879251 23966 connection.cc:256] RPC call timeout handler was delayed by -3.1727403410002353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 12:21:22.879575 23966 connection.cc:256] RPC call timeout handler was delayed by -3.1340403410001727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 12:21:22.879915 23966 connection.cc:256] RPC call timeout handler was delayed by -2.9061810499999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3288s for a response
W20260709 12:21:22.880234 23966 connection.cc:256] RPC call timeout handler was delayed by -2.7713403410002684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 12:21:22.881640 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.880537 23966 connection.cc:256] RPC call timeout handler was delayed by -2.5004403410002851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24300000000000002s for a response
W20260709 12:21:22.883095 23966 connection.cc:256] RPC call timeout handler was delayed by -1.8722403410001789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3128s for a response
I20260709 12:21:22.885522 23852 raft_consensus.cc:2410] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:21:22.754277 26754 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:22.896039 23995 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:21:22.898936 23846 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:22.912585 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:22.882278 27046 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:22.941958 24004 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:22.946657 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:22.948309 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 123971us
I20260709 12:21:22.959324 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:22.961838 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.902608 27056 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:22.970530 24525 leader_election.cc:336] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.512s (SENT)
I20260709 12:21:22.960306 23846 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:22.985183 23848 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:22.993570 23850 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:22.997192 23895 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:23.001060 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44246.1us
W20260709 12:21:23.001377 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 107723us
I20260709 12:21:22.982427 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:22.953742 26973 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:23.018466 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 106963us
I20260709 12:21:23.015375 23892 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:22.945245 26868 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:21:23.070050 23998 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:23.009461 27048 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.030755 23893 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:21:23.075973 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 230677us
I20260709 12:21:23.017786 26910 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:23.087301 24004 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:21:23.011404 27046 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:23.060274 27015 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.111371 23998 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:23.068459 27060 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:23.114078 24000 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:21:23.072299 26921 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.116526 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.022607 26660 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:23.124856 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 89101us
W20260709 12:21:23.120465 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 149983us
W20260709 12:21:23.127067 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.111681 27048 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:23.026203 26553 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:21:23.026789 26973 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:23.123323 27068 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 12:21:23.173190 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.173488 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 171716us
W20260709 12:21:23.173930 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.129667 26884 consensus_meta.cc:287] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.006s
W20260709 12:21:23.169214 24525 leader_election.cc:336] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.231s (SENT)
I20260709 12:21:23.181620 24525 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:23.131489 27056 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:23.187907 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 99844.3us
I20260709 12:21:23.189356 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:23.182857 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.178687 26754 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:23.203027 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.118548 27015 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:23.203250 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 115444us
I20260709 12:21:23.206735 26950 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:23.210500 26950 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:23.210943 26950 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:23.211668 27065 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:21:23.212387 26510 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:23.175262 26728 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.294s
I20260709 12:21:23.214279 27055 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:23.214920 27055 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:23.215669 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.215996 27055 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:23.220574 26904 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:23.221262 26430 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:23.222909 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.223943 26913 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:23.213774 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 77491.9us
W20260709 12:21:23.232367 27076 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:21:23.233987 26893 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:23.236224 27072 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 12:21:23.240201 27067 log.cc:927] Time spent T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.399s	user 0.000s	sys 0.002s
W20260709 12:21:23.243145 27070 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.402s	user 0.000s	sys 0.013s
I20260709 12:21:23.243283 26973 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:23.243999 27046 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:23.245851 27059 raft_consensus.cc:3055] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:21:23.246135 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 67775.4us
I20260709 12:21:23.246670 27059 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:23.247920 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:23.255584 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.133404 26921 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:23.198231 26537 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:23.260128 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.261034 23852 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:21:23.261224 24525 leader_election.cc:336] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.865s (SENT)
I20260709 12:21:23.278678 24525 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:23.247633 26660 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.197834 27064 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:23.282022 23852 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:21:23.282555 23852 pending_rounds.cc:85] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 4
I20260709 12:21:23.282864 23852 pending_rounds.cc:107] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:21:23.283010 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.283208 23852 raft_consensus.cc:2889] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:23.284075 23853 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:21:23.286559 23853 pending_rounds.cc:85] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 6
I20260709 12:21:23.286888 23853 pending_rounds.cc:107] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:21:23.287205 23853 raft_consensus.cc:2889] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:23.284219 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:23.285779 23845 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:23.262498 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:23.249630 27048 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:23.301256 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:23.306792 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.315979 24554 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:23.291760 23847 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:23.318311 23854 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:23.319181 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.323391 23818 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.326741 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.326835 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.328728 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:23.329702 23925 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:23.332405 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.323391 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.333992 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.335003 23920 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:23.338852 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 74496.4us
I20260709 12:21:23.343839 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.344964 23929 raft_consensus.cc:2410] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:23.349025 23924 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:21:23.351316 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 91280.5us
I20260709 12:21:23.352612 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.342134 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.325714 27056 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:23.325927 26728 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.319360 27061 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:23.360140 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:23.391729 23850 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:23.324178 26913 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:23.363790 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.247704 27059 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:23.365149 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:23.367579 23922 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:23.368435 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.380884 26893 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.381556 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.392976 23920 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:21:23.394359 23928 consensus_meta.cc:287] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.680s	user 0.012s	sys 0.000s
I20260709 12:21:23.409787 23928 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:23.406243 23926 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:23.357978 27049 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:23.417263 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 64743.7us
W20260709 12:21:23.418931 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 389134us
I20260709 12:21:23.420981 23893 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:21:23.419296 23999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.014s	sys 0.025s
W20260709 12:21:23.422302 23999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.015s	sys 0.025s
W20260709 12:21:23.404649 26879 consensus_meta.cc:287] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.000s
I20260709 12:21:23.397367 27084 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:23.427609 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 75231.7us
I20260709 12:21:23.357939 26430 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:21:23.406541 26910 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:23.433862 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 65528.6us
W20260709 12:21:23.436528 24003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.017s	sys 0.019s
W20260709 12:21:23.438755 24003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.017s	sys 0.019s
I20260709 12:21:23.416146 27064 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:23.406646 27083 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:23.406822 26868 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:21:23.399092 26728 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:23.423952 26895 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:23.471802 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 54422.8us
I20260709 12:21:23.450133 26868 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:23.472530 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:23.472638 27090 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:23.473371 26553 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:23.473400 23892 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:23.473978 26553 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.474411 26553 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.474690 26985 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:23.475093 26985 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.475449 26985 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.426985 27084 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:23.466400 26910 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:23.467435 26728 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:23.467934 23817 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:23.486467 23850 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:21:23.486912 23850 pending_rounds.cc:85] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 3
I20260709 12:21:23.487141 23850 pending_rounds.cc:107] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:21:23.487360 23850 raft_consensus.cc:2889] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:23.489524 23818 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:23.468534 27015 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:23.426527 26955 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 12:21:23.491314 26988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.016s	sys 0.017s
W20260709 12:21:23.499223 26988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.016s	sys 0.017s
I20260709 12:21:23.434698 27059 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:23.434160 26929 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:21:23.472909 26868 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:23.487496 27084 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:23.458725 27074 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.259s	user 0.003s	sys 0.000s
I20260709 12:21:23.479923 23966 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:23.481113 23852 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:21:23.490592 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.494727 24524 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:23.500249 23926 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:23.471009 26921 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:23.506834 23895 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:23.449980 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:23.494645 27054 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:23.543977 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.547818 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.546195 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 112793us
I20260709 12:21:23.545976 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.549075 23924 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:23.549130 23818 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:23.557873 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 178185us
W20260709 12:21:23.563691 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 113862us
I20260709 12:21:23.565901 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.572276 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:23.573578 24554 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:21:23.563671 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 76324.4us
I20260709 12:21:23.575975 24524 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:23.582033 23922 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:21:23.582551 23922 pending_rounds.cc:85] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 4
I20260709 12:21:23.582830 23922 pending_rounds.cc:107] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:21:23.583127 23922 raft_consensus.cc:2889] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:23.585420 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.586776 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 106956us
I20260709 12:21:23.538529 26868 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.535331 27085 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:23.595397 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 46414.3us
I20260709 12:21:23.547268 27054 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:23.579873 27091 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:23.623598 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.586926 26973 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:23.542744 26537 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 12:21:23.643697 23736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8630b76482c543a2a08e289b32b13ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 22996f888daf435398b693481171c18c (127.22.43.65:34895) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:21:23.645233 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.629081 24524 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:23.629319 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.634348 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.579074 26879 raft_consensus.cc:2764] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:21:23.640543 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 47796.1us
W20260709 12:21:23.641058 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.642191 23966 leader_election.cc:400] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7.
I20260709 12:21:23.561924 26485 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:21:23.578872 27015 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:23.608091 26904 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:23.636320 27054 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.638372 27091 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:23.663741 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 91693.2us
I20260709 12:21:23.640002 27061 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:23.664986 23893 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:21:23.666100 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.675339 26879 raft_consensus.cc:2764] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:21:23.676548 27094 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:21:23.676580 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 47591.3us
I20260709 12:21:23.656872 26510 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:21:23.667270 27091 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:23.683269 27061 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:23.683808 27061 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:23.659420 26895 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.685891 26895 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:23.689437 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:23.690449 24554 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:23.695333 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.699061 24556 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:21:23.700304 27097 log.cc:927] Time spent T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:23.702356 26950 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:23.704674 26950 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:23.705476 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1729) took 1056 ms. Trace:
I20260709 12:21:23.705922 23999 rpcz_store.cc:276] 0709 12:21:22.648906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.787578 (+138672us) service_pool.cc:224] Handling call
0709 12:21:22.820075 (+ 32497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.828699 (+  8624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.828738 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:22.855730 (+ 26992us) log.cc:844] Serialized 26 byte log entry
0709 12:21:23.422788 (+567058us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:23.430394 (+  7606us) log.cc:844] Serialized 14 byte log entry
0709 12:21:23.430705 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.430804 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.705253 (+274449us) raft_consensus.cc:1685] finished
0709 12:21:23.705277 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.705414 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6473,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":8879,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":5252,"thread_start_us":550926,"threads_started":1,"wal-append.queue_time_us":668230}
I20260709 12:21:23.710536 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:23.711462 24556 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 3.
I20260709 12:21:23.711797 26553 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:23.712447 27054 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:23.713508 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:23.714359 24556 raft_consensus.cc:2376] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 8. Re-sending same reply.
I20260709 12:21:23.716491 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:23.717496 24554 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:23.719990 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:23.720825 24554 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:23.720865 27084 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:23.722894 27061 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:23.724345 23848 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:23.725745 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:23.726358 23848 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:23.739526 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 97457.2us
W20260709 12:21:23.739557 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 152886us
W20260709 12:21:23.689399 27093 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:21:23.765764 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 100904us
I20260709 12:21:23.768388 24554 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:23.771121 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:23.774664 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:23.775379 24555 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:23.775485 24563 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:23.775943 24554 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:23.744592 26921 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:23.778112 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 85456.1us
I20260709 12:21:23.781810 23893 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:23.748381 26510 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:23.744690 27085 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:23.749585 26553 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:23.810127 26510 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:23.786840 26660 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:23.776508 26929 consensus_queue.cc:1059] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:21:23.811815 26895 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:23.814138 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 43730.1us
W20260709 12:21:23.826177 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 307902us
I20260709 12:21:23.802491 26910 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:23.821103 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 186906us
I20260709 12:21:23.828377 23818 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.823446 23893 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:21:23.824287 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 75409.5us
I20260709 12:21:23.821682 26510 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:23.840921 23818 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.842864 23818 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.843922 26833 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.843971 26754 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:23.843971 26955 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:23.844698 26754 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:23.845152 26754 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.848822 23818 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:23.850133 26955 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:23.850634 26955 raft_consensus.cc:697] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:23.851603 26955 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:23.854415 23848 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:23.820729 26660 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:23.861106 23848 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:21:23.861722 23848 pending_rounds.cc:85] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 5
I20260709 12:21:23.862097 23848 pending_rounds.cc:107] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:21:23.862450 23848 raft_consensus.cc:2889] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:23.853365 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:23.856494 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:23.863418 24563 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:23.827278 27015 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:23.860210 23966 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:23.853313 26754 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:23.877028 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.827644 26537 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:21:23.883740 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 60406.9us
I20260709 12:21:23.864531 26660 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.886657 23854 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:23.892534 23848 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:23.871987 27015 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.875200 26913 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:23.896375 24554 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:23.872397 26833 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:23.907199 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:23.911870 27085 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:23.867456 26895 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:21:23.903153 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:23.854964 26985 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:23.902153 27015 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:23.949389 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 63772.1us
I20260709 12:21:23.903597 26913 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:23.947510 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44394.5us
I20260709 12:21:23.881336 27001 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:21:23.906090 27109 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:23.901525 26950 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:21:23.949807 26910 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.949594 26893 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.969512 27064 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.976948 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:23.977085 27064 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:23.978035 27112 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:21:23.970186 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:23.979894 27064 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:23.971149 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 61128.8us
I20260709 12:21:23.978050 24563 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:23.971365 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:23.953946 26913 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.981575 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:23.969401 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 101156us
I20260709 12:21:23.954180 27056 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:23.990252 23846 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:23.995380 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.011376 23999 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:23.996445 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:23.998348 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:24.012388 23995 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:23.999290 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:23.998366 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:23.997679 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.000535 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.015239 23998 raft_consensus.cc:2368] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8.
I20260709 12:21:24.001551 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.002600 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:24.015769 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 52347.9us
I20260709 12:21:23.999215 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.016561 23820 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:23.967039 26973 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:24.016674 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:24.014369 24003 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:24.017480 23846 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:24.017825 23854 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:24.018656 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:24.020263 23922 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:24.021535 23925 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:23.957062 26895 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:21:23.990203 26893 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:24.022954 27114 log.cc:927] Time spent T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:21:24.025226 23996 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:23.954739 26430 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:21:23.967615 26728 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:21:24.040066 26868 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:24.026252 26754 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.011082 27109 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:24.037387 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:24.039438 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:24.040246 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:24.040350 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:23.981360 26910 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.010808 26904 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:21:24.009001 26537 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:21:24.054081 23849 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:24.059711 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:24.055367 23846 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:24.055753 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.052855 23854 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:24.060259 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:24.058182 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:24.061352 23995 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:24.060338 23928 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:24.064819 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:24.065696 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:24.068877 27116 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:21:24.056952 27124 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:24.070333 27124 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.070770 27124 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:24.070925 27115 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:21:24.042289 27091 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.078650 27109 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:24.064627 26754 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:24.082696 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.083539 23995 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 4: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:24.084390 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.085091 23995 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:24.079785 26910 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:24.070327 27110 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 12:21:24.110656 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 238069us
I20260709 12:21:24.112934 24556 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:24.061587 26893 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:24.127055 23923 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:24.130352 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.134696 23995 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:24.147506 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:24.147779 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:24.148312 24556 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
W20260709 12:21:24.145872 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 170477us
I20260709 12:21:24.149693 23895 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:24.155689 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:24.156885 24555 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:24.148203 24557 raft_consensus.cc:2376] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4. Re-sending same reply.
I20260709 12:21:24.170377 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.171802 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.172957 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.159742 27049 consensus_queue.cc:1059] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:21:24.175050 27049 raft_consensus.cc:3055] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:24.175472 27049 raft_consensus.cc:740] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:24.176308 27049 consensus_queue.cc:260] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:24.179595 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.179499 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.188689 23920 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:24.193815 23817 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:24.195039 26950 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:24.195678 26950 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:24.197168 23995 raft_consensus.cc:2393] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:24.198165 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.199180 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.201809 23995 raft_consensus.cc:2393] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:24.206686 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 56358.6us
W20260709 12:21:24.195063 27095 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.554s	user 0.003s	sys 0.000s
I20260709 12:21:24.210214 27056 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.219661 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.221621 23995 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
W20260709 12:21:24.223425 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 73822.4us
W20260709 12:21:24.228628 23966 leader_election.cc:336] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.129s (SENT)
I20260709 12:21:24.231266 27135 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:24.218979 27049 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:24.231904 27135 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:24.233493 27121 log.cc:927] Time spent T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.263s	user 0.003s	sys 0.000s
I20260709 12:21:24.236842 26868 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.236703 27124 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.226984 26910 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:24.225400 27056 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.218215 26950 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:24.198470 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 296625us
I20260709 12:21:24.255980 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:24.264012 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 116899us
I20260709 12:21:24.271651 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:24.242601 27015 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:24.277913 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.278793 23995 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:24.263664 26910 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:24.283886 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 141085us
I20260709 12:21:24.288334 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.288601 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.289279 23996 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:24.292979 27137 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.298064 23995 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:24.285342 26910 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.300186 27131 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:24.322672 27015 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:24.279129 26913 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:24.354270 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 67263.5us
I20260709 12:21:24.288761 27135 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:24.356725 23969 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:24.278649 26510 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:24.339975 27145 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:21:24.372229 23997 raft_consensus.cc:2368] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 5. Current term is 6.
I20260709 12:21:24.380198 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:24.371716 27135 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.409267 23995 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:24.411197 23995 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:24.417254 27084 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.417943 27084 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.418412 27056 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.419957 26913 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:24.426784 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:24.433540 23893 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:24.366020 27147 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:21:24.390012 27135 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.342500 27137 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.438836 24524 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:21:24.440857 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60770.5us
I20260709 12:21:24.443018 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:24.443120 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:24.451356 24554 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:24.442078 26913 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:21:24.386996 26660 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:24.449918 26879 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:24.460870 26879 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.461297 26879 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:24.360190 27131 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.446564 27135 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.418443 27084 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:24.483989 27146 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.484872 27015 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:24.485265 26567 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.454768 27145 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:24.486554 27137 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:24.486979 26660 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.487488 26510 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.457376 26893 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:24.495643 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:24.474766 27048 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:24.503103 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 139652us
W20260709 12:21:24.500330 27139 log.cc:927] Time spent T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:21:24.467248 26868 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:21:24.460870 27055 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:21:24.526013 27158 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.526602 27158 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:24.528769 27158 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.534163 27124 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:24.534842 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:24.535326 27145 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:24.535585 24002 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:24.536968 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 76627.8us
I20260709 12:21:24.537737 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:24.539358 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:24.539693 27015 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:24.540113 27137 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.503288 26567 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:24.542999 26567 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.519986 27084 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.547309 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:24.547972 24000 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.549732 26879 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.552785 24003 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:24.511260 23969 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:24.508072 26893 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:24.523617 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.529603 27131 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:24.520493 27156 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:24.569761 24002 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:24.540512 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:24.556967 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 45789.3us
I20260709 12:21:24.562544 24003 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:21:24.520983 27087 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:21:24.574493 27087 consensus_queue.cc:1059] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:24.575524 27087 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:24.575929 27087 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:24.577056 27087 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:24.580382 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:24.605216 27087 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:24.614481 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:24.615510 24558 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:21:24.633818 24563 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:24.634868 27135 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.646935 27056 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:24.647810 27135 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:24.647634 27056 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.498562 27146 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.554701 26893 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:24.655058 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:24.656168 27090 raft_consensus.cc:3055] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:24.656592 27090 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:24.638183 27155 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:24.659487 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:24.659742 27146 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:24.657474 27090 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:24.552954 26879 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.661748 27090 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:24.631059 26868 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:21:24.556689 27048 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.641855 27156 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:24.663112 27054 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.663992 27048 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:24.664968 27156 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:24.636811 26910 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.660833 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.665930 23997 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:24.654325 23893 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:24.682767 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:24.683583 24560 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.684530 24557 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:24.702374 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:24.703249 24563 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:24.649844 27056 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:24.709898 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 169412us
I20260709 12:21:24.709568 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.711932 23895 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:24.687314 26973 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:24.718544 23997 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:24.716842 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:24.702288 27155 raft_consensus.cc:697] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:24.698704 23848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:21:24.745191 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.844614 23848 raft_consensus.cc:606] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:24.787184 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:24.845701 23848 raft_consensus.cc:614] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:24.728586 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.787492 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:24.847579 24557 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.775642 24560 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:24.672887 24000 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:24.766376 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:24.849131 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.850775 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:24.808627 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.851799 24001 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:24.852428 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:24.831450 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 120491us
I20260709 12:21:24.767241 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:24.853124 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:24.854934 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 88698.7us
I20260709 12:21:24.846097 24563 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.855564 24001 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:24.855554 23818 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:24.850834 23893 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:24.854579 23997 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:24.859038 23818 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:24.716423 27056 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.862849 26950 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:24.863329 26950 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.863720 26950 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:24.865070 23966 leader_election.cc:400] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:21:24.719666 27109 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:24.736307 26910 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:24.828563 27156 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:24.767338 27054 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.775175 26904 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:24.786940 27061 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:24.871759 27109 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.731416 27154 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:24.875802 27056 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.735855 26973 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:24.879956 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:24.921515 24000 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:24.860446 26955 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:24.860680 26868 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:24.888924 27054 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.861812 27146 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:24.891342 27109 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:24.918115 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 43818.3us
I20260709 12:21:24.920361 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:24.921805 23997 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.930773 24560 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.759008 26893 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:24.928061 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 74107.8us
I20260709 12:21:24.932116 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:24.933794 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:24.889115 27155 consensus_queue.cc:237] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:24.936327 27154 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:24.937374 27154 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:24.939229 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:24.930436 27146 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.975869 27146 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:24.926877 26921 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:24.919272 26485 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.016198 24000 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:25.022965 23848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:21:25.029147 23848 raft_consensus.cc:606] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:25.029592 23848 raft_consensus.cc:614] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:25.034430 24563 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:25.038995 24560 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
W20260709 12:21:25.040904 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 101780us
I20260709 12:21:25.042724 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:25.041049 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:25.034372 27164 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:21:25.028626 26921 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.030771 27154 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.028090 27133 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:25.031947 27156 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:25.051267 24562 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:25.023043 26868 raft_consensus.cc:697] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:25.142136 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 99495us
I20260709 12:21:25.033116 27089 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:25.152544 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:25.178573 23969 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:25.034500 26485 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:25.243376 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 64894.7us
I20260709 12:21:25.153607 26895 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:25.239639 27056 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:25.266510 23997 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:25.168071 27133 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:25.232791 26567 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.298964 24524 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:25.297812 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:25.300630 23998 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:25.166934 27132 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.120s
I20260709 12:21:25.307955 27054 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:25.301023 26567 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:25.250437 26913 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:25.320839 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:25.324658 24559 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:25.235469 26973 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:25.320840 26988 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:25.325752 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1868) took 1099 ms. Trace:
I20260709 12:21:25.327414 23998 rpcz_store.cc:276] 0709 12:21:24.226547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.324907 (+1098360us) service_pool.cc:224] Handling call
0709 12:21:25.325236 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.325419 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.325447 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:25.325488 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:25.325525 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.325580 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.325695 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:25.160840 27154 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:25.327621 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 175172us
I20260709 12:21:25.334682 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:25.299574 26936 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:25.334792 23966 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:25.340368 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:25.309514 26895 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:25.304615 27061 raft_consensus.cc:2764] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:21:25.337651 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:25.335418 23922 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:25.342465 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:25.349138 23925 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:25.202402 27089 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:25.353422 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:25.354210 23848 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.358029 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:25.358349 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:25.358789 23847 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:25.358912 23928 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:25.325747 26567 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:25.347360 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:25.342880 23998 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:21:25.363842 23845 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:25.326860 27046 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:25.352732 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:25.398643 24559 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:25.398715 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1865) took 1178 ms. Trace:
I20260709 12:21:25.365362 26567 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:25.365715 26895 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:25.366159 24561 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:21:25.367164 27169 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 12:21:25.368018 27172 log.cc:927] Time spent T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:21:25.368813 27168 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:21:25.371366 23998 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:25.313639 27156 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:21:25.349726 26913 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:25.374615 26893 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:25.377420 26950 consensus_meta.cc:287] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 12:21:25.388568 27109 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:25.389165 24557 consensus_meta.cc:287] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
I20260709 12:21:25.433068 24557 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:25.336959 27087 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.348941 26936 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:25.400867 23847 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:25.326483 26988 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:25.399372 24003 rpcz_store.cc:276] 0709 12:21:24.220769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.580344 (+359575us) service_pool.cc:224] Handling call
0709 12:21:24.586756 (+  6412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:24.686141 (+ 99385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:24.686172 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:24.710182 (+ 24010us) log.cc:844] Serialized 26 byte log entry
0709 12:21:25.016372 (+306190us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:25.397814 (+381442us) log.cc:844] Serialized 14 byte log entry
0709 12:21:25.398223 (+   409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.398404 (+   181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:25.398461 (+    57us) raft_consensus.cc:1685] finished
0709 12:21:25.398480 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.398640 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86776,"raft.queue_time_us":79488,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":4762,"thread_start_us":531528,"threads_started":2,"wal-append.queue_time_us":588961}
I20260709 12:21:25.405575 23848 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:25.410188 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:25.360759 26553 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:25.418099 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.431612 26950 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:25.321327 26868 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:25.441094 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:25.441376 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:25.390308 23997 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:25.360909 27055 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:21:25.440163 23848 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:25.443209 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:25.444242 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:25.445722 23852 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:25.403261 27046 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:25.452183 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:25.452373 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:25.453912 23848 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:25.453715 23845 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:25.405057 26567 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:25.491972 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1857) took 1273 ms. Trace:
I20260709 12:21:25.490341 23847 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:25.457172 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:25.458832 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:25.514348 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1854) took 1305 ms. Trace:
I20260709 12:21:25.506170 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1867) took 1281 ms. Trace:
I20260709 12:21:25.524507 23848 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:25.499018 23845 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:25.523594 24004 rpcz_store.cc:276] 0709 12:21:24.210050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.419551 (+209501us) service_pool.cc:224] Handling call
0709 12:21:24.419952 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:24.505204 (+ 85252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:24.505233 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:24.512314 (+  7081us) log.cc:844] Serialized 26 byte log entry
0709 12:21:24.878463 (+366149us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:24.878507 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.878573 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:25.482856 (+604283us) raft_consensus.cc:1685] finished
0709 12:21:25.482884 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.483104 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40240,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":13132,"thread_start_us":280449,"threads_started":2,"wal-append.queue_time_us":401892}
I20260709 12:21:25.442435 26485 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:25.525461 23995 rpcz_store.cc:276] 0709 12:21:24.209073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.412097 (+203024us) service_pool.cc:224] Handling call
0709 12:21:24.412476 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:24.500829 (+ 88353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:24.500877 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:24.504989 (+  4112us) log.cc:844] Serialized 26 byte log entry
0709 12:21:24.843704 (+338715us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:24.843789 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.843895 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:25.514010 (+670115us) raft_consensus.cc:1685] finished
0709 12:21:25.514042 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.514259 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"raft.queue_time_us":47570,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":28314,"thread_start_us":298337,"threads_started":2,"wal-append.queue_time_us":515110}
I20260709 12:21:25.526268 24002 rpcz_store.cc:276] 0709 12:21:24.225086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.716680 (+491594us) service_pool.cc:224] Handling call
0709 12:21:24.765022 (+ 48342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:24.786889 (+ 21867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:24.786920 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:24.848934 (+ 62014us) log.cc:844] Serialized 26 byte log entry
0709 12:21:25.035841 (+186907us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:25.035914 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.036044 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:25.505834 (+469790us) raft_consensus.cc:1685] finished
0709 12:21:25.505865 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.506081 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":62855,"thread_start_us":152476,"threads_started":1,"wal-append.queue_time_us":329377}
I20260709 12:21:25.563956 23995 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:21:25.561414 24525 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.897s (SENT)
I20260709 12:21:25.565646 24525 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:25.455722 26895 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:25.505473 27146 consensus_meta.cc:287] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.529s	user 0.013s	sys 0.000s
I20260709 12:21:25.571332 23995 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:25.440203 27087 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:25.482137 26913 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:25.573145 24004 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:25.573220 24002 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:25.535764 27046 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:25.575624 24525 leader_election.cc:336] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.952s (SENT)
I20260709 12:21:25.579531 24525 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:25.583022 23995 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:25.584321 23848 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:21:25.588889 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:25.576382 27056 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:25.560906 26893 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:21:25.586177 27166 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:25.578116 27146 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:25.576511 27175 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:25.572698 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 326976us
I20260709 12:21:25.573670 27084 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:25.589871 26985 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:25.590571 27176 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:25.592289 27091 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:25.604602 27061 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:25.628495 23969 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:25.593027 26553 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:25.633337 23969 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:25.603035 26913 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:21:25.620175 26893 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:25.614102 26988 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:25.615507 26567 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:25.654240 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 297987us
I20260709 12:21:25.614368 27056 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:25.646643 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1875) took 1099 ms. Trace:
I20260709 12:21:25.658208 24003 rpcz_store.cc:276] 0709 12:21:24.547119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.437142 (+890023us) service_pool.cc:224] Handling call
0709 12:21:25.437534 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:25.438055 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.438095 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:25.466528 (+ 28433us) log.cc:844] Serialized 52 byte log entry
0709 12:21:25.646272 (+179744us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:25.646318 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.646391 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:25.646438 (+    47us) raft_consensus.cc:1685] finished
0709 12:21:25.646450 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.646575 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2545,"raft.queue_time_us":1879,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":10216,"thread_start_us":155373,"threads_started":1,"wal-append.queue_time_us":153066}
I20260709 12:21:25.660583 24003 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:25.624321 27109 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:25.627985 27155 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 12:21:25.665581 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 315245us
W20260709 12:21:25.663741 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 141131us
I20260709 12:21:25.640873 26950 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:25.613749 27166 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:25.688510 23892 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:25.628823 27084 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:25.653725 27179 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:25.689860 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:25.690829 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 115235us
I20260709 12:21:25.659268 26567 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:25.658109 27056 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:25.668401 27132 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:25.665246 26893 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:25.625846 27175 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:25.668186 27089 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:25.681478 27154 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:25.706282 27183 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:25.724478 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 135669us
I20260709 12:21:25.681682 27061 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:25.682332 26936 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:25.685040 27133 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:25.685256 27180 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:25.628997 27176 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:25.805651 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 138115us
W20260709 12:21:25.804414 24525 leader_election.cc:336] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.177s (SENT)
I20260709 12:21:25.979954 24525 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:25.697383 26950 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:25.997485 27178 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 12:21:26.004859 27176 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:25.871274 27186 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:25.828238 26567 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:25.824347 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 156925us
W20260709 12:21:25.832399 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 194329us
I20260709 12:21:25.822093 26553 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:25.707036 27179 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:25.915180 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 226732us
I20260709 12:21:25.806713 26985 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:21:25.979391 23820 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:21:25.834867 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.036267 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:25.989953 27192 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.828147 27087 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:26.006999 27180 raft_consensus.cc:697] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:25.990155 27189 raft_consensus.cc:3055] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:25.958988 27061 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:26.062278 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 82941.4us
I20260709 12:21:25.826638 27184 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:26.063612 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1759) took 1352 ms. Trace:
I20260709 12:21:26.122634 23999 rpcz_store.cc:276] 0709 12:21:24.710942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.622499 (+911557us) service_pool.cc:224] Handling call
0709 12:21:25.633936 (+ 11437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.634241 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:25.651418 (+ 17177us) log.cc:844] Serialized 14 byte log entry
0709 12:21:26.063242 (+411824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:26.063296 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:26.063354 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.063423 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.063552 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19849,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":38,"thread_start_us":411426,"threads_started":2}
I20260709 12:21:26.026681 27146 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:26.131930 24524 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:26.133201 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:26.137143 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:26.138005 23848 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
W20260709 12:21:26.138144 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 333731us
I20260709 12:21:26.140673 23848 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:21:26.142751 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:26.137102 27189 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:25.918558 26884 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.006351 26950 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:26.147238 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:26.148567 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:26.140853 23820 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:26.035385 27056 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:26.156358 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 120186us
I20260709 12:21:26.165119 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:26.147364 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:26.173599 23999 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:26.176676 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1766) took 1429 ms. Trace:
I20260709 12:21:26.177119 23999 rpcz_store.cc:276] 0709 12:21:24.746779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.137718 (+1390939us) service_pool.cc:224] Handling call
0709 12:21:26.169799 (+ 32081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.176342 (+  6543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.176606 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:26.175606 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:21:26.178913 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 144152us
I20260709 12:21:26.181223 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:26.181814 23847 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:26.145220 27176 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.054497 26936 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:25.918939 27183 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:26.027153 27186 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:26.159443 26985 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:21:26.153199 27184 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:26.158964 27211 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:26.208609 23817 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.517s (SENT) [suppressed 20 similar messages]
I20260709 12:21:26.137470 27087 consensus_queue.cc:1059] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:21:26.180661 27146 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:26.056514 26893 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:26.253760 27059 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:21:26.261350 27186 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:26.084029 27192 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:26.169304 27109 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:21:26.212292 27200 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.175057 26884 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:26.244998 27084 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:26.279901 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 146791us
W20260709 12:21:26.267527 27196 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:21:26.254963 27166 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:26.256250 27146 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.158218 27189 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:26.300573 23847 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:26.213225 27176 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:26.224609 26936 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:26.289713 27211 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:26.332909 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:26.362207 24559 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:26.296622 27214 raft_consensus.cc:3055] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:26.296257 27084 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:26.276543 27186 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:21:26.317579 27146 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:26.339020 27155 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:26.324407 27166 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:26.284866 27200 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:26.267714 27180 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:26.422502 24525 leader_election.cc:336] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.823s (SENT)
W20260709 12:21:26.687399 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 511827us
W20260709 12:21:26.498099 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 289515us
W20260709 12:21:26.481361 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.687069 23892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.012s	sys 0.022s
W20260709 12:21:26.689637 23892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.012s	sys 0.022s
I20260709 12:21:26.674306 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1754) took 2020 ms. Trace:
I20260709 12:21:26.690838 24004 rpcz_store.cc:276] 0709 12:21:24.654120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.580499 (+926379us) service_pool.cc:224] Handling call
0709 12:21:25.590508 (+ 10009us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:25.595091 (+  4583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.595143 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:25.595800 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 12:21:25.832153 (+236353us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:25.832194 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.832277 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:26.464724 (+632447us) raft_consensus.cc:1685] finished
0709 12:21:26.464758 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.674199 (+209441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4071,"raft.queue_time_us":13999,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6053,"thread_start_us":203337,"threads_started":1,"wal-append.queue_time_us":444651}
I20260709 12:21:26.331539 27211 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:26.718567 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:26.655027 27190 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 12:21:26.624092 27132 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.001s	sys 0.010s
I20260709 12:21:26.655169 27191 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:26.562963 27056 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:26.746085 27182 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:26.746714 27182 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:26.749017 27182 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:26.750790 27216 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:21:26.726464 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:26.751636 23924 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:26.752748 27179 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:26.692519 27166 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:26.656756 26921 consensus_meta.cc:287] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.503s	user 0.014s	sys 0.002s
I20260709 12:21:26.753767 27166 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:26.754217 26921 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:26.756831 23845 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:26.758211 27223 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:26.693073 27154 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:26.683234 27176 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:26.768680 27183 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:26.769641 27215 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.770388 27215 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:26.692593 27175 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:26.654978 27208 raft_consensus.cc:2764] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:26.777529 27192 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:26.367520 27214 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:26.732925 27230 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.738441 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:26.830478 23928 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
W20260709 12:21:26.498339 26485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.002s	sys 0.009s
I20260709 12:21:26.674659 27189 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:26.413141 26567 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:26.837863 27187 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:26.739993 27132 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.002s	sys 0.011s
I20260709 12:21:26.845029 23924 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
W20260709 12:21:26.847575 27201 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:21:26.847672 27230 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:26.376931 27184 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:26.376595 27084 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:26.730995 27211 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:26.779678 27231 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:21:26.655097 27213 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.436s
I20260709 12:21:26.826807 27223 raft_consensus.cc:697] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:26.839043 26485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.002s	sys 0.012s
I20260709 12:21:26.854444 27132 raft_consensus.cc:697] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:26.907074 26884 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:26.841450 27155 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:26.977566 23999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.003s	sys 0.008s
W20260709 12:21:26.978233 23999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.003s	sys 0.008s
I20260709 12:21:26.861847 27187 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:26.829571 27191 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:27.003304 27210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.030s	sys 0.094s
W20260709 12:21:27.016402 27210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.030s	sys 0.094s
I20260709 12:21:26.989739 26485 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:26.990056 27155 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:27.171614 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 749128us
W20260709 12:21:27.097788 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 409330us
W20260709 12:21:27.171032 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44750.4us
W20260709 12:21:27.181130 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:27.125630 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.189782 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:27.200659 23966 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:27.092689 27146 consensus_meta.cc:287] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.677s	user 0.008s	sys 0.004s
I20260709 12:21:27.135828 27230 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:27.031733 26884 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:27.126674 26936 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:27.201835 27192 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.203840 27186 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.082901 27191 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:26.990463 27214 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:27.209656 27213 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:27.223865 27175 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:27.117828 27166 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:27.227314 27215 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:27.206849 26485 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:27.258028 27192 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:27.249956 26884 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:27.240342 27187 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:27.239827 27200 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:27.259282 27186 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:27.126974 27132 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:27.259333 27230 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:21:27.253090 27217 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:27.227238 27146 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:27.339498 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1881) took 2464 ms. Trace:
I20260709 12:21:27.255971 27084 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:27.256153 26921 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:27.076128 27223 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:27.416793 27231 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:27.418318 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1879) took 2720 ms. Trace:
W20260709 12:21:27.418481 27236 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:21:27.419771 26884 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:27.418704 23995 rpcz_store.cc:276] 0709 12:21:24.698350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.584931 (+886581us) service_pool.cc:224] Handling call
0709 12:21:25.587510 (+  2579us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:25.592024 (+  4514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.592059 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:25.596514 (+  4455us) log.cc:844] Serialized 52 byte log entry
0709 12:21:26.070562 (+474048us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:26.135442 (+ 64880us) log.cc:844] Serialized 14 byte log entry
0709 12:21:26.689194 (+553752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.689272 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:27.414982 (+725710us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b180032cf20. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:27.417977 (+  2995us) raft_consensus.cc:1685] finished
0709 12:21:27.418079 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.418249 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10797,"prepare.queue_time_us":64555,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":210133,"spinlock_wait_cycles":37976448,"thread_start_us":466153,"threads_started":2,"wal-append.queue_time_us":591901}
I20260709 12:21:27.420717 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:27.417438 27231 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:27.386951 27214 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.423236 27231 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:27.405130 23999 rpcz_store.cc:276] 0709 12:21:24.875218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.185080 (+1309862us) service_pool.cc:224] Handling call
0709 12:21:26.202369 (+ 17289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.202622 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:26.202930 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 12:21:27.331831 (+1128901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:27.339163 (+  7332us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:27.339224 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.339294 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.339439 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18175,"prepare.queue_time_us":1704,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":13481,"raft.queue_time_us":251517,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":10314,"thread_start_us":1089662,"threads_started":2,"wal-append.queue_time_us":1053831}
I20260709 12:21:27.424289 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:27.424855 23999 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:27.425205 27166 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:27.308830 27191 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.426294 23851 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:27.426002 27191 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:27.427292 27146 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:27.427659 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1831) took 1263 ms. Trace:
I20260709 12:21:27.428007 23851 rpcz_store.cc:276] 0709 12:21:26.164474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.164730 (+   256us) service_pool.cc:224] Handling call
0709 12:21:27.427440 (+1262710us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002fb2d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:27.427572 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2874422016}
I20260709 12:21:27.428442 27191 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:27.408347 27217 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:27.430415 27217 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:27.421419 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1771) took 1115 ms. Trace:
I20260709 12:21:27.431370 23995 rpcz_store.cc:276] 0709 12:21:26.306283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.420480 (+1114197us) service_pool.cc:224] Handling call
0709 12:21:27.421364 (+   884us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:27.433126 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.433084 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:27.425268 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1775) took 1070 ms. Trace:
I20260709 12:21:27.256102 27213 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:27.433863 23999 rpcz_store.cc:276] 0709 12:21:26.354804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.424023 (+1069219us) service_pool.cc:224] Handling call
0709 12:21:27.425218 (+  1195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:27.434818 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:27.435359 23999 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:27.434479 27213 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:27.438634 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:27.386647 27243 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:27.437618 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.408820 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:27.440429 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 351) took 3429 ms. Trace:
W20260709 12:21:27.442570 27157 log.cc:927] Time spent T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 2.706s	user 0.001s	sys 0.012s
I20260709 12:21:27.444890 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:27.439569 23851 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:27.454205 23996 rpcz_store.cc:276] 0709 12:21:24.007022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.291576 (+284554us) service_pool.cc:224] Handling call
0709 12:21:24.295435 (+  3859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:24.498393 (+202958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:24.498430 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:24.502209 (+  3779us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:24.502259 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.436620 (+2934361us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540020f3d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:27.436672 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.436787 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454352768}
I20260709 12:21:27.461652 24003 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:27.508198 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1772) took 1186 ms. Trace:
I20260709 12:21:27.508647 24003 rpcz_store.cc:276] 0709 12:21:26.322307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.444606 (+1122299us) service_pool.cc:224] Handling call
0709 12:21:27.508109 (+ 63503us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:27.511272 27239 log.cc:927] Time spent T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:21:27.311071 27175 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:27.438606 27166 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:27.557893 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:27.587646 23996 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:27.588335 23999 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:27.588464 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:27.567440 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:27.559831 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 377329us
I20260709 12:21:27.437956 27191 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.591156 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1776) took 1221 ms. Trace:
I20260709 12:21:27.592854 23999 rpcz_store.cc:276] 0709 12:21:26.370284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.434563 (+1064279us) service_pool.cc:224] Handling call
0709 12:21:27.591095 (+156532us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:27.594002 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:27.594861 23999 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:27.592881 24525 leader_election.cc:336] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 3.290s (SENT)
I20260709 12:21:27.595512 24525 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:27.589867 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 389293us
W20260709 12:21:27.635447 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:27.662997 23966 connection.cc:256] RPC call timeout handler was delayed by -1.7417779809998137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 12:21:27.668080 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0271779809997952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28490000000000004s for a response
I20260709 12:21:27.672435 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:27.479890 26893 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.674968 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1825) took 3167 ms. Trace:
W20260709 12:21:27.560384 27056 consensus_meta.cc:287] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.814s	user 0.012s	sys 0.000s
W20260709 12:21:27.677712 23853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.009s	sys 0.014s
W20260709 12:21:27.690474 23853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.009s	sys 0.014s
I20260709 12:21:27.678805 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:27.691200 23851 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.680130 23920 rpcz_store.cc:276] 0709 12:21:24.429852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.430766 (+   914us) service_pool.cc:224] Handling call
0709 12:21:24.431101 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:24.666445 (+235344us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:24.717497 (+ 51052us) log.cc:844] Serialized 14 byte log entry
0709 12:21:24.717761 (+   264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:24.717812 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:24.717869 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.597071 (+2879202us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54003ce454. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:27.597124 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.597283 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":167565,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":747,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":540729088,"thread_start_us":50668,"threads_started":1}
I20260709 12:21:27.590227 27213 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:27.742295 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1834) took 1515 ms. Trace:
I20260709 12:21:27.741724 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:27.732633 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60299.2us
I20260709 12:21:27.747843 23853 rpcz_store.cc:276] 0709 12:21:26.227436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.706446 (+479010us) service_pool.cc:224] Handling call
0709 12:21:26.706931 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.707216 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:27.012073 (+304857us) log.cc:844] Serialized 14 byte log entry
0709 12:21:27.741846 (+729773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:27.741934 (+    88us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:27.741996 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.742074 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.742223 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50846,"prepare.queue_time_us":140379,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":52133,"thread_start_us":906748,"threads_started":2}
I20260709 12:21:27.748245 23999 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:27.675710 27131 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:27.790899 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:27.698969 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.793522 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:27.788276 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:27.794929 23849 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:27.794915 23999 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:27.793344 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:27.797361 23854 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:27.812870 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:27.692276 27155 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:27.813755 23853 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:27.742255 27251 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.859614 27223 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:27.861907 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:27.745196 27249 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.674928 27191 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:27.651324 27166 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:27.863056 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:27.812136 27236 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:21:27.748788 27247 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:27.875368 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:27.905357 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:27.905970 23853 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:27.743566 26893 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:27.861424 27085 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.812377 27230 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:21:27.911449 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:27.875480 27210 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.950489 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:27.951327 23920 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:27.812275 27131 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:27.917928 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:27.873247 26537 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.865974 26485 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:27.804996 27217 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:21:27.907449 26973 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.974004 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:27.974829 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:27.976121 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:27.906838 27184 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.970563 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:27.977332 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:27.972004 23922 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:27.976758 23928 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:27.979712 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:27.980552 23853 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
W20260709 12:21:27.966981 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 223626us
I20260709 12:21:27.998549 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.002363 23928 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:28.005125 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:27.873562 27251 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.034077 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:27.976531 27186 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:27.977238 26485 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:28.040956 23920 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:27.963124 27085 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.008504 27192 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:27.968106 27210 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:27.976909 26537 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:28.042465 27237 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.530s	user 0.000s	sys 0.001s
I20260709 12:21:28.047518 27229 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.985709 26973 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.051833 27214 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.007552 27184 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.071063 27192 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:28.110261 23851 raft_consensus.cc:2410] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:21:28.110965 23849 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:28.051103 26485 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.113284 27131 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:28.132922 23996 consensus_meta.cc:287] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.000s
I20260709 12:21:28.133361 23996 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:28.134236 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:28.127197 24525 leader_election.cc:336] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 3.086s (SENT)
I20260709 12:21:28.136299 23849 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:28.136860 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:28.135233 23920 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:21:28.136521 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 83918.9us
I20260709 12:21:28.138669 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:28.138969 23996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1773) took 1814 ms (client timeout 2245 ms). Trace:
I20260709 12:21:28.139338 23928 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:28.139402 23996 rpcz_store.cc:269] 0709 12:21:26.325083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.481967 (+1156884us) service_pool.cc:224] Handling call
0709 12:21:28.138906 (+656939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:28.140317 26904 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:28.140805 26904 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.141095 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:28.141592 27085 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:28.141827 24001 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:28.142757 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.143332 24001 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:28.144168 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:28.146708 27253 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:21:28.114331 27175 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:28.121224 27262 log.cc:927] Time spent T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.260s	user 0.002s	sys 0.000s
I20260709 12:21:28.155035 26537 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:28.158056 27184 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:28.091194 27229 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.160323 26973 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:28.162742 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.093003 27214 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.163666 24003 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:28.165855 23854 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:28.117424 27048 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:21:28.140357 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 641) took 1803 ms. Trace:
W20260709 12:21:28.177031 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49868.7us
W20260709 12:21:28.181237 24525 leader_election.cc:336] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 3.107s (SENT)
I20260709 12:21:28.181687 24525 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:28.183183 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:28.158915 27261 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:21:28.184672 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.187237 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.123397 27265 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:28.190166 27255 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:21:28.189081 23928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:21:28.164832 27191 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:28.196625 27189 consensus_meta.cc:287] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.334s	user 0.010s	sys 0.003s
I20260709 12:21:28.185966 27264 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.201978 23995 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:28.178407 27166 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:28.137926 27267 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:21:28.204171 26893 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:28.218328 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.219210 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.220835 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.222587 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:28.225764 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.228303 26950 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:28.205571 27259 log.cc:927] Time spent T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:21:28.205935 27264 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:28.208139 23736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8630b76482c543a2a08e289b32b13ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 22996f888daf435398b693481171c18c (127.22.43.65:34895) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:28.208319 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1876) took 3660 ms. Trace:
I20260709 12:21:28.233574 23997 rpcz_store.cc:276] 0709 12:21:24.547419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.478673 (+931254us) service_pool.cc:224] Handling call
0709 12:21:25.503393 (+ 24720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:25.514022 (+ 10629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.514070 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:25.514707 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 12:21:25.705469 (+190762us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:25.705506 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.705571 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:28.207922 (+2502351us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b2c00185288. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2856fc291 00007fa2857170ca 00007fa2874454ad 00007fa28744cf8e 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2
0709 12:21:28.208003 (+    81us) raft_consensus.cc:1685] finished
0709 12:21:28.208019 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.208256 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3149,"raft.queue_time_us":72874,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9294,"spinlock_wait_cycles":4573440,"thread_start_us":139503,"threads_started":1,"wal-append.queue_time_us":560919,"wal-append.run_cpu_time_us":8114,"wal-append.run_wall_time_us":1803327}
W20260709 12:21:28.209327 24525 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 3.128s (SENT)
I20260709 12:21:28.236100 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.236780 23997 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:28.207855 27265 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.239624 27265 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:28.179687 24561 rpcz_store.cc:276] 0709 12:21:26.331677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.332577 (+   900us) service_pool.cc:224] Handling call
0709 12:21:26.339865 (+  7288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:26.340284 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:26.340323 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:26.376919 (+ 36596us) log.cc:844] Serialized 26 byte log entry
0709 12:21:26.826204 (+449285us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:26.826262 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.826363 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:28.134927 (+1308564us) raft_consensus.cc:1685] finished
0709 12:21:28.134948 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.135079 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":419256,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":135,"thread_start_us":359255,"threads_started":1,"wal-append.queue_time_us":957588}
I20260709 12:21:28.241407 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.242089 23921 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:28.244287 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1747) took 3592 ms. Trace:
I20260709 12:21:28.244704 24002 rpcz_store.cc:276] 0709 12:21:24.651822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.559440 (+907618us) service_pool.cc:224] Handling call
0709 12:21:25.560470 (+  1030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.577216 (+ 16746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.244023 (+2666807us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b540021a2d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:28.244225 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28845312}
I20260709 12:21:28.247290 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:28.247961 24556 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:28.247758 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.248697 24554 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:28.249332 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.250166 24558 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 10: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:28.250288 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:28.250367 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.251672 24557 raft_consensus.cc:2410] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:28.252997 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.254024 24555 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:28.192462 27214 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:28.176121 27211 consensus_meta.cc:287] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 1.292s	user 0.009s	sys 0.004s
I20260709 12:21:28.259507 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.237722 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:28.261911 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:28.262485 23997 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.263164 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.263164 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:28.117679 27192 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.264303 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:28.265807 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.267617 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.267915 24563 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:28.266249 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.274541 24561 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:28.276722 23996 raft_consensus.cc:2376] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 5. Re-sending same reply.
I20260709 12:21:28.276629 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.208386 26485 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:28.279865 23818 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:28.285840 23818 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:28.279302 27176 consensus_queue.cc:1059] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:21:28.289162 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:28.289449 24004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1777) took 1912 ms (client timeout 1533 ms). Trace:
I20260709 12:21:28.290148 24557 raft_consensus.cc:2410] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:21:28.265862 27203 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.279628 26950 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:21:28.292548 26950 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:28.292927 26950 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:28.293936 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.293812 26950 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.294811 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.295511 23923 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:28.296100 24562 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:28.298810 26950 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:28.302176 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.299566 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:28.299965 24004 rpcz_store.cc:269] 0709 12:21:26.385124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.289240 (+1904116us) service_pool.cc:211] Skipping call since client already timed out
0709 12:21:28.289376 (+   136us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:21:28.300901 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.303503 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:28.303992 23922 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:28.309557 24563 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:28.309940 23997 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:28.288190 23818 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:28.312629 23818 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:28.313090 23895 connection.cc:256] RPC call timeout handler was delayed by -1.9629912329999115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 12:21:28.314139 23895 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:28.295686 27186 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:28.315958 23818 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:28.289162 27208 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:28.267711 27211 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.273893 26728 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:21:28.321460 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.342617 23996 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:28.282660 27085 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:21:28.346390 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.347291 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.347599 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1815) took 2963 ms. Trace:
I20260709 12:21:28.348014 23850 rpcz_store.cc:276] 0709 12:21:25.360147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.360259 (+   112us) service_pool.cc:224] Handling call
0709 12:21:25.360522 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.456235 (+ 95713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.456273 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:25.456317 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:25.456371 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.323036 (+2866665us) spinlock_profiling.cc:243] Waited 95.5 ms on lock 0x7b54001f36d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:28.323080 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.323200 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219609984}
I20260709 12:21:28.349695 24556 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:28.350059 23895 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:28.324118 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.328543 27265 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.319100 26973 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.322868 23818 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:28.315220 27048 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.364058 27048 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.364307 27265 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.366437 27048 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:28.366595 27132 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.367244 27265 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:28.368072 27055 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:28.367993 27243 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:28.368635 26973 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.370903 27192 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:28.402678 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.403360 23924 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:28.368018 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.309438 27263 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:28.369446 27184 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:28.364197 26833 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:28.380350 27267 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:28.334141 27175 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:28.322651 27186 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:28.392323 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:28.388986 27155 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.291261 27203 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.364183 27177 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:28.401528 23923 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:28.384089 27185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.328s	user 0.020s	sys 0.026s
I20260709 12:21:28.404956 27131 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.374418 27210 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:28.413735 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.451294 23996 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:28.452286 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.452958 23996 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:28.415272 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.416709 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:28.454698 23924 raft_consensus.cc:2376] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 5. Re-sending same reply.
W20260709 12:21:28.394536 24000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1758) took 3687 ms (client timeout 1960 ms). Trace:
W20260709 12:21:28.455731 24000 rpcz_store.cc:269] 0709 12:21:24.707276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.852205 (+144929us) service_pool.cc:224] Handling call
0709 12:21:28.394333 (+3542128us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b540014ad54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:28.394457 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156862208}
I20260709 12:21:28.457369 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:28.405260 27198 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.415786 27267 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:28.408349 26728 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:28.419982 27186 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:28.405498 27230 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:28.417760 23922 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:28.459164 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:28.462625 27249 consensus_meta.cc:287] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.000s
I20260709 12:21:28.453821 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.402572 27243 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.406082 27055 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:28.382055 27132 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.471077 27267 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:28.465015 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 104206us
W20260709 12:21:28.446175 27185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.403s	user 0.020s	sys 0.027s
I20260709 12:21:28.413512 27175 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:28.452111 27213 consensus_meta.cc:287] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.000s
I20260709 12:21:28.440810 27177 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:28.475497 23996 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:28.488284 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.488958 23996 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:28.408262 27156 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:28.428735 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 78753.7us
W20260709 12:21:28.477653 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 154867us
I20260709 12:21:28.477662 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.410115 27263 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.465794 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:28.493561 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:28.493952 24000 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:28.494181 23996 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.492813 23818 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:28.477491 27208 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:28.423992 27155 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.475692 26728 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:28.492507 24001 raft_consensus.cc:2410] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:28.479521 27249 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:28.513523 27132 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:28.465648 27198 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.514981 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:28.491719 27177 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:28.476871 27230 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.517402 26728 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.465366 27131 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.490620 27175 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.519811 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:28.520116 23818 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:28.508782 23996 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:28.506865 27211 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:28.592363 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.526677 27085 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:28.592990 27085 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:28.593407 27085 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:28.596136 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.531725 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:28.597574 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:28.597771 23996 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.598241 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.598803 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.599649 23926 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 12 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:28.599792 23925 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:28.511744 27156 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.601426 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.602664 27156 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:28.516501 27203 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:28.603233 27243 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:28.603966 26904 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.604574 27133 raft_consensus.cc:3055] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:28.605028 27133 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:28.605443 27208 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.606395 26904 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:28.606916 23995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1778) took 1907 ms (client timeout 1699 ms). Trace:
W20260709 12:21:28.607529 23995 rpcz_store.cc:269] 0709 12:21:26.699458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.432152 (+732694us) service_pool.cc:224] Handling call
0709 12:21:28.606728 (+1174576us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b540034b054. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:28.606839 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766454144}
I20260709 12:21:28.608708 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.609361 23995 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:28.534271 27184 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:28.495700 27055 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.618062 23922 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:28.555907 27155 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:28.527619 27277 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:21:28.516059 27275 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:28.559158 26973 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:28.559981 23895 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:28.621371 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 61478.5us
I20260709 12:21:28.623348 23895 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:28.568235 27273 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:28.570652 23893 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:28.574506 27131 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:28.578259 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.579097 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.579253 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.629134 24003 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:28.579842 27056 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:28.579872 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59826.6us
I20260709 12:21:28.580484 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.580226 27280 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:28.582733 27244 log.cc:927] Time spent T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 1.176s	user 0.007s	sys 0.001s
I20260709 12:21:28.582891 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.584954 27230 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:28.585779 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.606982 23928 raft_consensus.cc:606] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:28.537993 27272 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:21:28.567488 27263 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:28.623471 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:28.626595 26904 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:28.615264 27211 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:28.630822 23996 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:28.638130 23928 raft_consensus.cc:614] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:28.635234 23920 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
W20260709 12:21:28.639155 24524 connection.cc:256] RPC call timeout handler was delayed by -1.6512600280000242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 12:21:28.647399 23818 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:28.647671 24524 connection.cc:256] RPC call timeout handler was delayed by -1.5625483110000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:21:28.634776 27280 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:28.648011 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.649250 24003 raft_consensus.cc:2393] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:28.650401 23921 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:28.645391 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 74818.1us
I20260709 12:21:28.651919 23893 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:28.653184 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.654286 23895 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:28.653218 23893 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:28.655678 23893 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:28.656242 24556 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:28.658316 24556 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:21:28.659511 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:28.649508 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.665832 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:28.666792 23996 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:28.663842 24559 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:28.630422 27273 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:28.630191 27275 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:28.672118 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.672214 24561 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:28.673040 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 360) took 1001 ms. Trace:
I20260709 12:21:28.673457 24003 rpcz_store.cc:276] 0709 12:21:27.671211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.671835 (+1000624us) service_pool.cc:224] Handling call
0709 12:21:28.672977 (+  1142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:28.674445 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.675298 24003 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:28.676468 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.677320 24003 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:28.677727 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.678587 24556 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:28.680342 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 361) took 1008 ms. Trace:
I20260709 12:21:28.682343 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.616216 27177 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.688473 24003 rpcz_store.cc:276] 0709 12:21:27.671485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.676132 (+1004647us) service_pool.cc:224] Handling call
0709 12:21:28.680259 (+  4127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:28.672747 27263 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:28.615469 27133 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.645994 27192 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:28.671188 27048 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:28.671273 27278 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:28.694684 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:28.671494 26910 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:28.646530 26904 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:28.650265 27264 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.678680 27274 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:21:28.635327 27186 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.651046 27280 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.679627 26893 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:28.730602 26893 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:28.731252 26893 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.670466 27277 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:28.734306 27277 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.734830 27277 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:28.703248 23996 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:28.641498 27056 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.740298 27056 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:28.720861 26910 raft_consensus.cc:697] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:28.693836 27089 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:28.705928 27048 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:28.712519 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.678617 27275 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.714813 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.679850 27273 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:28.716751 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 355) took 1047 ms. Trace:
I20260709 12:21:28.719723 24560 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:28.757794 24556 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:28.693485 27263 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.722014 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1882) took 3823 ms. Trace:
I20260709 12:21:28.696307 26833 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:28.723515 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.759900 23999 rpcz_store.cc:276] 0709 12:21:24.898707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.705751 (+3807044us) service_pool.cc:224] Handling call
0709 12:21:28.721430 (+ 15679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.721619 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:28.721662 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:28.721708 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:28.721750 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.721808 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.721954 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:28.760977 24558 raft_consensus.cc:2393] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:28.671304 27211 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.720450 27133 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:28.771039 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 126543us
I20260709 12:21:28.709151 27278 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.711555 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.774484 24561 raft_consensus.cc:2393] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:28.758785 24003 rpcz_store.cc:276] 0709 12:21:27.669710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.694291 (+1024581us) service_pool.cc:224] Handling call
0709 12:21:28.716685 (+ 22394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:28.718168 26904 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:28.763151 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:28.779807 24560 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:28.705300 27192 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.783542 27192 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:28.773229 23817 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:28.776516 23999 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:28.753383 27215 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:28.777261 27278 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:28.753823 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 106497us
I20260709 12:21:28.747288 26910 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.725369 27264 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:28.784859 24003 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:28.983254 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1768) took 4052 ms. Trace:
I20260709 12:21:28.983670 24003 rpcz_store.cc:276] 0709 12:21:24.931297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.775074 (+3843777us) service_pool.cc:224] Handling call
0709 12:21:28.775459 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.982714 (+207255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.983194 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:28.966506 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:28.985030 27189 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:28.985455 27189 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:28.985841 27189 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:28.988750 23892 connection.cc:256] RPC call timeout handler was delayed by -1.0799632229998224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
I20260709 12:21:28.988987 27198 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:28.989212 23892 connection.cc:256] RPC call timeout handler was delayed by -1.0691632229998049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260709 12:21:28.972716 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1787) took 1538 ms. Trace:
I20260709 12:21:28.902978 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:28.990648 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:28.936899 24004 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:28.792351 24560 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:28.995775 24001 rpcz_store.cc:276] 0709 12:21:27.434151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.143936 (+709785us) service_pool.cc:224] Handling call
0709 12:21:28.972482 (+828546us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540020eed4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:28.972641 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799345920}
I20260709 12:21:28.958910 23996 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:28.938706 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1770) took 2643 ms. Trace:
I20260709 12:21:28.867354 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1873) took 4423 ms. Trace:
I20260709 12:21:28.998905 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:28.996116 23846 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:28.877202 27186 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:28.900296 27061 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:28.991850 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 218740us
I20260709 12:21:29.001660 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.904417 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:28.992915 27205 raft_consensus.cc:2764] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:21:29.025370 23892 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:29.028050 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:28.887476 27177 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:28.994459 27213 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:28.762640 27263 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.977016 26754 raft_consensus.cc:3055] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:28.990222 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1832) took 2801 ms. Trace:
I20260709 12:21:28.998996 24000 rpcz_store.cc:276] 0709 12:21:26.295858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.937685 (+2641827us) service_pool.cc:224] Handling call
0709 12:21:28.938035 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.938287 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:28.938326 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:28.938381 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:28.938431 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.938499 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.938635 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:28.991007 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1884) took 4062 ms. Trace:
I20260709 12:21:29.048332 23999 rpcz_store.cc:276] 0709 12:21:24.929032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.761280 (+3832248us) service_pool.cc:224] Handling call
0709 12:21:28.776337 (+ 15057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.990738 (+214401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.990952 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:29.050107 23999 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:21:29.050522 23999 pending_rounds.cc:85] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 3
I20260709 12:21:29.050808 23999 pending_rounds.cc:107] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:21:29.051095 23999 raft_consensus.cc:2889] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:29.042711 27133 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:29.001157 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.003481 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.057125 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:29.003346 23851 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:28.794117 24557 raft_consensus.cc:2410] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:21:28.999687 23998 rpcz_store.cc:276] 0709 12:21:24.444418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.417920 (+973502us) service_pool.cc:224] Handling call
0709 12:21:25.426758 (+  8838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:25.427276 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.427319 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:28.601898 (+3174579us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b2c0011d7e8. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa285d45a11 00007fa285d55372 00007fa287487a01 00007fa28744c43a 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2
0709 12:21:28.602508 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 12:21:28.725659 (+123151us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:28.725721 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.725807 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:28.866987 (+141180us) raft_consensus.cc:1685] finished
0709 12:21:28.867012 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.867276 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9732,"spinlock_wait_cycles":7337856,"thread_start_us":117195,"threads_started":1,"wal-append.queue_time_us":176594}
I20260709 12:21:28.761862 27048 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.996474 23854 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:29.062963 23854 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:29.025076 27198 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:29.001324 23893 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:29.071151 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 69901.6us
I20260709 12:21:28.974220 27267 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.017585 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.842547 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:28.763819 27089 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:29.015269 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1769) took 2730 ms. Trace:
I20260709 12:21:29.088184 24004 rpcz_store.cc:276] 0709 12:21:26.285363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.936145 (+2650782us) service_pool.cc:224] Handling call
0709 12:21:28.936530 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.996832 (+ 60302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.015191 (+ 18359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:29.089694 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:29.090415 24004 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:29.029577 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:29.094619 23929 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.031420 23924 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:29.032843 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:29.032951 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.099773 23922 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:29.055430 27243 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:29.035169 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:29.036972 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:29.039921 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:28.928573 27229 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:28.907894 27211 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:29.042018 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:29.119405 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:29.119959 24554 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:28.996119 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:28.773931 26833 raft_consensus.cc:697] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:29.043880 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:29.120612 23848 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 4.
I20260709 12:21:29.044938 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:29.122146 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 78359.5us
I20260709 12:21:29.121598 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1883) took 4209 ms. Trace:
I20260709 12:21:28.973660 27251 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:29.047225 23845 rpcz_store.cc:276] 0709 12:21:26.188891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.189071 (+   180us) service_pool.cc:224] Handling call
0709 12:21:26.189467 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.757326 (+567859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.989994 (+2232668us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b5400215054. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:28.990162 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304251776}
I20260709 12:21:29.085916 27185 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:29.043051 27275 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.997534 23818 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:28.794600 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:29.129376 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 142694us
I20260709 12:21:29.016331 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:29.039381 26537 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:29.073355 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:28.874387 27085 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.893399 27175 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:28.893399 26893 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.086090 24002 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:29.069844 27217 consensus_queue.cc:1059] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:21:28.878890 27280 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.047168 26754 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:29.103996 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:29.107147 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 70230.3us
I20260709 12:21:29.110309 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:29.112178 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.039214 26485 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:21:29.022639 27215 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.208181 23853 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:29.208588 24002 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:29.117098 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:29.086536 27273 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.128082 27229 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:29.213600 23850 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:29.122684 23996 rpcz_store.cc:276] 0709 12:21:24.911891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.737572 (+3825681us) service_pool.cc:224] Handling call
0709 12:21:28.958322 (+220750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.998434 (+ 40112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.121412 (+122978us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540020e9d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:29.121542 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506223360}
I20260709 12:21:29.216449 23996 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:21:29.019498 27184 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.042894 27277 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.043614 27213 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.129422 24558 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
W20260709 12:21:29.070029 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 228967us
I20260709 12:21:29.130199 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:29.132547 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:29.136231 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:29.105536 27243 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:29.033380 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:29.143965 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 70757.6us
I20260709 12:21:29.139341 23820 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:21:29.235795 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 96585.7us
I20260709 12:21:29.147540 24562 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:29.238307 23920 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:29.119395 27223 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:29.206418 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 59294us
I20260709 12:21:29.070712 27198 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:29.208192 24560 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:29.210880 23929 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:29.218555 23996 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:29.137437 27208 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:29.219705 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 88296.9us
I20260709 12:21:29.221294 24556 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:29.133338 26537 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.127537 27185 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:29.228506 24554 raft_consensus.cc:2393] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:29.230489 23851 raft_consensus.cc:1240] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:29.227830 24555 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:29.293449 23969 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:29.245664 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:29.248617 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:29.263006 23852 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:29.295948 27292 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:21:29.296324 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:29.211776 27187 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:29.296927 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:29.279829 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.298418 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:29.301404 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:29.303018 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44384.6us
W20260709 12:21:29.243459 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 113346us
I20260709 12:21:29.306239 23818 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:29.298097 23848 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:29.307423 23895 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:29.150846 27209 consensus_queue.cc:1059] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:21:29.244261 27243 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:29.339968 24525 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:29.347054 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:29.259553 27186 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:29.321162 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:29.363124 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 56965.3us
I20260709 12:21:29.363873 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:29.372586 23852 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
W20260709 12:21:29.358222 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 63469.2us
I20260709 12:21:29.411972 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:29.414114 23852 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:29.414856 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:29.415679 23847 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:29.417006 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:29.260417 27223 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:29.233001 27184 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.258699 27089 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.421231 27223 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:29.423161 27184 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:29.298067 26537 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.423826 27215 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:29.268597 27224 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:29.424680 27184 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:29.424772 27224 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:29.425364 27184 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:29.267166 27131 consensus_queue.cc:1059] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 12:21:29.425827 27184 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.425751 27224 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:29.426528 27131 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:29.426883 27131 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:29.427671 27131 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.428895 27131 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.429337 27211 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:29.309217 27155 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
W20260709 12:21:29.430472 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 90608.6us
I20260709 12:21:29.430783 27155 raft_consensus.cc:3055] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:29.431350 27155 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:29.432454 27155 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.298522 27185 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.268661 27251 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:29.293663 27198 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:29.462493 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 82393.3us
W20260709 12:21:29.464758 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 156160us
I20260709 12:21:29.378067 27217 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:29.475721 24555 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:29.295362 26833 consensus_queue.cc:237] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:29.496760 23751 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59378 (request call id 141) took 15684 ms (client timeout 15000 ms). Trace:
I20260709 12:21:29.465384 27155 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:29.460372 24004 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:29.362619 27208 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:29.498888 23820 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:29.481489 26728 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:29.473647 27288 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.364372 26485 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.139s
I20260709 12:21:29.478302 27251 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:29.511752 27189 consensus_meta.cc:287] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
W20260709 12:21:29.531473 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 119660us
I20260709 12:21:29.554983 23818 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:29.556524 23818 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:29.441896 27187 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:21:29.550383 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:29.562263 24004 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:29.505807 27217 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.515282 27186 raft_consensus.cc:697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:29.510639 23751 rpcz_store.cc:269] 0709 12:21:13.778555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.778812 (+   257us) service_pool.cc:224] Handling call
0709 12:21:29.364282 (+15585470us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:23.060042 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:23.237753 (+177711us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:23.237805 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:21:23.237821 (+    16us) tablet.cc:662] Decoding operations
0709 12:21:23.239211 (+  1390us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:23.239294 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:23.239327 (+    33us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:21:23.240746 (+  1419us) tablet.cc:701] Row locks acquired
0709 12:21:23.240801 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:21:23.241022 (+   221us) write_op.cc:270] Start()
0709 12:21:23.241187 (+   165us) write_op.cc:276] Timestamp: P: 1783599683240939 usec, L: 0
0709 12:21:23.241210 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:21:23.419174 (+177964us) log.cc:844] Serialized 5536 byte log entry
0709 12:21:24.045170 (+625996us) op_driver.cc:464] REPLICATION: finished
0709 12:21:24.067510 (+ 22340us) write_op.cc:301] APPLY: starting
0709 12:21:24.067642 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:24.068107 (+   465us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:24.068285 (+   178us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:24.113115 (+ 44830us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:24.113625 (+   510us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:21:24.113694 (+    69us) write_op.cc:312] APPLY: finished
0709 12:21:24.114280 (+   586us) log.cc:844] Serialized 101 byte log entry
0709 12:21:24.114528 (+   248us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:24.114756 (+   228us) write_op.cc:454] Released schema lock
0709 12:21:24.125003 (+ 10247us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:24.205164 (+ 80161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:24.205208 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1923343,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":21994,"apply.run_cpu_time_us":5422,"apply.run_wall_time_us":111851,"num_ops":14,"prepare.queue_time_us":268390,"prepare.run_cpu_time_us":60741,"prepare.run_wall_time_us":661661,"raft.queue_time_us":198558,"raft.run_cpu_time_us":12070,"raft.run_wall_time_us":85192,"replication_time_us":799488,"thread_start_us":408023,"threads_started":4,"wal-append.queue_time_us":310866,"wal-append.run_cpu_time_us":34989,"wal-append.run_wall_time_us":1368977}]]}
I20260709 12:21:29.566823 27189 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.522558 26728 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:29.594153 26728 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:29.596282 27280 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:29.598691 24555 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:29.309119 26754 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.547850 27177 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:29.600979 27054 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:29.607410 26904 consensus_meta.cc:287] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.001s
I20260709 12:21:29.568339 27209 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:29.547884 27288 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.586382 27217 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:29.587229 27205 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:29.599488 26485 consensus_queue.cc:1243] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 22996f888daf435398b693481171c18c log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:29.625334 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:29.532373 27184 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.628075 24004 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:29.602332 27267 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:29.612645 27177 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.646623 27177 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.648983 27198 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.612409 27175 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:29.643661 27224 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.627424 27209 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:29.650242 27186 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:29.651113 27133 consensus_meta.cc:287] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
W20260709 12:21:29.633755 27048 consensus_meta.cc:287] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 12:21:29.629379 27208 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.626266 26754 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.642611 27189 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:29.621958 26904 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.663596 27198 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:29.626222 27054 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:29.672111 24557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36558 (request call id 631) took 1015 ms. Trace:
I20260709 12:21:29.627858 26893 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:29.625854 27205 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:29.708070 24004 raft_consensus.cc:1240] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:29.691555 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 398175us
I20260709 12:21:29.708205 24557 rpcz_store.cc:276] 0709 12:21:28.657107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.657240 (+   133us) service_pool.cc:224] Handling call
0709 12:21:29.669608 (+1012368us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54005f14d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:29.672016 (+  2408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241184128}
I20260709 12:21:29.671304 27273 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:29.684827 27133 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:29.684795 27263 consensus_meta.cc:287] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.006s
I20260709 12:21:29.715545 27205 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.845772 27209 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.848606 26537 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.692842 27048 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.635808 27251 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.851312 24004 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:29.852135 26904 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:29.858552 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.863171 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 379793us
W20260709 12:21:29.803406 27296 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:21:29.830561 27198 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.832604 26895 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:29.802091 27249 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 12:21:29.892379 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.898427 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 879333us
W20260709 12:21:29.872292 24003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.024s	sys 0.028s
W20260709 12:21:29.910454 24003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.024s	sys 0.028s
I20260709 12:21:29.910876 23817 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:29.891785 27251 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:29.907281 23892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.022s	sys 0.029s
I20260709 12:21:29.914172 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:29.916277 23892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.022s	sys 0.029s
W20260709 12:21:29.916638 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 611436us
I20260709 12:21:29.920305 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:29.917989 23892 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:29.931203 23817 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:29.943043 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.927757 27133 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:21:29.926329 27193 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:29.928557 27229 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:29.946475 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:29.948375 23893 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:29.933514 27280 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:29.890746 27263 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.891556 27054 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.908053 27198 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.923117 26895 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.944425 27089 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:29.979995 27224 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:29.980737 27224 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:29.980986 27185 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.003s
I20260709 12:21:29.981177 27224 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:29.981654 27224 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.983290 27048 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:29.984253 26728 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:29.985275 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.986281 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.987579 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.988724 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.976394 23921 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:29.986390 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.990183 27273 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:29.990943 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.991269 27193 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:29.991706 23925 raft_consensus.cc:2393] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:29.992475 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.992975 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.993570 23924 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:29.994168 27306 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:29.995416 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:29.995728 27278 consensus_meta.cc:287] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.002s	user 0.002s	sys 0.008s
I20260709 12:21:29.996235 23928 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:29.996140 27278 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:29.997098 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.998199 23929 raft_consensus.cc:2368] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9.
I20260709 12:21:29.990949 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:29.998966 23923 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:29.999029 26904 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:29.999334 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:30.000088 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:30.000711 23923 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:30.001432 23921 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:29.995496 26895 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:29.946463 27223 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.002s
I20260709 12:21:29.954468 27184 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:29.951941 27280 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.950784 27229 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.989823 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:30.001832 23923 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:21:29.933127 27267 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 12:21:29.957619 23854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.014s	sys 0.009s
I20260709 12:21:30.003530 23893 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:30.012992 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:29.993022 23925 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
W20260709 12:21:30.016897 23854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.017s	sys 0.015s
I20260709 12:21:30.018458 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1854) took 1028 ms. Trace:
I20260709 12:21:30.019644 23893 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:29.945659 26485 consensus_queue.cc:1059] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:21:30.034191 26893 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:29.981446 27185 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.020573 23893 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:30.029692 27263 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:30.004380 27131 consensus_meta.cc:287] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.006s
I20260709 12:21:30.018915 23854 rpcz_store.cc:276] 0709 12:21:28.988946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.063673 (+ 74727us) service_pool.cc:224] Handling call
0709 12:21:29.065799 (+  2126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:29.066021 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:29.440780 (+374759us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b18003e57e0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435c455 00007fa28ae443c7 00007fa2874569a7 00007fa2874660bf
0709 12:21:29.440966 (+   186us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.017497 (+576531us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:30.017551 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:30.017601 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.017664 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.017795 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81989,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":8170,"raft.queue_time_us":95,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":52259072,"thread_start_us":760433,"threads_started":2}
I20260709 12:21:30.007418 27280 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:30.002842 26537 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:30.007761 27229 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:30.049475 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:30.003677 27133 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:21:30.051697 23926 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:30.037550 26893 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.004560 27288 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:30.003845 27048 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 12:21:30.051896 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 495458us
I20260709 12:21:30.034472 27312 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:30.052363 27301 log.cc:927] Time spent T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
I20260709 12:21:30.039140 27184 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:30.044678 26868 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:30.077905 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:30.070242 23818 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:30.006193 27223 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.075340 26893 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:30.076493 24525 leader_election.cc:336] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.838s (SENT)
I20260709 12:21:30.085484 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:30.041375 27177 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:30.126031 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49577.1us
W20260709 12:21:30.127997 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 57826.6us
I20260709 12:21:30.045281 27306 consensus_queue.cc:1059] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:21:30.129611 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 185970us
I20260709 12:21:30.130406 23818 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:30.134159 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1907) took 1091 ms. Trace:
I20260709 12:21:30.134783 27316 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:30.139350 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1908) took 1086 ms. Trace:
I20260709 12:21:30.139775 24001 rpcz_store.cc:276] 0709 12:21:29.053450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.122035 (+ 68585us) service_pool.cc:224] Handling call
0709 12:21:29.122317 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:29.312317 (+190000us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:29.707442 (+395125us) log.cc:844] Serialized 14 byte log entry
0709 12:21:29.951290 (+243848us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:29.951344 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:29.951394 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.139096 (+187702us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540034b554. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:30.139152 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.139286 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2796,"prepare.queue_time_us":295253,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":3704,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":20560,"spinlock_wait_cycles":436220160,"thread_start_us":598280,"threads_started":2}
I20260709 12:21:30.142158 27175 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:30.142802 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:30.143580 24004 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:30.143953 24559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 648) took 1437 ms. Trace:
I20260709 12:21:30.144014 27175 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:30.144431 24559 rpcz_store.cc:276] 0709 12:21:28.706733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.708106 (+  1373us) service_pool.cc:224] Handling call
0709 12:21:28.708465 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:29.019988 (+311523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:29.020020 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:29.030967 (+ 10947us) log.cc:844] Serialized 26 byte log entry
0709 12:21:29.527682 (+496715us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:29.527742 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.527840 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:30.143717 (+615877us) raft_consensus.cc:1685] finished
0709 12:21:30.143739 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.143898 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4244,"raft.queue_time_us":32199,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"thread_start_us":714741,"threads_started":2,"wal-append.queue_time_us":600785}
I20260709 12:21:30.146796 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:30.147507 24003 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:30.148434 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:30.142889 27274 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:30.149295 27274 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:30.150180 27274 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.151499 24001 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:30.155015 27277 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:30.156243 23997 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.004s	sys 0.035s
W20260709 12:21:30.156585 23997 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.004s	sys 0.035s
I20260709 12:21:30.158232 23927 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:30.160269 27177 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:30.162127 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 746) took 1057 ms. Trace:
I20260709 12:21:30.162606 27223 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:30.162921 24561 rpcz_store.cc:276] 0709 12:21:29.105046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.105209 (+   163us) service_pool.cc:224] Handling call
0709 12:21:29.669797 (+564588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:29.670125 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:29.670171 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:29.670238 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:29.670298 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.670379 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.161835 (+491456us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54005f14d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:30.162038 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294467840}
I20260709 12:21:30.077903 27184 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.166219 27184 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:30.166577 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 651) took 1401 ms. Trace:
I20260709 12:21:30.166958 24556 rpcz_store.cc:276] 0709 12:21:28.764939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.765154 (+   215us) service_pool.cc:224] Handling call
0709 12:21:28.765437 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:29.291198 (+525761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.166319 (+875121us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b5400498c54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:30.166514 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1047735552}
I20260709 12:21:30.090674 26868 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.171605 26868 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:30.171799 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1897) took 1761 ms. Trace:
I20260709 12:21:30.079063 27278 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:30.176009 24563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 630) took 1520 ms. Trace:
I20260709 12:21:30.176468 24563 rpcz_store.cc:276] 0709 12:21:28.655833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.656764 (+   931us) service_pool.cc:224] Handling call
0709 12:21:28.683013 (+ 26249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.793300 (+110287us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:29.137966 (+344666us) log.cc:844] Serialized 14 byte log entry
0709 12:21:29.489833 (+351867us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:29.489932 (+    99us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:29.491137 (+  1205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.848100 (+356963us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b18002cd640. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28432d2a6 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1
0709 12:21:29.850001 (+  1901us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b18002cd640. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:30.173249 (+323248us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b18002cd640. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28432d2a6 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28432d2a6 00007fa28432d240
0709 12:21:30.174948 (+  1699us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18002cd640. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28432d2a6 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419
0709 12:21:30.175753 (+   805us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54004f15d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:30.175796 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.175942 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":634497,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":7483,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4914,"spinlock_wait_cycles":347134848,"thread_start_us":575562,"threads_started":2,"wal-append.queue_time_us":504264}
I20260709 12:21:30.134604 23998 rpcz_store.cc:276] 0709 12:21:29.043239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.058987 (+ 15748us) service_pool.cc:224] Handling call
0709 12:21:29.061389 (+  2402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:29.061580 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:29.528207 (+466627us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.126414 (+598207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:30.126471 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:30.126558 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.133939 (+  7381us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.134097 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":545365,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":20427,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":10870,"thread_start_us":1038303,"threads_started":3,"wal-append.queue_time_us":508989}
I20260709 12:21:30.162186 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1898) took 1698 ms. Trace:
I20260709 12:21:30.194202 23997 rpcz_store.cc:276] 0709 12:21:28.463635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.994015 (+530380us) service_pool.cc:224] Handling call
0709 12:21:28.994355 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:28.994687 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:28.994714 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:28.995175 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 12:21:29.352884 (+357709us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:30.156925 (+804041us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.161863 (+  4938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.161960 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:30.162005 (+    45us) raft_consensus.cc:1685] finished
0709 12:21:30.162018 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.162130 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18692,"prepare.queue_time_us":254605,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":3197,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":9287,"spinlock_wait_cycles":645376,"thread_start_us":1016028,"threads_started":2,"wal-append.queue_time_us":612089}
I20260709 12:21:30.004417 27217 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.172222 23995 rpcz_store.cc:276] 0709 12:21:28.410322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.991018 (+580696us) service_pool.cc:224] Handling call
0709 12:21:28.991360 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:28.991771 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:28.991802 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:28.992319 (+   517us) log.cc:844] Serialized 52 byte log entry
0709 12:21:29.128743 (+136424us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:29.619628 (+490885us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.170956 (+551328us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b18003e5780. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa284361a40 00007fa28435c4e4 00007fa28435c455 00007fa28ae443c7 00007fa2874569a7 00007fa2874660bf 00007fa287466038
0709 12:21:30.171191 (+   235us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.171409 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.171482 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:30.171591 (+   109us) raft_consensus.cc:1685] finished
0709 12:21:30.171606 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.171741 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19748,"prepare.queue_time_us":478591,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":7158,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":13291,"spinlock_wait_cycles":2444160,"thread_start_us":540507,"threads_started":2,"wal-append.queue_time_us":609392}
I20260709 12:21:30.069283 27263 consensus_queue.cc:1059] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:21:30.231475 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:30.242142 23998 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:30.158437 27314 log.cc:927] Time spent T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:21:30.130491 27198 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:30.238185 24001 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:30.121850 26728 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:30.090132 27312 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:30.240490 23854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:21:30.328361 23854 raft_consensus.cc:606] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:30.328781 23854 raft_consensus.cc:614] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:30.306137 24003 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:30.075255 27313 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.156s
I20260709 12:21:30.174655 27288 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:30.333729 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 154783us
I20260709 12:21:30.235837 24004 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:30.319756 23998 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
W20260709 12:21:30.319970 27317 log.cc:927] Time spent T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:21:30.320746 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1905) took 1284 ms. Trace:
I20260709 12:21:30.357056 23999 rpcz_store.cc:276] 0709 12:21:29.036840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.052306 (+ 15466us) service_pool.cc:224] Handling call
0709 12:21:29.052638 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:29.052897 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:29.558802 (+505905us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.320190 (+761388us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.320363 (+   173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:30.320436 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:30.320495 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.320570 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.320689 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":388471,"prepare.queue_time_us":922878,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":42790,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":141,"thread_start_us":862588,"threads_started":2,"wal-append.queue_time_us":506970}
I20260709 12:21:30.324946 23996 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:21:30.359364 23996 pending_rounds.cc:85] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 3
I20260709 12:21:30.359630 23996 pending_rounds.cc:107] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:21:30.359859 23996 raft_consensus.cc:2889] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:30.318209 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1911) took 1241 ms. Trace:
I20260709 12:21:30.126175 27222 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:30.333629 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 158488us
I20260709 12:21:30.367308 24003 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:21:30.360718 24002 rpcz_store.cc:276] 0709 12:21:29.076393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.215297 (+138904us) service_pool.cc:224] Handling call
0709 12:21:29.247390 (+ 32093us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:29.290777 (+ 43387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:29.290810 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:29.340137 (+ 49327us) log.cc:844] Serialized 52 byte log entry
0709 12:21:29.675237 (+335100us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:30.317282 (+642045us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.317678 (+   396us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.317845 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.317939 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:30.317983 (+    44us) raft_consensus.cc:1685] finished
0709 12:21:30.317995 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.318146 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":515200,"prepare.queue_time_us":642241,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":26132,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":28696,"thread_start_us":249790,"threads_started":1,"wal-append.queue_time_us":525847}
I20260709 12:21:30.366358 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:30.375772 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:30.351352 27288 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:30.372530 27222 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.386461 27288 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:30.386299 27312 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:30.333635 27296 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:21:30.388293 26728 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:30.388602 27185 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:30.389191 27213 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:30.390188 27055 raft_consensus.cc:3055] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:30.390600 27055 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:30.395372 26868 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.398334 26988 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:21:30.398847 27320 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:21:30.398901 26988 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:30.399745 26728 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:30.400195 26728 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.400034 26988 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.400595 26728 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:30.401232 26988 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:30.402077 27177 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:30.402940 27177 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:30.403256 27177 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:30.403978 27177 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.405089 27177 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:30.407006 27217 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:30.407989 27321 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:30.409365 26728 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.410004 27273 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:30.411031 23921 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:21:30.411707 27155 consensus_meta.cc:287] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.890s	user 0.007s	sys 0.004s
W20260709 12:21:30.412398 26754 consensus_meta.cc:287] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.719s	user 0.006s	sys 0.001s
I20260709 12:21:30.413306 23845 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:30.413718 27264 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:30.414698 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2143) took 1166 ms. Trace:
I20260709 12:21:30.414803 26728 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:30.415104 23845 rpcz_store.cc:276] 0709 12:21:29.248040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.248357 (+   317us) service_pool.cc:224] Handling call
0709 12:21:30.414530 (+1166173us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400071f54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:30.414639 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2570995072}
W20260709 12:21:30.417389 27243 consensus_meta.cc:287] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.936s	user 0.009s	sys 0.000s
I20260709 12:21:30.417256 23749 catalog_manager.cc:5697] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:30.419377 23749 catalog_manager.cc:5697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 4 to 5, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 5 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:30.421360 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:30.319970 27205 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.422520 23999 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:30.422396 23749 catalog_manager.cc:5697] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.412781 27224 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.430562 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:30.433279 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 45230.5us
W20260709 12:21:30.434681 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.434540 23893 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:30.430213 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:30.438632 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.440860 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.441716 23854 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:30.441795 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:30.444039 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.444307 23854 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:30.436817 23999 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:30.450199 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:30.451366 23818 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:30.453609 23999 raft_consensus.cc:2393] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:30.455055 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:30.451413 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 117807us
I20260709 12:21:30.457789 23749 catalog_manager.cc:5697] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 3, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 3 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:30.460012 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:30.462693 24525 leader_election.cc:336] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.225s (SENT)
I20260709 12:21:30.465628 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:30.466766 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.473284 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:30.423530 27205 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:30.471477 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.475801 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.446610 27155 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.450080 26754 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:30.570914 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:30.480050 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 45576.9us
W20260709 12:21:30.484479 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.535702 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.454766 27186 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:30.577590 23893 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:30.583892 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.545918 23854 raft_consensus.cc:1240] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:30.589447 23999 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:30.541307 23749 catalog_manager.cc:5697] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 4 to 5, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 5 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.463511 27054 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:30.640720 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.535274 26988 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:30.642567 23749 catalog_manager.cc:5697] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 3, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 3 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:30.631384 27251 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.446825 27243 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.650498 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:30.679730 24000 raft_consensus.cc:2410] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:30.679847 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1843) took 1778 ms. Trace:
I20260709 12:21:30.680260 23850 rpcz_store.cc:276] 0709 12:21:28.901805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.904597 (+  2792us) service_pool.cc:224] Handling call
0709 12:21:28.905022 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:29.214054 (+309032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.679571 (+1465517us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400402c54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:30.679786 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703207296}
I20260709 12:21:30.687940 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:30.537065 27324 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:21:30.593012 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:30.586862 27213 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.695977 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.653374 27054 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.695539 27251 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.702411 27054 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:30.704326 23920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 360) took 1702 ms (client timeout 1669 ms). Trace:
W20260709 12:21:30.704794 23920 rpcz_store.cc:269] 0709 12:21:29.002268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.002408 (+   140us) service_pool.cc:224] Handling call
0709 12:21:30.704095 (+1701687us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b5400278dd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:30.704247 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9692544}
I20260709 12:21:30.585494 27198 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:30.710291 27198 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.713213 27198 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:30.645795 27280 consensus_meta.cc:287] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.001s
W20260709 12:21:30.698002 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 120495us
I20260709 12:21:30.701650 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:30.715073 23893 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:30.716171 23893 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:30.715862 23749 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 3 to 7, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 7 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.698429 27269 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:30.715107 24000 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:30.720280 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.720963 23852 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:30.722591 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:30.722977 23966 connection.cc:256] RPC call timeout handler was delayed by -1.3226436740001191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
I20260709 12:21:30.567904 27217 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:30.583302 26913 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:30.699904 27243 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:30.581970 27155 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.723323 23852 raft_consensus.cc:2393] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:30.726764 23966 connection.cc:256] RPC call timeout handler was delayed by -1.2713436740000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 12:21:30.739307 23966 connection.cc:256] RPC call timeout handler was delayed by -1.1246436740000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
W20260709 12:21:30.739746 23966 connection.cc:256] RPC call timeout handler was delayed by -1.1057436739999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 12:21:30.699393 26988 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:30.735726 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.592841 27323 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:30.747517 23851 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:30.637892 27222 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:30.749519 23850 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:30.750804 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:21:30.751407 23920 raft_consensus.cc:606] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
W20260709 12:21:30.752803 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 111911us
W20260709 12:21:30.793740 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 52600.7us
I20260709 12:21:30.794837 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:30.795977 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:30.798791 23749 catalog_manager.cc:5697] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 5, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 5 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:30.802335 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:30.803610 24525 leader_election.cc:336] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.566s (SENT)
I20260709 12:21:30.804142 24525 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:30.805233 27264 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:21:30.807255 27229 consensus_meta.cc:287] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.000s
I20260709 12:21:30.807709 27229 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.811508 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:30.812314 23854 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:30.813052 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.587219 26754 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.818228 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:30.818718 23998 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:30.816041 24002 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:30.816015 23854 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
W20260709 12:21:30.820045 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.820384 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:30.741776 27133 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:30.747949 27277 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:30.826583 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:30.747766 27269 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:30.734547 27280 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.857678 23846 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:30.820508 27307 raft_consensus.cc:2764] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:30.740670 27213 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.852737 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:30.737413 27217 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.821171 27229 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:30.741012 26913 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.822685 27264 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.831825 27198 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:30.866247 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:30.872169 27184 consensus_meta.cc:287] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.705s	user 0.008s	sys 0.004s
I20260709 12:21:30.815621 27323 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.873157 27133 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:30.940850 27217 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:30.940507 27133 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.874543 27290 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.941859 27290 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.944459 27290 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:30.875444 27269 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.881081 24002 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:30.822362 27131 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:21:30.884506 27213 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:30.886732 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60686 (request call id 82) took 1606 ms. Trace:
I20260709 12:21:30.950320 23848 rpcz_store.cc:276] 0709 12:21:29.280655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.358224 (+ 77569us) service_pool.cc:224] Handling call
0709 12:21:30.886426 (+1528202us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400073354. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa287452735 00007fa28744a9fa 00007fa28c4124c9 00007fa28598ec54 00007fa28598ebe2 00007fa28598eb11 00007fa28598ea8c 00007fa28598dd42 00007fa28578748c 00007fa2857868c6
0709 12:21:30.886627 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2678845184}
I20260709 12:21:30.951862 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:30.953246 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.957278 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:30.958740 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:30.959996 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:30.960654 23995 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:30.962790 26754 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:30.954716 27184 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.967233 27323 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:30.954370 27251 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:30.968701 27280 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:30.921456 26988 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.971158 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:30.972028 23852 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:30.972787 27307 consensus_queue.cc:1059] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:30.973306 23852 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:30.973757 27307 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:30.974164 27307 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:30.975026 27307 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.975659 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1914) took 1755 ms. Trace:
I20260709 12:21:30.976409 27307 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:30.976073 23996 rpcz_store.cc:276] 0709 12:21:29.220232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.269381 (+ 49149us) service_pool.cc:224] Handling call
0709 12:21:29.269708 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:30.360297 (+1090589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.975399 (+615102us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001c75d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:30.975580 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2425799040}
I20260709 12:21:30.978845 23997 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:30.936990 27264 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:30.866509 27277 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:30.892418 27288 consensus_meta.cc:287] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.001s
W20260709 12:21:30.894805 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.931802 27198 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:30.991685 27198 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:30.997135 27341 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:21:30.998508 27333 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:21:30.950369 27337 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:21:31.000300 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:31.000398 27277 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.898082 27155 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:30.991287 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.870054 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:21:30.920830 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 97626.6us
W20260709 12:21:31.014669 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.929364 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:30.892426 27055 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:30.977406 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:30.961615 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.026244 23995 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
W20260709 12:21:30.985365 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 189440us
I20260709 12:21:30.967284 26913 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:30.983207 27224 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:30.988873 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.016563 23854 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:31.026976 23996 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:30.984519 23852 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:31.027783 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:30.912503 23998 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:31.038410 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:31.039404 23998 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:31.039328 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.040686 23996 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:31.043183 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.045064 23996 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:31.042985 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:31.048416 23996 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:21:31.048890 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.051863 24000 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:31.053273 23996 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:31.055295 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.056241 23995 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:31.052192 23820 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:31.060025 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.061491 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:31.062680 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:31.035390 27184 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:31.063971 23998 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:31.072849 24524 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:31.080304 24001 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:31.047600 27264 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:31.084146 23995 raft_consensus.cc:1240] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:31.059502 23820 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:31.089329 24525 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:31.024593 27288 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:31.059857 27055 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:31.094538 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:31.095625 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:31.071712 27177 consensus_meta.cc:287] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.666s	user 0.004s	sys 0.008s
I20260709 12:21:31.100044 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:31.125165 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.126094 23920 raft_consensus.cc:2410] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:31.126892 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.127497 24002 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:31.128962 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.130024 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.131266 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:31.131702 23920 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:31.131824 23853 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:31.132356 24001 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:31.063243 27350 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:31.134270 23929 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:31.134804 23922 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:21:31.147243 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:31.125157 23818 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:31.135749 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.136765 23921 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:31.137511 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.138720 23998 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:31.142020 23996 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:31.145774 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:31.083029 27230 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:31.083128 27342 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:31.160457 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.171291 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:31.156348 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:31.150535 23852 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:21:31.151981 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.152290 23922 pending_rounds.cc:85] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 5
I20260709 12:21:31.175760 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:31.176017 23922 pending_rounds.cc:107] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:21:31.176474 23852 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:31.176424 23922 raft_consensus.cc:2889] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:31.177316 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:31.154767 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.165316 23846 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:31.165510 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.165984 23818 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:31.166117 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.153119 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.155263 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.178350 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:31.163553 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:31.166700 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:31.180150 24002 raft_consensus.cc:2376] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7. Re-sending same reply.
I20260709 12:21:31.180984 23852 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:31.194433 23996 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:31.180933 24001 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:31.190336 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.117714 27224 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:31.192179 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.202899 23921 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:31.193463 23923 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:31.204421 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.205183 23923 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:31.193557 23966 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:31.194027 23927 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:31.122020 27209 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:31.191576 23818 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:31.190073 26728 consensus_queue.cc:1059] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:21:31.198868 23925 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:21:31.209142 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 45725.8us
I20260709 12:21:31.208355 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.210602 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.212244 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:31.213441 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:31.132949 27264 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:31.090209 27155 consensus_queue.cc:1059] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:21:31.214191 24558 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:31.214191 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:31.215425 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:31.217613 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:31.219298 23736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8630b76482c543a2a08e289b32b13ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 22996f888daf435398b693481171c18c (127.22.43.65:34895) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:21:31.221263 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:31.223423 23817 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:31.218366 23927 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:31.227017 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.227690 23925 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:31.228523 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.229743 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.230830 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.231805 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.232719 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.233157 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:31.170081 27342 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:31.233680 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:31.234190 27342 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:31.234862 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.235898 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.237100 23925 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:31.238049 26754 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:31.238909 23925 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:31.239096 26754 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:31.239363 23925 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:31.239552 26754 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:31.240170 23925 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:31.240332 26754 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:31.241271 23925 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:31.241430 26754 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:31.243825 27288 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:31.245369 27336 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.373s	user 0.000s	sys 0.002s
I20260709 12:21:31.245954 27350 raft_consensus.cc:2764] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:21:31.149089 27347 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:31.233810 24563 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:31.246790 27347 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:31.238974 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:31.248505 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 57001.4us
I20260709 12:21:31.248564 23995 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:31.198957 27205 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:31.159503 27230 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:31.200018 27189 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:31.199720 27338 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:31.256076 23853 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:21:31.259716 23927 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:31.260634 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:31.203013 27054 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.004s
W20260709 12:21:31.262185 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 189468us
I20260709 12:21:31.263640 23892 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:31.268452 24563 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
W20260709 12:21:31.269248 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.272842 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:31.295971 23966 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:31.301483 24558 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:31.300575 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:31.302767 24524 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:31.169090 27312 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:21:31.226013 27243 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:31.162789 27322 consensus_queue.cc:1059] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:21:31.258222 27175 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:31.330036 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:31.336284 24556 raft_consensus.cc:2410] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:31.307531 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:31.317050 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:31.318902 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 55395.5us
W20260709 12:21:31.326725 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 76640.1us
I20260709 12:21:31.332540 23848 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:31.297757 27230 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:31.292024 27223 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:31.328382 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.268270 27251 consensus_queue.cc:1059] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.079s
W20260709 12:21:31.384871 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 295600us
W20260709 12:21:31.509944 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 171810us
W20260709 12:21:31.653365 27345 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 12:21:31.391278 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.298568 27264 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:31.337957 23853 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:31.425355 23925 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:31.369027 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:31.657084 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 319614us
I20260709 12:21:31.368597 24558 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:31.682322 24563 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:31.389766 27186 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.294s
W20260709 12:21:31.678829 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:31.350654 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 127318us
I20260709 12:21:31.398959 24561 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:31.597579 27048 raft_consensus.cc:3055] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:31.685075 27048 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:31.393831 23851 raft_consensus.cc:2393] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:31.662317 24525 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.873s (SENT) [suppressed 48 similar messages]
I20260709 12:21:31.685962 27048 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:31.686424 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:31.319813 27217 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.379s
I20260709 12:21:31.675482 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.689185 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:31.690197 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.679201 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:31.690606 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:31.692894 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:31.693259 23996 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:21:31.693620 23996 pending_rounds.cc:85] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 8
I20260709 12:21:31.693863 23996 pending_rounds.cc:107] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:21:31.694130 23996 raft_consensus.cc:2889] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:31.695034 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:31.687263 27048 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:31.697453 23817 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:31.701133 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.701956 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:31.701150 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.704860 23925 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:31.699378 24563 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:31.705806 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:31.662600 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:31.700920 23995 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:31.322620 27350 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:31.697417 23996 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:31.711294 23928 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:31.303836 27351 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:31.708775 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:31.597942 27243 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.590095 27359 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.595549 27155 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.595220 27189 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.328871 27277 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:31.601965 27275 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:31.718739 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 56255.4us
I20260709 12:21:31.462568 27344 raft_consensus.cc:3055] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:31.736120 23996 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:31.736112 23925 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:31.710858 27089 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:21:31.681399 27264 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:31.711427 27350 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:31.694763 27193 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:21:31.737845 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 435113us
I20260709 12:21:31.737656 27343 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:31.425482 26833 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:31.425134 27205 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:31.474702 27357 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:31.681141 27280 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:21:31.317247 27054 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:31.764631 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:31.671202 27209 consensus_queue.cc:1059] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:21:31.737165 27344 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:31.737619 27348 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:31.763496 27360 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:21:31.715482 26955 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:21:31.716660 26988 consensus_queue.cc:1059] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:21:31.901261 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:31.887576 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 189991us
W20260709 12:21:31.888388 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.892019 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2154) took 1172 ms. Trace:
I20260709 12:21:31.899580 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2151) took 1181 ms. Trace:
I20260709 12:21:31.717643 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:31.743726 23921 consensus_meta.cc:287] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.001s
I20260709 12:21:31.722461 23927 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:31.761590 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:31.999557 27205 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:31.981570 23849 rpcz_store.cc:276] 0709 12:21:30.718483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.719821 (+  1338us) service_pool.cc:224] Handling call
0709 12:21:30.748529 (+ 28708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:30.748734 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:30.748758 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:30.798297 (+ 49539us) log.cc:844] Serialized 26 byte log entry
0709 12:21:31.095121 (+296824us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:31.095156 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.095222 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:31.652464 (+557242us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:31.898759 (+246295us) raft_consensus.cc:1685] finished
0709 12:21:31.898842 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:31.899350 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32940288,"thread_start_us":257774,"threads_started":1,"wal-append.queue_time_us":390387}
I20260709 12:21:32.010632 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:32.009660 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:31.941133 27209 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:31.942708 26728 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:32.013386 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:31.736783 27155 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.024179 27278 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.025295 27278 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.026521 27375 consensus_queue.cc:1059] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:32.028646 27278 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:32.028882 27375 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:31.739615 27189 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:31.733141 27243 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:31.753963 27264 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:31.733135 27290 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:21:32.056378 27290 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:32.056592 27243 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:32.056921 27290 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:31.750561 27312 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:21:31.792834 27348 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:32.077747 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 327762us
I20260709 12:21:32.078472 27348 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:31.766376 27350 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:31.848848 27360 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:31.737999 27359 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:32.081583 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 316854us
I20260709 12:21:31.806438 27365 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:32.083433 27365 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:32.085103 27359 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:31.800844 27224 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:32.086431 27224 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:32.086587 23996 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:31.804440 27274 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:31.855564 27307 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.879s	user 0.013s	sys 0.002s
I20260709 12:21:31.827689 27323 raft_consensus.cc:3055] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:32.091957 27323 raft_consensus.cc:740] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:31.849462 27339 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.959s	user 0.004s	sys 0.001s
W20260709 12:21:32.081697 23997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 1934) took 1325 ms (client timeout 1577 ms). Trace:
W20260709 12:21:31.807824 27342 consensus_meta.cc:287] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.004s
W20260709 12:21:32.095204 23997 rpcz_store.cc:269] 0709 12:21:30.744477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.826273 (+ 81796us) service_pool.cc:224] Handling call
0709 12:21:32.049577 (+1223304us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540040ddd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:32.070288 (+ 20711us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337163520}
I20260709 12:21:32.096355 27342 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:31.842106 27344 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:31.783793 27347 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:31.836469 27353 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.577s	user 0.001s	sys 0.000s
I20260709 12:21:32.110231 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:31.838076 27354 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.500s	user 0.002s	sys 0.000s
I20260709 12:21:32.085489 27365 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.112180 27203 raft_consensus.cc:3055] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:32.112855 27203 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:31.783257 27357 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:31.884639 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 180686us
W20260709 12:21:31.978575 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 243547us
I20260709 12:21:31.996668 27343 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:31.997565 27351 raft_consensus.cc:697] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:31.998057 27352 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:32.011368 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2162) took 1285 ms. Trace:
I20260709 12:21:32.136178 27352 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.136668 23851 rpcz_store.cc:276] 0709 12:21:30.725358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.238736 (+513378us) service_pool.cc:224] Handling call
0709 12:21:32.010740 (+772004us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001e50d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:32.011104 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331675904}
I20260709 12:21:32.138728 23851 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:32.138896 27352 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:32.140813 23851 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:31.732939 27133 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:21:32.016211 27209 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:32.143980 26913 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:32.017002 26728 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:31.930847 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 268439us
I20260709 12:21:31.985415 26955 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:31.702934 27186 consensus_queue.cc:1059] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:21:32.030014 23921 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:32.162923 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1897) took 1025 ms. Trace:
I20260709 12:21:32.163337 23921 rpcz_store.cc:276] 0709 12:21:31.137655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.191934 (+ 54279us) service_pool.cc:224] Handling call
0709 12:21:32.162802 (+970868us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.164108 27189 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:32.164470 27055 consensus_meta.cc:287] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.043s	user 0.012s	sys 0.008s
I20260709 12:21:32.031985 26868 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:32.036576 23928 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:32.039467 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:32.035166 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:32.046073 23850 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:32.167129 24525 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:32.048439 27054 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:32.049260 23849 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:32.081905 27360 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:31.809221 27362 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 12:21:32.091236 23925 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:32.122375 27203 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.122959 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:32.123327 23923 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:32.128250 27343 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.128295 27351 consensus_queue.cc:237] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.131373 27290 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.135243 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1805) took 1705 ms. Trace:
I20260709 12:21:31.981504 23847 rpcz_store.cc:276] 0709 12:21:30.719437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.719589 (+   152us) service_pool.cc:224] Handling call
0709 12:21:31.119732 (+400143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:31.119939 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:31.321480 (+201541us) log.cc:844] Serialized 14 byte log entry
0709 12:21:31.666518 (+345038us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:31.666578 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:31.666627 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.666696 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:31.891445 (+224749us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400428bd0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:31.891769 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217268,"prepare.queue_time_us":279076,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":279190,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":857064192,"thread_start_us":212974,"threads_started":2,"wal-append.queue_time_us":460829}
I20260709 12:21:32.035789 27287 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
W20260709 12:21:32.161065 27198 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.169s	user 0.011s	sys 0.010s
I20260709 12:21:32.237605 27198 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.161615 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1933) took 1409 ms. Trace:
W20260709 12:21:32.167284 23850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2161) took 1442 ms (client timeout 1865 ms). Trace:
I20260709 12:21:32.046465 27085 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:32.093531 27323 consensus_queue.cc:260] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.126127 27342 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:32.178797 27360 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:32.200826 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.200666 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1871) took 1020 ms. Trace:
I20260709 12:21:32.202548 23920 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:21:32.180161 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:32.153651 26955 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:32.182462 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1877) took 1011 ms. Trace:
I20260709 12:21:32.208339 23892 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:32.218278 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 52382.6us
I20260709 12:21:32.263334 23849 rpcz_store.cc:276] 0709 12:21:31.160283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.014938 (+854655us) service_pool.cc:224] Handling call
0709 12:21:32.048797 (+ 33859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:32.171522 (+122725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.171808 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.219817 26537 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:32.258302 23920 pending_rounds.cc:85] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 4
W20260709 12:21:32.233433 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 240042us
W20260709 12:21:32.241698 23850 rpcz_store.cc:269] 0709 12:21:30.725125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.900374 (+1175249us) service_pool.cc:224] Handling call
0709 12:21:32.167206 (+266832us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:32.267688 27368 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:21:32.267555 27312 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:32.268419 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1876) took 1095 ms. Trace:
I20260709 12:21:32.275674 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:32.232367 24003 rpcz_store.cc:276] 0709 12:21:30.429356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.429545 (+   189us) service_pool.cc:224] Handling call
0709 12:21:30.430564 (+  1019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:30.430953 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:30.430979 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:30.431443 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:21:30.820929 (+389486us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:30.820964 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.821021 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:31.813660 (+992639us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:32.106752 (+293092us) raft_consensus.cc:1685] finished
0709 12:21:32.115225 (+  8473us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.134973 (+ 19748us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4686,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":7989,"spinlock_wait_cycles":30243200,"thread_start_us":298174,"threads_started":1,"wal-append.queue_time_us":424131}
I20260709 12:21:32.243374 27198 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:32.266129 23920 pending_rounds.cc:107] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:21:32.288805 23920 raft_consensus.cc:2889] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:32.277642 26955 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.279167 27280 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.279474 27322 raft_consensus.cc:3055] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:32.280318 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 113427us
W20260709 12:21:32.281136 27230 consensus_meta.cc:287] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.599s	user 0.013s	sys 0.003s
I20260709 12:21:32.282011 27347 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.281172 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:32.288877 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.278244 23895 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:32.293509 27230 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.295253 23849 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:32.296481 27230 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:32.296984 23849 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:32.293530 27322 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:32.298565 27290 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:32.299302 27322 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.300657 27322 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.300896 27055 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.302634 23895 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:32.298621 23851 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:32.300588 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 92466.3us
I20260709 12:21:32.292126 23996 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:32.306553 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:32.271718 27287 consensus_queue.cc:1243] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:21:32.256980 23846 rpcz_store.cc:276] 0709 12:21:31.134835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.370728 (+235893us) service_pool.cc:224] Handling call
0709 12:21:31.661262 (+290534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:31.661476 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:31.696416 (+ 34940us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.053992 (+357576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:32.072398 (+ 18406us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:32.114170 (+ 41772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.125489 (+ 11319us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.155347 (+ 29858us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":248149,"prepare.queue_time_us":41623,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":44624,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":13604,"thread_start_us":288462,"threads_started":1,"wal-append.queue_time_us":350395}
W20260709 12:21:32.316308 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 193560us
I20260709 12:21:32.317617 27186 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:32.288324 27359 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:32.318310 23999 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:32.240520 24000 rpcz_store.cc:276] 0709 12:21:30.743911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.058971 (+315060us) service_pool.cc:224] Handling call
0709 12:21:31.059358 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:31.067498 (+  8140us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:31.096844 (+ 29346us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.139299 (+1042455us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b180033ece0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a
0709 12:21:32.139752 (+   453us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:32.140745 (+   993us) log.cc:844] Serialized 26 byte log entry
0709 12:21:32.141063 (+   318us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:32.141108 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.141226 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.146099 (+  4873us) raft_consensus.cc:1685] finished
0709 12:21:32.146213 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.153391 (+  7178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6164,"prepare.queue_time_us":29586,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":17053,"raft.queue_time_us":15033,"raft.run_cpu_time_us":480,"raft.run_wall_time_us":78941,"spinlock_wait_cycles":24252160,"thread_start_us":84594,"threads_started":1,"wal-append.queue_time_us":649486}
I20260709 12:21:32.310324 27203 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.330889 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:32.352727 27344 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.335860 27264 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.355468 27264 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:32.336169 23845 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:32.341487 27054 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:21:32.360841 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:32.339221 27375 raft_consensus.cc:3055] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:32.362210 27375 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:32.362715 27347 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:32.304699 26955 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.363631 27193 raft_consensus.cc:3055] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:32.364256 27193 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:32.363785 27375 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:32.339246 26754 consensus_meta.cc:287] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.097s	user 0.016s	sys 0.011s
I20260709 12:21:32.366061 23847 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.343050 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1829) took 1198 ms. Trace:
I20260709 12:21:32.346225 27373 raft_consensus.cc:3055] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:32.339823 27323 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.362039 27378 consensus_queue.cc:1059] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:21:32.371201 27378 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:21:32.357429 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.371750 27378 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:32.346241 27280 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.374797 27280 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:32.375200 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1888) took 1242 ms. Trace:
I20260709 12:21:32.375871 27189 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:32.376164 27217 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.373147 27378 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.376619 27189 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.376773 27217 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.377916 27378 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:32.358390 27055 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:32.352415 23998 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:21:32.359450 23845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 379) took 1904 ms (client timeout 1504 ms). Trace:
I20260709 12:21:32.350641 24002 raft_consensus.cc:1240] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:32.346468 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 59037.5us
I20260709 12:21:32.384974 27189 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:32.386718 24525 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:32.389029 26537 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:32.283303 27350 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.390427 23922 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:32.390887 27357 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:32.344878 26913 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:32.381743 27373 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:32.391672 23997 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:32.341372 27155 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:32.307674 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:32.367089 24004 rpcz_store.cc:276] 0709 12:21:31.144520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.199875 (+ 55355us) service_pool.cc:224] Handling call
0709 12:21:32.053205 (+853330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.054595 (+  1390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.054623 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:32.054714 (+    91us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:32.054794 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.054905 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.342704 (+287799us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b540040ddd0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:32.342844 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875158400}
W20260709 12:21:32.394382 23845 rpcz_store.cc:269] 0709 12:21:30.454849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.455058 (+   209us) service_pool.cc:224] Handling call
0709 12:21:32.359177 (+1904119us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54002fc6d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:32.359345 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4181204864}
I20260709 12:21:32.284530 23848 rpcz_store.cc:276] 0709 12:21:31.149018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.657995 (+508977us) service_pool.cc:224] Handling call
0709 12:21:31.658374 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:31.698300 (+ 39926us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:32.036129 (+337829us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.218097 (+181968us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:32.218936 (+   839us) log.cc:844] Serialized 26 byte log entry
0709 12:21:32.223123 (+  4187us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:32.223173 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.233964 (+ 10791us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.234022 (+    58us) raft_consensus.cc:1685] finished
0709 12:21:32.234032 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.244637 (+ 10605us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":347517,"prepare.queue_time_us":286948,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":87403,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":13527,"thread_start_us":195404,"threads_started":2,"wal-append.queue_time_us":112116}
I20260709 12:21:32.375664 23920 rpcz_store.cc:276] 0709 12:21:31.132689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.133367 (+   678us) service_pool.cc:224] Handling call
0709 12:21:31.133628 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.319104 (+1185476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.374857 (+ 55753us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540039b054. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:32.375111 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2373706624}
I20260709 12:21:32.407325 27312 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.418083 27375 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:32.422417 27269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.278s	user 0.009s	sys 0.013s
I20260709 12:21:32.386847 27264 consensus_queue.cc:1059] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:21:32.328816 27224 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.426757 26913 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.460071 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:32.461308 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 157147us
W20260709 12:21:32.449981 27269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.502s	user 0.010s	sys 0.013s
I20260709 12:21:32.465497 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:32.443693 27055 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:32.471398 23852 consensus_meta.cc:287] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.175s	user 0.011s	sys 0.013s
I20260709 12:21:32.471873 27274 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.471468 27343 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:21:32.475925 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.477496 23818 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:32.477805 23849 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:32.452791 26537 raft_consensus.cc:697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:32.416982 27230 consensus_queue.cc:1059] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 12:21:32.488559 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 48758.3us
I20260709 12:21:32.469730 23995 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:32.495971 27352 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.498710 27372 consensus_queue.cc:1059] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:21:32.498822 27352 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.501183 26537 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.501837 27373 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.503608 27373 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.506086 23852 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:32.506482 27230 raft_consensus.cc:3055] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:32.506753 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1875) took 1371 ms. Trace:
I20260709 12:21:32.506960 27230 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:32.507190 23852 rpcz_store.cc:276] 0709 12:21:31.135808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.178137 (+ 42329us) service_pool.cc:224] Handling call
0709 12:21:32.506677 (+1328540us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.508114 27230 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.509519 27230 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.513034 23995 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:32.514988 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:32.518894 27350 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:32.520300 27359 raft_consensus.cc:3055] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:32.520754 27359 raft_consensus.cc:740] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:32.496040 27217 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:32.523162 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:32.526120 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.526495 27264 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.527283 27224 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:32.450261 27312 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.529667 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:32.530128 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:32.530225 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:32.531044 23848 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.531392 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:32.531752 27312 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:32.531041 23849 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:32.533972 27357 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.467219 27347 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:32.534936 27347 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.535295 27347 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:32.538213 27359 consensus_queue.cc:260] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.539204 27193 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.540870 27193 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.539675 27359 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:32.542713 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.544044 23847 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
W20260709 12:21:32.546221 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 94111us
I20260709 12:21:32.553361 23848 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:32.487447 27209 raft_consensus.cc:3055] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:32.550704 27274 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.567975 27274 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:32.545437 27287 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.570261 27352 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:32.570677 27287 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.571354 27372 raft_consensus.cc:3055] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:32.571823 27372 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:32.572839 27372 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.574393 27372 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.574126 27347 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.577761 27347 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:32.578142 27205 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:32.578564 24558 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:32.570097 23893 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:32.559032 27209 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:32.598304 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 157629us
W20260709 12:21:32.599886 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 52751.7us
W20260709 12:21:32.616012 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 138619us
I20260709 12:21:32.594609 27224 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.592301 27352 consensus_queue.cc:1059] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:21:32.592413 27205 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:32.658334 27263 consensus_queue.cc:1059] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:32.658565 27205 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.660127 27263 raft_consensus.cc:3055] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:32.660698 27263 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:32.627148 27055 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.657383 26913 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:32.662798 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.664242 26913 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:32.628652 24524 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:32.629585 23926 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:32.666251 27352 raft_consensus.cc:3055] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:32.666706 27352 raft_consensus.cc:740] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:32.667797 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1886) took 1537 ms. Trace:
I20260709 12:21:32.667608 27352 consensus_queue.cc:260] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.668174 23926 rpcz_store.cc:276] 0709 12:21:31.130366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.130784 (+   418us) service_pool.cc:224] Handling call
0709 12:21:31.148641 (+ 17857us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:32.666111 (+1517470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.667485 (+  1374us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400106b54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:32.667712 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3293848960}
W20260709 12:21:32.599434 27048 consensus_queue.cc:1175] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" responder_term: 7 status { last_received { term: 7 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 7 index: 5 } }
I20260709 12:21:32.630761 27277 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.670316 27264 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:32.632366 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 71978.3us
I20260709 12:21:32.671986 26973 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:32.673678 27397 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:32.673223 23893 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:32.633625 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1878) took 1458 ms. Trace:
I20260709 12:21:32.635619 26955 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:32.630764 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.642607 27203 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:32.642900 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:32.644328 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:32.646699 27209 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.648979 27344 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:32.650341 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:32.651163 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:32.651367 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.654682 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:32.656507 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:32.657333 27390 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:21:32.700145 27313 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.675535 23854 rpcz_store.cc:276] 0709 12:21:31.175300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.052997 (+877697us) service_pool.cc:224] Handling call
0709 12:21:32.170174 (+117177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:32.221918 (+ 51744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.221956 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:32.222542 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:21:32.458927 (+236385us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:32.458971 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.459042 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.633397 (+174355us) raft_consensus.cc:1685] finished
0709 12:21:32.633421 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.633563 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12453,"raft.queue_time_us":4082,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":28759,"thread_start_us":235923,"threads_started":1,"wal-append.queue_time_us":333802}
I20260709 12:21:32.681929 27263 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.707336 27263 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:32.679015 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60325.2us
I20260709 12:21:32.708258 24004 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:32.709291 27344 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.683079 27287 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:32.710458 27287 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:32.711458 27054 consensus_queue.cc:1059] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:32.618477 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:32.712507 27054 raft_consensus.cc:3055] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:32.712371 27338 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:32.712996 27054 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:32.698108 23997 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:32.714154 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:32.714346 27054 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.715149 26913 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:32.674831 26973 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:21:32.715754 26913 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:32.668431 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:32.717190 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 48825.6us
W20260709 12:21:32.717999 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 112107us
I20260709 12:21:32.718588 24524 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:32.712811 24558 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:32.711771 27344 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:32.707443 23995 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:32.708310 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 51883.8us
W20260709 12:21:32.690547 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.715858 27054 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.717082 26913 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:32.718756 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:32.713649 26485 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:32.729372 27048 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.676534 27274 consensus_queue.cc:1059] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:21:32.729758 27360 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.730844 27209 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.731504 24002 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:32.731590 23895 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:32.732473 27360 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:32.732935 23999 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.733099 26485 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:32.734087 27372 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:32.746488 24554 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:32.746874 24561 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
W20260709 12:21:32.750030 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 76904.9us
I20260709 12:21:32.746574 27360 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.754460 23999 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:32.753135 27155 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:32.739951 27352 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:32.765283 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:32.765853 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.741079 27397 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:32.778595 23895 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:32.780305 24002 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:21:32.787535 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 69043.6us
I20260709 12:21:32.758183 27155 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:32.801286 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:32.803102 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.805259 23997 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:32.753544 27048 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:32.762286 27372 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:21:32.816856 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:32.790122 27269 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:32.791231 27230 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.773195 26537 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 12:21:32.826709 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.829241 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:32.838205 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.840183 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:32.830765 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:32.850018 27397 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:32.850634 27397 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:32.851092 27397 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:32.823469 27269 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.853379 27269 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.833069 27230 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:32.858701 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.862618 24002 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:32.817233 27343 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:21:32.822700 26973 consensus_queue.cc:1059] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:21:32.890120 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:32.860333 27230 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:32.891642 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 83943.9us
I20260709 12:21:32.894157 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:32.820089 27313 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:21:32.911408 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:32.912689 23997 raft_consensus.cc:2393] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:32.944078 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:32.944446 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:32.956432 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:32.979142 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.987986 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:32.992836 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:32.993781 23848 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:33.003527 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:33.008800 23893 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:33.010416 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:33.011166 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.014801 23850 raft_consensus.cc:2410] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:21:33.023339 27396 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:21:32.999778 27313 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.025192 27313 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.026515 24561 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:33.027577 27313 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:33.030445 27406 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:21:33.020495 27323 consensus_meta.cc:287] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.652s	user 0.014s	sys 0.000s
I20260709 12:21:33.031927 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:33.033437 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:33.034783 24004 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:33.035854 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:33.036618 24004 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:33.036657 27278 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:21:33.037073 27403 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:21:33.038539 27405 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:21:33.042685 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:33.043771 24003 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:33.046737 27048 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:33.047307 26485 raft_consensus.cc:3055] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:33.048089 26485 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:32.989013 27155 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.047449 27048 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:33.023218 23925 raft_consensus.cc:3055] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:33.037415 27278 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:33.037541 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:33.060098 23925 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:33.056969 23853 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:33.065485 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:33.078130 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:33.077526 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:33.081332 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.060067 27048 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:33.100837 23848 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:33.115348 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:33.122404 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.115608 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:33.070091 27360 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:33.116451 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:33.125590 24002 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:33.127300 24558 raft_consensus.cc:2410] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:21:33.128472 24561 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:33.130868 24004 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 12:21:33.145442 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.049355 26485 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:33.151500 23848 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 9 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:33.130296 27048 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:33.151553 23850 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:33.132694 27280 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:33.147455 27404 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:21:33.148366 23925 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.159650 23997 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:21:33.166980 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 103634us
W20260709 12:21:33.168438 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.175072 23818 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:33.180905 27408 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:21:33.173504 27278 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:33.186617 24558 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:33.187975 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:33.191969 23999 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
W20260709 12:21:33.194216 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 114182us
I20260709 12:21:33.196023 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:33.199291 27398 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.297s	user 0.003s	sys 0.002s
W20260709 12:21:33.202718 27401 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:21:33.204838 27402 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:21:33.205093 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.206084 24563 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:33.211321 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:33.212572 24561 raft_consensus.cc:2410] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:33.213263 27352 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:33.213989 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.214265 27352 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.215075 24557 raft_consensus.cc:2393] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:33.214965 27352 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.216619 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.217422 24555 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 3.
I20260709 12:21:33.221928 23925 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:33.161154 27193 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.197758 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:33.253993 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 56296.9us
I20260709 12:21:33.254231 24554 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:33.218843 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.219554 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.255291 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:33.170394 26913 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:33.274734 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 106831us
I20260709 12:21:33.231796 26485 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:33.261412 24562 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
W20260709 12:21:33.277153 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.217801 27352 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:33.286286 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:33.287686 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 252119us
I20260709 12:21:33.220796 27323 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.263407 27230 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:33.306088 23818 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:33.269972 27054 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:33.314978 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.301559 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.324051 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.325085 24554 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:33.305279 27230 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.270859 27193 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:33.315717 27209 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.002s
I20260709 12:21:33.308343 27352 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:33.346431 23854 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:33.330601 27230 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:33.352471 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.356458 24554 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:33.330672 27280 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:33.358335 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:33.359206 24559 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:33.366031 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:33.343897 26955 raft_consensus.cc:3055] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:33.367944 24562 raft_consensus.cc:2410] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:33.369114 23818 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:33.348451 27352 raft_consensus.cc:697] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:33.372311 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.373384 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:33.365020 27054 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.349398 27323 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:33.374562 23969 leader_election.cc:336] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 1.765s (SENT)
I20260709 12:21:33.382416 23969 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:33.369740 26955 raft_consensus.cc:740] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:33.386816 26955 consensus_queue.cc:260] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:33.388273 26955 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:33.358664 27269 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:33.383162 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 127979us
I20260709 12:21:33.372314 27280 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:33.391296 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:33.377640 27203 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:33.389744 27054 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.400183 24525 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:33.403234 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:33.398769 27351 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:33.405484 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 127705us
I20260709 12:21:33.404985 26913 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:33.408164 27419 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:21:33.407797 27280 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.408746 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.410633 27322 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:33.411113 27322 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.411454 27322 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:33.401930 27397 consensus_meta.cc:287] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.004s
I20260709 12:21:33.422372 23925 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:33.424324 27360 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:33.424571 27422 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:21:33.426076 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:33.404495 27350 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:33.427294 23848 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:33.430613 24560 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:33.431432 27432 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.432088 27432 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.433187 27323 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:33.407855 26913 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:33.426733 27055 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:21:33.435441 26913 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:33.441102 27054 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:33.442265 23969 leader_election.cc:336] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 2.207s (SENT)
I20260709 12:21:33.444586 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:33.450599 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 50488.7us
I20260709 12:21:33.451047 24559 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:33.452639 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:33.455394 24559 raft_consensus.cc:2410] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:21:33.456983 24525 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:33.463672 27269 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:33.463678 27209 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.465669 27209 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.468364 27209 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:33.464206 27421 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:21:33.464344 27155 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.469807 27155 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.471689 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:33.472431 23848 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:33.472544 27155 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:33.474494 23850 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:21:33.474814 23853 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:21:33.475071 23848 raft_consensus.cc:1240] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:33.476307 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:33.446599 27352 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:33.482244 27423 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:21:33.478578 23852 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:21:33.489362 27193 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:33.453143 27275 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:21:33.492143 27278 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.422616 27397 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:33.496037 27397 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:33.496606 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.496753 24558 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:33.502264 27432 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:33.503077 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 46152.9us
W20260709 12:21:33.504714 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 178242us
I20260709 12:21:33.507593 23893 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:33.489804 27048 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.511474 27348 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:33.511952 27373 consensus_queue.cc:1059] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:33.512590 27397 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:33.513021 27373 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:33.517139 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 69524.4us
I20260709 12:21:33.518718 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:33.532948 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:33.533763 24559 raft_consensus.cc:2368] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10.
W20260709 12:21:33.539109 23966 leader_election.cc:336] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.773s (SENT)
I20260709 12:21:33.541644 23997 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:33.542549 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:33.543143 24554 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:33.544725 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:33.547170 23995 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:33.540302 27313 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:33.548765 27313 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:33.549911 23999 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:33.513535 27048 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:33.550675 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:33.513597 27373 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:33.513026 27397 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.554667 24560 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:33.562341 24004 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:33.565253 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:33.566588 23995 raft_consensus.cc:2410] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:21:33.576447 24562 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:33.578595 23998 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:33.552767 27224 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:33.550034 27263 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:33.586941 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.583884 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:33.587639 24004 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:33.568812 27313 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.592139 27313 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:33.580773 27397 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:33.597064 24554 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:33.562165 27432 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:33.615628 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 89126.9us
W20260709 12:21:33.605960 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 52142.3us
I20260709 12:21:33.603582 27269 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.614001 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.613638 23929 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:33.612771 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.613389 23924 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 12:21:33.666736 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 80683.2us
I20260709 12:21:33.671679 23848 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:21:33.674949 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.675416 27420 log.cc:927] Time spent T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.311s	user 0.003s	sys 0.000s
I20260709 12:21:33.667356 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.694128 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:33.667047 27054 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:33.696076 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:33.700881 23997 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:33.698877 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.701689 23920 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:33.607370 27263 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:33.710207 27269 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:33.608250 27224 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.706423 26910 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:21:33.707172 27277 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:33.707885 26973 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:33.713461 27312 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:33.714702 27224 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:33.702901 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.715147 27312 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:33.715906 23926 raft_consensus.cc:2410] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:21:33.716212 23966 leader_election.cc:336] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.849s (SENT)
I20260709 12:21:33.614447 27338 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:21:33.718084 27278 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:33.718611 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:33.612202 27373 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.719343 27278 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:33.719798 27278 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:33.720664 27278 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.718465 23998 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:33.722287 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:33.723450 27432 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:33.723500 26910 consensus_queue.cc:1243] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:33.723985 27432 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:33.724737 27432 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:33.726013 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.667800 27230 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.726799 24554 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:33.728760 27230 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:33.729609 24003 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:33.717679 23893 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:33.730693 27322 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.732954 23847 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:33.703035 23895 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:33.712745 27269 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:33.729318 27372 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:21:33.738807 24554 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:33.739393 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:33.740607 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.740898 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.741468 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.741567 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.741999 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.742302 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:33.745304 26537 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:33.747740 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:33.775421 23923 raft_consensus.cc:2410] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:21:33.748039 26868 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:33.778791 23998 raft_consensus.cc:2410] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:33.712729 27263 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:33.747632 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 44677.7us
I20260709 12:21:33.777942 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:33.785037 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 66512.3us
I20260709 12:21:33.748871 27338 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.749024 27440 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.750276 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:33.750769 27437 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.764240 23924 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:33.790320 23920 raft_consensus.cc:2368] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6.
I20260709 12:21:33.757937 27352 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.791625 24560 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
W20260709 12:21:33.802471 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.750643 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 232029us
I20260709 12:21:33.755764 27278 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:33.811753 23997 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:33.749933 27224 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:33.813932 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:33.815307 23818 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:33.816574 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:33.819226 27397 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:33.822429 27322 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:33.823858 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.824647 23920 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:33.804273 26868 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:33.826987 26868 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:33.830539 24562 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:33.803269 27338 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:33.805672 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:33.771847 26537 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.803722 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:33.834120 27224 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.804023 24558 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:33.841673 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:33.825677 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.846544 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.848520 23997 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:33.850208 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.851431 24560 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:33.854832 24554 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:33.860045 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:33.891606 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.837988 27350 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:33.893626 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:33.895975 23895 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:33.898710 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:33.902361 24562 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:33.852263 26537 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:33.905704 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:33.909540 23848 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:33.909828 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.909548 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.850930 27397 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:33.857308 27322 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:33.816206 27352 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:33.805778 27440 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:33.847544 27360 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:21:33.857676 27280 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:21:33.811183 27437 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:33.913691 23966 leader_election.cc:336] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.987s (SENT)
I20260709 12:21:34.074753 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:33.945842 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:34.081199 23850 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:34.090523 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.918509 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.066802 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:34.094901 23848 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:33.942329 23920 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 9: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:33.943955 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.918259 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:33.918040 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:34.084386 23922 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:34.086714 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:34.100138 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.104357 23850 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
W20260709 12:21:34.102201 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 206302us
I20260709 12:21:34.106875 24559 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:34.095670 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.113598 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:34.114904 24562 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:33.948329 27322 raft_consensus.cc:697] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:33.956341 27263 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:33.941546 27054 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:34.101372 27313 consensus_meta.cc:287] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260709 12:21:34.133849 27322 consensus_queue.cc:237] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:34.132625 27263 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:34.112313 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:34.139752 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 293894us
W20260709 12:21:34.105165 26955 consensus_meta.cc:287] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.716s	user 0.013s	sys 0.000s
I20260709 12:21:34.142640 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:34.139415 23920 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:34.144548 24559 raft_consensus.cc:2368] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10.
I20260709 12:21:34.138250 27263 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.148756 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.150774 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.156946 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:34.158613 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.159044 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.160605 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.112990 27312 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:34.164220 23922 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:33.940843 27350 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:34.138769 27155 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:34.165699 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:34.182984 24559 raft_consensus.cc:2376] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 9. Re-sending same reply.
W20260709 12:21:34.168490 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 265009us
I20260709 12:21:34.194908 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.196499 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.202278 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:34.131502 27277 consensus_queue.cc:1059] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:21:34.143190 27432 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:34.206948 23966 leader_election.cc:336] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.044s (SENT)
I20260709 12:21:34.211069 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:34.207551 23927 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:34.178715 27230 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:34.209384 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.215961 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:34.192557 27338 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:34.190833 27280 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:34.238651 24559 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:34.241992 23995 raft_consensus.cc:1217] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Deduplicated request from leader. Original: 9.5->[10.6-10.6]   Dedup: 10.6->[]
I20260709 12:21:34.242168 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:34.242687 23995 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:21:34.243014 24562 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:34.226431 27230 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.246393 27230 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:34.236449 23850 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:34.185197 27312 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.209347 27224 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:34.263226 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.248626 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:34.255259 27445 log.cc:927] Time spent T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:21:34.256770 27440 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:34.260080 27442 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:21:34.273177 27280 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.274914 27432 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:34.221000 27155 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:34.315712 24559 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:21:34.324355 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:34.342252 24556 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:34.351613 27441 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.352300 27441 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.343039 24559 pending_rounds.cc:85] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 9
I20260709 12:21:34.356192 24559 pending_rounds.cc:107] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:21:34.356540 24559 raft_consensus.cc:2889] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:34.358112 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:34.359145 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 159020us
I20260709 12:21:34.362739 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.374925 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:34.375982 24562 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:34.342133 27343 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:34.382318 23966 leader_election.cc:336] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.207s (SENT)
I20260709 12:21:34.383038 23966 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:34.406602 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:34.407399 23846 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:34.410223 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:34.410550 23845 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:34.411936 23851 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:34.412304 23845 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:34.413259 23851 pending_rounds.cc:85] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 3
I20260709 12:21:34.413582 23851 pending_rounds.cc:107] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 6.4
W20260709 12:21:34.416851 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.413818 23851 raft_consensus.cc:2889] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:34.432674 27448 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:21:34.388470 27360 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.381107 27343 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.390098 27350 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:34.477157 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.557921 27352 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:34.562063 26913 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:34.562528 27186 raft_consensus.cc:3055] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:34.561741 27435 raft_consensus.cc:3055] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:34.565809 23846 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:34.569504 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60686 (request call id 83) took 1121 ms. Trace:
I20260709 12:21:34.575445 23854 rpcz_store.cc:276] 0709 12:21:33.458071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.460692 (+  2621us) service_pool.cc:224] Handling call
0709 12:21:34.555837 (+1095145us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b5400073354. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa287452735 00007fa28744a9fa 00007fa28c4124c9 00007fa28598ec54 00007fa28598ebe2 00007fa28598eb11 00007fa28598ea8c 00007fa28598dd42 00007fa28578748c 00007fa2857868c6
0709 12:21:34.565812 (+  9975us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602167680}
W20260709 12:21:34.585031 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 202722us
W20260709 12:21:34.587180 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 134230us
I20260709 12:21:34.565603 26955 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.588019 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:34.588510 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:34.568934 27186 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:34.569234 27209 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.558918 27360 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:34.573809 27441 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:34.574576 27435 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:34.582197 27437 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:34.582345 26868 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:34.607340 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 263320us
I20260709 12:21:34.598315 27460 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:34.622326 23820 leader_election.cc:336] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 1.784s (SENT)
I20260709 12:21:34.622805 23820 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:34.628691 27437 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:34.643046 23854 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:21:34.644037 23966 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.228s (SENT)
W20260709 12:21:34.645263 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 57377.8us
W20260709 12:21:34.645961 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 82129.4us
I20260709 12:21:34.646622 23893 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:34.646908 23969 leader_election.cc:336] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 1.822s (SENT)
I20260709 12:21:34.650282 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:34.653918 23849 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:34.654419 27290 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:34.654824 27290 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:34.655926 23852 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:34.655634 27290 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.656654 27290 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:34.657518 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1898) took 1125 ms. Trace:
I20260709 12:21:34.657904 23852 rpcz_store.cc:276] 0709 12:21:33.531692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.531878 (+   186us) service_pool.cc:224] Handling call
0709 12:21:34.655764 (+1123886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:34.656331 (+   567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.657315 (+   984us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400299d50. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:34.657455 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543366016}
I20260709 12:21:34.660851 27441 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:34.655635 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2187) took 1251 ms. Trace:
I20260709 12:21:34.662434 23849 rpcz_store.cc:276] 0709 12:21:33.403799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.407223 (+  3424us) service_pool.cc:224] Handling call
0709 12:21:33.407587 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:34.654362 (+1246775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.655377 (+  1015us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400299d54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:34.655573 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2865427712}
W20260709 12:21:34.664608 23736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8630b76482c543a2a08e289b32b13ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 22996f888daf435398b693481171c18c (127.22.43.65:34895) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:21:34.675904 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.677049 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:34.678387 23846 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:21:34.679927 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.639585 24524 connection.cc:256] RPC call timeout handler was delayed by -3.4238661660001526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 12:21:34.608561 27280 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:34.602100 27209 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.603292 26955 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:34.688834 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.625568 27277 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:34.648576 27464 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.696532 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:34.700277 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.676133 26485 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:34.703254 23999 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:34.704246 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.704650 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:34.705036 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:34.705305 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:34.674158 27452 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:34.706727 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:34.673233 27465 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:34.693115 27263 consensus_meta.cc:287] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.002s
I20260709 12:21:34.696197 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:34.716342 24002 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:34.731194 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:34.691660 27055 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.712010 24000 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:21:34.723770 23996 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:34.724540 27452 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:34.742702 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 115101us
I20260709 12:21:34.725250 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:34.743793 24004 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:34.725684 26973 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.726176 26485 raft_consensus.cc:697] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:34.683858 27372 consensus_queue.cc:1059] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:21:34.631908 26868 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:34.743898 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:34.786391 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:34.694378 27437 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:34.689218 27462 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:34.633771 27460 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.788244 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:34.790668 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:34.792071 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:34.795934 24002 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:34.797971 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:34.804723 26485 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.806872 27322 consensus_queue.cc:1059] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:34.808216 27322 raft_consensus.cc:3055] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:21:34.813045 23969 leader_election.cc:336] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 1.910s (SENT)
I20260709 12:21:34.823012 23969 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:34.814790 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:34.710050 27312 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:34.793562 27155 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:34.831537 23820 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:34.829865 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 118679us
I20260709 12:21:34.793426 27323 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:34.717144 27277 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:34.831513 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 183431us
I20260709 12:21:34.843971 23853 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:21:34.846946 23853 pending_rounds.cc:85] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 5
I20260709 12:21:34.847321 23853 pending_rounds.cc:107] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:21:34.847652 23853 raft_consensus.cc:2889] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:34.736785 27263 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:34.848668 24524 connection.cc:256] RPC call timeout handler was delayed by -3.4056951850002406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 12:21:34.809966 27432 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:34.820760 27278 consensus_meta.cc:287] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.980s	user 0.014s	sys 0.007s
I20260709 12:21:34.852890 24000 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:34.784539 27055 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.849292 23818 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:34.727810 27464 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.858355 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:34.809353 27461 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.808671 27322 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:34.843998 27441 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:21:34.860656 27462 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:34.784227 26973 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.862651 27277 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:34.784844 27452 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:34.715626 27435 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.896951 23820 leader_election.cc:400] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10.
I20260709 12:21:34.838613 27350 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:34.837194 27372 consensus_queue.cc:1243] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:21:34.844167 27352 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:34.875830 24002 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:34.876196 23818 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:34.879854 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:34.882546 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 139886us
I20260709 12:21:34.908427 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:34.858114 27463 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 12:21:34.846122 27323 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:34.844256 27155 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:34.896018 24524 connection.cc:256] RPC call timeout handler was delayed by -2.585966166000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2961s for a response
I20260709 12:21:34.809233 27437 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:34.859846 27432 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:34.747439 27465 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.844350 27230 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:21:34.909162 23920 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:34.927527 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.845011 27351 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:21:34.889518 27338 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:34.915251 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.930335 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.918668 23850 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:34.913558 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:34.899580 27350 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.933238 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:34.876092 27224 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:21:34.937098 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:34.874950 27455 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:34.918664 27275 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:34.927150 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:34.933027 23928 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:34.920518 26913 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:34.935295 23925 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:21:34.935913 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:34.905184 27360 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:34.938001 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 57045.3us
I20260709 12:21:34.933980 27338 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.937645 27350 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:34.941167 26868 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:34.942543 27469 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:21:34.921351 27432 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.921497 27155 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:34.914631 27323 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:34.933089 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:34.894716 27461 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:34.920888 27352 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:34.962075 23920 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:34.964221 23926 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
W20260709 12:21:34.919137 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 106124us
I20260709 12:21:34.969573 23921 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:34.913209 27373 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 12:21:34.989817 23969 leader_election.cc:336] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 1.938s (SENT)
I20260709 12:21:34.972011 27477 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:34.973845 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 68306.1us
I20260709 12:21:34.955839 27275 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.958709 26955 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:34.986627 27352 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:35.017480 23920 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:35.017416 23820 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:35.010077 23923 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:21:34.988095 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 121644us
I20260709 12:21:34.967634 27209 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:34.972744 27338 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:34.975471 27360 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:35.002830 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 71610.9us
I20260709 12:21:35.007562 27452 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:35.009681 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2105) took 1266 ms. Trace:
I20260709 12:21:35.010133 27263 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:35.012187 27435 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:35.004027 27275 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:35.014020 27477 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:35.014976 27437 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:34.967374 27054 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 12:21:35.039594 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49818.8us
I20260709 12:21:35.037537 23927 rpcz_store.cc:276] 0709 12:21:33.742845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.798617 (+ 55772us) service_pool.cc:224] Handling call
0709 12:21:35.009408 (+1210791us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54002792d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:35.009567 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732969344}
I20260709 12:21:34.957221 27322 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:34.979117 27269 consensus_queue.cc:1059] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:21:35.048808 27055 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:35.014478 26973 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:35.060353 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:35.061115 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:35.026499 26868 raft_consensus.cc:3055] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:35.073616 24524 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:35.079198 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:35.097047 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 79754.6us
I20260709 12:21:35.097985 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:35.065797 27452 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.099805 23920 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:21:35.102439 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 45133.9us
I20260709 12:21:35.065521 27460 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:35.104543 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:35.034750 27351 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:21:35.109539 23921 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:35.144992 27464 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:35.147051 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49196.8us
I20260709 12:21:35.135787 27452 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:35.080060 27193 consensus_queue.cc:1059] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:21:35.044167 27360 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:35.094436 26868 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:35.145637 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 100816us
I20260709 12:21:35.105834 27055 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:35.138491 27209 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.100927 27496 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.106436 27455 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.097661 27492 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:35.284117 27455 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:35.222388 27351 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:35.172835 23926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2109) took 1428 ms (client timeout 1843 ms). Trace:
I20260709 12:21:35.285753 27351 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:35.285825 23926 rpcz_store.cc:269] 0709 12:21:33.743974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.798832 (+ 54858us) service_pool.cc:224] Handling call
0709 12:21:35.148120 (+1349288us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003746d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:35.172763 (+ 24643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410744704}
I20260709 12:21:35.200423 27343 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:35.287367 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:35.288252 27351 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:35.198468 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.202455 27465 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:35.203368 27482 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.005s
I20260709 12:21:35.289979 27350 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:35.290411 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:35.290478 26868 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:35.292076 26868 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:35.202054 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1891) took 1731 ms. Trace:
W20260709 12:21:35.216228 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:35.293664 27494 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:21:35.147847 27488 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:35.224740 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:35.227746 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:35.262316 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:35.214906 26537 consensus_meta.cc:287] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.275s	user 0.009s	sys 0.006s
I20260709 12:21:35.196584 27460 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:35.282110 27055 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:35.283015 27496 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:35.149976 27437 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:35.286106 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 223981us
I20260709 12:21:35.138953 27230 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:21:35.284543 27155 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:35.279589 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:35.315907 24003 raft_consensus.cc:2393] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:35.295753 23928 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:35.293205 23847 rpcz_store.cc:276] 0709 12:21:33.470395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.470846 (+   451us) service_pool.cc:224] Handling call
0709 12:21:33.471161 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:33.733336 (+262175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.201786 (+1468450us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400073d54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:35.201980 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601610496}
W20260709 12:21:35.292802 27471 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.561s	user 0.004s	sys 0.000s
I20260709 12:21:35.241372 27277 raft_consensus.cc:3055] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:35.241145 26955 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:35.330601 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 391177us
I20260709 12:21:35.308298 27460 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.330869 27351 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:35.329386 27277 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:35.363155 24524 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:35.263268 27441 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 12:21:35.382508 27491 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.383345 27491 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:35.417302 27493 log.cc:927] Time spent T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:21:35.311252 26537 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:35.345739 27460 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:35.340723 26955 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:35.633097 27451 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:21:35.664459 27275 consensus_meta.cc:287] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.013s
I20260709 12:21:35.665171 27275 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:35.669456 27338 consensus_meta.cc:287] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.006s
I20260709 12:21:35.670174 27338 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:35.673635 27435 consensus_meta.cc:287] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.002s
W20260709 12:21:35.731945 24002 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.821s	user 0.012s	sys 0.000s
W20260709 12:21:35.960106 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 620492us
W20260709 12:21:35.960178 23924 consensus_meta.cc:287] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.021s	user 0.008s	sys 0.008s
I20260709 12:21:35.962240 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:35.858929 27491 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:35.744931 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1902) took 1592 ms. Trace:
W20260709 12:21:35.997195 27343 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.006s	sys 0.021s
I20260709 12:21:35.962287 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:35.998731 23925 raft_consensus.cc:2410] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:21:35.994946 23924 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:35.999385 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 375) took 1091 ms. Trace:
I20260709 12:21:35.999491 27506 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:35.960139 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 787614us
W20260709 12:21:35.997867 27343 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.006s	sys 0.021s
I20260709 12:21:36.000403 27506 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.841238 26955 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.000890 27506 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.001551 23969 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:35.999784 23924 rpcz_store.cc:276] 0709 12:21:34.908405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.914248 (+  5843us) service_pool.cc:224] Handling call
0709 12:21:35.999319 (+1085071us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:36.002835 27352 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:36.004101 27506 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.004840 27506 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:35.999653 24002 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:36.005330 27506 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.006117 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 394) took 1171 ms. Trace:
I20260709 12:21:36.006839 27230 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:35.996694 23848 rpcz_store.cc:276] 0709 12:21:34.153097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.207840 (+ 54743us) service_pool.cc:224] Handling call
0709 12:21:34.220141 (+ 12301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:34.263358 (+ 43217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:34.263613 (+   255us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:34.298246 (+ 34633us) log.cc:844] Serialized 26 byte log entry
0709 12:21:34.579410 (+281164us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:34.579455 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.579533 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:35.146662 (+567129us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:35.727932 (+581270us) raft_consensus.cc:1685] finished
0709 12:21:35.727962 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.744828 (+ 16866us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17783,"raft.queue_time_us":40869,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":176605952,"thread_start_us":223186,"threads_started":1,"wal-append.queue_time_us":289910}
I20260709 12:21:36.006798 24002 rpcz_store.cc:276] 0709 12:21:34.835090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.835270 (+   180us) service_pool.cc:224] Handling call
0709 12:21:36.006024 (+1170754us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:35.960418 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 735767us
I20260709 12:21:36.007562 27230 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.008571 27519 consensus_queue.cc:1059] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:36.010010 27230 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:35.864274 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 299732us
W20260709 12:21:35.894084 27278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.002s	sys 0.014s
W20260709 12:21:36.027119 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 745191us
I20260709 12:21:36.060883 23966 leader_election.cc:400] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6.
I20260709 12:21:36.061348 23966 leader_election.cc:403] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:35.805255 27323 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.814s	user 0.014s	sys 0.001s
I20260709 12:21:35.652088 27451 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:36.071266 23996 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:36.072466 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.073154 23995 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:36.073282 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.074584 23999 raft_consensus.cc:2410] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:21:36.074951 24524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.006s	sys 0.014s
W20260709 12:21:36.076526 24524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.006s	sys 0.014s
I20260709 12:21:35.734195 27496 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:36.077558 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 77722.7us
I20260709 12:21:35.839592 26537 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:35.855283 27432 consensus_meta.cc:287] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.852s	user 0.011s	sys 0.000s
W20260709 12:21:36.070796 27278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.009s	sys 0.017s
I20260709 12:21:36.084147 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.084308 27343 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.836419 27360 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:35.836007 27155 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:36.097149 27504 raft_consensus.cc:3055] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:36.099179 27461 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:36.004151 27352 consensus_queue.cc:1059] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:21:36.123534 27455 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:36.085951 27230 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 5. Current term is 6.
I20260709 12:21:36.075968 27350 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:36.110157 27055 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:36.125661 24526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.007s	sys 0.051s
I20260709 12:21:36.129189 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:36.130199 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 780880us
W20260709 12:21:36.133066 24526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.007s	sys 0.051s
W20260709 12:21:36.134191 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.649873 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:36.138270 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:36.123970 27521 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:21:36.078449 27323 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.144591 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:35.771497 27277 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.145644 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.145972 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:36.146525 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.147099 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.154755 24556 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 9: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:36.155311 24562 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:36.119854 27504 raft_consensus.cc:740] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:36.151613 27506 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.152155 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.115919 27511 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:36.134310 27275 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.157764 23996 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:36.156814 24555 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:36.154732 24559 raft_consensus.cc:2376] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10. Re-sending same reply.
I20260709 12:21:36.114648 27432 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:36.157526 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 96892.3us
I20260709 12:21:36.118575 27343 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.162107 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:36.143865 27360 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:36.136132 27055 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:21:36.177428 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:36.161592 26868 consensus_meta.cc:287] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.003s
I20260709 12:21:36.180117 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.181779 23996 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:36.180135 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.158465 27511 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.192154 23966 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.178594 26955 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.179292 27352 raft_consensus.cc:2764] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:36.193535 27511 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:36.226115 23996 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:36.190631 27506 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:36.237766 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 45688.4us
I20260709 12:21:36.239231 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:21:36.183156 27460 consensus_meta.cc:287] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.003s
I20260709 12:21:36.179559 27452 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:36.226799 27360 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.194468 27496 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.156324 27451 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.194454 27516 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:36.192458 27504 consensus_queue.cc:260] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.229251 27522 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:36.232564 27514 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:36.228300 26955 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.276014 26955 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.250821 27352 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:36.276916 27352 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:36.276932 27526 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:36.278188 27352 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:36.279414 23749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43184 (request call id 224) took 42686 ms (client timeout 15000 ms). Trace:
I20260709 12:21:36.263893 27451 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:36.248517 27523 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:36.282501 27525 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.283169 27525 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.283564 27186 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.285215 23748 catalog_manager.cc:5697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 6 to 7, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 7 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:36.286864 27525 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.289706 27525 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.290661 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1939) took 1260 ms. Trace:
I20260709 12:21:36.290452 27525 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.291107 23920 rpcz_store.cc:276] 0709 12:21:35.031286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.032624 (+  1338us) service_pool.cc:224] Handling call
0709 12:21:35.032934 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.103923 (+ 70989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.290374 (+1186451us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b5400329454. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:36.290592 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152927104}
I20260709 12:21:36.293352 27525 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.295817 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.296147 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.296672 23927 raft_consensus.cc:2393] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:36.299043 27322 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:36.305150 27278 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.305984 27278 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.309350 27278 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:36.264542 27517 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:21:36.315989 23817 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:36.316423 27275 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:36.317770 27275 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:36.318212 27275 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.318583 27275 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:36.320969 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 214152us
I20260709 12:21:36.322425 27529 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.323869 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1867) took 1630 ms. Trace:
I20260709 12:21:36.322997 27529 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.326799 27275 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.328941 27275 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:36.329365 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.329592 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.329950 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.330617 24562 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:36.331677 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:36.331822 27491 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:21:36.332468 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.332629 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:36.333133 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.251035 27496 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.265262 27323 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:36.248972 27360 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.335873 27360 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.336166 27496 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:36.337078 24557 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:36.337749 27529 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.262250 27516 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.340376 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.340633 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:36.341423 23847 raft_consensus.cc:2368] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11.
I20260709 12:21:36.249037 27506 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.341766 23820 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.343175 27525 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:36.343667 27525 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.344111 27525 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.344383 27506 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.266090 27504 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:36.346892 27506 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:36.268828 27351 consensus_meta.cc:287] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.873s	user 0.009s	sys 0.002s
I20260709 12:21:36.349164 27351 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:36.281527 26955 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.330102 24556 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:36.350162 26955 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.350703 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:36.351311 24556 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.352577 26955 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.333464 24561 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:36.267271 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.354734 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.355262 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.355495 27323 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:36.355762 24563 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:36.356804 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:36.264518 27467 log.cc:927] Time spent T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 1.580s	user 0.010s	sys 0.000s
I20260709 12:21:36.358801 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.359589 23848 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:36.347926 27506 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.361824 24556 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
W20260709 12:21:36.362195 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 95002.9us
I20260709 12:21:36.365250 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.365901 24556 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:36.366858 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.362238 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.324317 23997 rpcz_store.cc:276] 0709 12:21:34.693288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.724028 (+ 30740us) service_pool.cc:224] Handling call
0709 12:21:34.724360 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:34.724580 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:34.808824 (+ 84244us) log.cc:844] Serialized 14 byte log entry
0709 12:21:36.323215 (+1514391us) log.cc:844] Serialized 14 byte log entry
0709 12:21:36.323452 (+   237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.323507 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:36.323567 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.323640 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.323798 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1349667,"prepare.queue_time_us":181427,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":6659,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":3559,"thread_start_us":267114,"threads_started":2,"wal-append.queue_time_us":329906}
I20260709 12:21:36.378294 24558 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:36.271869 27460 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.364147 27506 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:36.441113 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 119461us
I20260709 12:21:36.441485 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.398782 27523 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:36.437909 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 44974.5us
I20260709 12:21:36.453804 23748 catalog_manager.cc:5697] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:36.279866 23749 rpcz_store.cc:269] 0709 12:20:53.593230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.593397 (+   167us) service_pool.cc:224] Handling call
0709 12:21:36.279143 (+42685746us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:31.213573 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:31.242684 (+ 29111us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:31.242732 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:21:31.242757 (+    25us) tablet.cc:662] Decoding operations
0709 12:21:31.244344 (+  1587us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:31.244426 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:31.244464 (+    38us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:21:31.245367 (+   903us) tablet.cc:701] Row locks acquired
0709 12:21:31.245387 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:21:31.245591 (+   204us) write_op.cc:270] Start()
0709 12:21:31.245732 (+   141us) write_op.cc:276] Timestamp: P: 1783599691245516 usec, L: 0
0709 12:21:31.245757 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:21:31.388986 (+143229us) log.cc:844] Serialized 3234 byte log entry
0709 12:21:31.850581 (+461595us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b18001cf600. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:31.996674 (+146093us) op_driver.cc:464] REPLICATION: finished
0709 12:21:32.118966 (+122292us) write_op.cc:301] APPLY: starting
0709 12:21:32.119179 (+   213us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:32.119598 (+   419us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:32.119651 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:32.165238 (+ 45587us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:32.165656 (+   418us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:21:32.165733 (+    77us) write_op.cc:312] APPLY: finished
0709 12:21:32.166269 (+   536us) log.cc:844] Serialized 65 byte log entry
0709 12:21:32.166496 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:32.166738 (+   242us) write_op.cc:454] Released schema lock
0709 12:21:32.166819 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:32.202402 (+ 35583us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:32.202461 (+    59us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":487578,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":121732,"apply.run_cpu_time_us":5368,"apply.run_wall_time_us":83396,"num_ops":8,"prepare.queue_time_us":248089,"prepare.run_cpu_time_us":35410,"prepare.run_wall_time_us":628167,"raft.queue_time_us":5614,"raft.run_cpu_time_us":32484,"raft.run_wall_time_us":220512,"replication_time_us":613490,"spinlock_wait_cycles":21814144,"thread_start_us":683840,"threads_started":4,"wal-append.queue_time_us":418110,"wal-append.run_cpu_time_us":8786,"wal-append.run_wall_time_us":1469761}]]}
I20260709 12:21:36.455689 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.379715 27514 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.382077 27230 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:36.560375 23969 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:36.563786 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 157661us
I20260709 12:21:36.566236 23820 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:36.399904 27352 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:36.570317 23848 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:36.596843 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 230043us
W20260709 12:21:36.557535 27475 log.cc:927] Time spent T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 1.696s	user 0.007s	sys 0.035s
I20260709 12:21:36.599170 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.576210 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:36.602324 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:36.457894 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.445724 27516 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.449990 27527 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:36.505745 27350 raft_consensus.cc:3055] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:36.456429 27530 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.188s
I20260709 12:21:36.572564 27523 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:36.636238 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.634977 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.572424 27193 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:36.648849 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.639447 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:36.656301 23927 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:36.639885 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.556703 27277 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.640420 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.641115 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.640295 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.642204 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.661569 23925 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:21:36.662020 23926 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:21:36.643183 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.634752 24561 raft_consensus.cc:2410] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:36.639012 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.648057 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.648371 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.663506 23850 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:36.641528 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.657634 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.659528 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.599509 27522 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:36.665726 27522 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:36.662943 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 86850.5us
I20260709 12:21:36.597568 27230 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.596541 27416 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:21:36.667551 23969 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:36.670753 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.676905 23845 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:36.606999 27432 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:36.597533 27458 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:21:36.637558 27312 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.678815 27338 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:36.678606 27312 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.679157 23848 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:36.634490 27048 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:21:36.633922 27350 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:36.680465 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 78231.5us
I20260709 12:21:36.570794 27186 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:36.659302 26537 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.636814 27452 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.636538 27532 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.666463 27274 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.662294 27278 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.631286 27521 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:21:36.655558 27323 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:36.637228 27524 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:36.648371 27343 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:36.682641 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.687069 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:36.631042 27453 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:21:36.689513 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:36.692876 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.691906 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.688325 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:36.741360 24554 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:36.690726 27514 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:36.674714 27193 raft_consensus.cc:697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:36.670118 27522 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.746073 27193 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.744956 27312 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.690763 27048 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:36.753399 27048 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:36.715263 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.729583 23748 catalog_manager.cc:5697] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 6 to 9, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 9 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.755203 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.755339 23748 catalog_manager.cc:5697] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 8 to 9, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 9 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:36.756831 27048 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.749998 27274 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.758818 24560 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:36.721575 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.760052 23848 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:36.760617 27522 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.761286 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.762823 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:36.763743 23848 raft_consensus.cc:2393] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:36.764673 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.682529 27155 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:36.747045 27524 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.753973 27514 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:36.745015 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.685056 27432 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:36.758324 27048 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.766176 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1986) took 1454 ms. Trace:
I20260709 12:21:36.725178 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:36.781165 24559 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:36.751672 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 62237.8us
I20260709 12:21:36.782574 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.783725 27529 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:36.772596 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 124244us
W20260709 12:21:36.747597 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60026.1us
I20260709 12:21:36.683638 27352 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:36.773309 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1911) took 2344 ms. Trace:
W20260709 12:21:36.775130 27511 consensus_meta.cc:287] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.005s
I20260709 12:21:36.713961 27545 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:36.792694 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.788462 23851 rpcz_store.cc:276] 0709 12:21:34.405799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.412744 (+  6945us) service_pool.cc:224] Handling call
0709 12:21:34.413068 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:34.575928 (+162860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:34.576045 (+   117us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:34.576953 (+   908us) log.cc:844] Serialized 26 byte log entry
0709 12:21:34.673302 (+ 96349us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:34.673354 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.673435 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:36.553757 (+1880322us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:36.738748 (+184991us) raft_consensus.cc:1685] finished
0709 12:21:36.738777 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.749872 (+ 11095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8298240,"thread_start_us":66999,"threads_started":1,"wal-append.queue_time_us":211926}
I20260709 12:21:36.666282 27527 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.779458 24001 rpcz_store.cc:276] 0709 12:21:35.228483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.228606 (+   123us) service_pool.cc:224] Handling call
0709 12:21:35.280563 (+ 51957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.280774 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:36.331626 (+1050852us) log.cc:844] Serialized 14 byte log entry
0709 12:21:36.681590 (+349964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.681651 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:36.681703 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.681773 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.682522 (+   749us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1050538,"prepare.queue_time_us":1056330,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":51031,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":11271,"thread_start_us":349525,"threads_started":2,"wal-append.queue_time_us":352684}
W20260709 12:21:36.775444 23820 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 2.100s (SENT) [suppressed 38 similar messages]
I20260709 12:21:36.786550 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.692917 27523 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:36.819677 23928 raft_consensus.cc:2410] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:21:36.757019 23748 catalog_manager.cc:5697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 5 to 10, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.796312 23848 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:21:36.788633 23849 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:36.689757 27506 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:21:36.750378 27525 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.787420 27514 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:36.824899 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.751143 27452 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.714308 26537 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.751595 27278 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.797973 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.790575 27546 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:36.835002 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 59586.1us
W20260709 12:21:36.849828 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.793955 27536 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:36.779086 27350 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.827955 27523 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:36.860360 27545 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:36.751010 27532 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.881354 27350 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:36.882830 27532 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.831430 27460 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:36.863198 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1951) took 1579 ms. Trace:
I20260709 12:21:36.886399 23921 rpcz_store.cc:276] 0709 12:21:35.283419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.291442 (+  8023us) service_pool.cc:224] Handling call
0709 12:21:35.291758 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.334355 (+ 42597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:35.334407 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:35.334473 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:35.334524 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.862910 (+1528386us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b54003cdf54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:36.862964 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.863140 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97320832}
I20260709 12:21:36.797711 27511 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.796830 27352 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:36.870942 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 46128us
I20260709 12:21:36.857246 23847 raft_consensus.cc:2393] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:36.902251 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.828864 27290 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:21:36.874627 27453 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.875016 27451 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.875375 23748 catalog_manager.cc:5697] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.876632 27343 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.878170 27338 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:36.879976 27455 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:36.862231 27546 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:21:36.905910 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 108014us
I20260709 12:21:36.873278 27435 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.912820 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:36.916302 24555 raft_consensus.cc:1240] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:36.926179 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.908341 27506 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:36.935297 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:36.935989 23927 raft_consensus.cc:2376] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7. Re-sending same reply.
I20260709 12:21:36.934897 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.910791 27523 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:36.945358 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.949612 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.951484 24002 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:36.951016 24001 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:36.920084 27536 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:36.957005 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.918059 27546 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.958890 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.965350 23997 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:36.966464 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.958020 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:36.968117 23998 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.959407 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:36.971276 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.978937 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.979296 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:36.979926 23999 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.981638 23921 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:36.982889 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 60613us
I20260709 12:21:36.984015 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.984880 24002 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:36.987771 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 73491.6us
I20260709 12:21:36.909456 27451 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.991638 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.989977 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:36.915863 27343 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.990882 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:36.994406 27523 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:36.994910 27523 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:36.997088 27523 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:36.997627 27523 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.913018 27453 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.921296 27435 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:36.956811 27323 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:36.999960 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:37.001456 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:36.987743 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:36.965569 27536 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.002584 23849 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:36.992262 24001 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:36.957018 27545 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.998118 27523 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:37.034425 27352 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:37.035645 27500 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 1.810s	user 0.002s	sys 0.010s
I20260709 12:21:37.035893 27523 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:36.984098 27543 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.010757 27511 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:36.937618 27514 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:37.014425 27549 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:21:37.016297 27343 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:37.024286 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:37.025116 27323 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:37.025769 27269 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.009106 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1941) took 1977 ms. Trace:
I20260709 12:21:37.037343 27536 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:37.040544 27524 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:37.046222 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:37.056233 24557 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:37.049353 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:37.067625 24559 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:37.039108 23999 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
W20260709 12:21:37.069113 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 44865.4us
I20260709 12:21:37.064806 23929 rpcz_store.cc:276] 0709 12:21:35.031958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.032089 (+   131us) service_pool.cc:224] Handling call
0709 12:21:35.045982 (+ 13893us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:35.059055 (+ 13073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:35.059088 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:36.768859 (+1709771us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b2c0005c228. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa285d45a11 00007fa285d55372 00007fa287487a01 00007fa28744c43a 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2
0709 12:21:36.769251 (+   392us) log.cc:844] Serialized 26 byte log entry
0709 12:21:36.912692 (+143441us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:36.912895 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.912997 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:37.008738 (+ 95741us) raft_consensus.cc:1685] finished
0709 12:21:37.008763 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.009035 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97656,"raft.queue_time_us":59753,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":29707,"spinlock_wait_cycles":29629824,"thread_start_us":142987,"threads_started":1,"wal-append.queue_time_us":173659}
I20260709 12:21:37.041077 26537 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:37.046208 27278 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:37.054601 27525 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:37.047806 27435 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:37.044656 27274 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:37.078577 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:37.049156 27451 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:37.079670 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:37.042533 27453 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:37.084244 24557 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:37.087209 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:37.088371 27432 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:37.074113 27155 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:37.045688 27543 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:37.039115 23748 catalog_manager.cc:5697] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.139456 27432 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.139895 27523 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:37.140352 27543 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:37.152616 27523 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:37.038758 27545 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:37.155009 27432 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:37.157049 27545 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:37.157585 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.158454 24559 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:37.074276 27527 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:37.162473 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:37.163287 24559 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:37.180159 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 100161us
I20260709 12:21:37.182301 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:37.075001 27269 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:37.191268 24524 leader_election.cc:400] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11.
I20260709 12:21:37.191843 24524 leader_election.cc:403] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:21:37.207655 27536 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:37.210980 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.211913 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.214025 23892 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:37.214190 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:37.157073 27432 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:37.231761 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:37.232365 23893 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:37.232628 23928 raft_consensus.cc:2410] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:37.233489 23892 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:37.225132 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:37.226365 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.237308 23847 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:21:37.231096 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:37.225744 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 43565.3us
I20260709 12:21:37.239748 23893 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:37.241156 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2126) took 3111 ms. Trace:
I20260709 12:21:37.228386 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.242199 23999 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:37.220679 24559 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:37.243054 23818 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:37.241534 23923 rpcz_store.cc:276] 0709 12:21:34.114777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.370769 (+255992us) service_pool.cc:224] Handling call
0709 12:21:35.009573 (+638804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.019787 (+ 10214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.215321 (+2195534us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54002792d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:37.225793 (+ 10472us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468204288}
I20260709 12:21:37.245041 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.248202 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.249007 23920 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:37.248205 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.250291 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.250837 23995 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:37.251171 23922 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
W20260709 12:21:37.265122 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 74070.1us
I20260709 12:21:37.267163 24524 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:37.268282 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.273305 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.274256 23999 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:37.275254 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.275904 23995 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
W20260709 12:21:37.275939 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44995.7us
I20260709 12:21:37.276997 23892 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:37.220165 27278 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.273195 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:37.281895 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.279882 23892 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:37.282557 23995 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:37.282437 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:37.231931 27524 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:37.282358 23849 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:37.283857 23892 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:37.246433 27545 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:37.234772 27435 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:37.292341 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.293893 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.292198 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.294499 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.294842 23925 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:37.293350 24001 raft_consensus.cc:2393] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:37.253988 27451 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:37.299540 23818 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:37.298911 24525 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:37.301208 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.275171 27048 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:37.279206 27313 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.310765 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.271015 27491 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:37.364020 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 80244us
I20260709 12:21:37.282939 27529 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:37.289829 27277 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:37.281248 26910 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:37.395773 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.396925 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.397554 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:37.291327 27511 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11.
I20260709 12:21:37.293435 27532 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:37.400094 23926 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:37.400102 23999 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:37.411415 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.412369 23995 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:37.304535 27451 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.412369 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:37.413574 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 146504us
I20260709 12:21:37.414688 24524 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:37.415658 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36570 (request call id 699) took 1067 ms. Trace:
I20260709 12:21:37.368081 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.432933 23925 raft_consensus.cc:2410] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:21:37.413775 23851 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:37.416240 24561 rpcz_store.cc:276] 0709 12:21:36.336132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.354465 (+ 18333us) service_pool.cc:224] Handling call
0709 12:21:37.403031 (+1048566us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54005a46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:37.403247 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641555328}
I20260709 12:21:37.365223 27054 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:37.367606 27545 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:37.406068 27540 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:21:37.297175 27278 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:37.411609 27532 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.399267 27277 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:37.452726 27186 consensus_meta.cc:287] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.004s
I20260709 12:21:37.542930 26910 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:37.549947 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.407074 23748 catalog_manager.cc:5697] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 6 to 8, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 8 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.553647 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.554773 27548 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:37.519526 27435 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:21:37.370590 27491 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:37.303498 27524 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:37.706130 23929 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:37.646057 27532 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:37.641937 23998 consensus_meta.cc:287] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.002s
I20260709 12:21:37.740638 23998 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:37.451483 27451 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:37.635357 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:37.666111 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.513567 27054 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.743249 23925 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:37.702678 23996 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:37.706451 23853 raft_consensus.cc:2410] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:37.755868 23851 raft_consensus.cc:2410] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:21:37.760212 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.761174 23998 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:37.772372 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.759773 27224 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.778286 27224 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:37.778765 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:37.780614 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.783648 27278 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:37.784675 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:37.785342 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.786509 23996 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:37.787918 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:37.790321 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.791875 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:37.792572 23998 raft_consensus.cc:2376] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9. Re-sending same reply.
I20260709 12:21:37.789615 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.796599 23996 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:37.698176 27565 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:37.703235 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 291591us
I20260709 12:21:37.640226 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:37.660483 27277 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:37.808008 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:37.738026 27529 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:37.826540 23851 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:37.724210 27548 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.834470 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:37.835402 23925 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:37.835623 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.814503 24558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36570 (request call id 692) took 1484 ms. Trace:
I20260709 12:21:37.815528 24556 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:21:37.817734 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:37.738485 27491 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:37.763748 27048 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:37.754885 27054 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:37.836853 24558 rpcz_store.cc:276] 0709 12:21:36.330435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.331410 (+   975us) service_pool.cc:224] Handling call
0709 12:21:37.814224 (+1482814us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b54004cf4d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:37.814397 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50020096}
I20260709 12:21:37.842427 27548 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:37.856083 24002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.008s
I20260709 12:21:37.856458 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:37.710842 23926 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:37.725426 26910 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:37.856492 24002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.000s	sys 0.008s
I20260709 12:21:37.999683 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.857378 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:37.875633 23818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.012s
I20260709 12:21:37.857658 23847 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:38.006531 23998 raft_consensus.cc:2410] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:21:38.006682 23818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.000s	sys 0.020s
I20260709 12:21:37.925518 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:38.007115 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 706214us
I20260709 12:21:38.007314 23925 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:38.007864 23818 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:38.013945 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:38.013967 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:38.015575 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:37.834648 27536 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:38.020061 24004 raft_consensus.cc:1240] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:37.847141 27514 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.006s	sys 0.002s
W20260709 12:21:37.855978 27563 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:21:37.856813 27373 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:37.972270 27564 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.430s	user 0.000s	sys 0.002s
I20260709 12:21:37.858204 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:37.995759 27511 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:37.843050 27048 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:38.027371 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:38.030670 23845 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:37.994477 27477 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:38.028141 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:38.033216 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:38.011854 27524 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:38.022954 27514 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.010s	sys 0.004s
I20260709 12:21:38.034854 23845 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:38.035458 23925 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:38.035593 24004 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:38.036751 24003 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:38.042392 24003 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:38.043061 26910 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:38.043478 24003 raft_consensus.cc:1217] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Deduplicated request from leader. Original: 6.3->[7.4-7.4]   Dedup: 7.4->[]
I20260709 12:21:38.043972 24003 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:21:38.045025 24003 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:38.023130 27352 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.007s	sys 0.004s
I20260709 12:21:37.847368 27323 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.180s
I20260709 12:21:38.026329 27523 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:38.023823 27373 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.014760 27054 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:37.998486 27529 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:37.856578 27545 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:38.593250 27590 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:38.566323 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:38.553465 27230 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:38.596160 23920 raft_consensus.cc:2410] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:21:38.595418 27590 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:38.583386 27584 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.388929 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1992) took 1161 ms. Trace:
I20260709 12:21:38.075270 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:38.265659 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:38.179440 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 663) took 2016 ms. Trace:
I20260709 12:21:38.148166 23847 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:21:38.575778 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2007) took 1273 ms. Trace:
I20260709 12:21:38.275269 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1957) took 1090 ms. Trace:
I20260709 12:21:38.514639 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:38.076771 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:38.547595 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:38.601352 23929 rpcz_store.cc:276] 0709 12:21:37.185093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.186028 (+   935us) service_pool.cc:224] Handling call
0709 12:21:38.275093 (+1089065us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54000e6854. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:38.275211 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110204160}
W20260709 12:21:38.499418 24525 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.008s	sys 0.037s
I20260709 12:21:38.098510 23846 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:38.179204 24557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 794) took 1179 ms. Trace:
I20260709 12:21:37.921810 23748 catalog_manager.cc:5697] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:38.602808 24525 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.008s	sys 0.039s
I20260709 12:21:38.600384 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2194) took 1327 ms. Trace:
W20260709 12:21:38.606688 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 696478us
I20260709 12:21:38.606848 23847 rpcz_store.cc:276] 0709 12:21:37.272498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.015314 (+742816us) service_pool.cc:224] Handling call
0709 12:21:38.600258 (+584944us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:38.181597 23853 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 401) took 1819 ms (client timeout 1914 ms). Trace:
I20260709 12:21:38.263733 24560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 789) took 1657 ms. Trace:
I20260709 12:21:38.403105 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:38.610437 23849 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:38.597390 23996 rpcz_store.cc:276] 0709 12:21:37.227595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.804868 (+577273us) service_pool.cc:224] Handling call
0709 12:21:38.022488 (+217620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.022716 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:38.045756 (+ 23040us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.388416 (+342660us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:38.388496 (+    80us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:38.388582 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.388674 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.388846 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92451,"prepare.queue_time_us":30017,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":306134,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":146,"thread_start_us":238085,"threads_started":1}
I20260709 12:21:38.597957 23845 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:38.610031 24560 rpcz_store.cc:276] 0709 12:21:36.606720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.759755 (+153035us) service_pool.cc:224] Handling call
0709 12:21:36.760056 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.906899 (+146843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:36.906934 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.906985 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:36.907018 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.263402 (+1356384us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400466c54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:38.263486 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.263656 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337222528}
I20260709 12:21:38.612427 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1939) took 1373 ms. Trace:
I20260709 12:21:38.612926 23845 rpcz_store.cc:276] 0709 12:21:37.238545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.040666 (+802121us) service_pool.cc:224] Handling call
0709 12:21:38.612363 (+571697us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.281275 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 697) took 1945 ms. Trace:
W20260709 12:21:38.603296 23846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2203) took 1315 ms (client timeout 1693 ms). Trace:
W20260709 12:21:38.615036 23846 rpcz_store.cc:269] 0709 12:21:37.287453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.829236 (+541783us) service_pool.cc:224] Handling call
0709 12:21:38.603226 (+773990us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.615892 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:38.616611 23847 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:38.616710 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:38.056936 24524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.004s	sys 0.019s
W20260709 12:21:38.618216 24524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.014s	sys 0.040s
W20260709 12:21:38.619155 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 1.20444e+06us
I20260709 12:21:38.621191 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:38.122968 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:38.570044 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:38.600441 24003 rpcz_store.cc:276] 0709 12:21:37.302504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.044596 (+742092us) service_pool.cc:224] Handling call
0709 12:21:38.044859 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.045332 (+   473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.575679 (+530347us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.571945 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:38.599126 24002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.008s	sys 0.004s
I20260709 12:21:38.211114 24000 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:38.623740 24002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.008s	sys 0.004s
W20260709 12:21:38.520741 24563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.005s	sys 0.008s
I20260709 12:21:38.604872 23927 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:38.624454 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1895) took 1644 ms. Trace:
W20260709 12:21:38.624738 24563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.006s	sys 0.009s
W20260709 12:21:38.593761 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 399701us
W20260709 12:21:38.262347 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.594871 27373 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:38.595425 27523 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.602228 23850 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:38.639830 27523 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:38.600030 24555 rpcz_store.cc:276] 0709 12:21:36.174812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.176051 (+  1239us) service_pool.cc:224] Handling call
0709 12:21:36.184259 (+  8208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:36.920215 (+735956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.179112 (+1258897us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b540053f2d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:38.179362 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682933632}
W20260709 12:21:38.172619 27520 log.cc:927] Time spent T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 2.049s	user 0.009s	sys 0.022s
I20260709 12:21:38.613960 24556 rpcz_store.cc:276] 0709 12:21:36.335629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.366953 (+ 31324us) service_pool.cc:224] Handling call
0709 12:21:37.815140 (+1448187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.838016 (+ 22876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.281003 (+442987us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54004cf4d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:38.281192 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3329659648}
W20260709 12:21:38.262584 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 254795us
I20260709 12:21:38.954555 27600 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.954949 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:38.955240 27600 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:38.957078 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:38.596581 27054 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:38.624874 24002 rpcz_store.cc:276] 0709 12:21:36.980222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.000310 (+ 20088us) service_pool.cc:224] Handling call
0709 12:21:37.018359 (+ 18049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:37.018577 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:37.278196 (+259619us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.624145 (+1345949us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:38.624198 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:38.624248 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.624310 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.624403 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":444822,"prepare.run_cpu_time_us":5301,"prepare.run_wall_time_us":78281,"raft.queue_time_us":17775,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":5908,"thread_start_us":1604712,"threads_started":3,"wal-append.queue_time_us":1330151}
W20260709 12:21:38.086041 27563 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:21:38.594036 27352 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.538s	user 0.007s	sys 0.040s
I20260709 12:21:38.959599 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 393) took 2030 ms. Trace:
I20260709 12:21:38.959991 27352 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:38.960662 27352 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:38.275063 27546 consensus_meta.cc:287] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.286s	user 0.009s	sys 0.003s
I20260709 12:21:38.623777 23999 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:38.622452 24004 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:38.962172 27546 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:38.084434 27313 consensus_meta.cc:287] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.000s
I20260709 12:21:38.963253 27313 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:38.964831 27546 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:38.330824 23851 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
W20260709 12:21:38.966231 23851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2204) took 1678 ms (client timeout 1625 ms). Trace:
W20260709 12:21:38.966727 23851 rpcz_store.cc:269] 0709 12:21:37.287778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.801488 (+513710us) service_pool.cc:224] Handling call
0709 12:21:38.966127 (+1164639us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.968003 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:38.968814 23851 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:38.969355 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2210) took 1671 ms. Trace:
W20260709 12:21:38.609340 23853 rpcz_store.cc:269] 0709 12:21:36.362685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.379529 (+ 16844us) service_pool.cc:224] Handling call
0709 12:21:38.181312 (+1801783us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002fb7d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:38.181518 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2635494272}
I20260709 12:21:38.970674 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:38.971532 23853 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:21:38.972060 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2207) took 1683 ms. Trace:
I20260709 12:21:38.972386 23853 rpcz_store.cc:276] 0709 12:21:37.288960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.970302 (+1681342us) service_pool.cc:224] Handling call
0709 12:21:38.972008 (+  1706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.603210 24557 rpcz_store.cc:276] 0709 12:21:37.000298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.088391 (+ 88093us) service_pool.cc:224] Handling call
0709 12:21:37.088788 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.089276 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.089320 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.113954 (+ 24634us) log.cc:844] Serialized 26 byte log entry
0709 12:21:37.281471 (+167517us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:37.281514 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.281585 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.178914 (+897329us) raft_consensus.cc:1685] finished
0709 12:21:38.178937 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.179103 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3127,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":65879,"thread_start_us":70628,"threads_started":1,"wal-append.queue_time_us":358734}
I20260709 12:21:38.611323 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1942) took 1371 ms. Trace:
I20260709 12:21:38.632159 23847 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
W20260709 12:21:38.974433 23847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2200) took 1688 ms (client timeout 2148 ms). Trace:
W20260709 12:21:38.974855 23847 rpcz_store.cc:269] 0709 12:21:37.286478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.615607 (+1329129us) service_pool.cc:224] Handling call
0709 12:21:38.974368 (+358761us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.975564 27322 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:38.976016 27322 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.976110 23847 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:38.976424 27322 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:38.976897 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1938) took 1738 ms. Trace:
I20260709 12:21:38.977284 23847 rpcz_store.cc:276] 0709 12:21:37.238305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.975563 (+1737258us) service_pool.cc:224] Handling call
0709 12:21:38.975885 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:38.976629 (+   744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.976842 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.978133 27455 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:38.978734 27455 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.978897 23847 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:38.979241 27455 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:38.979592 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1943) took 1739 ms. Trace:
I20260709 12:21:38.979964 23847 rpcz_store.cc:276] 0709 12:21:37.240091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.978270 (+1738179us) service_pool.cc:224] Handling call
0709 12:21:38.978574 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.979347 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.979539 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.981351 23847 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:38.206187 27224 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:38.611838 27055 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.974162 23849 rpcz_store.cc:276] 0709 12:21:37.239870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.387715 (+1147845us) service_pool.cc:224] Handling call
0709 12:21:38.611247 (+223532us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.633567 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1932) took 1396 ms. Trace:
I20260709 12:21:38.633812 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:38.983390 23849 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:38.984102 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2197) took 1699 ms. Trace:
I20260709 12:21:38.984445 23849 rpcz_store.cc:276] 0709 12:21:37.284886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.982750 (+1697864us) service_pool.cc:224] Handling call
0709 12:21:38.983050 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.983863 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.984048 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.636421 23817 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:38.608644 27527 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.007s	sys 0.007s
I20260709 12:21:38.986799 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2198) took 1700 ms. Trace:
W20260709 12:21:38.986971 27527 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.007s	sys 0.007s
W20260709 12:21:38.606371 27277 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.764s	user 0.013s	sys 0.000s
I20260709 12:21:38.636801 23748 catalog_manager.cc:5697] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 3 to 7, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 7 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.988206 27277 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:38.275722 27491 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:38.991011 27277 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:38.991441 27491 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:38.670740 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2205) took 1382 ms. Trace:
I20260709 12:21:38.268791 27269 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:38.674568 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:38.992149 23997 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:21:38.993283 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:38.279910 27452 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:38.257380 27451 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:38.204969 27522 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:38.611961 27280 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:38.995672 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2196) took 1702 ms. Trace:
I20260709 12:21:38.992180 23846 rpcz_store.cc:276] 0709 12:21:37.288302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.616143 (+1327841us) service_pool.cc:224] Handling call
0709 12:21:38.670674 (+ 54531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.996279 23847 rpcz_store.cc:276] 0709 12:21:37.279487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.980715 (+1701228us) service_pool.cc:224] Handling call
0709 12:21:38.981014 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.981657 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.981845 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.997188 27280 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:38.677627 27562 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.921s	user 0.004s	sys 0.000s
W20260709 12:21:38.678619 27548 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.833s	user 0.012s	sys 0.000s
I20260709 12:21:38.998909 23923 raft_consensus.cc:2368] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10.
I20260709 12:21:38.998459 27548 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.000272 23847 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:21:39.000874 27548 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.001024 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2142) took 1085 ms. Trace:
I20260709 12:21:38.053089 27560 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:39.001399 23969 leader_election.cc:336] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 1.789s (SENT)
I20260709 12:21:38.260651 27186 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:38.680684 23893 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:38.759979 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:38.644491 27478 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.001823 27560 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:38.628940 27592 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.959992 23921 rpcz_store.cc:276] 0709 12:21:36.929158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.982322 (+ 53164us) service_pool.cc:224] Handling call
0709 12:21:36.986056 (+  3734us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:36.991064 (+  5008us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:37.036986 (+ 45922us) log.cc:844] Serialized 14 byte log entry
0709 12:21:37.275579 (+238593us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:37.280844 (+  5265us) log.cc:844] Serialized 52 byte log entry
0709 12:21:37.281023 (+   179us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:37.281064 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.281134 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.959350 (+1678216us) raft_consensus.cc:1685] finished
0709 12:21:38.959370 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.959534 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42122,"prepare.queue_time_us":45891,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":34586,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":21475,"thread_start_us":176504,"threads_started":1,"wal-append.queue_time_us":344961}
I20260709 12:21:39.004343 27592 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.005105 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:38.165385 27048 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.002621 23845 raft_consensus.cc:2368] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:21:39.006296 27048 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:39.006377 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2202) took 1719 ms. Trace:
I20260709 12:21:39.006815 23845 rpcz_store.cc:276] 0709 12:21:37.287155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.628272 (+1341117us) service_pool.cc:224] Handling call
0709 12:21:39.006309 (+378037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.614708 27584 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:38.788617 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.008462 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2135) took 1156 ms. Trace:
I20260709 12:21:39.008800 23924 rpcz_store.cc:276] 0709 12:21:37.852226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.758461 (+906235us) service_pool.cc:224] Handling call
0709 12:21:39.008400 (+249939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.010097 23925 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:38.997740 27280 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:38.836377 27520 log.cc:927] Time spent T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:21:39.002187 27186 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.009757 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.018537 27548 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:38.982687 23854 rpcz_store.cc:276] 0709 12:21:37.236770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.239002 (+  2232us) service_pool.cc:224] Handling call
0709 12:21:37.274473 (+ 35471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.290984 (+ 16511us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:37.362360 (+ 71376us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.256732 (+894372us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b1800001d20. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa28b32058f 00007fa28435f571 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd
0709 12:21:38.261087 (+  4355us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.262340 (+  1253us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:38.262815 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:21:38.262969 (+   154us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:38.263190 (+   221us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.556118 (+292928us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b1800001d20. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:38.633130 (+ 77012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.633233 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.633287 (+    54us) raft_consensus.cc:1685] finished
0709 12:21:38.633310 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.633483 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":956591,"prepare.queue_time_us":663301,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":103,"raft.queue_time_us":928504,"raft.run_cpu_time_us":491,"raft.run_wall_time_us":64807,"spinlock_wait_cycles":83303040,"thread_start_us":262538,"threads_started":1,"wal-append.queue_time_us":520011}
I20260709 12:21:38.998306 23818 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:38.749226 27230 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:38.645860 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:39.021728 27491 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:39.021582 27230 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:38.923354 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1934) took 1686 ms. Trace:
I20260709 12:21:39.024143 23848 rpcz_store.cc:276] 0709 12:21:37.237301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.239148 (+  1847us) service_pool.cc:224] Handling call
0709 12:21:37.255183 (+ 16035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.255662 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.255710 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.256321 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 12:21:37.700627 (+444306us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:37.700684 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.700768 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.923078 (+1222310us) raft_consensus.cc:1685] finished
0709 12:21:38.923105 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.923272 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10024,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7804,"thread_start_us":334293,"threads_started":1,"wal-append.queue_time_us":1286123}
I20260709 12:21:38.191705 27495 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.026700 27491 raft_consensus.cc:697] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:39.026664 27495 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.027869 27491 consensus_queue.cc:237] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.030437 23818 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:39.035077 27230 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:39.035108 27592 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:39.037071 27495 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:39.037773 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 392189us
I20260709 12:21:38.989130 23748 catalog_manager.cc:5697] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 5, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 5 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.041416 23748 catalog_manager.cc:5697] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.924247 23850 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
W20260709 12:21:39.048451 23850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2201) took 1761 ms (client timeout 2107 ms). Trace:
W20260709 12:21:39.048864 23850 rpcz_store.cc:269] 0709 12:21:37.286838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.547219 (+1260381us) service_pool.cc:224] Handling call
0709 12:21:39.048384 (+501165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.049747 27556 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:38.926869 27532 consensus_meta.cc:287] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.150s	user 0.013s	sys 0.004s
I20260709 12:21:39.050848 27186 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:38.930260 27591 log.cc:927] Time spent T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.344s	user 0.000s	sys 0.002s
I20260709 12:21:38.935717 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:39.052735 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2139) took 1160 ms. Trace:
I20260709 12:21:39.053189 23922 rpcz_store.cc:276] 0709 12:21:37.892901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.935374 (+1042473us) service_pool.cc:224] Handling call
0709 12:21:39.052670 (+117296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.052546 23748 catalog_manager.cc:5697] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 5 to 6, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 6 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.054216 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.054853 23922 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:39.055404 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2140) took 1141 ms. Trace:
I20260709 12:21:39.054646 23748 catalog_manager.cc:5697] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 3, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:39.055697 23922 rpcz_store.cc:276] 0709 12:21:37.914674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.053910 (+1139236us) service_pool.cc:224] Handling call
0709 12:21:39.055350 (+  1440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.056733 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:39.057562 23922 raft_consensus.cc:2393] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:38.937494 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.057266 23925 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:39.058619 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2147) took 1066 ms. Trace:
I20260709 12:21:39.058727 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2141) took 1143 ms. Trace:
I20260709 12:21:39.059113 23929 rpcz_store.cc:276] 0709 12:21:37.992213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.937178 (+944965us) service_pool.cc:224] Handling call
0709 12:21:39.058548 (+121370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.060511 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:38.986486 27224 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:38.987236 23849 rpcz_store.cc:276] 0709 12:21:37.285724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.985253 (+1699529us) service_pool.cc:224] Handling call
0709 12:21:38.985550 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.985723 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.985751 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:38.985795 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:38.985860 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.986071 (+   211us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.986223 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.062172 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2144) took 1117 ms. Trace:
I20260709 12:21:38.982312 27055 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.064400 27055 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.003098 27478 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.067380 27478 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:38.862963 27580 log.cc:927] Time spent T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:21:39.038692 23893 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:39.042659 27451 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.068501 23929 rpcz_store.cc:276] 0709 12:21:37.945123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.060167 (+1115044us) service_pool.cc:224] Handling call
0709 12:21:39.062104 (+  1937us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.049839 27590 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:39.073664 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.050477 27556 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.050586 27532 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:38.995303 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1889) took 2047 ms. Trace:
I20260709 12:21:39.075304 23926 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:38.969667 23851 rpcz_store.cc:276] 0709 12:21:37.297989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.967651 (+1669662us) service_pool.cc:224] Handling call
0709 12:21:38.969296 (+  1645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.075117 23997 rpcz_store.cc:276] 0709 12:21:36.947901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.985685 (+ 37784us) service_pool.cc:224] Handling call
0709 12:21:36.986118 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:38.992631 (+2006513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.994961 (+  2330us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b540034b054. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:38.995185 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4552267648}
I20260709 12:21:39.059187 23925 rpcz_store.cc:276] 0709 12:21:37.915310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.992979 (+1077669us) service_pool.cc:224] Handling call
0709 12:21:39.058666 (+ 65687us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:38.939687 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:39.077368 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:39.077858 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.078537 27495 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.079049 27495 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.080210 27506 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:39.081305 27495 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.069204 23893 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:39.083316 27578 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:39.084542 23893 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:39.085084 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.085821 23921 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:39.085927 23893 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:39.086407 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2150) took 1038 ms. Trace:
I20260709 12:21:39.086768 27323 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:39.087199 23893 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:39.087462 27323 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:39.045979 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 409676us
I20260709 12:21:39.001446 23923 rpcz_store.cc:276] 0709 12:21:37.915807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.514271 (+598464us) service_pool.cc:224] Handling call
0709 12:21:39.000809 (+486538us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54003ce454. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:39.000962 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":910752512}
I20260709 12:21:39.090260 27548 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:39.090401 23817 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:39.090663 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:39.091288 27495 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:39.091810 27495 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:38.921927 27579 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.154s	user 0.000s	sys 0.005s
I20260709 12:21:39.090802 27548 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:39.080806 27506 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.092675 27055 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:39.089727 23893 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:39.086860 23921 rpcz_store.cc:276] 0709 12:21:38.048485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.084711 (+1036226us) service_pool.cc:224] Handling call
0709 12:21:39.086348 (+  1637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.092211 27495 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:39.094097 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:39.101472 23852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1921) took 2462 ms (client timeout 2048 ms). Trace:
I20260709 12:21:39.156054 23925 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:21:39.155747 23852 rpcz_store.cc:269] 0709 12:21:36.640913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.641213 (+   300us) service_pool.cc:224] Handling call
0709 12:21:39.101205 (+2459992us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54001b2bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:39.101360 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4435885824}
I20260709 12:21:39.104835 23920 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:21:39.000914 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2206) took 1712 ms. Trace:
I20260709 12:21:38.985342 27373 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:38.928381 27595 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:39.110827 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 80520.4us
I20260709 12:21:39.113662 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:39.162603 23966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.011s	sys 0.012s
W20260709 12:21:39.162983 23966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.011s	sys 0.012s
W20260709 12:21:39.161265 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 209697us
I20260709 12:21:39.114276 23929 raft_consensus.cc:2393] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:39.114805 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.069550 27478 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:39.076478 27532 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.115518 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1967) took 1926 ms. Trace:
I20260709 12:21:39.116163 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.057215 23748 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 5, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 5 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.118441 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:38.758322 27521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.014s	sys 0.038s
W20260709 12:21:38.924309 27576 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.102s	user 0.001s	sys 0.006s
W20260709 12:21:38.925379 27577 log.cc:927] Time spent T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.163s	user 0.001s	sys 0.007s
I20260709 12:21:39.128058 23817 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:38.951538 27523 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:39.114526 27274 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:39.142338 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:39.144039 24557 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:39.146015 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.157063 23847 rpcz_store.cc:276] 0709 12:21:37.288633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.997147 (+1708514us) service_pool.cc:224] Handling call
0709 12:21:38.999943 (+  2796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.000657 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.000850 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.157032 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2134) took 1305 ms. Trace:
I20260709 12:21:39.160265 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2148) took 1148 ms. Trace:
W20260709 12:21:39.162084 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 517174us
I20260709 12:21:39.166150 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:39.167321 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:39.198942 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 70987.4us
I20260709 12:21:39.199402 23996 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:39.173317 24554 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:39.175947 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:39.201241 23817 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:39.174542 23922 rpcz_store.cc:276] 0709 12:21:37.189535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.056444 (+1866909us) service_pool.cc:224] Handling call
0709 12:21:39.115453 (+ 59009us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.202198 24560 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:39.185025 23920 rpcz_store.cc:276] 0709 12:21:37.851902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.615487 (+763585us) service_pool.cc:224] Handling call
0709 12:21:39.156966 (+541479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.185168 23925 rpcz_store.cc:276] 0709 12:21:38.011602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.093796 (+1082194us) service_pool.cc:224] Handling call
0709 12:21:39.160200 (+ 66404us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.188035 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.208935 24559 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:39.182489 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:39.173341 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2146) took 1210 ms. Trace:
I20260709 12:21:39.215268 23929 rpcz_store.cc:276] 0709 12:21:37.962789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.073353 (+1110564us) service_pool.cc:224] Handling call
0709 12:21:39.173265 (+ 99912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.190336 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.191123 24556 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
W20260709 12:21:39.218784 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 129138us
I20260709 12:21:39.219570 23893 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:39.192509 24524 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:39.190577 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:39.232273 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 68610.4us
I20260709 12:21:39.232630 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.144488 27548 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:39.233572 24561 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:39.231964 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.239866 23817 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:39.235443 24524 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:39.234943 23820 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.013s	sys 0.000s
I20260709 12:21:39.236258 23924 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:39.143173 27452 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:39.275166 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.277756 24524 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:39.178856 27521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.440s	user 0.017s	sys 0.043s
I20260709 12:21:39.243021 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:39.246762 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.153084 27568 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:39.289672 23925 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
W20260709 12:21:39.290839 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 100350us
W20260709 12:21:39.242327 23820 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.014s	sys 0.000s
I20260709 12:21:39.288086 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:39.291752 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 1998) took 2062 ms. Trace:
I20260709 12:21:39.289520 24559 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:39.288137 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.293803 24555 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:39.173532 27478 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.299547 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:39.291821 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:39.307426 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:39.236196 27529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.009s	sys 0.004s
I20260709 12:21:39.167081 27230 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:39.163779 27581 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:39.221197 27516 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:39.232523 27186 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:39.166157 27545 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:39.303452 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:39.231884 27313 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:39.166807 27592 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:39.314785 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.295959 27323 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:39.316505 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.339563 23920 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:39.234452 27523 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:39.244558 27532 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:39.345216 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 105442us
I20260709 12:21:39.269418 27193 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:39.325783 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:39.374102 24002 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:39.325819 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:39.327044 24001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.037s	sys 0.045s
W20260709 12:21:39.375408 24001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.037s	sys 0.046s
I20260709 12:21:39.296703 27565 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:39.328986 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 109506us
I20260709 12:21:39.329496 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:39.380688 24000 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:39.330886 24003 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:39.381975 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:39.311846 27478 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:39.335119 23966 leader_election.cc:400] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10.
I20260709 12:21:39.384864 23966 leader_election.cc:403] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:21:39.385895 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.346060 27599 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:39.313973 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.303293 27590 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:39.387516 23925 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
W20260709 12:21:39.335702 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 704419us
I20260709 12:21:39.331863 27230 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.221016 27595 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:39.325076 27529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.010s	sys 0.005s
I20260709 12:21:39.243489 27274 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:39.332978 27606 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:21:39.352291 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1978) took 1954 ms. Trace:
I20260709 12:21:39.178095 23748 catalog_manager.cc:5697] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 3 to 7, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 7 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:39.349673 27322 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.359310 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:39.333514 27313 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.367290 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:39.344751 27532 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.280104 27451 raft_consensus.cc:2764] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:39.359589 27578 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:39.391207 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 56274.3us
I20260709 12:21:39.391947 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:39.444114 24002 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 3.
W20260709 12:21:39.447608 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 173703us
I20260709 12:21:39.396731 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:39.454293 24000 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:39.391655 27506 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.400279 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.330848 27581 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.341542 27592 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.482784 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.483841 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:39.337018 27545 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.378611 27565 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.343904 27280 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.403638 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1981) took 1644 ms. Trace:
I20260709 12:21:39.404615 23922 rpcz_store.cc:276] 0709 12:21:37.398195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.334328 (+1936133us) service_pool.cc:224] Handling call
0709 12:21:39.351758 (+ 17430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.351951 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.351979 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.352022 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:39.352053 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.352106 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.352238 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.342002 27516 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:39.406810 27373 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.406371 27274 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.408811 24559 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:39.390216 27599 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:39.419063 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 51916.3us
I20260709 12:21:39.389196 27590 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:39.420140 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 142518us
I20260709 12:21:39.403434 27323 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:39.441169 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2008) took 2075 ms. Trace:
I20260709 12:21:39.350163 27523 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.444164 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:39.426036 27532 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:39.441152 27626 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:39.519047 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:39.517756 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:39.520574 23925 rpcz_store.cc:276] 0709 12:21:37.759151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.388770 (+1629619us) service_pool.cc:224] Handling call
0709 12:21:39.403121 (+ 14351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.403305 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.403331 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.403373 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:39.403410 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.403462 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.403585 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.488554 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.487517 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.527904 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:39.492895 24563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 792) took 2656 ms. Trace:
I20260709 12:21:39.488077 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.528771 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.529973 23847 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:39.486678 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.523288 23817 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:39.524538 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.485698 23995 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:39.400602 27521 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:21:39.402117 27455 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.528051 23849 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:39.528448 24563 rpcz_store.cc:276] 0709 12:21:36.836395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.053784 (+217389us) service_pool.cc:224] Handling call
0709 12:21:37.403447 (+349663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:37.403748 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:37.949195 (+545447us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.078878 (+1129683us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b18004628e0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa284361a40 00007fa28435c4e4 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287 00007fa287467208
0709 12:21:39.270425 (+191547us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.270496 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:39.270557 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.270635 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.492588 (+221953us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54005a46d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:39.492771 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18420,"prepare.queue_time_us":585539,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":459014,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":862178304,"thread_start_us":1350701,"threads_started":3,"wal-append.queue_time_us":632516}
I20260709 12:21:39.494139 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.531409 24559 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:39.486184 23850 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:21:39.400944 27055 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:21:39.431628 27313 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:39.528569 24001 rpcz_store.cc:276] 0709 12:21:37.366160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.055475 (+689315us) service_pool.cc:224] Handling call
0709 12:21:38.055858 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.056130 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:38.599478 (+543348us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.436811 (+837333us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.437011 (+   200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.437062 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:39.437115 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.440967 (+  3852us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.441105 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21955,"prepare.queue_time_us":170134,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":118,"raft.queue_time_us":475,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3351,"thread_start_us":1284988,"threads_started":3,"wal-append.queue_time_us":810782}
I20260709 12:21:39.533427 24555 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
W20260709 12:21:39.535179 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 94601us
I20260709 12:21:39.548683 23893 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:39.531327 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.550287 23848 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:39.551494 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.551880 27568 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:39.552337 27568 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:39.552697 27568 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:39.553025 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:39.555060 23848 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:39.555423 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.547871 23850 pending_rounds.cc:85] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 8
I20260709 12:21:39.556351 23850 pending_rounds.cc:107] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:21:39.556782 23850 raft_consensus.cc:2889] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:39.556921 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.558699 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.558768 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:39.560576 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:39.442890 27560 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:39.471256 27546 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:39.564348 23850 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:21:39.564927 23852 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:21:39.526252 27601 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:21:39.568921 24554 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:39.575014 24003 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:39.519272 27193 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:39.585575 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.518230 27590 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:39.586061 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 136810us
I20260709 12:21:39.583046 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.533416 27565 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:39.587328 23850 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:39.598268 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:39.599027 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:39.599411 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:39.587261 23895 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:39.525127 27599 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:39.602417 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2199) took 2316 ms. Trace:
I20260709 12:21:39.602809 23846 rpcz_store.cc:276] 0709 12:21:37.286059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.996689 (+1710630us) service_pool.cc:224] Handling call
0709 12:21:38.997089 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:38.997505 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.997539 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.032774 (+ 35235us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.110024 (+ 77250us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:39.110071 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.110145 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.602180 (+492035us) raft_consensus.cc:1685] finished
0709 12:21:39.602199 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.602359 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":76727,"threads_started":1,"wal-append.queue_time_us":77129}
I20260709 12:21:39.532575 27578 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:39.596830 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:39.605212 23849 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:39.605355 27269 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:39.554275 27054 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.554491 27491 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:39.602818 23848 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:21:39.446455 27616 consensus_queue.cc:1059] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 12:21:39.607018 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1962) took 2419 ms. Trace:
I20260709 12:21:39.568262 27506 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:39.608829 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:39.518148 27277 consensus_queue.cc:1059] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:21:39.612124 23852 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:39.581590 27529 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:39.613654 27605 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:21:39.615139 27455 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.618014 27352 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:39.605958 27269 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:39.470665 27613 consensus_queue.cc:1059] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.171s
I20260709 12:21:39.622888 27230 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:39.623065 27545 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:39.622658 27491 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.624020 27322 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.606824 23748 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 4 to 6, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 6 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:39.625663 27589 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 1.043s	user 0.001s	sys 0.002s
I20260709 12:21:39.613423 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1982) took 1780 ms. Trace:
I20260709 12:21:39.567778 27615 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:39.577621 27617 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:39.633710 23849 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
W20260709 12:21:39.667230 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 118650us
W20260709 12:21:39.666309 23736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8630b76482c543a2a08e289b32b13ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 22996f888daf435398b693481171c18c (127.22.43.65:34895) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:21:39.730794 23736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 64571.9us
I20260709 12:21:39.672571 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:21:39.730882 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:39.731573 23852 raft_consensus.cc:606] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:39.664551 27269 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:39.673333 27478 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:39.675693 27596 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 12:21:39.676493 27598 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:21:39.626988 27054 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.677778 27280 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.679626 27613 raft_consensus.cc:3055] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:39.752482 27613 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:39.753384 27313 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.755460 27592 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:39.755626 27313 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.756474 27491 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:39.757238 23820 leader_election.cc:336] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 2.100s (SENT)
I20260709 12:21:39.759403 23927 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:21:39.682551 27604 log.cc:927] Time spent T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:21:39.292335 23998 rpcz_store.cc:276] 0709 12:21:37.229240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.016777 (+787537us) service_pool.cc:224] Handling call
0709 12:21:38.017069 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.017275 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:38.028685 (+ 11410us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.932006 (+903321us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b18003b5f60. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a 00007fa287456a2a
0709 12:21:39.291201 (+359195us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.291397 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.291446 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:39.291493 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.291560 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.291693 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139730,"prepare.queue_time_us":11280,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4790,"raft.queue_time_us":1115,"spinlock_wait_cycles":6916992,"thread_start_us":313518,"threads_started":1}
W20260709 12:21:39.688637 23926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2136) took 1836 ms (client timeout 1507 ms). Trace:
I20260709 12:21:39.689903 27277 raft_consensus.cc:3055] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:39.690397 27373 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:39.700351 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.612331 27560 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:39.708657 24000 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:39.717278 23850 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:39.725303 23922 rpcz_store.cc:276] 0709 12:21:37.830894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.608470 (+1777576us) service_pool.cc:224] Handling call
0709 12:21:39.611026 (+  2556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.611223 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.611249 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.611289 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:39.611324 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.611375 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.611475 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.737998 27581 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.736583 23852 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:39.720177 27230 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:39.775939 23847 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:39.699944 27506 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.659864 27629 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:39.749383 27594 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 1.159s	user 0.010s	sys 0.000s
W20260709 12:21:39.750053 27495 consensus_meta.cc:287] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.005s
I20260709 12:21:39.750392 27478 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.750964 23748 catalog_manager.cc:5697] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 4 to 7, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 7 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:39.760438 23820 leader_election.cc:336] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 3.284s (SENT)
I20260709 12:21:39.770967 27373 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:39.792663 23748 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 3 to 5, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 5 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:39.793897 27614 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:39.794056 27373 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.795312 27373 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:39.794680 23748 catalog_manager.cc:5697] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 4 to 8, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 8 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:39.796270 23748 catalog_manager.cc:5697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 6, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 6 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:21:39.768975 23926 rpcz_store.cc:269] 0709 12:21:37.852519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.013602 (+161083us) service_pool.cc:224] Handling call
0709 12:21:39.688404 (+1674802us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540005f854. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:39.688565 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437851392}
I20260709 12:21:39.780067 23922 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:39.779804 23850 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:21:39.780407 27491 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.780104 27230 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.785992 27506 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.806876 27491 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.810097 23748 catalog_manager.cc:5697] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 2 to 7, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 7 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:39.782924 27629 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:39.813283 27629 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:39.770705 27277 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:39.753415 27613 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.790038 27495 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.795130 27451 consensus_queue.cc:1059] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:39.803514 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2132) took 1952 ms. Trace:
I20260709 12:21:39.853044 23922 rpcz_store.cc:276] 0709 12:21:37.851244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.774497 (+1923253us) service_pool.cc:224] Handling call
0709 12:21:39.778529 (+  4032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.803239 (+ 24710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.803459 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.658907 27529 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:39.788038 27054 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.733795 27615 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.851053 23850 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:39.852458 23926 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:39.862340 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2137) took 2009 ms. Trace:
I20260709 12:21:39.859105 23923 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:39.839187 27595 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:39.912529 27578 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:39.912607 27615 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.913353 27615 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.913897 27615 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.784472 27560 raft_consensus.cc:697] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:39.918471 27523 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:39.918514 27615 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:39.739890 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 295836us
I20260709 12:21:39.922384 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:39.863180 23926 rpcz_store.cc:276] 0709 12:21:37.852811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.802975 (+1950164us) service_pool.cc:224] Handling call
0709 12:21:39.852239 (+ 49264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.861989 (+  9750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.862238 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.864493 23748 catalog_manager.cc:5697] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 3 to 6, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 6 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:39.865682 27506 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:39.866007 27277 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.866050 27495 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:39.868214 23922 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:21:39.936746 23922 pending_rounds.cc:85] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 3
I20260709 12:21:39.937130 23922 pending_rounds.cc:107] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:21:39.937417 23922 raft_consensus.cc:2889] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:39.868837 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:39.938203 24557 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:39.870246 27451 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:39.870579 27230 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:39.870981 27548 consensus_meta.cc:287] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 12:21:39.872206 27491 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.875391 27629 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:39.878010 27632 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:39.884557 27556 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.886289 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.888109 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.888844 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.949932 24558 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:39.951246 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:39.956760 24003 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:39.888624 27269 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.891593 27599 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.895627 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.970937 23854 raft_consensus.cc:2393] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:39.897161 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:39.971923 23850 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:39.900040 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.902215 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:39.974457 23846 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:39.903980 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:39.905705 27532 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.908732 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:39.975718 23849 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:39.909044 27628 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 12:21:39.910808 27600 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:39.910714 27568 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.013710 27568 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:39.911975 27624 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:40.016201 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1980) took 2356 ms. Trace:
I20260709 12:21:39.920504 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:39.939966 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2138) took 2086 ms. Trace:
I20260709 12:21:40.017812 27230 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:40.018330 27230 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.018745 27230 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:39.861632 27529 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:39.900672 27590 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.027721 27590 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:40.017201 23922 rpcz_store.cc:276] 0709 12:21:37.892399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.860829 (+1968430us) service_pool.cc:224] Handling call
0709 12:21:39.867879 (+  7050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.939710 (+ 71831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.939908 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:40.016697 23920 rpcz_store.cc:276] 0709 12:21:37.660163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.340386 (+1680223us) service_pool.cc:224] Handling call
0709 12:21:39.370695 (+ 30309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.371226 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.371269 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.371890 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.601247 (+229357us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:39.601285 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.601349 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:40.015834 (+414485us) raft_consensus.cc:1685] finished
0709 12:21:40.015868 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.016107 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":8342,"thread_start_us":198594,"threads_started":1,"wal-append.queue_time_us":359465}
I20260709 12:21:40.031365 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:40.032567 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:40.029626 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:40.033695 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:39.949991 24563 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:40.005362 23849 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
W20260709 12:21:40.017536 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 97089.4us
I20260709 12:21:40.036226 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:40.037977 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:40.038726 27590 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:40.039417 27595 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:40.039829 27595 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.040199 27595 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:39.919329 27560 consensus_queue.cc:237] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.042145 27590 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:40.044229 27590 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:39.938230 27578 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:40.046434 27578 raft_consensus.cc:697] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:39.946419 23925 raft_consensus.cc:1240] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:40.047609 27578 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.048434 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2151) took 1946 ms. Trace:
I20260709 12:21:40.048853 23925 rpcz_store.cc:276] 0709 12:21:38.102498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.945706 (+1843208us) service_pool.cc:224] Handling call
0709 12:21:39.946180 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.048145 (+101965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.048369 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.904326 27565 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.050302 23925 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:40.051147 24561 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:40.051214 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1987) took 1870 ms. Trace:
I20260709 12:21:40.051684 23925 rpcz_store.cc:276] 0709 12:21:38.180480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.049726 (+1869246us) service_pool.cc:224] Handling call
0709 12:21:40.050115 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.050949 (+   834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.051157 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.945348 23748 catalog_manager.cc:5697] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 9. New cstate: current_term: 9 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:40.053304 23748 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.057183 27584 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:40.058641 27532 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:39.941206 27451 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:40.060992 27451 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.062219 23999 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:40.062675 27451 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:40.067451 27599 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:40.067971 27629 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:40.040205 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:39.999747 27277 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:40.038060 27269 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:40.035518 23920 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:40.083519 23925 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:39.940037 23818 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:40.029531 27323 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.001s
I20260709 12:21:40.077348 24525 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:40.089277 24557 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:40.090103 27600 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:40.096347 23995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.088s	sys 0.188s
W20260709 12:21:40.096700 23995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.088s	sys 0.188s
W20260709 12:21:40.092572 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 152625us
I20260709 12:21:40.099674 23818 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:40.081511 23850 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:40.093245 23999 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:40.099927 23820 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:40.114658 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.116307 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:40.119132 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.001382 27632 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.125156 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.124415 23818 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:40.131057 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:40.131855 24557 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:40.129033 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:40.124460 23820 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:40.136260 23818 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:40.137226 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:40.137281 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:40.138275 24558 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:40.139897 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.142345 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.141773 23818 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:40.103044 27054 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:40.141230 23892 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:40.159126 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:40.091856 27599 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:21:40.160619 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:40.128216 27523 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:40.104049 27323 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10.
I20260709 12:21:40.149760 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:40.148818 27634 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:40.100764 27600 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:40.128078 27193 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:39.999544 27548 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.133289 26955 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:40.055555 23748 catalog_manager.cc:5697] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 1 to 5, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 5 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:21:40.162593 23854 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:40.161535 23892 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:40.142459 27506 consensus_queue.cc:1059] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:21:40.136241 27632 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:40.151589 27568 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:40.146319 27478 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:40.104890 27495 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:21:40.143189 27615 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:40.375213 27615 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.375456 27269 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:40.375696 27615 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:40.375976 27269 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.376425 27269 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:40.376953 27478 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.377406 27478 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:40.164196 23966 leader_election.cc:400] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:21:40.228858 27634 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.163172 27491 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:40.383534 27048 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:40.384140 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 220077us
I20260709 12:21:40.384316 27048 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.387905 27280 raft_consensus.cc:993] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:21:40.387673 27352 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:40.388453 27280 raft_consensus.cc:1081] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:21:40.390741 23966 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:40.391595 27352 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:40.392216 27352 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.392555 27352 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:40.394078 27581 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:40.394471 27581 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:40.166803 27373 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:40.400358 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:21:40.401227 23852 raft_consensus.cc:606] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:40.401664 23852 raft_consensus.cc:614] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:40.170729 27600 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:40.304843 26955 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:40.395323 27581 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.368860 23854 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:40.405818 27373 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.368342 27568 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:40.414188 26955 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:40.393512 27529 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.230309 27635 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:40.230116 27636 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:40.481093 24559 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:40.168792 27584 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.303s
I20260709 12:21:40.406308 27323 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:21:40.461190 27568 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:40.451092 27373 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:40.167733 27592 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.308s
W20260709 12:21:40.471405 27633 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 12:21:40.488845 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 387193us
I20260709 12:21:40.450524 27560 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:21:40.168668 27523 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.480365 27620 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:40.450469 27269 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.486050 27636 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.515264 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:40.516582 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:40.517016 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:40.520524 23998 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:21:40.519814 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.523528 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:40.519666 24004 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:40.528774 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:40.529397 24004 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:40.533428 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.534405 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:40.534839 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:40.536741 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 375247us
I20260709 12:21:40.540367 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.541746 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.540722 23892 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:40.544591 24000 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:40.545300 27616 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:40.510125 27634 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:40.513298 27620 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:40.548774 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:40.566620 23997 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:40.566690 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:40.554026 27643 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:21:40.554710 27523 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:40.535616 27230 consensus_meta.cc:287] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.001s
I20260709 12:21:40.579169 23995 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:40.554817 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:40.574673 23892 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:40.561482 27548 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:40.522924 27636 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:40.580235 24554 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:40.535856 27048 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:40.600487 23892 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:40.612524 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:40.614738 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:40.615334 23854 raft_consensus.cc:2368] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:21:40.569051 27616 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:40.568686 27620 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:40.625654 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.629626 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.630829 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.611958 27532 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:40.636749 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 239216us
I20260709 12:21:40.628608 27547 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:40.611178 27495 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:40.603886 27352 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.659204 23966 leader_election.cc:400] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:21:40.662446 23966 leader_election.cc:403] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:21:40.596417 27230 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.660506 23892 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:40.664378 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:40.664752 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:40.665237 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:40.635510 27629 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:40.672171 23995 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:40.508203 23748 catalog_manager.cc:5697] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 6 to 7, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 7 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.671298 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1909) took 1476 ms. Trace:
I20260709 12:21:40.675029 24003 rpcz_store.cc:276] 0709 12:21:39.195303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.381720 (+186417us) service_pool.cc:224] Handling call
0709 12:21:40.671078 (+1289358us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540009abd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:40.671229 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442544512}
I20260709 12:21:40.646782 27054 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:40.669663 24001 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:40.671298 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1989) took 1587 ms. Trace:
I20260709 12:21:40.681854 23923 rpcz_store.cc:276] 0709 12:21:39.083461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.090386 (+  6925us) service_pool.cc:224] Handling call
0709 12:21:40.671112 (+1580726us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54000118d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:40.671233 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765175680}
I20260709 12:21:40.646363 27547 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.676213 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:40.683266 23997 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:40.676410 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.672027 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1977) took 3295 ms. Trace:
I20260709 12:21:40.684034 23921 rpcz_store.cc:276] 0709 12:21:37.377071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.153966 (+1776895us) service_pool.cc:224] Handling call
0709 12:21:39.156788 (+  2822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.224523 (+ 67735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.224570 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.224630 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:39.224684 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.671802 (+1447118us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b540039ab54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:40.671854 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.671977 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155134848}
I20260709 12:21:40.677734 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:40.639509 27548 consensus_queue.cc:1059] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:21:40.673388 24002 raft_consensus.cc:2393] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:40.686729 23892 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:40.688176 24525 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:40.712070 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:40.688545 27547 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:40.689379 27595 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.001s
I20260709 12:21:40.679564 27048 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:40.691962 27627 raft_consensus.cc:3055] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:40.694312 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2159) took 1510 ms. Trace:
I20260709 12:21:40.731617 23920 rpcz_store.cc:276] 0709 12:21:39.184296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.097394 (+913098us) service_pool.cc:224] Handling call
0709 12:21:40.097943 (+   549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:40.098382 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:40.098432 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:40.099064 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 12:21:40.629365 (+530301us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:40.629411 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.629487 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:40.694064 (+ 64577us) raft_consensus.cc:1685] finished
0709 12:21:40.694083 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.694252 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":887,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":20632,"thread_start_us":483980,"threads_started":1,"wal-append.queue_time_us":560674}
I20260709 12:21:40.694533 27581 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:40.671118 27529 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:40.696902 27373 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.672544 27495 raft_consensus.cc:697] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:40.729751 24525 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:40.698542 27269 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:40.743211 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:40.744059 24002 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:40.733368 27627 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:40.728899 27274 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.687456 27590 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:21:40.641274 27616 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.731362 27655 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:40.753424 27627 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.735339 27645 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:40.739943 27548 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:40.703392 26955 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.780128 27600 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.782367 26955 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:40.750916 27529 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:40.734045 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 47388.6us
I20260709 12:21:40.700435 27054 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.801023 27627 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:40.768151 27274 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.803617 27274 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:40.807348 27659 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:21:40.814734 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:40.818861 23924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 1975) took 3503 ms (client timeout 3008 ms). Trace:
W20260709 12:21:40.819319 23924 rpcz_store.cc:269] 0709 12:21:37.315550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.009472 (+1693922us) service_pool.cc:224] Handling call
0709 12:21:40.818625 (+1809153us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54003d0754. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:40.818785 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503940352}
I20260709 12:21:40.775900 27645 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:40.822216 27645 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:40.779958 27352 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:40.738832 27632 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.734728 27595 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.789391 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:40.837957 27656 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:21:40.839151 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:40.840248 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 50978us
I20260709 12:21:40.791441 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:40.844444 24000 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:40.827237 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:40.831614 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.832821 23926 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:40.790671 27548 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:40.843022 23846 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:40.843631 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:40.856120 24001 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:40.790274 24004 raft_consensus.cc:2410] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:21:40.852421 24556 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:40.849347 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:40.854257 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:40.866076 24000 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:40.861693 23998 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:40.867333 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:40.867398 24002 raft_consensus.cc:2410] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:40.868613 23920 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:40.869148 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:40.867465 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:40.869220 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:40.871662 23923 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:40.872438 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:40.873363 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:40.877080 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:40.877651 23921 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:40.878921 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.879664 23846 raft_consensus.cc:2393] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:40.880641 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:40.882411 23929 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:40.888350 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:40.889111 23924 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:40.885262 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1937) took 3647 ms. Trace:
I20260709 12:21:40.859922 26910 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:40.853719 27600 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:40.875262 27495 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.856949 27632 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:40.889410 23853 rpcz_store.cc:276] 0709 12:21:37.238077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.973126 (+1735049us) service_pool.cc:224] Handling call
0709 12:21:38.973519 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.071926 (+ 98407us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:39.072283 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.162121 (+ 89838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.162184 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:39.162232 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.885047 (+1722815us) spinlock_profiling.cc:243] Waited 98.1 ms on lock 0x7b5400071a54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:40.885090 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.885208 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":330,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":84,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":41369,"spinlock_wait_cycles":226942464,"thread_start_us":89376,"threads_started":1,"wal-append.queue_time_us":334981,"wal-append.run_cpu_time_us":1041,"wal-append.run_wall_time_us":1002348}
I20260709 12:21:40.883244 27352 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:40.876627 27664 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:40.899585 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:40.902855 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:40.904687 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.912995 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:40.881654 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:40.886730 27616 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:40.917872 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:40.921921 24002 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:40.918087 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:40.906597 26910 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:40.919973 23923 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:40.925544 27548 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.961295 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:40.961957 23853 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:40.966378 27054 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:40.971840 27277 consensus_meta.cc:287] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.880s	user 0.015s	sys 0.000s
W20260709 12:21:40.973518 27615 consensus_meta.cc:287] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.000s
I20260709 12:21:40.974166 27615 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.981033 27547 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:40.973173 27636 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.984299 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2145) took 3032 ms. Trace:
I20260709 12:21:40.984712 23926 rpcz_store.cc:276] 0709 12:21:37.951806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.932237 (+1980431us) service_pool.cc:224] Handling call
0709 12:21:40.825423 (+893186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.849475 (+ 24052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.984073 (+134598us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54003d0750. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:40.984230 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031731584}
I20260709 12:21:40.985841 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:40.988050 23926 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:40.991384 23921 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:40.991539 23853 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:40.995615 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:40.996311 23853 raft_consensus.cc:2368] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10.
I20260709 12:21:40.931347 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:40.997047 23846 raft_consensus.cc:2376] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7. Re-sending same reply.
W20260709 12:21:40.988257 27478 consensus_meta.cc:287] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 12:21:41.001319 27478 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:40.992902 27506 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:41.003670 27478 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.004844 23854 raft_consensus.cc:2393] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:41.000748 23920 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:41.009171 23996 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:41.018360 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.925190 27230 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:41.021472 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.022173 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.026346 23853 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:41.003942 27506 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.037565 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.039384 23846 raft_consensus.cc:2376] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12. Re-sending same reply.
I20260709 12:21:41.041196 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.042061 23853 raft_consensus.cc:2376] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6. Re-sending same reply.
I20260709 12:21:41.042006 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:41.050531 23996 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.046702 27547 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:41.047191 26955 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:41.030637 27568 consensus_meta.cc:287] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.001s
I20260709 12:21:41.051968 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.059725 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.061391 23853 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:41.062330 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 194915us
I20260709 12:21:41.063474 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.066005 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.069334 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.070713 24524 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.066943 23853 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:41.109675 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:41.126166 23846 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:41.128279 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:41.128978 23997 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:21:41.129320 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 55123.5us
I20260709 12:21:41.051764 27595 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:41.134467 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 109229us
W20260709 12:21:41.133069 27668 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:21:41.130877 27581 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:41.143553 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:41.063920 26910 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.132761 27655 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.146070 23996 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:41.061267 27568 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.130681 27615 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:41.164415 23848 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:21:41.060736 26955 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.142593 27625 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:41.170122 23848 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:41.132608 27590 consensus_queue.cc:1059] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:21:41.183844 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:41.170653 23846 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:21:41.128376 27634 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:21:41.133332 27665 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:21:41.128134 27600 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:21:41.142865 27627 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:41.169415 23997 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:41.137462 27522 consensus_queue.cc:1059] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:21:41.175519 26955 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.186103 23817 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.173432 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:41.167263 27670 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:41.178009 27636 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.178730 27546 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.166893 27478 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.179183 27625 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.182541 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:41.203593 27478 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.205952 27478 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:41.185245 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 75660.9us
I20260709 12:21:41.136190 27620 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.187726 23852 raft_consensus.cc:2393] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:41.207317 24554 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:41.194938 23996 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:41.171264 27581 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:41.173218 27655 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.219094 27655 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.220723 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.221455 23929 raft_consensus.cc:2368] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10.
W20260709 12:21:41.187999 27649 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.548s	user 0.000s	sys 0.005s
I20260709 12:21:41.197266 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:41.206382 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1911) took 2009 ms. Trace:
I20260709 12:21:41.189985 27186 consensus_queue.cc:1059] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:21:41.212124 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.230130 23999 rpcz_store.cc:276] 0709 12:21:39.196876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.431265 (+234389us) service_pool.cc:224] Handling call
0709 12:21:41.206220 (+1774955us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54003f66d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:41.206325 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229726592}
I20260709 12:21:41.212291 27636 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.215080 27568 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.215274 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:41.216023 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:41.199139 27670 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.218003 27595 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:41.218539 27673 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:41.196188 27627 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.231817 23850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:21:41.222388 27581 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.231383 23893 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:41.233389 27674 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:41.254202 23850 raft_consensus.cc:606] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 5 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:41.235836 23966 leader_election.cc:400] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10.
I20260709 12:21:41.237118 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:41.255164 23966 leader_election.cc:403] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:41.255606 23929 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:41.239523 27645 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.240352 27452 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.242623 24557 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:41.201680 27547 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:41.253090 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1976) took 3890 ms. Trace:
I20260709 12:21:41.263306 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.263726 23927 rpcz_store.cc:276] 0709 12:21:37.363128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.109253 (+1746125us) service_pool.cc:224] Handling call
0709 12:21:39.109731 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.766861 (+657130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.252829 (+1485968us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b540039a154. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:41.253029 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493289728}
I20260709 12:21:41.199766 27546 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:41.260804 23996 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:21:41.262292 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.270390 23849 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:41.265973 23895 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:41.267264 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.244994 27478 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:41.275360 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.276950 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.266220 27660 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10.
I20260709 12:21:41.251467 27615 consensus_queue.cc:1059] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:21:41.250455 27595 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:41.280941 27615 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:41.295528 27615 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:41.264516 27581 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:41.298229 27644 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.807s	user 0.000s	sys 0.009s
I20260709 12:21:41.298350 24558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 717) took 1417 ms. Trace:
I20260709 12:21:41.284509 27616 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:41.299660 23847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 1964) took 1746 ms (client timeout 1680 ms). Trace:
I20260709 12:21:41.299840 27616 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.298811 24558 rpcz_store.cc:276] 0709 12:21:39.881014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.154960 (+273946us) service_pool.cc:224] Handling call
0709 12:21:40.155314 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:40.155665 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:40.155694 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:40.156372 (+   678us) log.cc:844] Serialized 52 byte log entry
0709 12:21:40.451110 (+294738us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:40.476706 (+ 25596us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.482718 (+  6012us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.613340 (+130622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.613412 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:41.158625 (+545213us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:41.298114 (+139489us) raft_consensus.cc:1685] finished
0709 12:21:41.298140 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:41.298287 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5407,"prepare.queue_time_us":53337,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":2214,"raft.queue_time_us":140227,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":7026,"spinlock_wait_cycles":15177472,"thread_start_us":424508,"threads_started":2,"wal-append.queue_time_us":457616}
W20260709 12:21:41.300104 23847 rpcz_store.cc:269] 0709 12:21:39.553697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.556667 (+  2970us) service_pool.cc:224] Handling call
0709 12:21:41.299480 (+1742813us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54001e50d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:41.299581 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501666176}
I20260709 12:21:41.300484 27616 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.301136 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:41.301775 24558 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:41.298400 27645 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.274387 27674 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.315712 27323 raft_consensus.cc:3055] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:41.316309 27323 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:41.318863 27506 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.319732 27627 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.322114 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:41.266088 27048 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:41.265089 27547 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:41.268472 27452 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.264549 27673 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.337867 27655 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.338512 27547 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.338881 27452 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.339100 27673 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.339875 27230 raft_consensus.cc:3055] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:41.340310 27230 raft_consensus.cc:740] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:41.253628 27671 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.342222 27671 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.343664 27048 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:41.269132 23846 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:41.344645 27048 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.346441 27671 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:41.341143 27230 consensus_queue.cc:260] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.347548 27230 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:41.347678 27674 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:41.349402 27625 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.323890 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.284031 27478 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.323213 23924 raft_consensus.cc:2393] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:41.350206 27478 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:41.346709 27670 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.351230 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.351917 23924 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:41.352829 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.354183 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:41.355314 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.356467 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.363284 23924 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:41.365613 23849 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:41.357347 24558 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
W20260709 12:21:41.329684 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 51782.3us
I20260709 12:21:41.368621 23893 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:41.370371 23929 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:41.371860 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:41.266201 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:41.374455 27581 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.375906 27546 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.376791 27581 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:41.373241 27670 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.317461 27323 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.381361 27323 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.296350 27615 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.382833 27615 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.374264 24557 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:41.388797 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 152085us
I20260709 12:21:41.389940 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:41.359601 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 91316.3us
I20260709 12:21:41.395709 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:41.397784 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:41.397982 27625 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:41.398706 27634 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:41.398711 27625 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:41.399127 27634 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:41.399236 27546 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:41.399559 27634 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.399964 27625 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.322829 27595 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.402271 27595 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:41.402534 27547 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.403475 27478 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.405560 27478 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.406243 23927 raft_consensus.cc:2393] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:41.416867 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.417860 23853 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:21:41.412032 24557 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:41.419993 24557 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:41.407905 23929 raft_consensus.cc:2368] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:21:41.371906 23893 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:41.421074 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.419883 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.422459 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:41.423691 23929 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:41.424726 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 52927.4us
I20260709 12:21:41.426817 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.428481 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:41.430025 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.430769 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:41.429198 23924 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:41.432164 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.433063 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:21:41.415020 27529 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.011s
I20260709 12:21:41.434432 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.437845 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:41.440414 23966 leader_election.cc:400] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:21:41.440970 23893 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:41.406910 27671 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:41.442014 23893 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:41.444773 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.430402 27627 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:41.423463 27547 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:41.448668 27048 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:41.450028 27613 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.443390 27529 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:41.467195 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.439522 27546 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:41.433118 27592 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:41.465003 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 59927.4us
W20260709 12:21:41.446462 27532 consensus_meta.cc:287] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.800s	user 0.015s	sys 0.004s
I20260709 12:21:41.446826 27660 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:41.473397 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.474709 24524 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:41.475394 24562 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:41.456907 27665 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:41.477583 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.479744 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:41.480361 23996 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:41.480397 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:41.477988 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:41.483855 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:41.484179 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:41.484441 24002 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:41.485102 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:41.485659 24003 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.485519 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.487914 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:41.488516 23996 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:41.483857 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:41.491685 23924 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:41.445604 27277 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:21:41.493420 23929 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:41.492799 23924 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:41.496822 24002 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:41.497208 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 1988) took 2414 ms. Trace:
I20260709 12:21:41.497776 24003 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:41.497581 23925 rpcz_store.cc:276] 0709 12:21:39.083124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.052513 (+969389us) service_pool.cc:224] Handling call
0709 12:21:40.052863 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.086963 (+ 34100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.496993 (+1410030us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b540018b5d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:41.497154 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70029568}
I20260709 12:21:41.469836 27546 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:41.457190 27671 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.477218 27532 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:41.506605 24562 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:21:41.490258 27618 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.501910 27546 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.475685 27048 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:41.526728 27048 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.529052 23893 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:41.511101 23925 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:41.515571 23929 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:41.516232 27634 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.494232 27678 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.477352 27617 consensus_queue.cc:1059] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:21:41.494416 27529 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:41.516906 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:41.493032 27660 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:41.494534 27658 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:41.520082 27671 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.532321 23924 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:41.532925 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:41.555962 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.521258 27618 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.500377 27665 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:41.568410 24554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 719) took 1170 ms. Trace:
I20260709 12:21:41.570257 23999 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:41.569063 24554 rpcz_store.cc:276] 0709 12:21:40.397672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.614102 (+216430us) service_pool.cc:224] Handling call
0709 12:21:40.633188 (+ 19086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.231822 (+598634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.568014 (+336192us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54006220d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:41.568288 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319939328}
I20260709 12:21:41.573556 27673 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:41.575418 27529 raft_consensus.cc:697] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:21:41.580204 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 47345.1us
I20260709 12:21:41.581341 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:41.556638 27625 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:41.582252 23925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:21:41.611606 23925 raft_consensus.cc:606] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:41.589093 27618 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:41.589910 23922 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:41.592332 27230 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.592375 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 1946) took 2071 ms. Trace:
I20260709 12:21:41.561486 27658 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:41.622547 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:41.593329 24561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36558 (request call id 674) took 2404 ms (client timeout 1725 ms). Trace:
W20260709 12:21:41.623955 24561 rpcz_store.cc:269] 0709 12:21:39.189191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.274791 (+ 85600us) service_pool.cc:224] Handling call
0709 12:21:41.593073 (+2318282us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54005901d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:41.593213 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1781449600}
I20260709 12:21:41.622488 23845 rpcz_store.cc:276] 0709 12:21:39.521025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.521550 (+   525us) service_pool.cc:224] Handling call
0709 12:21:39.564276 (+ 42726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.736677 (+172401us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:39.736975 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.804825 (+ 67850us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.804895 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:39.804967 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.145544 (+340577us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b18003dbb20. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28432d2a6 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419
0709 12:21:41.592138 (+1446594us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54001f40d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:41.592189 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:41.592312 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2701,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":109,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2678,"spinlock_wait_cycles":597444352,"thread_start_us":67393,"threads_started":1,"wal-append.queue_time_us":48441,"wal-append.run_cpu_time_us":1141,"wal-append.run_wall_time_us":1003678}
I20260709 12:21:41.593830 27313 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:39.610332 23928 rpcz_store.cc:276] 0709 12:21:37.187873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.107420 (+1919547us) service_pool.cc:224] Handling call
0709 12:21:39.107762 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.107973 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:39.298282 (+190309us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.605630 (+307348us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.605798 (+   168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.605840 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:39.605906 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.605970 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.606966 (+   996us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10665,"prepare.queue_time_us":284063,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":2415,"raft.queue_time_us":62013,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":10293,"spinlock_wait_cycles":37604096,"thread_start_us":485756,"threads_started":3,"wal-append.queue_time_us":313081}
I20260709 12:21:41.607784 23996 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:41.608494 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:41.629873 24003 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.609262 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:41.566030 27581 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:41.615104 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.616192 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.617264 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.621526 23966 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:41.635179 23966 leader_election.cc:400] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10.
I20260709 12:21:41.623512 23853 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:41.624071 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.623302 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:41.636031 23849 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:41.628271 24004 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:41.630461 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:41.637604 23996 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:41.637928 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.639492 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.640228 23850 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:41.631261 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.633746 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.636052 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.642946 23845 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:41.643234 23847 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:41.645200 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.645821 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.645371 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:41.647121 23997 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:41.647418 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.648043 23848 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:41.649430 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.650256 23853 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:41.653056 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.654665 23996 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:41.656112 27665 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.629271 27313 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:41.658167 27313 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.659452 27313 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:41.628100 27658 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:41.662153 27678 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:41.662787 27678 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.668841 27546 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.670028 27660 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.610805 27478 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:41.670903 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.611181 27625 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.671809 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:41.671593 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:41.691007 24000 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:21:41.691496 24000 pending_rounds.cc:85] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 6
I20260709 12:21:41.691756 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.691748 24000 pending_rounds.cc:107] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:21:41.681214 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.692463 24000 raft_consensus.cc:2889] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:41.692713 23845 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:41.682723 23997 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:41.610649 27685 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:41.678699 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 53495.9us
I20260709 12:21:41.694448 24003 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 4.
I20260709 12:21:41.696316 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.696760 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2225) took 1172 ms. Trace:
I20260709 12:21:41.697237 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.697175 23854 rpcz_store.cc:276] 0709 12:21:40.524664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.630522 (+105858us) service_pool.cc:224] Handling call
0709 12:21:41.696578 (+1066056us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400298e54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:41.696705 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848206080}
I20260709 12:21:41.698510 23847 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:21:41.698634 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.696954 23849 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.698725 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.701872 23847 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:41.645934 27522 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:41.701519 23851 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:41.702922 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.701521 23850 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:41.703802 23847 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:41.672226 27600 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:41.707932 23995 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:41.706951 27592 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:41.713021 23845 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:41.587111 27529 consensus_queue.cc:237] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.680852 27599 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:41.707762 27595 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:41.715405 27373 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:41.697368 27625 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.671415 27581 raft_consensus.cc:697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:41.715519 27546 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:41.719753 23847 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:41.720397 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:41.744125 23845 raft_consensus.cc:2376] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7. Re-sending same reply.
I20260709 12:21:41.744931 23849 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:41.741391 23848 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:41.631261 27230 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.701484 27523 raft_consensus.cc:2764] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:21:41.755888 27599 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:41.745405 27685 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:41.751665 27678 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:41.762131 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 66478.8us
I20260709 12:21:41.763069 23892 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:41.767239 23845 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:41.770169 24001 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:41.742745 27478 raft_consensus.cc:697] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:41.751164 27313 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:41.778862 23892 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:41.760931 27522 raft_consensus.cc:697] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:41.787959 23892 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:41.793516 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:41.798280 23892 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:41.800067 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:41.780479 27313 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.803289 27627 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:41.804090 27373 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:41.794588 27581 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.807548 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:41.807862 27313 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:41.808794 24003 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:41.802310 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:41.813946 23969 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.012s	user 0.001s	sys 0.045s
W20260709 12:21:41.814474 27667 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.903s	user 0.002s	sys 0.002s
I20260709 12:21:41.815905 27478 consensus_queue.cc:237] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:41.819583 27230 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:41.822901 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2228) took 1297 ms. Trace:
W20260709 12:21:41.823451 24559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36570 (request call id 716) took 1942 ms (client timeout 1698 ms). Trace:
I20260709 12:21:41.823918 23853 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:41.824975 27269 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:41.825388 24556 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:41.801451 27532 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.826853 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:41.827571 27565 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:41.827512 24561 raft_consensus.cc:2376] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 8. Re-sending same reply.
I20260709 12:21:41.829013 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:41.823506 23852 rpcz_store.cc:276] 0709 12:21:40.525571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.629379 (+103808us) service_pool.cc:224] Handling call
0709 12:21:41.822573 (+1193194us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54002fbcd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:41.822803 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281576832}
I20260709 12:21:41.830893 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:41.830909 24557 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
W20260709 12:21:41.830366 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.831609 24561 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
W20260709 12:21:41.823940 24559 rpcz_store.cc:269] 0709 12:21:39.880794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.886035 (+  5241us) service_pool.cc:224] Handling call
0709 12:21:41.823226 (+1937191us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54005a46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:41.823379 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221930752}
W20260709 12:21:41.829200 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 130650us
I20260709 12:21:41.833164 23895 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:41.833405 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.833612 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.834471 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:41.801928 27616 consensus_meta.cc:287] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.001s
I20260709 12:21:41.794148 27664 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:41.787981 27522 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.885304 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:41.837386 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:41.846174 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.837960 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:41.855469 23969 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.054s	user 0.001s	sys 0.045s
W20260709 12:21:41.936553 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 2.13522e+06us
W20260709 12:21:41.937646 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 52461.4us
I20260709 12:21:41.853643 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:41.839584 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
W20260709 12:21:41.854334 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 47308.2us
W20260709 12:21:41.932857 23817 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.034s (SENT) [suppressed 38 similar messages]
I20260709 12:21:41.800674 27634 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:41.939297 27695 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:41.945276 27269 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.945950 27269 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.947428 27620 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:41.934777 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 96584.6us
W20260709 12:21:41.948338 23922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 398) took 1946 ms (client timeout 1670 ms). Trace:
W20260709 12:21:41.948735 23922 rpcz_store.cc:269] 0709 12:21:40.002072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.029311 (+ 27239us) service_pool.cc:224] Handling call
0709 12:21:41.948177 (+1918866us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54003ce954. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:41.948272 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3576320768}
I20260709 12:21:41.949270 24003 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:21:41.949405 23820 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:41.948107 27269 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:41.930119 27619 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:21:41.838783 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:41.949693 24003 pending_rounds.cc:85] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 5
W20260709 12:21:41.935526 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 98212.2us
I20260709 12:21:41.935124 27616 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.976200 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:42.013653 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 64316.6us
I20260709 12:21:42.014102 24003 pending_rounds.cc:107] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:21:41.989642 23923 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:42.014691 24003 raft_consensus.cc:2889] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:41.951020 23969 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.853117 27548 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:41.838235 27323 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:42.000391 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60369.9us
I20260709 12:21:41.905933 27671 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.940145 24563 raft_consensus.cc:2376] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 9. Re-sending same reply.
I20260709 12:21:41.940570 23852 raft_consensus.cc:606] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:41.857479 27665 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:41.936582 24558 raft_consensus.cc:2368] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11.
I20260709 12:21:41.964555 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:41.983134 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.936156 27684 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:41.959020 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:41.942512 27692 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.002s
W20260709 12:21:42.035518 23820 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 1.698s (SENT)
I20260709 12:21:42.055128 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:42.037756 23852 raft_consensus.cc:614] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:42.042593 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 91630.5us
I20260709 12:21:42.057601 23969 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.837543 27627 consensus_queue.cc:1059] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.186s
I20260709 12:21:41.881179 27532 consensus_queue.cc:1059] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.141s
I20260709 12:21:41.965869 27274 raft_consensus.cc:3055] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:41.927047 27658 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:41.834276 27600 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:41.978618 27693 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
I20260709 12:21:42.048902 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:41.967896 27651 log.cc:927] Time spent T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 1.329s	user 0.000s	sys 0.004s
I20260709 12:21:42.044518 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:41.972760 27452 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.020215 27615 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:42.069329 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:41.951740 27373 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:42.060660 23924 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:42.060776 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:42.071363 23926 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:41.967639 27650 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.045431 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:42.069715 24554 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:42.065404 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:42.107601 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:42.110535 23852 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:21:42.111021 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 53523.2us
I20260709 12:21:42.111832 23969 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:42.113054 23969 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:42.047106 27695 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.952267 27313 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:21:42.115610 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:42.047582 27665 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:41.955106 27672 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 12:21:42.060384 27274 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:42.121866 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 56438.1us
I20260709 12:21:42.057982 27592 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:42.120925 23969 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:42.123065 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:42.127763 23921 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:42.127817 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:42.034698 27618 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 12:21:42.050511 27634 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:21:42.046854 27671 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.120445 27323 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.136696 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:42.136785 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:41.857070 27685 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.133306 24525 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:42.065104 27696 consensus_queue.cc:1059] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:21:42.131376 23850 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [7.4-8.5]
I20260709 12:21:42.124292 27660 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:42.126786 27700 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:42.122396 27665 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.121579 27523 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:42.142730 24525 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:42.168413 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:42.172422 23921 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:42.128284 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:42.173281 24003 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:42.125065 27615 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:42.145864 23969 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:42.122125 27560 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:42.125996 27599 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:42.126623 27695 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:42.135862 27548 raft_consensus.cc:697] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:42.130771 27652 raft_consensus.cc:2764] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:21:42.120142 27581 consensus_queue.cc:1059] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:21:42.179708 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:42.114648 27452 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.114876 27650 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.148985 27565 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:42.167951 27595 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:42.174077 27700 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:42.179008 27578 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:42.200970 27615 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.194664 27546 raft_consensus.cc:3055] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:42.169631 27610 consensus_queue.cc:1059] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:21:42.200043 27678 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:42.199777 27674 raft_consensus.cc:3055] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:42.139865 27698 consensus_queue.cc:1059] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:21:42.202093 27704 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:42.169759 27625 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.190052 27529 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:21:42.267438 23845 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:42.143076 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:42.270802 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 306110us
I20260709 12:21:42.307071 23846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:21:42.308032 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:42.308368 23846 raft_consensus.cc:606] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:42.308964 23846 raft_consensus.cc:614] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:42.309689 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:42.310205 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:42.310735 24554 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.311097 24560 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
W20260709 12:21:42.137519 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 102037us
I20260709 12:21:42.278290 23925 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:42.280205 23928 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:21:42.282087 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 146453us
I20260709 12:21:42.201480 24525 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:42.215529 27546 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:42.199677 27590 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:21:42.213199 27592 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.341709 27546 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.342439 27610 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:42.343225 27610 raft_consensus.cc:697] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:42.344462 27548 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.222227 27616 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:42.347268 27529 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:42.347807 27529 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:21:42.348183 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 140368us
I20260709 12:21:42.178380 27600 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.228750 27625 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:42.223654 27650 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:42.228554 27658 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:42.230726 27671 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:42.220152 27674 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:42.226956 27678 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:42.223238 27698 raft_consensus.cc:3055] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:42.227461 27700 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.210294 27706 raft_consensus.cc:3055] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:42.302486 27452 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:42.277275 23920 raft_consensus.cc:2393] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:42.317130 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:42.326704 23817 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:42.327311 27618 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:42.238014 27665 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.203336 27274 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.338917 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:42.344816 27610 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.227201 27660 raft_consensus.cc:697] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:42.311093 27595 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:42.404709 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:42.378619 27618 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.349642 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:42.429245 27546 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:42.424989 23895 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:42.423833 27618 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:42.424429 27595 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:42.349679 27529 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.437038 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:42.444062 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 298105us
W20260709 12:21:42.444584 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.440450 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:42.417177 27698 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:42.440557 23927 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:42.463254 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:42.447240 27674 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.464944 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:42.463268 23928 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:42.427315 27578 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:42.465080 27674 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.445605 27723 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:42.477094 27723 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.477643 27723 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:42.477958 27698 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.480252 27698 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:42.480844 27650 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:42.481343 27650 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:42.476579 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 123092us
I20260709 12:21:42.485380 27696 consensus_queue.cc:1059] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:42.486543 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:42.488021 27696 raft_consensus.cc:3055] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:42.488747 27696 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:42.489480 24560 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:42.441555 27595 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.438825 27706 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:42.494472 27529 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.495507 27706 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:42.476402 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 126954us
I20260709 12:21:42.481786 27650 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.478470 27665 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:42.445752 23969 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:42.449631 27274 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:42.512245 23925 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:42.515708 27723 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.518569 27723 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:42.466562 27578 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.448475 27678 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.530172 27712 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.531013 27712 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.447316 27660 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:42.539646 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.540946 27578 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:42.549774 24562 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:42.558861 24560 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:21:42.567638 27560 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:42.572386 27712 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:42.500447 27048 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:21:42.578928 23820 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:42.578027 27696 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.579664 27671 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.598135 27696 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.597824 27671 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.600724 27671 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:42.611913 27618 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.593617 27650 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.619351 27650 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:42.620743 23820 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:42.622721 23820 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:42.623149 27274 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:42.624171 27274 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.624779 27274 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:42.622269 27615 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:42.626367 27615 raft_consensus.cc:697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:42.630391 27615 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.627362 27671 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:42.577665 27595 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.641251 27546 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:42.643354 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 197839us
I20260709 12:21:42.643852 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:42.626591 27618 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:42.644614 23969 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:42.652258 27560 raft_consensus.cc:2764] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:42.633780 27373 raft_consensus.cc:697] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:42.654688 23820 leader_election.cc:400] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11.
I20260709 12:21:42.655155 23820 leader_election.cc:403] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:21:42.650592 27595 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:42.662422 27671 consensus_queue.cc:1059] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:42.659242 27703 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:21:42.664589 27703 raft_consensus.cc:3055] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:42.665105 27703 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:42.665414 23999 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:42.656319 27618 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11.
W20260709 12:21:42.669335 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:42.675295 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:42.670753 27323 consensus_meta.cc:287] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.524s	user 0.014s	sys 0.000s
I20260709 12:21:42.667126 27671 consensus_queue.cc:1243] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Peer 35a9a1f8b1d847fb8f2063ced2a3c26d log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:42.665859 27695 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:42.666356 27703 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.682964 27695 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:42.683715 27703 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:42.685352 27373 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.682685 23969 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:42.691915 27274 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:42.684842 27695 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:42.699671 27323 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:42.700019 27695 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:42.702939 27274 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:42.711730 27696 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:42.712388 27696 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:42.715104 27696 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:43.106838 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:43.107766 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:43.108500 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.840684 27323 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.146750 27323 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:43.217768 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:43.261224 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:43.666592 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.656405 27274 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:43.962212 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.992306 27274 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.000667 27704 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.001370 27704 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:43.995366 27695 consensus_meta.cc:287] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.294s	user 0.009s	sys 0.005s
W20260709 12:21:44.105176 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.351226 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.351708 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.134351 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.140944 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2251) took 2008 ms. Trace:
I20260709 12:21:44.145455 23893 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:44.151584 24001 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:44.205165 27704 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:44.223881 23927 consensus_meta.cc:287] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.761s	user 0.012s	sys 0.012s
I20260709 12:21:44.352839 23927 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:44.263077 26910 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:44.263944 27522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.960s	user 0.008s	sys 0.015s
W20260709 12:21:44.268968 23920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 2009) took 2287 ms (client timeout 2358 ms). Trace:
W20260709 12:21:44.272612 23818 connection.cc:256] RPC call timeout handler was delayed by -1.7761685860000398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28550000000000003s for a response
I20260709 12:21:44.280230 24002 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:44.282387 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:44.308470 23966 leader_election.cc:336] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.587s (SENT)
I20260709 12:21:44.310791 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:44.313719 23995 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:21:43.947602 27546 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:44.327832 27734 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.328310 27743 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:44.358527 24000 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:44.358373 27734 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.358549 27743 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.328904 27738 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:44.329474 27733 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.329916 27740 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.327833 27741 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.334005 27739 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.334528 27736 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.338696 27737 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.339295 27274 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:44.343355 27745 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:43.961678 27595 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.356366 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1916) took 1658 ms. Trace:
W20260709 12:21:44.422465 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.373548 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 424) took 1702 ms. Trace:
W20260709 12:21:44.361722 23927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2181) took 2081 ms (client timeout 2065 ms). Trace:
I20260709 12:21:44.372784 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1913) took 1660 ms. Trace:
I20260709 12:21:44.361234 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:44.426347 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 281153us
W20260709 12:21:44.354880 27522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.051s	user 0.008s	sys 0.015s
I20260709 12:21:44.438534 27750 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:44.438936 27522 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.439563 27522 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.441457 27522 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:44.426275 27742 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.427281 24002 rpcz_store.cc:276] 0709 12:21:42.699258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.279269 (+1580011us) service_pool.cc:224] Handling call
0709 12:21:44.279736 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:44.356000 (+ 76264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.356267 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:44.428369 23927 rpcz_store.cc:269] 0709 12:21:42.272038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.316503 (+ 44465us) service_pool.cc:224] Handling call
0709 12:21:44.353284 (+2036781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:44.429335 24001 rpcz_store.cc:276] 0709 12:21:42.696553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.150676 (+1454123us) service_pool.cc:224] Handling call
0709 12:21:44.151129 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:44.355017 (+203888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.357310 (+  2293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:44.427253 23995 rpcz_store.cc:276] 0709 12:21:42.654773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.312612 (+1657839us) service_pool.cc:224] Handling call
0709 12:21:44.313108 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:44.355536 (+ 42428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.357202 (+  1666us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:44.447422 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 75298.6us
W20260709 12:21:44.448128 23818 connection.cc:256] RPC call timeout handler was delayed by -1.7062627600000724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 12:21:44.448866 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.448797 27274 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:44.422147 27734 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:44.352319 23845 rpcz_store.cc:276] 0709 12:21:42.132388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.132507 (+   119us) service_pool.cc:224] Handling call
0709 12:21:42.132795 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.304867 (+172072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.140388 (+1835521us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002d4bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:44.140733 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306544000}
I20260709 12:21:44.452006 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:44.450094 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 141654us
I20260709 12:21:44.456399 24000 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:44.454576 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:44.451576 23921 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 2.279s	user 0.020s	sys 0.004s
I20260709 12:21:44.450251 23893 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:44.451086 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:44.354097 23920 rpcz_store.cc:269] 0709 12:21:41.981600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.982771 (+  1171us) service_pool.cc:224] Handling call
0709 12:21:44.268625 (+2285854us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400119ed4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:44.268875 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550289152}
I20260709 12:21:44.449514 27743 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:44.534096 27737 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:44.539335 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.544561 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.373348 27546 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.546422 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 425) took 1882 ms. Trace:
I20260709 12:21:44.546497 23921 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:44.450532 27742 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.551263 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1922) took 1152 ms. Trace:
I20260709 12:21:44.551057 27754 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.552544 23928 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:21:44.552915 27754 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.554148 27737 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:44.554724 27742 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:44.554847 27737 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.555594 27737 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.444253 27736 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.558177 27754 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:44.559038 27754 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:44.559777 27736 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:44.442828 27738 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.456950 27595 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.443982 27739 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.459681 27740 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.450376 27733 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.536181 27274 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.460021 27741 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.501804 27745 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.552131 24002 rpcz_store.cc:276] 0709 12:21:43.395693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.454207 (+1058514us) service_pool.cc:224] Handling call
0709 12:21:44.548472 (+ 94265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:44.643929 27757 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.644685 27757 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.645087 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:44.612983 27737 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:44.646776 27751 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:44.647580 27751 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:44.586539 23818 connection.cc:256] RPC call timeout handler was delayed by -1.4878208140000879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 12:21:44.648555 23818 connection.cc:256] RPC call timeout handler was delayed by -1.3770443290002277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 12:21:44.648964 23818 connection.cc:256] RPC call timeout handler was delayed by -1.254462760000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 12:21:44.576205 23921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2175) took 2427 ms (client timeout 1639 ms). Trace:
W20260709 12:21:44.649513 23818 connection.cc:256] RPC call timeout handler was delayed by -1.1608627599998727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 12:21:44.649669 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.551697 24000 rpcz_store.cc:276] 0709 12:21:42.655268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.310232 (+1654964us) service_pool.cc:224] Handling call
0709 12:21:44.537198 (+226966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:44.631319 23895 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:44.646885 27753 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:44.605389 23995 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:44.539950 27734 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:44.647967 27739 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:44.650998 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.649737 23921 rpcz_store.cc:269] 0709 12:21:42.148308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.148428 (+   120us) service_pool.cc:224] Handling call
0709 12:21:44.566819 (+2418391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:44.651131 24002 raft_consensus.cc:2410] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:21:44.653224 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 203158us
I20260709 12:21:44.654011 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:44.539741 27748 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:44.600265 23996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1915) took 1900 ms (client timeout 1506 ms). Trace:
I20260709 12:21:44.654842 24001 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:44.658126 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1926) took 1260 ms. Trace:
I20260709 12:21:44.658433 24001 rpcz_store.cc:276] 0709 12:21:43.397296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.450810 (+1053514us) service_pool.cc:224] Handling call
0709 12:21:44.658061 (+207251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:44.653839 27743 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.648777 27744 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:44.662160 27743 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.662664 27756 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:44.662531 27744 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.663283 27756 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.637703 27754 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:44.664469 27274 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:44.575408 27750 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:44.627035 27522 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.595273 27742 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.667176 27756 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:44.667485 27546 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:44.631338 27755 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.668567 27704 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.680776 27755 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.681022 27704 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.682200 27740 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:44.682693 27546 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.670552 27753 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.683374 27546 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.680776 27627 raft_consensus.cc:3055] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:44.685128 27627 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:44.685781 27743 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:44.686146 27627 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.686609 27743 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.687561 27743 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.688802 27738 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:44.689821 27522 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.692179 24003 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:44.657294 23996 rpcz_store.cc:269] 0709 12:21:42.697465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.573548 (+1876083us) service_pool.cc:211] Skipping call since client already timed out
0709 12:21:44.597822 (+ 24274us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:21:44.664894 27744 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:44.668105 27748 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.669716 27751 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:44.670324 24000 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:44.611155 27736 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:44.694202 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 95361.4us
I20260709 12:21:44.679344 27742 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:44.673508 27274 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.717710 27758 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:44.990710 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.194669 27744 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.194811 27758 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:44.792146 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 2.46553e+06us
I20260709 12:21:45.195396 27744 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.114553 27745 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:45.196233 27758 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:45.046239 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.085490 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.048863 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.991786 27733 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:45.198203 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.788093 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.766129 27595 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:45.199422 24525 connection.cc:256] RPC call timeout handler was delayed by -1.4942286129999047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 12:21:44.781507 27756 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.200497 27756 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:44.895632 27725 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 2.493s	user 0.006s	sys 0.010s
I20260709 12:21:45.203158 27756 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:44.718650 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:44.765393 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:45.255419 24563 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:44.782047 27618 raft_consensus.cc:3055] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:44.672010 27739 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:45.258244 27618 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:45.258554 27739 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:45.259845 27618 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.262315 27618 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:45.266418 27740 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.267426 27740 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.270185 27756 consensus_queue.cc:1059] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:45.131592 27546 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:45.271473 27546 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.272262 27546 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:45.275473 27546 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:45.276180 27546 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.276826 27546 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:44.800423 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:21:44.779399 27750 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.429s
I20260709 12:21:45.207656 27748 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:45.089540 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08002998e0 after lost signal to thread 22704
W20260709 12:21:44.788771 24554 consensus_meta.cc:287] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 2.477s	user 0.008s	sys 0.029s
I20260709 12:21:45.279304 24554 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:45.279953 27735 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.280570 27735 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.281193 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:21:44.880445 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 82781.3us
I20260709 12:21:45.208786 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1942) took 1089 ms. Trace:
I20260709 12:21:45.282589 24000 rpcz_store.cc:276] 0709 12:21:44.119704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.650850 (+531146us) service_pool.cc:224] Handling call
0709 12:21:45.208676 (+557826us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:44.895519 27323 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:44.892580 27696 consensus_meta.cc:287] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.662s	user 0.014s	sys 0.002s
I20260709 12:21:44.721325 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:44.885936 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.212958 27590 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.789805 27757 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:45.261543 27739 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:45.118837 27704 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:45.197853 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.779263 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 70394.3us
I20260709 12:21:45.219497 27751 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.720842 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:45.194411 27736 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:45.250367 27595 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.250468 27733 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.204478 27274 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:45.356323 27736 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:45.356412 27733 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.356626 27595 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:45.358657 27733 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:45.358871 27595 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:45.206840 27742 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:44.937960 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 276895us
W20260709 12:21:45.322587 24554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 826) took 2978 ms (client timeout 1684 ms). Trace:
W20260709 12:21:45.362243 24554 rpcz_store.cc:269] 0709 12:21:42.305264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.309060 (+  3796us) service_pool.cc:224] Handling call
0709 12:21:45.283490 (+2974430us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.361276 27764 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:21:45.363847 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:45.323698 27744 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:45.324335 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:45.325076 27696 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.330495 23996 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:44.718063 27743 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:45.103546 27766 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:45.379133 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1945) took 1257 ms. Trace:
I20260709 12:21:45.379593 24000 rpcz_store.cc:276] 0709 12:21:44.121620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.283480 (+1161860us) service_pool.cc:224] Handling call
0709 12:21:45.379078 (+ 95598us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:44.892313 24004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1917) took 2058 ms (client timeout 1751 ms). Trace:
W20260709 12:21:45.351342 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.351449 24001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1921) took 1956 ms (client timeout 2241 ms). Trace:
I20260709 12:21:45.354797 27704 raft_consensus.cc:3055] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:45.355295 27751 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:45.355974 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:45.359175 23818 leader_election.cc:336] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.506s (SENT)
I20260709 12:21:45.359923 27762 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:44.770557 27741 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:45.361251 27274 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:45.349383 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 153317us
I20260709 12:21:45.324494 27620 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:45.270612 27740 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:45.375283 24563 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:45.378317 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1944) took 1257 ms. Trace:
I20260709 12:21:45.377259 24558 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
W20260709 12:21:45.380890 24001 rpcz_store.cc:269] 0709 12:21:43.395313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.666696 (+1271383us) service_pool.cc:224] Handling call
0709 12:21:45.351369 (+684673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.425177 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:45.507629 23996 rpcz_store.cc:276] 0709 12:21:44.121038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.720932 (+599894us) service_pool.cc:224] Handling call
0709 12:21:45.378252 (+657320us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:45.380499 24004 rpcz_store.cc:269] 0709 12:21:42.887938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.891897 (+2003959us) service_pool.cc:211] Skipping call since client already timed out
0709 12:21:44.892076 (+   179us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:21:45.378415 24003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 422) took 3036 ms (client timeout 1564 ms). Trace:
W20260709 12:21:45.440021 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.508551 24000 raft_consensus.cc:2376] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 12. Re-sending same reply.
I20260709 12:21:45.514850 24563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 833) took 1169 ms. Trace:
I20260709 12:21:45.449710 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 407) took 3144 ms. Trace:
I20260709 12:21:45.422763 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:45.492233 27697 log.cc:927] Time spent T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 3.428s	user 0.009s	sys 0.022s
I20260709 12:21:45.377061 27770 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.398877 27766 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:45.431567 27753 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:45.445080 27672 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:45.525918 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.541633 27733 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:45.542107 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.538368 24003 rpcz_store.cc:269] 0709 12:21:42.336643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.338132 (+  1489us) service_pool.cc:224] Handling call
0709 12:21:45.372717 (+3034585us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b54003d7cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:45.372933 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5318889216}
I20260709 12:21:45.435619 27696 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:45.529068 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:45.530884 27746 log.cc:927] Time spent T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 1.194s	user 0.003s	sys 0.003s
I20260709 12:21:45.508584 27704 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:45.546634 27313 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:45.372900 27590 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.524578 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:45.515972 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 312875us
I20260709 12:21:45.533486 27762 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.547657 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:45.555663 24002 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:45.515352 24563 rpcz_store.cc:276] 0709 12:21:44.338465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.764789 (+426324us) service_pool.cc:224] Handling call
0709 12:21:45.507530 (+742741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.538846 23928 rpcz_store.cc:276] 0709 12:21:42.305319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.466360 (+161041us) service_pool.cc:224] Handling call
0709 12:21:44.551831 (+2085471us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:44.552961 (+  1130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.449353 (+896392us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b5400328a50. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:45.449570 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4695515392}
I20260709 12:21:45.542866 24558 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:21:45.551937 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:45.427205 27546 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:45.538410 23895 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:45.542244 27733 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:45.545297 27740 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.579993 27745 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.580722 27745 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.580587 27740 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.583316 27745 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:45.583958 24001 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 4.
I20260709 12:21:45.579983 23895 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:45.515412 24000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1947) took 1392 ms (client timeout 1836 ms). Trace:
I20260709 12:21:45.508244 27620 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:45.585239 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:45.539150 24554 raft_consensus.cc:2376] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8. Re-sending same reply.
I20260709 12:21:45.555990 24004 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:45.542135 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:45.621323 23996 raft_consensus.cc:2410] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:45.557179 24558 pending_rounds.cc:85] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 7
I20260709 12:21:45.563597 23999 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:45.563400 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:45.561053 27743 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:21:45.564064 27547 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.564155 27744 consensus_queue.cc:1059] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:45.630851 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1946) took 1508 ms. Trace:
W20260709 12:21:45.566305 23998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 2054) took 4083 ms (client timeout 1884 ms). Trace:
W20260709 12:21:45.651263 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 301123us
I20260709 12:21:45.563483 27269 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.566232 27766 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:45.579447 27313 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:45.652542 27269 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.653169 27313 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.653626 27313 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:45.655745 27269 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:45.570528 27733 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:45.584764 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 228916us
W20260709 12:21:45.622809 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59498.5us
W20260709 12:21:45.608255 24000 rpcz_store.cc:269] 0709 12:21:44.123266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.380149 (+1256883us) service_pool.cc:224] Handling call
0709 12:21:45.515348 (+135199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.550036 27672 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:45.659801 27672 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.538079 27770 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.663656 27770 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:45.584048 27740 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:45.631749 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.632594 23996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1931) took 1538 ms (client timeout 2003 ms). Trace:
W20260709 12:21:45.665227 23996 rpcz_store.cc:269] 0709 12:21:44.094020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.525180 (+1431160us) service_pool.cc:224] Handling call
0709 12:21:45.632514 (+107334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.666258 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:45.633111 27547 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:45.621927 24558 pending_rounds.cc:107] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:21:45.631657 27742 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:45.635522 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:45.636361 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:45.704037 24563 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
W20260709 12:21:45.636966 27715 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 3.242s	user 0.024s	sys 0.040s
I20260709 12:21:45.638015 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:45.639091 27590 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:45.639427 23927 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:45.639724 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:45.715730 23996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1948) took 1579 ms (client timeout 2057 ms). Trace:
I20260709 12:21:45.640532 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:45.640841 23895 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:45.641453 23925 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:45.641373 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:45.646579 23921 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:45.718303 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:45.648157 27704 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:45.649852 27751 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:45.650410 27618 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:21:45.651111 23998 rpcz_store.cc:269] 0709 12:21:41.482298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.483962 (+  1664us) service_pool.cc:224] Handling call
0709 12:21:45.545449 (+4061487us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54001d2c54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:45.566071 (+ 20622us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328526080}
I20260709 12:21:45.742412 27704 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.743261 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:45.744024 23998 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
W20260709 12:21:45.744596 23998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1930) took 1651 ms (client timeout 2107 ms). Trace:
W20260709 12:21:45.744959 23998 rpcz_store.cc:269] 0709 12:21:44.093515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.742968 (+1649453us) service_pool.cc:224] Handling call
0709 12:21:45.744506 (+  1538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.657593 24003 rpcz_store.cc:276] 0709 12:21:44.122399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.543469 (+1421070us) service_pool.cc:224] Handling call
0709 12:21:45.630783 (+ 87314us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:45.627326 24004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1943) took 1507 ms (client timeout 2007 ms). Trace:
I20260709 12:21:45.661450 27672 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:45.746717 27269 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:45.747324 27269 raft_consensus.cc:697] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:45.748426 27269 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:45.674185 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.702418 24558 raft_consensus.cc:2889] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:45.647490 27762 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:45.746538 24004 rpcz_store.cc:269] 0709 12:21:44.120420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.525181 (+1404761us) service_pool.cc:224] Handling call
0709 12:21:45.627238 (+102057us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.755995 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:45.770458 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.719410 24000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1952) took 1446 ms (client timeout 1888 ms). Trace:
I20260709 12:21:45.732843 27742 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:45.733374 23928 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.733493 27766 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:45.733774 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 94235.6us
W20260709 12:21:45.737895 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 97117.3us
W20260709 12:21:45.746203 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.784813 24000 rpcz_store.cc:269] 0709 12:21:44.272848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.657420 (+1384572us) service_pool.cc:224] Handling call
0709 12:21:45.719334 (+ 61914us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:45.833400 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 52076us
I20260709 12:21:45.683346 27745 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:45.715394 27715 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 3.398s	user 0.024s	sys 0.040s
W20260709 12:21:45.797868 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.860200 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.757561 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:45.837167 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:45.865057 23895 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:45.716357 23996 rpcz_store.cc:269] 0709 12:21:44.124103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.665956 (+1541853us) service_pool.cc:224] Handling call
0709 12:21:45.703461 (+ 37505us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:45.875370 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 222980us
W20260709 12:21:45.882016 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.862517 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:45.897352 23998 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
W20260709 12:21:45.898110 23998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1924) took 2501 ms (client timeout 2855 ms). Trace:
W20260709 12:21:45.898557 23998 rpcz_store.cc:269] 0709 12:21:43.396516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.745691 (+2349175us) service_pool.cc:224] Handling call
0709 12:21:45.898037 (+152346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.900156 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:45.902482 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:45.861750 23929 raft_consensus.cc:2376] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10. Re-sending same reply.
I20260709 12:21:45.905934 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1949) took 1640 ms. Trace:
I20260709 12:21:45.906508 24000 rpcz_store.cc:276] 0709 12:21:44.265923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.835378 (+1569455us) service_pool.cc:224] Handling call
0709 12:21:45.905836 (+ 70458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.909466 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:45.910492 23998 raft_consensus.cc:2410] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:21:45.911460 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.911935 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:45.912358 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.912721 24563 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:45.912017 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:45.919469 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:45.924554 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1951) took 1652 ms. Trace:
I20260709 12:21:45.925168 23998 rpcz_store.cc:276] 0709 12:21:44.272455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.899362 (+1626907us) service_pool.cc:224] Handling call
0709 12:21:45.924451 (+ 25089us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:45.928929 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.954638 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:46.051046 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.941395 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.024601 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:45.983283 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.123265 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.124221 24000 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:45.974857 23818 leader_election.cc:336] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.751s (SENT)
I20260709 12:21:46.127492 23818 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:45.938462 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.133417 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 268459us
W20260709 12:21:46.133924 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.134193 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:45.918689 27274 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.137336 23996 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:21:46.137833 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.139758 24000 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:46.076009 27757 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:46.140668 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:45.913482 27751 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.221s
I20260709 12:21:46.140908 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1929) took 2144 ms. Trace:
I20260709 12:21:45.937781 27766 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:46.142282 23998 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:45.984608 27762 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.142844 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:46.143426 23893 connection.cc:256] RPC call timeout handler was delayed by -2.4847405839998373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 12:21:46.148314 24000 rpcz_store.cc:276] 0709 12:21:43.996973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.125237 (+2128264us) service_pool.cc:224] Handling call
0709 12:21:46.140836 (+ 15599us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.135159 27548 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:46.136412 27743 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:46.134403 27745 raft_consensus.cc:697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:46.146255 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:45.916497 27590 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.233s
I20260709 12:21:46.175853 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:46.176476 24000 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:46.165225 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.143220 27757 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.025104 27742 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.178653 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.177945 23996 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:46.182765 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:46.183743 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.142458 27274 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.186422 23998 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:46.186895 23969 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 2.057s (SENT)
I20260709 12:21:46.173274 27778 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.143541 27618 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:21:46.161165 27766 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.190166 23969 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:46.216377 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1925) took 2819 ms. Trace:
I20260709 12:21:46.216794 23998 rpcz_store.cc:276] 0709 12:21:43.396878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.174364 (+2777486us) service_pool.cc:224] Handling call
0709 12:21:46.216320 (+ 41956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.182065 27775 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.172134 27743 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.180377 27757 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:46.228729 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.219899 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:46.237838 27773 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:46.237515 27745 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.254469 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:46.255355 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.241479 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08002988e0 after lost signal to thread 23786
I20260709 12:21:46.173046 27768 consensus_queue.cc:1059] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.254s
I20260709 12:21:46.174871 27762 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.243925 23924 raft_consensus.cc:2376] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10. Re-sending same reply.
I20260709 12:21:46.189072 27777 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.220221 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.279306 23928 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:46.281410 27744 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.189249 27548 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.248081 27743 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:46.275600 24000 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:46.255712 23998 raft_consensus.cc:2376] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 11. Re-sending same reply.
I20260709 12:21:46.284376 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:46.295107 24524 connection.cc:256] RPC call timeout handler was delayed by -2.1970679010000822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 12:21:46.301965 24524 connection.cc:256] RPC call timeout handler was delayed by -2.1970679010000822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 12:21:46.302451 24524 connection.cc:256] RPC call timeout handler was delayed by -2.1016679010001553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
I20260709 12:21:46.295567 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:46.302884 24524 connection.cc:256] RPC call timeout handler was delayed by -1.7470679010000367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
I20260709 12:21:46.303614 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1950) took 2037 ms. Trace:
W20260709 12:21:46.303673 24524 connection.cc:256] RPC call timeout handler was delayed by -1.7470679010000367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 12:21:46.306985 24524 connection.cc:256] RPC call timeout handler was delayed by -1.6845924310000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 12:21:46.307799 24524 connection.cc:256] RPC call timeout handler was delayed by -1.6700169369999003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 12:21:46.282488 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 369192us
I20260709 12:21:46.306805 23998 rpcz_store.cc:276] 0709 12:21:44.266383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.217391 (+1951008us) service_pool.cc:224] Handling call
0709 12:21:46.303232 (+ 85841us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.304821 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:46.305781 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.306249 23921 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
W20260709 12:21:46.304315 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 122151us
I20260709 12:21:46.305393 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:46.314361 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 400562us
I20260709 12:21:46.215387 27778 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.322286 23920 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:46.389540 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.390487 23921 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:46.391613 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.295257 27751 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:46.395677 23996 raft_consensus.cc:2393] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:46.396991 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:46.411888 23996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1919) took 3017 ms (client timeout 4016 ms). Trace:
W20260709 12:21:46.412557 23996 rpcz_store.cc:269] 0709 12:21:43.394534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.288249 (+2893715us) service_pool.cc:224] Handling call
0709 12:21:46.411788 (+123539us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.415565 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.416854 23998 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:46.430990 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.431862 24000 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:46.434185 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.435060 23921 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
W20260709 12:21:46.311818 27758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.020s	sys 0.053s
I20260709 12:21:46.437973 23920 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:46.442763 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.444618 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.288070 27744 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.448096 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.283277 27775 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.296036 27777 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.450239 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.454461 23996 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:46.462625 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.470311 23818 leader_election.cc:336] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.796s (SENT)
I20260709 12:21:46.554062 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 429) took 1006 ms. Trace:
I20260709 12:21:46.554585 24000 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:46.554664 23996 rpcz_store.cc:276] 0709 12:21:45.547520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.429771 (+882251us) service_pool.cc:224] Handling call
0709 12:21:46.554001 (+124230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.555631 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1955) took 1019 ms. Trace:
W20260709 12:21:46.554147 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.556641 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.443603 27758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.020s	sys 0.054s
W20260709 12:21:46.518271 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.557034 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 374614us
W20260709 12:21:46.557024 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 168147us
I20260709 12:21:46.554136 23818 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:46.517046 23924 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:46.557909 24000 rpcz_store.cc:276] 0709 12:21:45.535861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.432676 (+896815us) service_pool.cc:224] Handling call
0709 12:21:46.555536 (+122860us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.559192 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.562496 27785 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.568101 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.569625 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:46.571144 27731 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Append to log took a long time: real 3.173s	user 0.018s	sys 0.004s
I20260709 12:21:46.572395 27778 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:46.579088 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.573727 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1912) took 3877 ms. Trace:
I20260709 12:21:46.427727 27779 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:46.578204 23998 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
W20260709 12:21:46.580960 23820 leader_election.cc:336] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 1.761s (SENT)
I20260709 12:21:46.505983 27780 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.600904 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.580435 23999 rpcz_store.cc:276] 0709 12:21:42.696132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.696329 (+   197us) service_pool.cc:224] Handling call
0709 12:21:45.549218 (+2852889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.622435 (+ 73217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.573443 (+951008us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b54001d2c50. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:46.573622 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6559929728}
I20260709 12:21:46.621507 23928 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:46.445560 27768 raft_consensus.cc:3055] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:46.618698 24003 raft_consensus.cc:2376] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 11. Re-sending same reply.
I20260709 12:21:46.621783 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 431) took 1048 ms. Trace:
W20260709 12:21:46.624825 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 64818.1us
W20260709 12:21:46.632344 24003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1941) took 2513 ms (client timeout 2144 ms). Trace:
W20260709 12:21:46.625181 24004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1936) took 2519 ms (client timeout 2358 ms). Trace:
W20260709 12:21:46.633312 24003 rpcz_store.cc:269] 0709 12:21:44.118953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.746180 (+1627227us) service_pool.cc:224] Handling call
0709 12:21:46.569442 (+823262us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:21:46.632270 (+ 62828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5457664}
W20260709 12:21:46.634387 24004 rpcz_store.cc:269] 0709 12:21:44.106220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.752261 (+1646041us) service_pool.cc:224] Handling call
0709 12:21:46.567935 (+815674us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:21:46.625122 (+ 57187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5409152}
I20260709 12:21:46.632652 23998 rpcz_store.cc:276] 0709 12:21:45.573866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.451419 (+877553us) service_pool.cc:224] Handling call
0709 12:21:46.621694 (+170275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.526607 27789 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.637537 23846 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:46.577116 27274 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:46.576879 27751 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:21:46.641536 23853 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:46.643250 27766 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:46.646664 27313 consensus_meta.cc:287] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.992s	user 0.008s	sys 0.004s
I20260709 12:21:46.647174 27313 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:46.647641 23995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1918) took 3375 ms (client timeout 1796 ms). Trace:
W20260709 12:21:46.648125 23995 rpcz_store.cc:269] 0709 12:21:43.272688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.451733 (+1179045us) service_pool.cc:224] Handling call
0709 12:21:46.647429 (+2195696us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b540009c4d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:46.647553 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158136192}
I20260709 12:21:46.649211 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:46.649386 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:46.651558 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.651901 24524 leader_election.cc:336] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.670s (SENT)
I20260709 12:21:46.619655 27548 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:46.622501 27781 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:46.657392 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1956) took 1121 ms. Trace:
I20260709 12:21:46.631361 27768 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:46.658139 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:46.656656 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.652904 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.660454 23999 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:46.657931 24003 rpcz_store.cc:276] 0709 12:21:45.536207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.634852 (+1098645us) service_pool.cc:224] Handling call
0709 12:21:46.657306 (+ 22454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.661121 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 432) took 1086 ms. Trace:
I20260709 12:21:46.661453 23999 rpcz_store.cc:276] 0709 12:21:45.574339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.624872 (+1050533us) service_pool.cc:224] Handling call
0709 12:21:46.661063 (+ 36191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.660419 24004 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:46.659022 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.652782 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.662999 23998 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:46.653568 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.632647 27780 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.664007 24000 raft_consensus.cc:2410] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:21:46.667883 23893 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:46.669335 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1958) took 1124 ms. Trace:
I20260709 12:21:46.669728 24000 rpcz_store.cc:276] 0709 12:21:45.545051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.637112 (+1092061us) service_pool.cc:224] Handling call
0709 12:21:46.669273 (+ 32161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.670881 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.671693 27706 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:46.672415 27762 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:46.672940 27704 consensus_meta.cc:287] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.930s	user 0.012s	sys 0.000s
I20260709 12:21:46.673732 27777 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:46.674065 27743 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:46.675984 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 249456us
I20260709 12:21:46.619837 27785 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.678169 27627 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:46.680559 23845 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:46.677189 24003 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:46.680424 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.684892 23999 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:46.685515 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1940) took 2567 ms. Trace:
I20260709 12:21:46.686012 23999 rpcz_store.cc:276] 0709 12:21:44.117784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.669143 (+2551359us) service_pool.cc:224] Handling call
0709 12:21:46.685435 (+ 16292us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:46.682224 27672 consensus_meta.cc:287] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.935s	user 0.011s	sys 0.002s
I20260709 12:21:46.673668 27776 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:46.688792 23817 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:46.689446 27744 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:46.689677 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.689831 23850 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:21:46.690673 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.691813 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.693914 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:46.694327 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:46.694396 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.694972 23848 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:46.696182 23851 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:46.697454 23854 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:46.697597 23999 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:46.698133 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1920) took 3303 ms. Trace:
I20260709 12:21:46.698293 24000 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:46.698491 27313 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:46.691339 27768 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:46.699206 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.700337 27767 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 1.278s	user 0.008s	sys 0.014s
I20260709 12:21:46.700842 24000 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:46.701472 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1923) took 3305 ms. Trace:
I20260709 12:21:46.696230 23847 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:46.701845 24000 rpcz_store.cc:276] 0709 12:21:43.396128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.700352 (+3304224us) service_pool.cc:224] Handling call
0709 12:21:46.700657 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.701195 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.701388 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.702621 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.698488 23999 rpcz_store.cc:276] 0709 12:21:43.394934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.697018 (+3302084us) service_pool.cc:224] Handling call
0709 12:21:46.697293 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.697936 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.698084 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.701565 23817 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:46.704807 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.703435 24004 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:46.705459 24003 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:46.699681 27768 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:46.707417 23818 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.836s (SENT)
I20260709 12:21:46.707924 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:46.707433 23893 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:46.709267 27781 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:46.710203 27313 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:46.710700 27313 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.711069 27313 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.714095 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:46.673666 27775 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:46.715337 24584 debug-util.cc:398] Leaking SignalData structure 0x7b0800039180 after lost signal to thread 23878
I20260709 12:21:46.654126 27789 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.718252 23996 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:46.718380 23893 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:46.710223 27787 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:21:46.720847 23817 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:46.702975 24000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:49640
I20260709 12:21:46.723628 24000 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:46.724020 24000 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.722325 27735 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:46.727826 23893 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:46.724627 27793 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:46.705140 27704 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:21:46.733464 27613 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:46.733734 23852 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:46.733950 27613 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.734120 27704 raft_consensus.cc:3055] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:46.734411 27613 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:46.735149 23999 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 10. Ops: []
I20260709 12:21:46.734869 27618 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:46.734532 27704 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:46.719228 27548 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:21:46.738404 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08003af240 after lost signal to thread 23953
I20260709 12:21:46.732111 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.740957 23853 raft_consensus.cc:2393] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:46.741230 24584 debug-util.cc:398] Leaking SignalData structure 0x7b0800285280 after lost signal to thread 24028
I20260709 12:21:46.739467 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1928) took 3056 ms. Trace:
I20260709 12:21:46.741703 23999 rpcz_store.cc:276] 0709 12:21:43.683568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.703973 (+3020405us) service_pool.cc:224] Handling call
0709 12:21:46.715657 (+ 11684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.739191 (+ 23534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.739403 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:46.742184 24584 debug-util.cc:398] Leaking SignalData structure 0x7b080034ee00 after lost signal to thread 24587
W20260709 12:21:46.742388 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5860 after lost signal to thread 24588
W20260709 12:21:46.742566 24584 debug-util.cc:398] Leaking SignalData structure 0x7b080035fa20 after lost signal to thread 27230
W20260709 12:21:46.742915 24584 debug-util.cc:398] Leaking SignalData structure 0x7b0800350fa0 after lost signal to thread 27597
W20260709 12:21:46.743044 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2700 after lost signal to thread 27599
W20260709 12:21:46.743279 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08003587e0 after lost signal to thread 27634
W20260709 12:21:46.743444 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2660 after lost signal to thread 27652
I20260709 12:21:46.737249 27618 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.744509 27618 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:46.745419 27620 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.746615 27620 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.725481 27274 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:46.750769 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 112430us
I20260709 12:21:46.728309 27775 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:46.749378 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.752974 24004 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:46.753470 23926 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:46.754253 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:46.754529 24001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1954) took 2477 ms (client timeout 1736 ms). Trace:
W20260709 12:21:46.755859 24001 rpcz_store.cc:269] 0709 12:21:44.273518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.507659 (+1234141us) service_pool.cc:224] Handling call
0709 12:21:46.750988 (+1243329us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b540012bbd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:46.751130 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87585536}
I20260709 12:21:46.757211 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1932) took 2662 ms. Trace:
I20260709 12:21:46.755568 23924 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:46.757532 24004 rpcz_store.cc:276] 0709 12:21:44.094374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.717406 (+2623032us) service_pool.cc:224] Handling call
0709 12:21:46.732297 (+ 14891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.757003 (+ 24706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.757169 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.734707 27785 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:46.759495 24001 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:46.740374 27548 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.763187 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.763839 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1934) took 2665 ms. Trace:
I20260709 12:21:46.763223 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.764361 24001 rpcz_store.cc:276] 0709 12:21:44.095032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.756468 (+2661436us) service_pool.cc:224] Handling call
0709 12:21:46.759363 (+  2895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.760263 (+   900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.760434 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.767130 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:46.767680 23818 leader_election.cc:336] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.034s (SENT)
W20260709 12:21:46.772635 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.773521 23818 leader_election.cc:336] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.144s (SENT)
I20260709 12:21:46.774008 23818 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:46.771996 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.765856 27548 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:46.775125 24525 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:46.758525 27775 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.767751 23921 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:46.776000 27775 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:46.776022 24525 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:46.778110 27742 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:46.771438 27789 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:46.774083 23853 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:46.772452 27780 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:46.778509 27742 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:46.783807 27742 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:46.784036 27735 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:46.784479 27735 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.784581 24004 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:46.784955 27735 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.785360 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1935) took 2685 ms. Trace:
I20260709 12:21:46.787933 27776 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.788498 27776 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.788431 24001 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:46.790604 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1939) took 2673 ms. Trace:
I20260709 12:21:46.785741 24004 rpcz_store.cc:276] 0709 12:21:44.100118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.758455 (+2658337us) service_pool.cc:224] Handling call
0709 12:21:46.784396 (+ 25941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.785060 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.785277 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.790992 24001 rpcz_store.cc:276] 0709 12:21:44.117496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.765138 (+2647642us) service_pool.cc:224] Handling call
0709 12:21:46.788255 (+ 23117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.790374 (+  2119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.790552 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.791219 24000 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.794481 23999 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 9. Ops: []
I20260709 12:21:46.796397 23848 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:46.801481 23921 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:46.802982 24000 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:46.803340 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.805090 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:46.805651 23848 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:46.806331 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:49640 (request call id 1927) took 3406 ms. Trace:
I20260709 12:21:46.806335 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.807427 24000 rpcz_store.cc:276] 0709 12:21:43.397719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.702868 (+3305149us) service_pool.cc:224] Handling call
0709 12:21:46.803589 (+100721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.808171 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.807092 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.809788 24004 raft_consensus.cc:2410] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:21:46.814050 27700 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:46.815367 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.817742 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.818648 24000 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:21:46.819341 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 426) took 1278 ms. Trace:
I20260709 12:21:46.819639 24000 rpcz_store.cc:276] 0709 12:21:45.540987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.816354 (+1275367us) service_pool.cc:224] Handling call
0709 12:21:46.816658 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.819091 (+  2433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.819296 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.820171 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:46.821110 24563 raft_consensus.cc:2410] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:46.821307 24000 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:46.821916 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 433) took 1247 ms. Trace:
I20260709 12:21:46.822098 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:46.822312 24000 rpcz_store.cc:276] 0709 12:21:45.574734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.820714 (+1245980us) service_pool.cc:224] Handling call
0709 12:21:46.820988 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.821648 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.821828 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.778509 27757 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.819988 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:46.826392 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2070) took 1162 ms. Trace:
I20260709 12:21:46.808310 27780 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:46.826848 24000 rpcz_store.cc:276] 0709 12:21:45.664401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.823171 (+1158770us) service_pool.cc:224] Handling call
0709 12:21:46.823480 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.823662 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.823688 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:46.826096 (+  2408us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:46.826154 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.826218 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.826339 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.821710 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:46.796934 27704 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.817593 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:46.829455 24555 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.830875 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.834271 24004 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:21:46.835727 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:46.836421 24563 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:21:46.836828 24563 pending_rounds.cc:85] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 6
I20260709 12:21:46.837105 24563 pending_rounds.cc:107] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:21:46.837340 24563 raft_consensus.cc:2889] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:46.838340 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.840234 24001 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:46.841060 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2071) took 1176 ms. Trace:
W20260709 12:21:46.842823 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9de0 after lost signal to thread 27671
W20260709 12:21:46.843281 24584 debug-util.cc:398] Leaking SignalData structure 0x7b0800131320 after lost signal to thread 27673
W20260709 12:21:46.843564 24584 debug-util.cc:398] Leaking SignalData structure 0x7b0800300480 after lost signal to thread 27674
W20260709 12:21:46.843981 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8ba0 after lost signal to thread 27688
W20260709 12:21:46.830341 27495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.404s	user 0.020s	sys 0.050s
I20260709 12:21:46.841456 24001 rpcz_store.cc:276] 0709 12:21:45.664750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.825190 (+1160440us) service_pool.cc:224] Handling call
0709 12:21:46.832949 (+  7759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.840748 (+  7799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.840990 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.845713 23924 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:46.845997 24584 debug-util.cc:398] Leaking SignalData structure 0x7b080033f7a0 after lost signal to thread 27698
W20260709 12:21:46.847174 24584 debug-util.cc:398] Leaking SignalData structure 0x7b080037d740 after lost signal to thread 27701
W20260709 12:21:46.847386 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08003517c0 after lost signal to thread 27703
I20260709 12:21:46.834777 24004 pending_rounds.cc:85] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 8
W20260709 12:21:46.847510 23966 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.634s (SENT)
W20260709 12:21:46.848453 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 74959.6us
W20260709 12:21:46.848793 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08001d10c0 after lost signal to thread 27708
I20260709 12:21:46.847841 24004 pending_rounds.cc:107] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:21:46.850132 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:46.850754 24561 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
W20260709 12:21:46.851423 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb980 after lost signal to thread 27711
I20260709 12:21:46.851533 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:46.851749 24584 debug-util.cc:398] Leaking SignalData structure 0x7b080037a680 after lost signal to thread 27712
W20260709 12:21:46.852022 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08003932e0 after lost signal to thread 27713
I20260709 12:21:46.852716 24004 raft_consensus.cc:2889] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:46.852072 23929 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:46.857369 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 411) took 1141 ms. Trace:
I20260709 12:21:46.854835 24558 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:46.859032 27522 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:46.860626 24559 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:21:46.846464 27495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.514s	user 0.021s	sys 0.050s
I20260709 12:21:46.857669 23929 rpcz_store.cc:276] 0709 12:21:45.716027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.838785 (+1122758us) service_pool.cc:224] Handling call
0709 12:21:46.857310 (+ 18525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.861744 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1953) took 2588 ms. Trace:
I20260709 12:21:46.862246 24004 rpcz_store.cc:276] 0709 12:21:44.273209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.813501 (+2540292us) service_pool.cc:224] Handling call
0709 12:21:46.827557 (+ 14056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.858545 (+ 30988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.861687 (+  3142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.865278 27704 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.865860 27757 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:46.867411 23851 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:46.868443 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:46.870002 27452 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.870545 27452 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.869598 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.874203 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:46.874925 24560 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:46.875583 27548 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.878141 27744 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.878744 27744 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.879465 23996 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:46.879994 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2076) took 1213 ms. Trace:
I20260709 12:21:46.880051 27627 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:46.880348 23996 rpcz_store.cc:276] 0709 12:21:45.666410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.861411 (+1195001us) service_pool.cc:224] Handling call
0709 12:21:46.879162 (+ 17751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.879786 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.879947 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.881038 27744 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:46.878167 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.882223 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.882972 23853 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:46.886906 23921 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:46.885367 23741 maintenance_manager.cc:419] P 8f9c39c095e54c96a7a90888b94785f5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033347
I20260709 12:21:46.888525 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:46.888952 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.889926 23854 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:21:46.890834 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.891453 23854 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:46.892468 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.893711 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.894342 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.895015 23849 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:46.894366 23854 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:46.897019 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.899065 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.899956 27775 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.874337 23851 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:46.901598 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2079) took 1127 ms. Trace:
I20260709 12:21:46.900514 23853 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:46.902029 23996 rpcz_store.cc:276] 0709 12:21:45.758542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.881192 (+1122650us) service_pool.cc:224] Handling call
0709 12:21:46.881488 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.881662 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.881688 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:46.881727 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:46.881763 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.881811 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.885585 (+  3774us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.897179 23849 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:46.910390 27755 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:46.910966 24525 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:46.911265 27613 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.912213 24525 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:46.913866 24001 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:21:46.914649 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2077) took 1248 ms. Trace:
I20260709 12:21:46.915153 24001 rpcz_store.cc:276] 0709 12:21:45.666680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.861616 (+1194936us) service_pool.cc:224] Handling call
0709 12:21:46.908445 (+ 46829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.914371 (+  5926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.914588 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.918470 24555 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:46.921598 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.922329 23849 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:46.923739 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.924001 27743 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:46.924535 27743 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:46.924948 27743 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:46.925786 27495 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:21:46.930044 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.931588 23929 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 8. Ops: []
I20260709 12:21:46.934207 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:46.934988 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2080) took 1176 ms. Trace:
I20260709 12:21:46.935432 23996 rpcz_store.cc:276] 0709 12:21:45.758986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.921732 (+1162746us) service_pool.cc:224] Handling call
0709 12:21:46.934430 (+ 12698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.934643 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.934673 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:46.934721 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:46.934762 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.934820 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.934925 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.936288 24525 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:46.937520 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.938019 23818 connection.cc:256] RPC call timeout handler was delayed by -1.0988677829998323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
I20260709 12:21:46.922364 27744 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:46.912649 27717 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 4.520s	user 0.027s	sys 0.020s
I20260709 12:21:46.881794 27548 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:46.940676 27762 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:46.948130 24561 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:46.949376 24554 raft_consensus.cc:2410] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:21:46.943198 24555 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:46.946537 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:46.958679 24004 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:46.947513 27779 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.960770 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:46.939471 23966 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.719s (SENT) [suppressed 53 similar messages]
I20260709 12:21:46.957651 27789 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.947679 27762 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:46.968308 27762 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:46.968142 27789 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:46.968154 24002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1938) took 2852 ms (client timeout 1718 ms). Trace:
W20260709 12:21:46.970341 24002 rpcz_store.cc:269] 0709 12:21:44.116667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.718311 (+601644us) service_pool.cc:224] Handling call
0709 12:21:46.967973 (+2249662us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540009bfd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:46.968087 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588164480}
I20260709 12:21:46.971552 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.972393 24000 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:46.972671 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:46.974881 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2075) took 1308 ms. Trace:
I20260709 12:21:46.975256 24000 rpcz_store.cc:276] 0709 12:21:45.666100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.829910 (+1163810us) service_pool.cc:224] Handling call
0709 12:21:46.972225 (+142315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.972809 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.974663 (+  1854us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540009bfd0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:46.974817 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326559104}
I20260709 12:21:46.976399 24560 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:21:46.979169 27779 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.981290 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2176) took 4832 ms. Trace:
I20260709 12:21:46.982632 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.981698 23922 rpcz_store.cc:276] 0709 12:21:42.148731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.277822 (+129091us) service_pool.cc:224] Handling call
0709 12:21:42.278419 (+   597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.279341 (+   922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.279400 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:42.280437 (+  1037us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.389334 (+108897us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:42.389397 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.389503 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:46.912024 (+4522521us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:46.980848 (+ 68824us) raft_consensus.cc:1685] finished
0709 12:21:46.980869 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.981092 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20943,"raft.queue_time_us":14559,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":326,"spinlock_wait_cycles":71033216,"thread_start_us":100907,"threads_started":1,"wal-append.queue_time_us":110986}
I20260709 12:21:46.983908 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.985231 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.987180 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.987797 23995 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:46.988720 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.989440 23995 raft_consensus.cc:2410] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:46.907097 27706 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:21:46.994386 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:46.994813 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.995397 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.995584 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:46.996065 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 2015) took 4952 ms. Trace:
I20260709 12:21:46.996692 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.997354 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 837) took 1551 ms. Trace:
I20260709 12:21:46.997694 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:46.998029 27756 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.998212 23852 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:46.998369 23851 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:46.998685 27756 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:46.999255 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:47.000089 23852 raft_consensus.cc:2410] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:21:46.981844 27779 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:46.996251 23995 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 5.
I20260709 12:21:47.001964 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:47.003091 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:47.004099 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.004655 23920 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:46.997365 23853 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:47.006697 23851 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:21:47.003247 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:47.011054 23996 raft_consensus.cc:2376] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 10. Re-sending same reply.
I20260709 12:21:46.996444 23923 rpcz_store.cc:276] 0709 12:21:42.043641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.043788 (+   147us) service_pool.cc:224] Handling call
0709 12:21:46.995712 (+4951924us) spinlock_profiling.cc:243] Waited 3.31 s on lock 0x7b5400375ad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:46.995865 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7620547456}
I20260709 12:21:47.012091 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:47.012323 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.012858 23996 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:47.012669 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:46.997721 24556 rpcz_store.cc:276] 0709 12:21:45.446061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.446265 (+   204us) service_pool.cc:224] Handling call
0709 12:21:45.446602 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.630163 (+183561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.630196 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.630260 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:45.630300 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.996983 (+1366683us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540019bc54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:46.997040 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.997168 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396104064}
I20260709 12:21:46.942185 27744 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:47.014098 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.013821 23851 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:21:47.014166 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:47.019419 24000 raft_consensus.cc:2410] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 12:21:47.015278 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 69493us
I20260709 12:21:47.021548 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.022747 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.023908 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.025055 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.025710 23849 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:47.026854 27706 consensus_queue.cc:1059] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:47.027277 27759 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.023612 27742 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:47.028658 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.040479 23920 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:47.034950 24002 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:47.038035 24000 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:47.017480 23995 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:47.043504 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:47.049623 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.046173 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.048460 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2082) took 1288 ms. Trace:
I20260709 12:21:47.044405 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:46.939451 27313 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:46.939576 27618 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:47.045051 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.051266 24000 rpcz_store.cc:276] 0709 12:21:45.759724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.037061 (+1277337us) service_pool.cc:224] Handling call
0709 12:21:47.037519 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.042124 (+  4605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.048375 (+  6251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:47.052654 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:47.069944 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.055006 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:47.055476 27749 log.cc:927] Time spent T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 2.591s	user 0.004s	sys 0.008s
I20260709 12:21:47.070750 27780 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:47.071439 27780 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:47.055554 27732 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 2.727s	user 0.009s	sys 0.024s
W20260709 12:21:47.056262 27719 log.cc:927] Time spent T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 4.664s	user 0.005s	sys 0.040s
I20260709 12:21:47.057219 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.058137 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:47.097232 24561 raft_consensus.cc:2376] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 22996f888daf435398b693481171c18c in term 14. Re-sending same reply.
I20260709 12:21:47.097594 23852 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:21:47.097831 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:47.098163 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.098672 24559 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:47.098608 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.099179 23849 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:21:47.058766 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.099681 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.100349 24559 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:47.099370 23852 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:21:47.101433 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:47.059712 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.060423 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.061223 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.063632 27789 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.009117 27620 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:21:47.039009 27759 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:47.099632 23849 pending_rounds.cc:85] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 7
I20260709 12:21:47.136709 23849 pending_rounds.cc:107] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:21:47.051499 24556 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:47.068899 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2083) took 1308 ms. Trace:
I20260709 12:21:47.137013 23849 raft_consensus.cc:2889] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:47.137283 24002 rpcz_store.cc:276] 0709 12:21:45.760016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.042348 (+1282332us) service_pool.cc:224] Handling call
0709 12:21:47.042656 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.068555 (+ 25899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.068585 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:47.068630 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:47.068666 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.068733 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.068841 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:47.070070 24560 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:47.044894 23923 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:47.034902 27744 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:47.014739 27756 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:47.075683 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.075959 24562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 832) took 2738 ms. Trace:
I20260709 12:21:47.076478 27613 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.076401 27685 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:47.077106 27706 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:47.078110 27742 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.079285 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.083226 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.150697 23927 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
W20260709 12:21:47.084281 27797 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:21:47.088325 27313 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.088946 23929 raft_consensus.cc:1240] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:47.090019 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.090693 27618 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.091316 23847 raft_consensus.cc:2393] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:47.092347 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.092921 27700 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:47.167101 23997 raft_consensus.cc:2410] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:21:47.092347 27739 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:21:47.101718 24555 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:47.059099 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.102101 23845 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:47.099515 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.101755 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.104344 23848 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:47.114399 27779 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:47.115154 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2205) took 1470 ms. Trace:
W20260709 12:21:47.174548 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.174468 23928 rpcz_store.cc:276] 0709 12:21:45.644983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.305662 (+660679us) service_pool.cc:224] Handling call
0709 12:21:47.114959 (+809297us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400328f54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:47.115089 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514190080}
I20260709 12:21:47.072549 27780 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:47.074519 23895 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:47.129304 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 164702us
I20260709 12:21:47.134039 23969 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:47.135285 24004 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:21:47.142993 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:47.148026 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:47.176571 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 102255us
I20260709 12:21:47.177830 24560 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:47.150776 23851 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:47.074499 27735 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:47.171368 24556 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:47.172727 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:47.170799 24561 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:47.183140 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:47.183586 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.145473 24562 rpcz_store.cc:276] 0709 12:21:44.338045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.338214 (+   169us) service_pool.cc:224] Handling call
0709 12:21:44.338691 (+   477us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:44.339164 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:44.339196 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:44.339876 (+   680us) log.cc:844] Serialized 52 byte log entry
0709 12:21:44.365523 (+ 25647us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:44.365580 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.365681 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:47.027154 (+2661473us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:47.072782 (+ 45628us) raft_consensus.cc:1685] finished
0709 12:21:47.072803 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.075877 (+  3074us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5710,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":330,"spinlock_wait_cycles":2435365248,"thread_start_us":25127,"threads_started":1,"wal-append.queue_time_us":96294}
W20260709 12:21:47.130395 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.185108 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.189252 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:47.189563 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.189981 24002 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:47.190752 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.191916 24557 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:47.194468 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:47.195259 23922 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:47.195616 23922 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:47.196382 27743 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:47.197779 24558 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:47.198999 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.199702 23851 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:47.200636 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.201561 23851 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:47.204100 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.205142 23850 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:21:47.206226 27613 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:47.139145 27755 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:21:47.206794 27613 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:47.207472 27735 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.207861 27613 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:47.208467 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.209108 23853 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:47.210083 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.211467 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:47.202477 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.212369 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.196455 23922 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:47.215466 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 194602us
I20260709 12:21:47.222309 23922 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:47.222716 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.216639 23818 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:47.223510 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.224280 23852 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
W20260709 12:21:47.226073 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.227805 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.228513 23851 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 4.
I20260709 12:21:47.225500 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.175810 27775 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:47.230252 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 96310.4us
I20260709 12:21:47.234207 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.234640 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.188813 27627 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:47.228645 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 87339.6us
I20260709 12:21:47.222092 27742 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:47.231289 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:47.276798 24004 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:47.230291 27779 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:47.238955 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.201567 27762 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:47.248157 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:47.279798 24001 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:47.251458 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2177) took 4982 ms. Trace:
I20260709 12:21:47.235849 23852 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:47.240731 27747 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:47.230178 27735 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:21:47.287160 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.233598 27763 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 12:21:47.234845 23849 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:47.221740 27590 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:47.246416 27755 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:47.295953 23998 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:21:47.273051 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.273267 24002 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:47.289937 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:47.280421 23926 rpcz_store.cc:276] 0709 12:21:42.269782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.315667 (+ 45885us) service_pool.cc:224] Handling call
0709 12:21:42.316344 (+   677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:46.756810 (+4440466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.251088 (+494278us) spinlock_profiling.cc:243] Waited 4.42 s on lock 0x7b5400374bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:47.251371 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10168760704}
I20260709 12:21:47.278868 23850 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:47.295553 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.235414 27739 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:47.302561 23851 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 5.
I20260709 12:21:47.289364 23922 raft_consensus.cc:2410] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:47.290760 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.227773 27799 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.900471 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:47.296415 23998 pending_rounds.cc:85] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 4
I20260709 12:21:47.308213 23998 pending_rounds.cc:107] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:21:47.308530 23998 raft_consensus.cc:2889] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:47.308457 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.309363 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.307344 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.310062 24563 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:47.303926 23893 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:47.305480 23852 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:47.299995 23846 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:47.306880 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.313213 24555 raft_consensus.cc:2393] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:47.284098 27779 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.309386 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2091) took 1070 ms. Trace:
I20260709 12:21:47.314697 23818 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:47.314885 23998 rpcz_store.cc:276] 0709 12:21:46.238977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.270251 (+1031274us) service_pool.cc:224] Handling call
0709 12:21:47.287543 (+ 17292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.309147 (+ 21604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.309331 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:47.315519 24559 raft_consensus.cc:2393] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:47.276664 27627 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.323794 27522 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:47.324103 27779 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:47.324527 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:47.325520 24002 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:47.346695 23849 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:47.346859 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2092) took 1107 ms. Trace:
I20260709 12:21:47.347266 24002 rpcz_store.cc:276] 0709 12:21:46.239331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.297229 (+1057898us) service_pool.cc:224] Handling call
0709 12:21:47.325334 (+ 28105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.346602 (+ 21268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.346801 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:47.326858 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:47.347915 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:47.332526 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.333063 23922 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:47.349120 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.341643 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:47.349586 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 73133.2us
I20260709 12:21:47.350698 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:47.350847 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.343847 24004 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:21:47.348238 23845 raft_consensus.cc:2376] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12. Re-sending same reply.
I20260709 12:21:47.296520 27590 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:47.354920 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:47.356398 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 60976.1us
W20260709 12:21:47.355948 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 179571us
I20260709 12:21:47.358321 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.358703 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:47.357038 23817 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:47.360769 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 182559us
I20260709 12:21:47.363023 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:47.363907 24555 raft_consensus.cc:2376] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9. Re-sending same reply.
I20260709 12:21:47.361478 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:47.364758 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.366890 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:47.367486 23929 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:47.287909 27742 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:47.366281 27756 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:47.331338 27706 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.346194 27775 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:47.382130 23927 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:47.382794 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.397567 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.351567 27548 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.374228 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:47.347043 27627 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:47.400967 23926 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:47.345110 27755 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:47.401849 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.366158 27789 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:47.350181 27547 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:47.360533 27522 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:47.429304 24563 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:47.383356 27700 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:47.414193 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 63546.1us
I20260709 12:21:47.441677 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:47.383646 27743 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.330629 27799 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:47.443069 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.410295 24001 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:47.455672 23846 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:21:47.456707 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2095) took 1142 ms. Trace:
I20260709 12:21:47.400985 24555 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:47.448796 27742 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:47.435356 27452 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:47.406466 27706 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:47.450975 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.451174 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.517581 24563 raft_consensus.cc:2393] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:47.451355 27755 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:47.461334 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2090) took 1263 ms. Trace:
W20260709 12:21:47.510821 27803 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:21:47.532187 24554 raft_consensus.cc:2410] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:21:47.510699 27590 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:47.494216 27672 consensus_queue.cc:1059] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:21:47.515154 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:47.529784 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88223us
I20260709 12:21:47.457109 24001 rpcz_store.cc:276] 0709 12:21:46.390487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.455877 (+1065390us) service_pool.cc:224] Handling call
0709 12:21:47.456176 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.456345 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.456372 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:47.456422 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:47.456467 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.456543 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.456651 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:47.532553 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 125670us
I20260709 12:21:47.536633 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:47.537863 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:47.539003 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:47.530932 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 173964us
I20260709 12:21:47.530422 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2081) took 1771 ms. Trace:
I20260709 12:21:47.407189 27757 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:21:47.408730 27548 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:47.563550 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.564213 23852 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:47.565065 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.565667 23853 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:47.545277 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:47.556145 27706 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.558319 27812 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:47.559700 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:47.529347 24003 rpcz_store.cc:276] 0709 12:21:46.191347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.084067 (+892720us) service_pool.cc:224] Handling call
0709 12:21:47.084423 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:47.085762 (+  1339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.085795 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:47.086353 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:21:47.299825 (+213472us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:47.299873 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.299951 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:47.454777 (+154826us) raft_consensus.cc:1685] finished
0709 12:21:47.454797 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.454941 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":328,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":213063,"threads_started":1,"wal-append.queue_time_us":319661}
I20260709 12:21:47.541276 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:47.572986 23849 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:47.545157 23996 rpcz_store.cc:276] 0709 12:21:45.759356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.036211 (+1276855us) service_pool.cc:224] Handling call
0709 12:21:47.067616 (+ 31405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.067996 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:47.275077 (+207081us) log.cc:844] Serialized 14 byte log entry
0709 12:21:47.495090 (+220013us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:47.495149 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:47.530176 (+ 35027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.530248 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.530365 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7679,"prepare.queue_time_us":274955,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":7948,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":20879,"thread_start_us":286024,"threads_started":2}
I20260709 12:21:47.495141 27747 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:47.460520 27700 raft_consensus.cc:697] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:47.536963 23895 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:47.580430 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:47.586325 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 45110.3us
W20260709 12:21:47.586661 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49812.7us
I20260709 12:21:47.587567 23820 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:47.589092 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.589329 23817 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:47.589596 24555 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:47.458515 27781 consensus_queue.cc:1059] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 12:21:47.596290 23929 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:47.561165 27763 raft_consensus.cc:2764] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:21:47.458761 27495 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.116s
W20260709 12:21:47.600565 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.602090 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2097) took 1044 ms. Trace:
I20260709 12:21:47.602532 24003 rpcz_store.cc:276] 0709 12:21:46.557682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.573079 (+1015397us) service_pool.cc:224] Handling call
0709 12:21:47.592937 (+ 19858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.601634 (+  8697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.601676 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:47.601737 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:47.601782 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.601860 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.602027 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:47.603843 23996 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:47.576683 27812 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.531397 27789 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:21:47.591082 27590 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:47.632954 24524 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:47.638715 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 100935us
I20260709 12:21:47.639433 24555 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:47.575819 27739 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:21:47.639662 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:47.596623 27706 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:47.643923 27806 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:21:47.646358 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1933) took 3551 ms. Trace:
I20260709 12:21:47.649451 23999 rpcz_store.cc:276] 0709 12:21:44.094703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.742333 (+2647630us) service_pool.cc:224] Handling call
0709 12:21:46.758772 (+ 16439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.794831 (+ 36059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.646095 (+851264us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b54001a77d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:47.646271 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81749248}
I20260709 12:21:47.642930 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.651567 24555 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:47.654461 23998 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:47.605130 27775 raft_consensus.cc:697] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:47.610464 27762 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.658401 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:47.643260 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:47.578805 27620 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:21:47.646795 27756 raft_consensus.cc:3055] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:47.600127 27704 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:47.662266 23996 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:47.662544 24524 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:47.632622 27672 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:47.643905 27801 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:47.647950 27742 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:47.648519 27706 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:47.687651 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 100159us
I20260709 12:21:47.693346 24524 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:47.599722 27744 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:47.688733 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 113394us
I20260709 12:21:47.633741 27812 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:47.699457 23996 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:47.695675 27706 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:47.647389 27743 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:21:47.685580 27806 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:47.686141 27756 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:47.628829 27522 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:47.687404 27672 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:21:47.717945 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.746688 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:47.747433 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:47.819898 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.820204 23852 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:47.691439 27704 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:47.788157 24556 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 9: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:47.819916 23853 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:47.653366 27780 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:21:47.809398 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 220124us
I20260709 12:21:47.839865 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:47.696928 27763 raft_consensus.cc:2764] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:47.815083 23845 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:47.816130 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.817225 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:47.692220 27742 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.708027 27762 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:47.909065 27742 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:47.908388 27495 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:21:47.831969 27620 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:47.832890 27704 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:47.913004 24004 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:21:47.913424 24004 pending_rounds.cc:85] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 6
I20260709 12:21:47.913650 24004 pending_rounds.cc:107] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:21:47.914207 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:47.915176 24002 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:47.695489 27700 consensus_queue.cc:237] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:47.825446 27756 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:47.890195 23848 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:47.922662 24556 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:47.891523 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:47.811275 27813 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:47.894132 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.934101 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.896504 27777 raft_consensus.cc:3055] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:47.897606 27779 consensus_meta.cc:287] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.003s
W20260709 12:21:47.951568 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 268863us
I20260709 12:21:47.907208 24558 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:47.907817 23997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1914) took 5210 ms (client timeout 2568 ms). Trace:
I20260709 12:21:47.952301 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:47.908475 27809 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 12:21:47.915644 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:47.956311 23851 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:47.916561 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 61879.4us
I20260709 12:21:47.957846 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:47.823418 27672 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:47.918550 24004 raft_consensus.cc:2889] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:47.865199 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:47.924350 23853 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
W20260709 12:21:47.952370 23997 rpcz_store.cc:269] 0709 12:21:42.696955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.281856 (+1584901us) service_pool.cc:224] Handling call
0709 12:21:47.907616 (+3625760us) spinlock_profiling.cc:243] Waited 2.81 s on lock 0x7b54003f5cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:47.907750 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6466996480}
I20260709 12:21:47.947965 23849 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:47.824214 27747 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:47.954388 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 46835us
I20260709 12:21:47.829514 27789 raft_consensus.cc:3055] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:21:47.966854 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 273544us
W20260709 12:21:47.979045 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.992305 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.983191 27806 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:47.826834 27824 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:47.883530 27799 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.994807 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:47.995594 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:48.004175 23846 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:47.875502 27744 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.878779 27548 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:47.994158 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:48.008323 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1961) took 1068 ms. Trace:
I20260709 12:21:48.011260 24004 rpcz_store.cc:276] 0709 12:21:46.939593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.912363 (+972770us) service_pool.cc:224] Handling call
0709 12:21:47.912671 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:48.007943 (+ 95272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.008238 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:47.869360 27823 consensus_queue.cc:1059] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 12:21:48.000870 23893 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:47.882747 27831 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:47.993820 27789 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:48.004484 24556 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:48.006742 24003 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:21:47.878149 27768 consensus_queue.cc:1059] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 12:21:47.951000 27777 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:48.016314 27452 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:48.017130 27616 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:21:48.031147 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 2026) took 1220 ms. Trace:
I20260709 12:21:48.031430 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2094) took 1744 ms. Trace:
I20260709 12:21:48.031872 23998 rpcz_store.cc:276] 0709 12:21:46.286643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.354742 (+1068099us) service_pool.cc:224] Handling call
0709 12:21:47.648089 (+293347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.655020 (+  6931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.031242 (+376222us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54001a77d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:48.031372 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608392960}
I20260709 12:21:48.035215 23854 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:48.035591 23969 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:47.928026 27613 consensus_queue.cc:1059] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:21:48.007206 27685 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:21:48.031764 23921 rpcz_store.cc:276] 0709 12:21:46.812583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.819581 (+  6998us) service_pool.cc:224] Handling call
0709 12:21:48.030918 (+1211337us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b540039a654. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:48.031067 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126907264}
I20260709 12:21:47.837642 27775 consensus_queue.cc:237] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.038918 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:47.989317 27313 consensus_queue.cc:1059] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:21:48.049467 24004 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:47.959489 27779 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.029523 23893 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:48.041404 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:48.040349 23969 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:48.074106 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 48739.5us
I20260709 12:21:48.074515 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:48.075913 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:48.037513 27757 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:48.043601 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 2017) took 1294 ms. Trace:
I20260709 12:21:48.010419 27756 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:48.002369 27826 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:47.973582 27547 consensus_queue.cc:1059] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:21:47.972922 27814 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:21:48.015244 27813 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.077633 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 436) took 1946 ms. Trace:
I20260709 12:21:48.079908 23969 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.079690 23847 rpcz_store.cc:276] 0709 12:21:46.740340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.740529 (+   189us) service_pool.cc:224] Handling call
0709 12:21:48.034613 (+1294084us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54004295d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:48.034813 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772254976}
I20260709 12:21:48.048465 27755 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:48.007958 27821 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:21:48.094316 23848 raft_consensus.cc:2393] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:48.095330 23998 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:48.090387 24000 rpcz_store.cc:276] 0709 12:21:46.131358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.069938 (+938580us) service_pool.cc:224] Handling call
0709 12:21:47.070342 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:47.142151 (+ 71809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.142188 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:47.168361 (+ 26173us) log.cc:844] Serialized 26 byte log entry
0709 12:21:47.369111 (+200750us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:47.369153 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.369219 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.077443 (+708224us) raft_consensus.cc:1685] finished
0709 12:21:48.077463 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.077577 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2558,"raft.queue_time_us":2677,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":19917,"thread_start_us":138221,"threads_started":1,"wal-append.queue_time_us":249569}
I20260709 12:21:48.072414 27820 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:48.084653 27590 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.087551 27826 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:48.000433 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.086192 27739 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:48.099795 27816 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:48.096194 27755 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.120097 23998 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:21:48.146323 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 188590us
I20260709 12:21:48.147713 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:48.149981 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 148264us
I20260709 12:21:48.108024 27757 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:48.115887 27739 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.117195 27826 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:48.098785 27706 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.128032 27759 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:48.180398 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:48.148700 27755 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:48.195711 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.174569 27618 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:48.157218 27768 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:21:48.203545 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 289400us
I20260709 12:21:48.178139 27739 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:48.204839 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 218096us
I20260709 12:21:48.087186 27747 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.184406 27816 raft_consensus.cc:697] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:48.118206 27812 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:48.207109 23966 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.634s (SENT)
I20260709 12:21:48.218781 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.221762 23817 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:48.223559 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:48.223579 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 68621.9us
W20260709 12:21:48.217967 27801 consensus_meta.cc:287] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.514s	user 0.004s	sys 0.005s
W20260709 12:21:48.227028 23966 leader_election.cc:336] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.662s (SENT)
I20260709 12:21:48.231837 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.240976 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.230379 23817 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:48.243372 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:48.222546 27759 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:48.098130 27808 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 12:21:48.252302 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.247108 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:48.231133 27801 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:48.229060 27627 consensus_meta.cc:287] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.002s
I20260709 12:21:48.316455 23846 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
W20260709 12:21:48.271478 27807 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.423s	user 0.000s	sys 0.001s
I20260709 12:21:48.226943 27841 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:21:48.261857 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 189625us
I20260709 12:21:48.265084 27779 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:48.267058 23736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8630b76482c543a2a08e289b32b13ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 22996f888daf435398b693481171c18c (127.22.43.65:34895) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:48.260454 27763 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:48.253172 27813 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:48.232678 27821 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:48.250787 27522 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:48.309398 23818 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.245956 27830 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:48.269600 27816 consensus_queue.cc:237] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.316284 27848 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:48.324219 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 248278us
I20260709 12:21:48.225203 27840 consensus_queue.cc:1059] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 12:21:48.250737 27823 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:48.246564 27704 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:48.360249 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 51148.7us
I20260709 12:21:48.255867 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:48.361235 23892 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:48.320407 27844 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.071s	user 0.006s	sys 0.000s
I20260709 12:21:48.316545 27806 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:48.342379 27821 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:48.259627 27757 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:48.346555 27845 log.cc:927] Time spent T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:21:48.348007 27763 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:21:48.348524 27834 log.cc:927] Time spent T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 12:21:48.324141 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 148843us
I20260709 12:21:48.320142 27799 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:21:48.362830 27704 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:48.337821 23736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 71000.8us
I20260709 12:21:48.342694 27522 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:48.353967 27846 log.cc:927] Time spent T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.115s	user 0.001s	sys 0.003s
I20260709 12:21:48.365013 23818 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.365322 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:48.325629 27616 consensus_queue.cc:1059] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:21:48.352335 27779 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.387239 27779 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:48.387872 27836 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:21:48.355695 27815 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.532s	user 0.004s	sys 0.000s
I20260709 12:21:48.319806 27627 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.358824 27808 raft_consensus.cc:3055] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:21:48.378799 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 123089us
I20260709 12:21:48.342679 27813 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:48.382076 27763 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:48.389858 27779 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:48.393553 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2291) took 1061 ms. Trace:
I20260709 12:21:48.368404 27821 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:48.369408 27823 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:48.378657 27759 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:48.376135 27812 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:48.385572 27806 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:48.400628 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.368654 27768 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:21:48.385334 27706 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:48.379355 23895 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:48.380474 27780 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.386337 27704 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.385917 27547 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:48.390265 27522 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.414719 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2223) took 1395 ms. Trace:
I20260709 12:21:48.385453 27781 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.412071 23850 rpcz_store.cc:276] 0709 12:21:47.332489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.332992 (+   503us) service_pool.cc:224] Handling call
0709 12:21:47.357684 (+ 24692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:47.609076 (+251392us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:47.810801 (+201725us) log.cc:844] Serialized 14 byte log entry
0709 12:21:48.117353 (+306552us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:48.150171 (+ 32818us) log.cc:844] Serialized 26 byte log entry
0709 12:21:48.150394 (+   223us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:48.150447 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.150548 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.390853 (+240305us) raft_consensus.cc:1685] finished
0709 12:21:48.390886 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.393462 (+  2576us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":267736,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":68573,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":29484,"thread_start_us":639285,"threads_started":3,"wal-append.queue_time_us":392592}
I20260709 12:21:48.437853 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2103) took 1552 ms. Trace:
I20260709 12:21:48.418641 27858 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:21:48.419039 23925 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:48.419584 27827 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:48.433854 27739 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.442369 27827 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:48.442880 27827 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.444149 27739 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:48.445082 27627 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:48.445207 27776 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:48.437007 27812 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:48.446400 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:48.420575 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:48.447393 24559 raft_consensus.cc:2393] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 9: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:48.410372 27813 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:48.431059 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 65791.2us
I20260709 12:21:48.438318 23999 rpcz_store.cc:276] 0709 12:21:46.885190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.650884 (+765694us) service_pool.cc:224] Handling call
0709 12:21:47.686138 (+ 35254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:47.946936 (+260798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.946969 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:47.999838 (+ 52869us) log.cc:844] Serialized 26 byte log entry
0709 12:21:48.133287 (+133449us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:48.133351 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.133476 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.437628 (+304152us) raft_consensus.cc:1685] finished
0709 12:21:48.437647 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.437797 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25978,"raft.queue_time_us":140187,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8209,"thread_start_us":352508,"threads_started":2,"wal-append.queue_time_us":175323}
I20260709 12:21:48.453444 23892 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:48.437402 23920 rpcz_store.cc:276] 0709 12:21:47.012280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.057713 (+ 45433us) service_pool.cc:224] Handling call
0709 12:21:47.058098 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:47.058568 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:47.161528 (+102960us) log.cc:844] Serialized 14 byte log entry
0709 12:21:47.608485 (+446957us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:47.638670 (+ 30185us) log.cc:844] Serialized 52 byte log entry
0709 12:21:47.638849 (+   179us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:47.639161 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 12:21:47.892968 (+253807us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b1800378d00. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa284361a40 00007fa28435c4e4 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287 00007fa287467208
0709 12:21:47.893192 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.893273 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.349512 (+456239us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:48.407526 (+ 58014us) raft_consensus.cc:1685] finished
0709 12:21:48.407555 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.407743 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1342,"prepare.queue_time_us":248744,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":6967,"raft.queue_time_us":269968,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":22453,"spinlock_wait_cycles":27254912,"thread_start_us":484556,"threads_started":2,"wal-append.queue_time_us":508554}
I20260709 12:21:48.417797 27613 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:48.437738 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2084) took 2670 ms. Trace:
I20260709 12:21:48.417519 27759 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:48.448146 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.459349 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.398036 27808 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:48.436724 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 75814.5us
I20260709 12:21:48.471374 23818 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.472936 23818 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.454521 24559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36558 (request call id 695) took 1152 ms. Trace:
I20260709 12:21:48.396770 27854 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:21:48.415632 27672 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:48.456862 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 77592.8us
I20260709 12:21:48.473698 24559 rpcz_store.cc:276] 0709 12:21:47.295410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.366490 (+ 71080us) service_pool.cc:224] Handling call
0709 12:21:48.446236 (+1079746us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b580001b998. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:21:48.447779 (+  1543us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6238976}
I20260709 12:21:48.481611 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:48.457955 23995 rpcz_store.cc:276] 0709 12:21:45.760362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.043335 (+1282973us) service_pool.cc:224] Handling call
0709 12:21:47.077625 (+ 34290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:47.078182 (+   557us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:47.158729 (+ 80547us) log.cc:844] Serialized 14 byte log entry
0709 12:21:47.810372 (+651643us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:47.821729 (+ 11357us) log.cc:844] Serialized 26 byte log entry
0709 12:21:47.821962 (+   233us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:47.822021 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.822130 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.430052 (+607922us) raft_consensus.cc:1685] finished
0709 12:21:48.430100 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.430269 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":282791,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2735,"raft.queue_time_us":133216,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":16853,"thread_start_us":688518,"threads_started":3,"wal-append.queue_time_us":457144}
I20260709 12:21:48.446939 27812 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:48.487761 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:48.488713 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:48.494248 24556 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:48.453807 27739 raft_consensus.cc:2764] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:21:48.469153 27700 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:48.468848 27759 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:48.499711 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.505268 23818 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.495468 27848 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:48.495980 27812 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:48.500985 27685 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:48.436163 27780 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.486858 27860 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:48.510680 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 51434.5us
I20260709 12:21:48.492497 27627 consensus_queue.cc:1059] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:21:48.522392 23966 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:48.492658 27841 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:21:48.523639 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:48.527104 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.511874 27739 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:48.518074 27852 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:21:48.531599 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.537110 23818 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.508472 27806 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.540503 23845 pending_rounds.cc:85] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 8
I20260709 12:21:48.540828 23845 pending_rounds.cc:107] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:21:48.541065 23845 raft_consensus.cc:2889] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:48.542886 27853 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:48.543406 27853 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.543776 27853 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:48.543675 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:48.544664 23850 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:48.545433 27819 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:48.454803 27763 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.550055 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:48.547425 27857 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:21:48.533325 27739 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.565934 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:48.513823 27776 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:21:48.554622 23846 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:21:48.528159 27848 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:48.528910 27862 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.532137 27613 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:48.503078 27823 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:48.590415 24554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36558 (request call id 703) took 1271 ms (client timeout 1639 ms). Trace:
W20260709 12:21:48.592592 24554 rpcz_store.cc:269] 0709 12:21:47.318895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.332278 (+ 13383us) service_pool.cc:224] Handling call
0709 12:21:48.572438 (+1240160us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54004678d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:48.590340 (+ 17902us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383296768}
I20260709 12:21:48.575299 23818 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:48.532994 27816 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 12:21:48.598215 23969 leader_election.cc:336] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 1.639s (SENT)
I20260709 12:21:48.508992 27808 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.536262 27747 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:48.571650 27757 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:48.569851 27739 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.563284 27867 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:48.603654 27700 raft_consensus.cc:2764] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:21:48.606129 27742 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.004s
I20260709 12:21:48.645529 27742 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.646396 27871 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:48.646883 27871 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:48.647295 27871 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:48.608009 27826 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.649647 23997 raft_consensus.cc:2393] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:48.650130 27742 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:48.652074 27826 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:48.651856 27704 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.653155 23849 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:21:48.603894 27763 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.658170 24559 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:21:48.659121 27871 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.661381 27871 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:48.564141 27819 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.667805 27819 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:48.609133 27744 consensus_queue.cc:1059] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:21:48.609135 27747 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.674782 27742 raft_consensus.cc:3055] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:48.675213 27747 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:48.675292 27742 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:21:48.622129 24524 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.564s (SENT)
W20260709 12:21:48.638725 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 72922.4us
I20260709 12:21:48.678228 23892 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:48.573769 27860 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:48.574640 27672 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:48.643430 27808 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:48.644052 27756 consensus_meta.cc:287] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.002s
I20260709 12:21:48.644706 27700 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:21:48.710736 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88669.6us
I20260709 12:21:48.711097 24556 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:48.716122 23892 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:48.639309 27757 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:48.703606 27627 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:48.641912 27867 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:48.709573 27755 consensus_meta.cc:287] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.004s
W20260709 12:21:48.731674 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 181665us
I20260709 12:21:48.724241 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:48.732931 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:48.735386 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:48.736177 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.736966 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.740178 24557 raft_consensus.cc:2393] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:48.744899 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:48.747912 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:48.753995 27875 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:48.754540 27875 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.755005 27875 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.731887 27867 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:48.756150 27874 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:48.756687 27874 raft_consensus.cc:697] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:48.754485 27780 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:48.758140 27869 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:48.758472 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:48.759459 27618 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:48.759642 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:48.759949 27618 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.760819 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:48.761670 27866 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:21:48.761938 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:48.763094 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:48.763401 27859 raft_consensus.cc:3055] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:48.763764 23995 raft_consensus.cc:2393] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:48.763885 27859 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:48.764962 23995 raft_consensus.cc:1240] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:48.768076 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:48.768590 23818 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.768988 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:48.771924 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:48.726141 27627 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.780702 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 438) took 2001 ms. Trace:
I20260709 12:21:48.781098 24003 rpcz_store.cc:276] 0709 12:21:46.779583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.603707 (+824124us) service_pool.cc:224] Handling call
0709 12:21:47.634424 (+ 30717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:48.021005 (+386581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.780451 (+759446us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54001d2254. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:48.780641 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855672064}
I20260709 12:21:48.676347 27742 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.741597 27819 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:48.786439 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:48.786063 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 70024.7us
I20260709 12:21:48.761695 27707 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:48.742025 27704 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:48.792863 23892 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:48.795970 24003 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:48.780328 27871 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:48.785565 27627 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.809726 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2096) took 2365 ms. Trace:
I20260709 12:21:48.785952 27826 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:48.669633 27848 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.819603 23929 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:48.821157 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:48.785730 27868 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.748469 27756 consensus_queue.cc:1059] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:21:48.815716 23920 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:48.814930 24001 rpcz_store.cc:276] 0709 12:21:46.447441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.536362 (+1088921us) service_pool.cc:224] Handling call
0709 12:21:47.582785 (+ 46423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.696100 (+113315us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:47.744454 (+ 48354us) log.cc:844] Serialized 14 byte log entry
0709 12:21:48.554619 (+810165us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b1800463a80. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a 00007fa287456a2a
0709 12:21:48.809411 (+254792us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:48.809457 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:48.809502 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.809585 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.809676 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54861,"prepare.run_wall_time_us":2405,"raft.queue_time_us":168235,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":4489,"spinlock_wait_cycles":26243072,"thread_start_us":367288,"threads_started":2}
I20260709 12:21:48.785619 27672 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.795194 27819 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.833603 27819 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:48.834023 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.835868 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.819322 24558 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:48.838019 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.812278 23995 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:21:48.740572 27755 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.840502 24000 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:48.842342 27755 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:48.826340 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.748647 27860 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:21:48.842724 27819 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.830698 24557 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:48.843853 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.845715 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.846146 27819 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:48.859565 23921 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:48.860478 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.861799 23920 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:48.810941 27700 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:48.808835 27745 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:48.864114 24556 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:21:48.814435 27742 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:48.862433 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 76073us
I20260709 12:21:48.867731 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:48.816815 27826 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.766641 27613 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.874987 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:48.818811 27806 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:48.875615 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.871392 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.816347 27707 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:48.757650 27874 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.881211 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.894536 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.865116 27779 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:48.865799 27700 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:48.764978 27859 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.876645 27826 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.789109 27757 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.816877 27862 consensus_queue.cc:1059] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:21:48.910953 23966 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:48.872660 27745 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.895316 27704 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:48.874511 27672 consensus_queue.cc:1059] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:21:48.936157 24524 leader_election.cc:336] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.878s (SENT)
I20260709 12:21:48.903560 27700 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:48.860159 27868 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.902845 27827 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.938295 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.940713 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:48.941795 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:48.955608 23929 raft_consensus.cc:2410] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:21:48.896631 27806 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:48.926635 27757 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:48.958895 27879 log.cc:927] Time spent T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:21:48.955614 27672 consensus_queue.cc:1243] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:21:48.942359 27863 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:21:48.903905 27840 consensus_queue.cc:1059] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:21:48.910159 27780 consensus_queue.cc:1059] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:21:48.962266 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:49.001706 23995 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:48.972811 23926 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:48.966251 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:48.966491 27865 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
W20260709 12:21:48.966491 27873 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 12:21:48.962714 27872 log.cc:927] Time spent T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:21:48.968820 27522 consensus_meta.cc:287] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.005s
I20260709 12:21:48.961835 27685 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:48.981196 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:48.903453 27707 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:48.942569 27755 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:48.962021 27878 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:48.962344 27877 raft_consensus.cc:2764] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:48.982743 27827 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:48.900184 27821 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:49.005713 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 174745us
I20260709 12:21:48.961989 27822 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.014227 24001 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:48.962446 27876 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:21:49.026472 27522 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.027123 23998 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
W20260709 12:21:49.040714 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 104621us
I20260709 12:21:49.042841 23998 pending_rounds.cc:85] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 6
I20260709 12:21:49.043181 23998 pending_rounds.cc:107] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:21:49.043437 23998 raft_consensus.cc:2889] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:49.043905 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:49.044672 24556 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:49.029068 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:49.029949 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:49.023782 27840 consensus_queue.cc:1243] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:49.025568 27704 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.055254 27707 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:49.055017 27618 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.059793 27627 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.063198 27806 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:49.066812 24001 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:49.075166 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:49.077286 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:49.077862 24001 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:49.081512 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:49.083595 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:49.084990 27886 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:21:49.087330 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:49.088217 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 2035) took 1340 ms. Trace:
I20260709 12:21:49.088546 23851 rpcz_store.cc:276] 0709 12:21:47.748236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.957068 (+208832us) service_pool.cc:224] Handling call
0709 12:21:49.087173 (+1130105us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:21:49.088136 (+   963us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4855040}
I20260709 12:21:49.089011 27826 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.090133 23995 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:49.093662 23920 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:49.094573 27888 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:49.095674 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:49.100589 27868 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:49.101094 27838 raft_consensus.cc:3055] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:49.101594 27838 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:49.038364 27823 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:21:49.104462 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:49.110700 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:49.111030 27821 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:49.091362 27878 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.112358 27878 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.115974 27859 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.118311 27522 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:49.122033 27548 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:49.122499 27548 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:49.122969 23852 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:49.123340 27548 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.124468 27548 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.124835 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:49.111811 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:49.134428 24524 leader_election.cc:336] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.064s (SENT)
I20260709 12:21:49.125752 23847 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:49.073122 27704 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.139310 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:49.144904 23845 raft_consensus.cc:3055] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:49.145280 23850 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:49.145859 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:49.146786 23846 raft_consensus.cc:2410] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:49.147913 23846 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:49.144085 27867 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.145293 23845 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:49.156296 23845 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.155616 27867 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:49.163141 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:49.163558 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 285226us
W20260709 12:21:49.143201 27813 consensus_meta.cc:287] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.672s	user 0.000s	sys 0.013s
I20260709 12:21:49.155619 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:49.166384 23847 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.166289 23927 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:21:49.151710 27618 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:49.189419 27759 consensus_meta.cc:287] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.679s	user 0.003s	sys 0.008s
I20260709 12:21:49.206573 24001 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:49.210183 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:49.199699 27812 consensus_meta.cc:287] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.679s	user 0.014s	sys 0.000s
W20260709 12:21:49.208658 27853 consensus_meta.cc:287] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.664s	user 0.015s	sys 0.000s
I20260709 12:21:49.205341 27821 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.173733 27813 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.211005 27704 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:49.206023 27878 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:49.249233 23851 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:49.208361 27700 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.212061 27759 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.219393 27812 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.257270 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:49.248282 27627 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:49.234091 27821 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.138007 27838 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.259193 27826 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:49.264191 27685 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.353144 23847 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:21:49.286175 27739 consensus_meta.cc:287] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.000s
I20260709 12:21:49.230741 27853 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.274398 27891 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:49.265035 27747 consensus_meta.cc:287] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.589s	user 0.005s	sys 0.008s
W20260709 12:21:49.356679 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 112805us
I20260709 12:21:49.357707 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:49.366096 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.366786 27745 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:49.371236 27812 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:49.372471 27777 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.373908 27777 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:49.378409 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.379590 27821 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:49.382293 27822 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.385046 27780 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:49.386106 27823 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:49.355001 27875 consensus_meta.cc:287] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.007s
I20260709 12:21:49.385710 27780 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.402429 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:49.360950 27747 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.402607 23923 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:49.419541 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:49.430183 23852 raft_consensus.cc:2368] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8.
I20260709 12:21:49.403074 23847 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:49.358162 27685 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.431771 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:49.432803 23846 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:49.386709 27823 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.438164 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:49.439839 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2266) took 2565 ms. Trace:
I20260709 12:21:49.441576 23999 raft_consensus.cc:2393] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 5: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:49.441612 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:49.358541 27739 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.440272 23854 rpcz_store.cc:276] 0709 12:21:46.868861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.899150 (+ 30289us) service_pool.cc:224] Handling call
0709 12:21:48.034945 (+1135795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:48.035828 (+   883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.434241 (+1398413us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54004295d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:49.434383 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2611396864}
I20260709 12:21:49.443518 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:49.444167 24557 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:49.398533 27700 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:49.441829 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:49.443521 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:49.448184 23854 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:49.449097 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:49.448168 23846 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:49.452541 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:49.454780 24557 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:49.456959 24554 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:49.395006 27856 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:49.459281 23820 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:49.420984 27875 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.516816 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:49.502032 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:49.564308 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 105107us
I20260709 12:21:49.531656 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:49.557869 23854 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:21:49.566028 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:49.533723 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2107) took 2497 ms. Trace:
I20260709 12:21:49.548801 24524 leader_election.cc:400] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8.
I20260709 12:21:49.500468 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 2037) took 2167 ms. Trace:
I20260709 12:21:49.567284 24524 leader_election.cc:403] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:49.516983 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 2031) took 1770 ms. Trace:
I20260709 12:21:49.505059 23924 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:21:49.477564 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:49.568434 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 51730.2us
I20260709 12:21:49.460704 23846 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:49.566998 24002 rpcz_store.cc:276] 0709 12:21:47.036022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.916011 (+879989us) service_pool.cc:224] Handling call
0709 12:21:47.971707 (+ 55696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:47.993341 (+ 21634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.993376 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:48.005252 (+ 11876us) log.cc:844] Serialized 26 byte log entry
0709 12:21:48.099106 (+ 93854us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:48.099147 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.099521 (+   374us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:49.532735 (+1433214us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b2400261278. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa2841e59c4 00007fa2841e3acb 00007fa28439edc9 00007fa28439ea55 00007fa28439dfb0 00007fa287014488 00007fa287014be8 00007fa286fec398 00007fa286fe776a 00007fa286fe6bb6
0709 12:21:49.533426 (+   691us) raft_consensus.cc:1685] finished
0709 12:21:49.533450 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:49.533659 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13238,"raft.queue_time_us":1394,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":10031,"spinlock_wait_cycles":23215488,"thread_start_us":47174,"threads_started":1,"wal-append.queue_time_us":147594}
I20260709 12:21:49.567633 23925 rpcz_store.cc:276] 0709 12:21:47.333138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.333341 (+   203us) service_pool.cc:224] Handling call
0709 12:21:49.500177 (+2166836us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000118d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:49.500388 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437315328}
I20260709 12:21:49.569264 23848 rpcz_store.cc:276] 0709 12:21:47.747002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.951272 (+204270us) service_pool.cc:224] Handling call
0709 12:21:49.516718 (+1565446us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b54001b21d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:49.516901 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192021760}
I20260709 12:21:49.510851 24559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 857) took 1024 ms. Trace:
I20260709 12:21:49.577821 24559 rpcz_store.cc:276] 0709 12:21:48.486080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.487284 (+  1204us) service_pool.cc:224] Handling call
0709 12:21:48.502514 (+ 15230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:48.658688 (+156174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.510457 (+851769us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54006e0fd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:49.510761 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357327104}
W20260709 12:21:49.583166 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.576370 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:49.508533 27742 consensus_meta.cc:287] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.003s
I20260709 12:21:49.516422 27819 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:49.538681 27823 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:49.617496 27819 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:49.605484 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:49.635388 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:49.636494 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:49.637072 23998 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:49.635874 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 69081.3us
I20260709 12:21:49.638195 23848 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:49.502400 27685 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:49.569283 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.482436 27813 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:49.609165 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:49.609776 23921 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:49.614753 27824 raft_consensus.cc:3055] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:49.615593 27839 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 1.390s	user 0.004s	sys 0.005s
I20260709 12:21:49.482182 27706 raft_consensus.cc:3055] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:49.461323 27859 consensus_queue.cc:1059] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 12:21:49.480887 27876 raft_consensus.cc:3055] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:21:49.540617 27847 log.cc:927] Time spent T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 1.215s	user 0.003s	sys 0.000s
I20260709 12:21:49.498720 27759 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:49.639628 27830 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.461522 27902 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:49.624868 24556 raft_consensus.cc:2410] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:21:49.632728 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:49.633934 23925 raft_consensus.cc:2410] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:21:49.642247 27826 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.640502 24001 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:49.573778 27801 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.670934 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:49.485034 27891 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.638770 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:49.649904 27824 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:49.607079 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:49.574597 27779 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:49.689172 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 50488.1us
I20260709 12:21:49.582908 27775 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:49.643882 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:49.483059 27856 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:49.648273 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:49.649119 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:49.641826 23893 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:49.704073 24555 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:49.650287 24562 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:49.650758 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:49.704692 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 62973.5us
W20260709 12:21:49.651822 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.589074 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:49.637461 27590 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:49.539192 27757 consensus_meta.cc:287] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.560s	user 0.019s	sys 0.005s
I20260709 12:21:49.664528 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:49.671743 24561 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
W20260709 12:21:49.687620 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.706249 24563 raft_consensus.cc:2393] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 9: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:49.656621 27706 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:49.643006 27756 consensus_queue.cc:1059] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:21:49.656294 27876 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:49.701678 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:49.715015 23995 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:49.665715 27853 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:49.650019 27750 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:21:49.717561 23922 raft_consensus.cc:2410] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:21:49.651168 27685 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:21:49.502813 27789 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.749831 24554 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:49.702061 27775 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.718250 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:49.702965 27819 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.756089 24002 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:49.756482 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:49.746760 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:49.758946 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:49.760373 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:49.761505 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:49.675365 27826 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.701907 27820 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.766297 23853 raft_consensus.cc:3055] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:49.766800 23853 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:49.750773 27857 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:21:49.784204 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2112) took 2569 ms. Trace:
I20260709 12:21:49.784837 24004 rpcz_store.cc:276] 0709 12:21:47.214730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.052714 (+837984us) service_pool.cc:224] Handling call
0709 12:21:48.074189 (+ 21475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:48.074607 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:48.074639 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:48.075194 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:21:48.153529 (+ 78335us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:48.153570 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.153638 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:49.539884 (+1386246us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:49.765258 (+225374us) raft_consensus.cc:1685] finished
0709 12:21:49.765286 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:49.784091 (+ 18805us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4610,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":11185,"spinlock_wait_cycles":7798016,"thread_start_us":77921,"threads_started":1,"wal-append.queue_time_us":159396}
I20260709 12:21:49.749187 27858 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.762388 27775 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:49.788682 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2106) took 2860 ms. Trace:
I20260709 12:21:49.754407 27780 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:49.796514 23996 rpcz_store.cc:276] 0709 12:21:46.927863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.700256 (+772393us) service_pool.cc:224] Handling call
0709 12:21:47.793105 (+ 92849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:47.818741 (+ 25636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.818778 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:47.828427 (+  9649us) log.cc:844] Serialized 26 byte log entry
0709 12:21:48.146495 (+318068us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:48.146536 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.146626 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:49.613858 (+1467232us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b2400261278. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa2841e59c4 00007fa2841e3acb 00007fa28439edc9 00007fa28439ea55 00007fa28439e09d 00007fa286fd010e 00007fa286fe788c 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221
0709 12:21:49.769281 (+155423us) raft_consensus.cc:1685] finished
0709 12:21:49.769303 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:49.788613 (+ 19310us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114255,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":18339712,"thread_start_us":156392,"threads_started":1,"wal-append.queue_time_us":268861}
I20260709 12:21:49.719745 27747 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:49.811465 23927 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:21:49.717540 27590 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.822098 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:49.823123 23927 raft_consensus.cc:2410] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:49.821442 24002 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:21:49.795703 27739 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:49.753666 27821 consensus_queue.cc:1059] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 12:21:49.863467 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.767844 23853 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.888021 23853 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.672505 27830 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.674417 27902 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:49.840255 27869 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.011s	sys 0.023s
I20260709 12:21:49.745784 27824 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:49.923487 27664 raft_consensus.cc:3055] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:49.924150 27664 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:49.926990 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:49.892583 27590 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:49.912679 27830 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:49.912885 27902 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:49.930146 23851 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: [8.7-13.9]
I20260709 12:21:49.931330 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:49.703433 27856 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:49.938683 23851 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:21:49.939914 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:49.941794 23851 pending_rounds.cc:85] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 5
I20260709 12:21:49.906992 27875 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:49.944633 27856 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:49.956290 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 446) took 1418 ms. Trace:
I20260709 12:21:49.956678 23849 rpcz_store.cc:276] 0709 12:21:48.537766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.537896 (+   130us) service_pool.cc:224] Handling call
0709 12:21:48.538207 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:48.653508 (+115301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.956009 (+1302501us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54001b2bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:49.956228 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263810816}
I20260709 12:21:49.957242 23851 pending_rounds.cc:107] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:21:49.957580 23851 raft_consensus.cc:2889] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:49.958381 23849 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:49.947556 27904 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:21:49.960639 23849 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:49.962131 23998 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:49.969199 27789 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.932334 23853 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:21:49.977075 27831 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:21:49.978456 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2036) took 2230 ms. Trace:
I20260709 12:21:49.980829 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 420) took 1080 ms. Trace:
W20260709 12:21:49.948302 27905 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:49.981248 23921 rpcz_store.cc:276] 0709 12:21:48.900987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.901103 (+   116us) service_pool.cc:224] Handling call
0709 12:21:49.609608 (+708505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:49.648003 (+ 38395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.980582 (+332579us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540018b0d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:49.980770 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611487616}
I20260709 12:21:49.984125 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 422) took 1044 ms. Trace:
I20260709 12:21:49.999703 23923 rpcz_store.cc:276] 0709 12:21:48.940162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.940385 (+   223us) service_pool.cc:224] Handling call
0709 12:21:49.983945 (+1043560us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b540039a654. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:49.984068 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1025430912}
I20260709 12:21:50.001060 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:50.001858 23923 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:49.965673 23998 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:50.008920 23998 pending_rounds.cc:85] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 4
I20260709 12:21:50.009305 23998 pending_rounds.cc:107] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:21:50.009590 23998 raft_consensus.cc:2889] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:49.953583 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 287808us
I20260709 12:21:49.978860 23853 rpcz_store.cc:276] 0709 12:21:47.748530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.997697 (+249167us) service_pool.cc:224] Handling call
0709 12:21:47.998056 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:49.766176 (+1768120us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b54000e86a0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873c3dc0 00007fa28744e1c0 00007fa28744f231 00007fa28744bd8f 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c
0709 12:21:49.976861 (+210685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.978391 (+  1530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171493248}
I20260709 12:21:49.941370 27824 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.910462 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:50.011612 24524 leader_election.cc:336] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.660s (SENT)
I20260709 12:21:50.010411 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:50.012686 23923 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:50.014184 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:50.015470 27806 consensus_queue.cc:1059] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:50.016501 27806 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:50.016932 27806 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.017294 27806 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:50.018079 27799 raft_consensus.cc:3055] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:50.018606 27799 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:50.019630 27799 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.021193 27799 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:50.030928 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:50.031596 24556 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:49.908231 27869 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.011s	sys 0.024s
I20260709 12:21:50.033063 23848 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:50.036580 24559 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:50.038221 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:50.038414 23895 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:49.996954 27860 raft_consensus.cc:3055] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:50.058979 27856 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:50.059221 27919 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:21:50.059530 27856 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.060122 27856 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:50.062090 27907 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:21:50.069010 27856 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.071414 27854 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.072012 27854 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:50.074790 27854 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:50.051059 27860 raft_consensus.cc:740] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:50.075275 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.076154 23847 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:50.076339 27860 consensus_queue.cc:260] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.078161 27856 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:50.030915 27664 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.079073 27664 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.079542 27757 raft_consensus.cc:3055] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:50.080039 27757 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:50.084020 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 2046) took 1258 ms. Trace:
I20260709 12:21:50.084491 23929 rpcz_store.cc:276] 0709 12:21:48.826004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.826112 (+   108us) service_pool.cc:224] Handling call
0709 12:21:50.083738 (+1257626us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540039b054. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:50.083944 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257383168}
I20260709 12:21:50.086123 23845 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:50.086953 23852 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:50.088297 23852 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:21:50.090178 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:50.090523 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 451) took 1131 ms. Trace:
I20260709 12:21:50.090932 23996 rpcz_store.cc:276] 0709 12:21:48.985833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.808395 (+822562us) service_pool.cc:224] Handling call
0709 12:21:49.822493 (+ 14098us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:49.822890 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.822919 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:49.823493 (+   574us) log.cc:844] Serialized 52 byte log entry
0709 12:21:49.939650 (+116157us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:49.939696 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.939773 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.090327 (+150554us) raft_consensus.cc:1685] finished
0709 12:21:50.090345 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.090466 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":381,"raft.queue_time_us":1725,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3299,"thread_start_us":115747,"threads_started":1,"wal-append.queue_time_us":208793}
I20260709 12:21:50.092059 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2047) took 1262 ms. Trace:
I20260709 12:21:50.092439 23924 rpcz_store.cc:276] 0709 12:21:48.829318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.829440 (+   122us) service_pool.cc:224] Handling call
0709 12:21:48.867648 (+ 38208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:49.570973 (+703325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.091847 (+520874us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54002788d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:50.092006 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464961792}
I20260709 12:21:50.093001 23996 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: [8.7-13.9]
I20260709 12:21:50.093528 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:50.070957 27706 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:50.094312 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.085615 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:50.109813 23929 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:50.077665 27860 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:50.098546 24556 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:50.114782 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:50.115031 23845 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:21:50.095973 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:50.115453 23927 raft_consensus.cc:2376] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11. Re-sending same reply.
I20260709 12:21:50.115733 24557 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.116039 23895 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:50.116345 23845 pending_rounds.cc:85] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 6
I20260709 12:21:50.043467 27826 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:50.116755 23845 pending_rounds.cc:107] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:21:50.120076 23845 raft_consensus.cc:2889] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:50.120397 23929 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 12:21:50.075301 27906 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:21:50.131671 23846 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:50.133415 23929 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:21:50.081076 27757 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.139500 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:50.193418 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 426) took 1164 ms. Trace:
I20260709 12:21:50.193828 23927 rpcz_store.cc:276] 0709 12:21:49.029505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.116160 (+1086655us) service_pool.cc:224] Handling call
0709 12:21:50.193349 (+ 77189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:50.177924 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1982) took 1431 ms. Trace:
I20260709 12:21:50.194865 23999 rpcz_store.cc:276] 0709 12:21:48.746278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.760607 (+ 14329us) service_pool.cc:224] Handling call
0709 12:21:50.177687 (+1417080us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b540012bbd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:50.177838 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1563511040}
I20260709 12:21:50.159389 23924 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:21:50.136276 27821 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.197177 24004 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:50.199383 24004 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:50.200484 24004 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:50.200856 27916 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:21:50.203027 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.204041 27855 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:50.204100 27613 consensus_queue.cc:1059] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:50.205842 23999 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:50.205925 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1976) took 1461 ms. Trace:
I20260709 12:21:50.127506 27875 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:50.206769 24000 rpcz_store.cc:276] 0709 12:21:48.744505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.744644 (+   139us) service_pool.cc:224] Handling call
0709 12:21:50.205663 (+1461019us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b54001d3154. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:50.205844 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217972608}
I20260709 12:21:50.201700 24004 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:50.208268 24000 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:50.178624 24003 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 12:21:50.130385 27862 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 12:21:50.096875 27745 consensus_queue.cc:1175] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" responder_term: 10 status { last_received { term: 9 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:50.198047 27821 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.212669 26910 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 12:21:50.218326 27908 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:21:50.211486 27875 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:50.219692 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2048) took 1085 ms. Trace:
I20260709 12:21:50.220163 23850 rpcz_store.cc:276] 0709 12:21:49.134162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.163379 (+ 29217us) service_pool.cc:224] Handling call
0709 12:21:49.169445 (+  6066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.186652 (+ 17207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.186706 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:49.187385 (+   679us) log.cc:844] Serialized 26 byte log entry
0709 12:21:49.538073 (+350688us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b1800369280. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec0d1 00007fa287407a0f
0709 12:21:49.837535 (+299462us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:49.837572 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.837653 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.219379 (+381726us) raft_consensus.cc:1685] finished
0709 12:21:50.219396 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.219614 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12871,"raft.queue_time_us":28529,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4582,"spinlock_wait_cycles":4438272,"thread_start_us":299270,"threads_started":1,"wal-append.queue_time_us":741600}
I20260709 12:21:50.223483 23847 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:50.226996 27757 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:50.139654 23929 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:50.137394 27548 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:50.203789 27916 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:21:50.238488 27875 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:50.236364 27613 consensus_queue.cc:1059] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:21:50.246327 27706 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:50.246604 27548 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:50.263643 27799 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:50.280085 27915 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.400s	user 0.004s	sys 0.000s
W20260709 12:21:50.313134 27921 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:21:50.314787 27853 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:50.314957 24002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 1987) took 1274 ms. Trace:
I20260709 12:21:50.315255 27853 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:50.316186 27853 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:50.315462 24002 rpcz_store.cc:276] 0709 12:21:49.040205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.824374 (+784169us) service_pool.cc:224] Handling call
0709 12:21:49.824761 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.837085 (+ 12324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.837147 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:49.837650 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.118725 (+281075us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:50.118769 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.118832 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.314636 (+195804us) raft_consensus.cc:1685] finished
0709 12:21:50.314676 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.314878 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11771,"raft.queue_time_us":13566,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":40688,"thread_start_us":217101,"threads_started":1,"wal-append.queue_time_us":352544}
I20260709 12:21:50.317576 27853 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:50.318884 27925 log.cc:927] Time spent T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:21:50.321323 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.327517 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:50.356071 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:50.356426 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.328490 23847 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:21:50.357399 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.329921 27814 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.333468 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:50.334321 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.336113 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.383368 23845 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:21:50.383800 24002 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:50.384243 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.384541 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:50.336792 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:50.343155 27801 consensus_meta.cc:287] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.001s
I20260709 12:21:50.337550 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.385390 23854 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:50.385746 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:50.395125 24004 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:21:50.396307 24004 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:50.382254 23846 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:50.295521 27799 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.399508 23893 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:50.397403 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.402684 23852 raft_consensus.cc:2393] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:50.398241 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:50.404976 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.404999 24557 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
W20260709 12:21:50.405793 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:50.406186 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:50.406549 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:50.407058 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.408353 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.409220 23845 raft_consensus.cc:2393] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 5: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:50.412182 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:50.412814 24002 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.408538 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.414469 23847 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:50.414705 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.417238 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.435878 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:50.442773 23997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 2115) took 2466 ms (client timeout 2005 ms). Trace:
W20260709 12:21:50.443207 23997 rpcz_store.cc:269] 0709 12:21:47.976656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.022804 (+ 46148us) service_pool.cc:224] Handling call
0709 12:21:50.442530 (+2419726us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b540040ddd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:50.442689 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328854272}
I20260709 12:21:50.408385 27801 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8.
I20260709 12:21:50.425650 27927 consensus_queue.cc:1059] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:21:50.413800 27916 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:21:50.435963 27926 log.cc:927] Time spent T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 12:21:50.473155 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 97053us
I20260709 12:21:50.500162 26910 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:50.566555 23997 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:50.391498 27898 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:21:50.426302 27868 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.350178 27548 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.392143 27814 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.401497 27855 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:21:50.508674 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.510456 24002 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:50.511030 23847 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:21:50.511224 23854 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
W20260709 12:21:50.536960 27775 consensus_meta.cc:287] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.712s	user 0.014s	sys 0.000s
W20260709 12:21:50.567077 23966 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.524s (SENT)
I20260709 12:21:50.596350 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:50.432447 27806 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.606037 27927 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.605823 27775 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:50.606725 27927 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:50.609053 27927 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:50.609093 27775 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:50.609946 27830 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:50.573441 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 162937us
I20260709 12:21:50.509523 27916 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.614209 27916 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:50.605902 27806 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:50.615336 27806 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:50.615804 27806 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.593348 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.618294 23854 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:50.594637 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:50.622146 27830 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:50.617823 27806 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:50.623135 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:50.623994 23847 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:50.624881 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:50.565315 26910 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:50.603821 23966 leader_election.cc:336] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.642s (SENT)
I20260709 12:21:50.625566 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:50.626111 26910 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:50.626654 23966 leader_election.cc:336] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.672s (SENT)
I20260709 12:21:50.627281 26910 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:50.627460 23966 leader_election.cc:336] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.684s (SENT)
I20260709 12:21:50.627878 23966 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:50.623252 27806 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.628856 27806 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:50.599786 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.598523 24002 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:50.630648 27822 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:50.633679 27806 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:50.634972 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:50.636324 23846 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:50.638358 23853 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:50.638633 27935 log.cc:927] Time spent T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:21:50.634990 27830 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:50.642081 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2124) took 1065 ms. Trace:
I20260709 12:21:50.642590 23996 rpcz_store.cc:276] 0709 12:21:49.576545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.093762 (+517217us) service_pool.cc:224] Handling call
0709 12:21:50.100261 (+  6499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.100662 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:50.100692 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:50.129934 (+ 29242us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.442733 (+312799us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:50.442782 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.442849 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.641693 (+198844us) raft_consensus.cc:1685] finished
0709 12:21:50.641719 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.642013 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":24508,"thread_start_us":260855,"threads_started":1,"wal-append.queue_time_us":442570}
I20260709 12:21:50.589570 27868 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:50.645120 23852 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:21:50.645599 27936 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 12:21:50.646308 27868 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:50.646795 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2065) took 1061 ms. Trace:
W20260709 12:21:50.647182 27934 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
W20260709 12:21:50.648331 27860 consensus_meta.cc:287] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.006s
I20260709 12:21:50.647159 23848 rpcz_store.cc:276] 0709 12:21:49.585449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.035324 (+449875us) service_pool.cc:224] Handling call
0709 12:21:50.047032 (+ 11708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.053328 (+  6296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:50.053377 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:50.054098 (+   721us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.256919 (+202821us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:50.256979 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.257061 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.646552 (+389491us) raft_consensus.cc:1685] finished
0709 12:21:50.646575 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.646723 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":488,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":98406,"threads_started":1,"wal-append.queue_time_us":252545}
W20260709 12:21:50.649099 27931 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:21:50.650282 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2121) took 1074 ms. Trace:
W20260709 12:21:50.650740 27942 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:21:50.650708 23998 rpcz_store.cc:276] 0709 12:21:49.575542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.008257 (+432715us) service_pool.cc:224] Handling call
0709 12:21:50.008693 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.027075 (+ 18382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:50.027122 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:50.027716 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.259988 (+232272us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:50.260023 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.260089 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.650001 (+389912us) raft_consensus.cc:1685] finished
0709 12:21:50.650022 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.650201 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":231948,"threads_started":1,"wal-append.queue_time_us":325226}
I20260709 12:21:50.652554 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:50.587682 27824 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.654572 27824 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:50.657090 27824 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:50.653964 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.660559 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:50.661419 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:50.662420 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.665601 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:50.670046 23854 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:21:50.671093 23853 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:50.672125 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:50.673013 23845 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:50.677109 23998 raft_consensus.cc:2393] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 6: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:50.678247 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:50.679350 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:50.680070 23998 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:50.688513 27799 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:50.689484 27943 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:21:50.689301 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:50.695854 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:50.701431 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:50.707904 23922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 417) took 1862 ms (client timeout 1700 ms). Trace:
W20260709 12:21:50.708559 23922 rpcz_store.cc:269] 0709 12:21:48.845271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.862901 (+ 17630us) service_pool.cc:224] Handling call
0709 12:21:50.701524 (+1838623us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54002e5754. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:50.707803 (+  6279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933673216}
I20260709 12:21:50.681218 27775 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.694041 27824 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:50.730628 23920 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:50.703914 27831 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:50.740341 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:50.741636 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 178486us
I20260709 12:21:50.744864 23999 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:50.757956 23997 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 10. Ops: []
I20260709 12:21:50.701364 27860 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:21:50.702764 27874 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:21:50.767688 23997 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:50.782547 23999 raft_consensus.cc:3055] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:50.782999 23999 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:50.790207 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.793808 23997 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:21:50.732869 27775 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:50.776890 27757 consensus_meta.cc:287] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.002s
I20260709 12:21:50.806615 27757 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:50.807157 27757 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.807504 27775 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:50.808385 27775 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:50.810971 23923 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:21:50.812531 27779 consensus_queue.cc:1059] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:50.758926 27917 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.763370 27789 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:50.737701 27824 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:50.802316 23999 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:50.858510 23999 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:50.862985 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:50.864053 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.807595 27757 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:50.827005 27868 raft_consensus.cc:3055] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:21:50.879302 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 236077us
W20260709 12:21:50.877347 27941 log.cc:927] Time spent T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:21:50.846709 27814 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:50.880134 24525 connection.cc:256] RPC call timeout handler was delayed by -1.4629958410000654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 12:21:50.884311 24525 connection.cc:256] RPC call timeout handler was delayed by -1.4197506650000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 12:21:50.884805 24525 connection.cc:256] RPC call timeout handler was delayed by -1.4111062929998752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 12:21:50.886049 24525 connection.cc:256] RPC call timeout handler was delayed by -1.11525997800004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
I20260709 12:21:50.888854 24525 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:50.892474 24525 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:50.895184 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 267729us
W20260709 12:21:50.895977 23966 leader_election.cc:336] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.719s (SENT)
I20260709 12:21:50.829015 27917 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.881796 27868 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:50.897518 24525 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:50.864862 27789 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:50.903506 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:50.897210 27801 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:50.851405 27876 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:50.895692 27946 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:50.904544 27799 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:21:50.913973 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 262213us
I20260709 12:21:50.922552 23820 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:50.911892 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 210530us
I20260709 12:21:50.928203 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:50.930248 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:50.931711 23966 connection.cc:256] RPC call timeout handler was delayed by -1.3638530009998249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4031s for a response
I20260709 12:21:50.907626 27822 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:50.972644 24557 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:50.973977 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.959512 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:50.978113 23846 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
I20260709 12:21:50.936575 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:50.936305 23820 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:51.077476 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 62710.5us
W20260709 12:21:51.058781 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.079898 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 143681us
W20260709 12:21:51.079196 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.081115 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.081477 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.082837 24560 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:50.936587 27946 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:51.086048 27830 consensus_queue.cc:1059] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:51.086944 27830 consensus_queue.cc:1243] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer 35a9a1f8b1d847fb8f2063ced2a3c26d log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:51.087452 27830 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:51.087775 27830 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:51.088593 27830 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:51.090197 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 110196us
I20260709 12:21:51.077512 23852 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:50.932075 27801 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:50.982044 27876 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:51.098861 24524 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:50.979652 27855 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.935828 27860 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:51.115346 27860 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:51.128435 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 445) took 2173 ms. Trace:
I20260709 12:21:51.091292 27744 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:51.089828 27830 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.113530 27801 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.129060 24003 rpcz_store.cc:276] 0709 12:21:48.955423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.959257 (+  3834us) service_pool.cc:224] Handling call
0709 12:21:50.178402 (+1219145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.211634 (+ 33232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.128148 (+916514us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540012bbd0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:51.128349 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2802684800}
I20260709 12:21:50.933248 27916 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:50.980315 27841 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.126s
W20260709 12:21:51.154971 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 370585us
W20260709 12:21:51.167721 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.136010 27822 consensus_queue.cc:1059] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 12:21:51.145525 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53890.2us
I20260709 12:21:50.979068 27868 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:51.180684 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.180095 23892 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:51.190433 23995 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11. Ops: [10.11-10.11]
W20260709 12:21:51.190340 24001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 1991) took 2007 ms (client timeout 1704 ms). Trace:
W20260709 12:21:51.191869 24001 rpcz_store.cc:269] 0709 12:21:49.183010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.209807 (+ 26797us) service_pool.cc:224] Handling call
0709 12:21:51.190057 (+1980250us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54000997d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:51.190248 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":985278336}
I20260709 12:21:51.148711 27744 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.195386 27744 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:51.196527 27928 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.971s	user 0.000s	sys 0.003s
I20260709 12:21:51.196592 27744 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:51.197264 27744 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.197641 27744 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:51.197894 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 448) took 1804 ms. Trace:
I20260709 12:21:51.200699 27917 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:51.137738 27855 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.171350 27946 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.207126 23999 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:21:51.220758 23999 pending_rounds.cc:85] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 4
I20260709 12:21:51.221109 23999 pending_rounds.cc:107] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:21:51.221472 23999 raft_consensus.cc:2889] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:51.210372 24524 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.795s (SENT)
I20260709 12:21:51.212467 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:51.178153 27824 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.218581 23851 rpcz_store.cc:276] 0709 12:21:49.393783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.960773 (+566990us) service_pool.cc:224] Handling call
0709 12:21:49.961066 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.963432 (+  2366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.963465 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:49.963988 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.028987 (+ 64999us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:50.029027 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.029112 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:51.195941 (+1166829us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:51.197589 (+  1648us) raft_consensus.cc:1685] finished
0709 12:21:51.197614 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.197821 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1804,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":3193216,"thread_start_us":64585,"threads_started":1,"wal-append.queue_time_us":260801}
I20260709 12:21:51.208840 27789 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.227165 27824 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.227591 27789 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.227661 27824 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.228109 27789 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.229998 27789 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:51.230114 27824 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.230480 27789 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.230590 27824 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:51.230934 27789 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.233071 27789 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:51.233268 24524 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.854s (SENT)
I20260709 12:21:51.233529 27789 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.225153 27916 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.233706 24524 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:51.213577 27831 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:51.231051 27824 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.237393 27806 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:51.237919 27831 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.239681 27824 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.239794 27855 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.240202 27824 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:51.241712 23892 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:51.213670 27874 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:51.254436 23892 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:51.218994 27868 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.218152 27953 raft_consensus.cc:3055] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:51.234908 27853 consensus_meta.cc:287] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.876s	user 0.003s	sys 0.011s
I20260709 12:21:51.255964 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:51.285347 23920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 446) took 1870 ms (client timeout 1795 ms). Trace:
W20260709 12:21:51.286005 23920 rpcz_store.cc:269] 0709 12:21:49.415323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.926661 (+511338us) service_pool.cc:224] Handling call
0709 12:21:51.285097 (+1358436us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54002e4d54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:51.285254 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717104384}
I20260709 12:21:51.299998 27744 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.303416 27927 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:51.303898 27744 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.313755 27821 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:51.301503 23751 catalog_manager.cc:5697] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 5 to 11, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 11 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:21:51.330715 24004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.009s	sys 0.042s
W20260709 12:21:51.333261 24004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.009s	sys 0.042s
I20260709 12:21:51.303900 27927 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:51.334162 27927 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.319350 27664 raft_consensus.cc:3055] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:51.240702 27824 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:51.349501 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 64902.7us
W20260709 12:21:51.349936 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 55560.4us
W20260709 12:21:51.346812 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.339799 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.360832 23893 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:51.361222 27875 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:51.361902 27875 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.349711 27917 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:21:51.364377 27875 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:51.350111 27874 consensus_queue.cc:1059] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:21:51.241046 27789 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.365554 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:51.269210 27916 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:51.267876 27855 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:51.366950 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:51.370332 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:51.370929 23998 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:51.368899 24003 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:21:51.371402 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.369565 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:51.374038 24002 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:51.378546 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 447) took 2422 ms. Trace:
I20260709 12:21:51.378990 23995 rpcz_store.cc:276] 0709 12:21:48.956105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.806363 (+850258us) service_pool.cc:224] Handling call
0709 12:21:51.190197 (+1383834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.190896 (+   699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.378318 (+187422us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000997d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:51.378468 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3108716288}
I20260709 12:21:51.383196 24557 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:51.372759 27745 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:51.385360 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:51.338243 27664 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:51.391770 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 440) took 2003 ms. Trace:
I20260709 12:21:51.392340 23923 rpcz_store.cc:276] 0709 12:21:49.388454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.089942 (+701488us) service_pool.cc:224] Handling call
0709 12:21:51.373031 (+1283089us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400375ad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:51.391693 (+ 18662us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654952704}
I20260709 12:21:51.270179 27953 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:51.269827 27957 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:51.372388 23999 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:51.400089 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:51.400619 23895 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:51.338019 27927 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.399811 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:51.355345 27889 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:51.403110 27706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.014s	sys 0.022s
I20260709 12:21:51.359598 27853 consensus_queue.cc:1059] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:21:51.409186 27824 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:51.410908 27889 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.413069 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2135) took 1793 ms. Trace:
I20260709 12:21:51.407686 23998 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:51.413666 24000 rpcz_store.cc:276] 0709 12:21:49.619574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.209012 (+589438us) service_pool.cc:224] Handling call
0709 12:21:50.209514 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:50.225951 (+ 16437us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:50.294886 (+ 68935us) log.cc:844] Serialized 14 byte log entry
0709 12:21:50.480136 (+185250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:50.480226 (+    90us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:50.480304 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.126728 (+646424us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b1800459ee0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:51.412823 (+286095us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b540009ced4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:51.412873 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.413009 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":282577,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":33031,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":7833,"spinlock_wait_cycles":148175104,"thread_start_us":220432,"threads_started":2,"wal-append.queue_time_us":348105}
I20260709 12:21:51.416877 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:51.418213 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:51.418974 24004 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:51.422297 23850 raft_consensus.cc:2410] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:51.424495 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2304) took 1096 ms. Trace:
I20260709 12:21:51.424880 23850 rpcz_store.cc:276] 0709 12:21:50.328039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.334034 (+  5995us) service_pool.cc:224] Handling call
0709 12:21:51.424242 (+1090208us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002fb7d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:51.424431 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2389914880}
I20260709 12:21:51.403316 27745 raft_consensus.cc:697] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:51.426983 27917 raft_consensus.cc:3055] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:51.427457 27917 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:51.413120 27889 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:51.428704 27706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.015s	sys 0.022s
I20260709 12:21:51.428297 27917 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.335731 27956 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:51.433640 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:51.370425 27916 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.435688 24560 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 6.
I20260709 12:21:51.439860 23969 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:51.447482 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 354750us
I20260709 12:21:51.406075 27957 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:51.450471 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:51.449712 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:51.458696 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 58341.3us
I20260709 12:21:51.458860 23929 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.372913 27814 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:21:51.460871 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:51.465253 23966 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:51.482170 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.483244 23920 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:51.435138 27875 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.487847 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.499981 23927 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:51.435593 27956 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:51.489971 27959 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.490033 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:51.481213 27755 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:51.490947 27613 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:51.492003 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:51.494062 27917 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.427945 27745 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.445037 27855 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:21:51.440389 27916 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.544821 27855 consensus_queue.cc:1243] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 22996f888daf435398b693481171c18c log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:51.520541 27853 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:21:51.502275 23923 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:21:51.481213 27957 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.505482 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:51.518853 27755 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:21:51.563480 24524 leader_election.cc:336] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.184s (SENT)
I20260709 12:21:51.564178 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:51.565011 27822 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:51.507754 23929 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:51.511673 23921 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:51.501772 27819 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:51.450806 27889 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:51.458266 27616 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:51.410137 27960 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:21:51.523458 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.513324 27956 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.517410 27959 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.512857 27953 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.514822 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:51.522239 23751 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:51.519028 27919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.317s	user 0.009s	sys 0.017s
I20260709 12:21:51.596951 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:51.585917 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:51.597769 23998 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
W20260709 12:21:51.601799 23820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.013s	sys 0.028s
W20260709 12:21:51.602278 23820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.013s	sys 0.028s
W20260709 12:21:51.602586 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 520367us
I20260709 12:21:51.612347 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:51.613559 24000 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:51.615787 24524 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.229s (SENT)
I20260709 12:21:51.616642 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:51.617797 23999 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:51.619386 23818 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:51.583995 27757 consensus_meta.cc:287] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.700s	user 0.008s	sys 0.004s
I20260709 12:21:51.584524 23925 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
W20260709 12:21:51.588333 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.630986 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:51.633744 23921 raft_consensus.cc:1217] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Deduplicated request from leader. Original: 6.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 12:21:51.634277 23921 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:51.635084 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:51.579718 27819 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:51.581398 27889 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.636296 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:51.515475 27875 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:51.683367 27830 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.000s
I20260709 12:21:51.637445 24004 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:51.583702 27616 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.639671 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:51.686412 24562 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:51.637580 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:51.639387 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:51.597416 27919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.395s	user 0.009s	sys 0.017s
I20260709 12:21:51.641676 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:51.635905 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.589442 27898 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:51.645641 23921 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:51.647902 27664 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.630503 27744 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:51.630331 27779 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:51.653610 27953 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.655757 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.656677 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.658306 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.659111 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.659976 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.671595 27959 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.620905 27876 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:21:51.622360 27838 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:51.689322 24001 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:51.689482 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.690366 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.741222 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.742623 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.744781 23817 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:51.691897 23922 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:51.694459 24559 raft_consensus.cc:2393] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:51.687794 24557 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:51.696547 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:51.635903 27824 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:51.696009 24560 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:21:51.700819 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:51.643981 27819 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:51.711169 24524 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.998s (SENT)
I20260709 12:21:51.763383 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.643007 27862 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:51.684517 27889 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:51.634189 27946 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:51.795008 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.687409 27616 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.764138 24524 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:51.638374 27757 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.767613 23929 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:51.716073 27744 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.801666 27744 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:51.782404 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.803949 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.705869 27868 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:51.810552 23929 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:51.783159 27801 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.811235 27801 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.813405 27801 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:51.735046 27779 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.813992 27964 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:21:51.815903 27975 raft_consensus.cc:2764] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:21:51.816394 27970 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:51.817279 27968 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.817354 27789 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.795641 27862 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.810001 27946 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.810384 27868 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.817835 27968 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:51.817065 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 116386us
I20260709 12:21:51.819329 27964 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.819952 27946 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.820096 27868 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.819849 27964 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.799027 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.799391 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.822110 27862 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.823248 27964 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:51.814898 27744 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.740465 27821 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.822042 23925 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:21:51.816648 27664 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:51.808463 27957 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.819989 27968 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:51.800496 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 89369.2us
I20260709 12:21:51.855386 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:51.856490 23820 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:51.781647 23817 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:51.820523 27789 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:51.764196 27973 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.841696 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.792622 27916 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:51.784090 27831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.024s	sys 0.025s
I20260709 12:21:51.763675 27824 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:51.768465 27965 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.821940 27875 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:51.816591 27975 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:51.858148 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 76610.1us
I20260709 12:21:51.894764 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:51.866427 27799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.038s	sys 0.048s
W20260709 12:21:51.853034 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 413291us
W20260709 12:21:51.859757 24524 leader_election.cc:336] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.438s (SENT)
I20260709 12:21:51.899657 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:51.861358 27789 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:51.838222 27801 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:51.886981 23920 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:51.835464 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:51.839582 27821 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.858984 27952 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:51.890434 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 385006us
I20260709 12:21:51.888063 27814 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.898612 23923 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:51.863543 27862 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:51.862669 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 381891us
W20260709 12:21:51.882458 27831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.025s	sys 0.025s
I20260709 12:21:51.902230 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:51.926330 24557 raft_consensus.cc:2410] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:51.901437 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:51.865908 27968 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:51.902851 23817 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:51.868422 27869 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:51.935678 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 450731us
W20260709 12:21:51.906406 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.907500 23927 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:51.863373 27964 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:51.890308 27824 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.910743 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:51.918933 23820 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:51.944736 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:51.906548 27799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.038s	sys 0.049s
I20260709 12:21:51.933084 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:51.908321 27898 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:51.946439 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:51.955291 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.949828 23926 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 10. Ops: []
I20260709 12:21:51.907335 27789 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:51.956116 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:51.956996 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:51.979017 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:51.928818 27952 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.898658 27876 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:21:51.983603 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.885640 27973 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:52.001901 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.942901 27964 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.951396 27875 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:51.940085 27970 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:51.905469 27963 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 12:21:52.027565 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 71546.2us
I20260709 12:21:51.998760 23925 raft_consensus.cc:2376] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11. Re-sending same reply.
I20260709 12:21:51.957358 27902 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:51.911942 27616 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:51.983439 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:51.979985 27969 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:51.900983 27975 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.896649 27965 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.953440 27869 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.014763 27916 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:52.016116 27889 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.020453 27956 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:51.930083 27814 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:52.022442 27976 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:21:52.032156 27902 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.023162 27757 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:51.958022 27799 raft_consensus.cc:697] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:51.987960 27831 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:52.005251 23929 raft_consensus.cc:2410] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:52.067310 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:52.067999 23929 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:52.069245 23929 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:52.070448 23929 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:21:52.070736 23929 pending_rounds.cc:85] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 7
I20260709 12:21:52.070946 23929 pending_rounds.cc:107] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:21:52.071192 23929 raft_consensus.cc:2889] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:52.032099 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.072460 23925 raft_consensus.cc:2368] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10.
I20260709 12:21:52.033510 27755 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:52.073242 27755 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:52.073671 27755 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.034009 27871 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:52.035519 27822 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:52.035998 27616 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:51.997570 27830 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:52.040143 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.085188 23921 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.044242 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:52.045056 27971 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:21:52.044961 27821 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:52.045666 27972 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:21:52.045925 27744 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:52.046422 27983 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:21:52.046721 27977 log.cc:927] Time spent T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 12:21:52.047006 27979 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:21:52.038995 27826 consensus_queue.cc:1059] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 12:21:52.048087 27980 log.cc:927] Time spent T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:21:52.050604 27775 raft_consensus.cc:3055] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:52.166298 27775 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:52.167419 27775 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.168984 27775 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.051708 27965 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:52.025938 27964 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:52.056320 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:52.056897 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:52.053435 27970 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:52.173419 27889 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:52.052769 27969 raft_consensus.cc:697] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:52.177079 27969 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.177227 27964 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.178854 27956 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:52.179654 27964 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:52.080269 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:52.093557 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:52.180371 27869 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:52.181054 23850 raft_consensus.cc:2393] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:52.096196 27830 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:52.181531 27744 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:52.182616 27830 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:52.184434 27917 consensus_meta.cc:287] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.004s
I20260709 12:21:52.158535 27875 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:52.185052 23922 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
W20260709 12:21:52.185534 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.185400 27875 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.062395 27902 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:52.187690 27875 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:52.188877 23924 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:21:52.053544 27452 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:21:52.191231 27994 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:21:52.192513 27952 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:52.192353 27819 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.193964 27975 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:52.194410 24524 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.803s (SENT) [suppressed 34 similar messages]
I20260709 12:21:52.195253 27973 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:52.198539 27819 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:52.105571 27957 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:52.206059 27819 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:52.104453 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 455) took 1177 ms. Trace:
I20260709 12:21:52.207027 23847 rpcz_store.cc:276] 0709 12:21:50.927326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.927829 (+   503us) service_pool.cc:224] Handling call
0709 12:21:51.074776 (+146947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.075175 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.075216 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.075755 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:21:51.580228 (+504473us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:51.580289 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.580380 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.104233 (+523853us) raft_consensus.cc:1685] finished
0709 12:21:52.104254 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.104394 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39920,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":112,"thread_start_us":477022,"threads_started":1,"wal-append.queue_time_us":763273}
I20260709 12:21:52.126998 23751 catalog_manager.cc:5697] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 2 to 6, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 6 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:52.209008 27819 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.157178 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:52.098399 27799 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.102108 27871 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:52.210636 27871 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.211613 27819 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:52.165671 27826 raft_consensus.cc:3055] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:52.212217 27826 raft_consensus.cc:740] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:52.213004 27826 consensus_queue.cc:260] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.096685 27613 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.206589 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2006) took 1038 ms. Trace:
W20260709 12:21:52.164815 27993 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:21:52.103770 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 153153us
I20260709 12:21:52.218989 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:52.221144 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:52.235270 23853 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
W20260709 12:21:52.226054 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.227631 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:52.213424 27871 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:52.250628 27613 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.251734 23847 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:52.214167 23997 rpcz_store.cc:276] 0709 12:21:51.167683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.167858 (+   175us) service_pool.cc:224] Handling call
0709 12:21:51.168197 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.171166 (+  2969us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:51.181434 (+ 10268us) log.cc:844] Serialized 14 byte log entry
0709 12:21:51.622983 (+441549us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.632451 (+  9468us) log.cc:844] Serialized 26 byte log entry
0709 12:21:51.632669 (+   218us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:51.632720 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.632811 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.206343 (+573532us) raft_consensus.cc:1685] finished
0709 12:21:52.206365 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.206514 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28676,"prepare.queue_time_us":35474,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":3032,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":17314,"thread_start_us":428722,"threads_started":1,"wal-append.queue_time_us":669360}
I20260709 12:21:52.254226 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:52.254944 27826 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.255892 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:52.256709 23850 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.259399 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:52.260036 24558 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:52.260689 23928 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
W20260709 12:21:52.261739 23928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 435) took 3160 ms (client timeout 1660 ms). Trace:
I20260709 12:21:52.251049 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:52.262240 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:52.255069 27814 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:52.263530 23853 raft_consensus.cc:2410] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:21:52.263679 23895 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:52.262209 23928 rpcz_store.cc:269] 0709 12:21:49.101095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.111559 (+ 10464us) service_pool.cc:224] Handling call
0709 12:21:52.261570 (+3150011us) spinlock_profiling.cc:243] Waited 3.13 s on lock 0x7b540005fad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:52.261673 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7208637824}
I20260709 12:21:52.253448 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:52.274878 23847 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:52.261652 23849 raft_consensus.cc:2393] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:52.262635 24557 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:52.278147 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:52.279340 23853 raft_consensus.cc:2393] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:52.281186 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:52.276923 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:52.290438 23921 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
W20260709 12:21:52.292582 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 359572us
I20260709 12:21:52.261303 27973 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:52.294435 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:52.297112 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 277837us
I20260709 12:21:52.324399 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:52.338524 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 419029us
I20260709 12:21:52.342525 23847 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:52.298494 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:52.331576 23817 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:52.350880 24557 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:52.355769 23895 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:52.358007 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.357640 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:52.359724 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:52.344691 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 315138us
I20260709 12:21:52.360639 23997 raft_consensus.cc:2410] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:21:52.361205 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:52.362111 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:52.363664 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:52.364919 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:52.365509 24000 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:52.286314 27996 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.366544 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:52.291735 27548 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:52.391171 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:52.397274 24004 raft_consensus.cc:2393] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:52.377171 23921 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:52.377581 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:52.398890 23996 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:52.399056 23924 raft_consensus.cc:2393] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:52.378290 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.367411 23998 raft_consensus.cc:2410] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:52.336979 27973 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:52.335018 27970 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:52.263052 27789 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.406200 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:52.412209 24001 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:52.374547 27860 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:52.380919 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 82523.2us
I20260709 12:21:52.394233 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.380858 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:52.346820 27965 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:52.401749 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 206921us
I20260709 12:21:52.400637 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:52.422211 23966 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:52.402935 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.423128 23922 raft_consensus.cc:2393] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 6: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:52.383857 23925 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:52.406695 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.424211 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:52.424541 23928 raft_consensus.cc:2393] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:52.424985 24558 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:52.367460 27819 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.380386 27821 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.389457 23818 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:52.380652 27814 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.380394 27853 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.390591 27989 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.407372 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.437774 23927 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:52.380846 27990 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:52.427812 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:52.428387 23920 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:52.395095 27548 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.398784 27987 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:52.432036 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:52.435670 23893 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:52.405128 27968 raft_consensus.cc:697] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:52.406358 27919 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:52.426029 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:52.466909 24556 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:52.441347 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:52.442646 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:52.442929 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.446708 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.400458 27755 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.450599 23926 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:52.458117 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.436625 27969 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:52.448401 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:52.448035 26910 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.477744 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.445279 27990 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.476464 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.506058 23920 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:52.450271 27548 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.481741 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:52.506467 24000 raft_consensus.cc:1240] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:52.391249 27996 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.446369 27853 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.447431 27989 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.443173 27814 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.437978 27819 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.681929 23927 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:52.652603 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:52.634927 24557 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:52.687631 23995 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:52.691372 23924 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:52.692776 27613 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:52.694469 28004 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:21:52.695644 27755 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:52.699357 27789 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:52.644845 27963 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.702481 27963 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.474502 27919 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.704981 27919 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:52.481312 27987 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:52.546885 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:52.667805 23920 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
W20260709 12:21:52.555691 23966 connection.cc:256] RPC call timeout handler was delayed by -1.9195531190000565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
I20260709 12:21:52.545099 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:52.710142 24001 raft_consensus.cc:2393] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:52.710529 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:52.468732 28006 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:52.479802 27959 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:52.713991 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:52.666751 27824 consensus_meta.cc:287] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
W20260709 12:21:52.537966 27998 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:21:52.537161 27779 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:52.592298 27806 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:52.522217 27990 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:52.449988 27902 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:52.722623 24524 leader_election.cc:336] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.826s (SENT)
I20260709 12:21:52.706919 27969 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:52.730672 24524 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:52.599517 27952 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:21:52.717098 27862 consensus_meta.cc:287] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.000s
I20260709 12:21:52.550537 27889 consensus_queue.cc:1059] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.174s
I20260709 12:21:52.718277 27959 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.521596 26910 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.906543 27755 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.907708 27755 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.908668 27819 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:52.357785 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:52.848668 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 459093us
I20260709 12:21:52.910357 27452 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.911599 27452 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:52.913478 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.909533 26910 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:52.860687 23820 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:21:52.861863 23846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.002s	sys 0.011s
I20260709 12:21:52.865831 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:52.869274 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:52.872825 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:52.874152 23851 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.010s
I20260709 12:21:52.876518 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:52.888211 23922 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:52.889667 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:52.890678 23923 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:52.891146 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.892592 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:52.894116 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:52.896951 23996 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:52.546499 27799 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.185s
I20260709 12:21:52.721602 27824 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.744364 27862 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:52.903338 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:52.851536 23751 catalog_manager.cc:5697] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 7 to 9, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 9 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:52.914667 27779 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:52.914513 27613 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:52.917586 27452 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:52.956280 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:52.935734 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 212984us
I20260709 12:21:52.940582 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:52.989508 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:52.917989 27789 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:53.003394 24563 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:53.004547 27862 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:53.004215 27789 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.909814 27777 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:53.005434 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.005999 27777 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.006439 27862 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.007589 27789 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:53.008440 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 148093us
I20260709 12:21:53.009696 23852 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:53.009773 27777 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:53.010208 23851 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.009s	sys 0.014s
W20260709 12:21:53.010609 23846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.007s	sys 0.011s
I20260709 12:21:53.011224 27824 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:53.003163 23926 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.003260 23928 raft_consensus.cc:2393] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:52.744551 27952 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.745234 27959 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:52.747107 27963 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:52.706346 27968 consensus_queue.cc:237] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.778273 27969 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.535511 27973 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:52.754541 27987 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.746793 27989 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:52.746941 27996 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:52.787154 28006 raft_consensus.cc:3055] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:52.994462 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:52.955096 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:52.927527 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:52.938006 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:52.938748 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:53.343819 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:53.252193 23847 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:21:53.012415 23751 catalog_manager.cc:5697] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:53.013249 23854 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:53.274835 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:53.298192 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 135008us
W20260709 12:21:53.344144 23966 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.002s	sys 0.004s
W20260709 12:21:53.383723 24560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.000s	sys 0.008s
I20260709 12:21:53.225963 23853 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:53.353046 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 637967us
I20260709 12:21:53.294036 23845 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:53.205143 24562 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
W20260709 12:21:53.396811 24560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.001s	sys 0.009s
I20260709 12:21:52.991503 27755 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:53.343359 23895 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:53.401364 24560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 880) took 1474 ms. Trace:
I20260709 12:21:53.401906 24560 rpcz_store.cc:276] 0709 12:21:51.927465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.930300 (+  2835us) service_pool.cc:224] Handling call
0709 12:21:51.930723 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.930988 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:52.400900 (+469912us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.730739 (+329839us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.787492 (+ 56753us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b1800468640. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28432d2a6 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1
0709 12:21:52.790027 (+  2535us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b1800468640. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:53.400623 (+610596us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:53.400734 (+   111us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:53.400890 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.401013 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.401278 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173305,"prepare.queue_time_us":116379,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":85,"raft.queue_time_us":183785,"raft.run_cpu_time_us":513,"raft.run_wall_time_us":4535,"spinlock_wait_cycles":17407488,"thread_start_us":1408407,"threads_started":3,"wal-append.queue_time_us":357672}
I20260709 12:21:52.918526 27814 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:52.943946 27744 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:53.467725 27744 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:52.927171 27853 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:53.413609 24000 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:53.470911 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2080) took 1243 ms. Trace:
I20260709 12:21:53.413970 23921 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:53.471560 27964 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.472312 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:53.472266 27964 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:53.473204 23921 raft_consensus.cc:2368] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10.
I20260709 12:21:53.414379 27997 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:53.474216 27997 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.474607 27997 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.474797 27964 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:53.470949 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:53.476007 24000 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:21:53.476960 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:53.393551 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:53.478360 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:53.478545 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:52.995019 27779 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:53.479086 24000 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:53.479192 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2082) took 1249 ms. Trace:
I20260709 12:21:53.479460 27779 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:53.480407 23924 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:53.429088 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.454655 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:53.422132 27970 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.438987 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:53.494396 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:53.052021 27862 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:53.454252 23996 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:53.430373 27821 consensus_meta.cc:287] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.985s	user 0.010s	sys 0.010s
I20260709 12:21:53.435012 27876 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:21:53.456818 23748 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43184 (request call id 225) took 28148 ms (client timeout 15000 ms). Trace:
I20260709 12:21:53.458302 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:52.938568 27830 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:53.459052 23850 consensus_meta.cc:287] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.202s	user 0.012s	sys 0.012s
I20260709 12:21:53.432252 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:53.457455 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:52.940781 27806 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:53.412895 27973 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:53.480014 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:53.480932 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 2072) took 1373 ms. Trace:
I20260709 12:21:53.429802 27902 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:53.429584 27799 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:52.918421 27831 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:53.412331 24525 leader_election.cc:336] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.781s (SENT)
W20260709 12:21:53.482043 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.479233 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:53.479657 23852 rpcz_store.cc:276] 0709 12:21:52.230069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.259789 (+ 29720us) service_pool.cc:224] Handling call
0709 12:21:52.260061 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.410565 (+1150504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.478858 (+ 68293us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400215554. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:53.479118 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1722757504}
I20260709 12:21:53.430002 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:53.417797 23923 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:21:53.449681 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:53.497234 23926 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:53.501513 23927 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:53.495807 24003 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:53.507568 23845 rpcz_store.cc:276] 0709 12:21:52.107336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.107505 (+   169us) service_pool.cc:224] Handling call
0709 12:21:53.480707 (+1373202us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b5400072954. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:53.480850 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1825870080}
W20260709 12:21:53.443547 27990 consensus_meta.cc:287] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.003s
W20260709 12:21:53.514719 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 75954.2us
I20260709 12:21:53.504659 23751 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:21:53.517997 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:53.518739 23850 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:53.521938 23922 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:53.471385 23846 rpcz_store.cc:276] 0709 12:21:52.228023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.228240 (+   217us) service_pool.cc:224] Handling call
0709 12:21:52.228578 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.228786 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:52.244704 (+ 15918us) log.cc:844] Serialized 14 byte log entry
0709 12:21:53.470407 (+1225703us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:53.470504 (+    97us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:53.470604 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.470684 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.470823 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35625,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":59965,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"thread_start_us":1140900,"threads_started":1,"wal-append.queue_time_us":477046}
I20260709 12:21:53.522456 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:53.524857 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 181725us
I20260709 12:21:53.526185 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:53.526822 23850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 2092) took 1276 ms (client timeout 1680 ms). Trace:
I20260709 12:21:53.518797 24525 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:53.527246 23850 rpcz_store.cc:269] 0709 12:21:52.250353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.255545 (+  5192us) service_pool.cc:224] Handling call
0709 12:21:53.526684 (+1271139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:53.527374 27452 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:53.527559 27876 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:53.530458 23997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.001s
W20260709 12:21:53.518500 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 807767us
I20260709 12:21:53.533574 24000 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:21:53.538283 24002 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:53.513943 27799 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:53.441133 28006 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:53.544850 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 338199us
I20260709 12:21:53.545151 28033 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:53.545794 28033 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.546195 27876 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:53.546250 28033 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:53.539085 23849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.011s	sys 0.019s
I20260709 12:21:53.552205 28041 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:53.553905 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2078) took 1329 ms. Trace:
I20260709 12:21:53.521696 27821 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:53.557199 27744 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:53.558398 27548 consensus_meta.cc:287] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.003s
I20260709 12:21:53.558984 27548 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:53.564764 23849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.011s	sys 0.019s
I20260709 12:21:53.565969 23929 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:53.533450 27452 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.564577 28040 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.568034 23920 raft_consensus.cc:2376] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13. Re-sending same reply.
W20260709 12:21:53.571815 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:53.549037 23997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.006s	sys 0.002s
I20260709 12:21:53.566156 23847 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:21:53.554389 23851 rpcz_store.cc:276] 0709 12:21:52.224763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.224956 (+   193us) service_pool.cc:224] Handling call
0709 12:21:52.225573 (+   617us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:52.233524 (+  7951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:52.233590 (+    66us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:52.264266 (+ 30676us) log.cc:844] Serialized 52 byte log entry
0709 12:21:52.539071 (+274805us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b48000e07d8. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28c375aa1 00007fa28c36cb37 00007fa28c36c9ca 00007fa28c46426f 00007fa28c463f37 00007fa28c47855c 00007fa28c478508 00007fa28c478488 00007fa28c478443 00007fa28c4776ec 00007fa28b3a1a96
0709 12:21:53.524339 (+985268us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:53.552533 (+ 28194us) log.cc:844] Serialized 14 byte log entry
0709 12:21:53.553138 (+   605us) log.cc:844] Serialized 14 byte log entry
0709 12:21:53.553359 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.553486 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:53.553623 (+   137us) raft_consensus.cc:1685] finished
0709 12:21:53.553643 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.553816 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68376,"prepare.queue_time_us":4030,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":8377,"raft.run_cpu_time_us":3136,"raft.run_wall_time_us":293132,"spinlock_wait_cycles":5526272,"thread_start_us":1018905,"threads_started":1,"wal-append.queue_time_us":447025}
I20260709 12:21:53.572727 27452 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:53.595667 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:53.581642 23848 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:53.593485 23850 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:53.530308 27990 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:53.599572 27821 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:53.607023 27821 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.610409 27821 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:53.610988 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2088) took 1357 ms. Trace:
I20260709 12:21:53.611387 23850 rpcz_store.cc:276] 0709 12:21:52.242796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.528302 (+1285506us) service_pool.cc:224] Handling call
0709 12:21:53.566796 (+ 38494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.599783 (+ 32987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.600099 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:53.612641 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:53.613279 23850 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:53.579035 27548 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:53.543877 27830 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.613647 27799 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.614399 23845 pending_rounds.cc:85] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 7
I20260709 12:21:53.619153 23854 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:53.598088 23818 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:53.619218 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 44091.3us
W20260709 12:21:53.662590 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 66285.9us
W20260709 12:21:53.662123 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 62135.8us
I20260709 12:21:53.659222 23845 pending_rounds.cc:107] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:21:53.666580 23845 raft_consensus.cc:2889] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:53.663774 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2087) took 1419 ms. Trace:
I20260709 12:21:53.574019 27831 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:53.669142 23854 rpcz_store.cc:276] 0709 12:21:52.241590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.536405 (+1294815us) service_pool.cc:224] Handling call
0709 12:21:53.574609 (+ 38204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.660099 (+ 85490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.660370 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:53.599944 27853 consensus_queue.cc:1059] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.091s
W20260709 12:21:53.698395 23995 consensus_meta.cc:287] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.852s	user 0.009s	sys 0.006s
W20260709 12:21:53.684468 27919 consensus_meta.cc:287] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.007s
I20260709 12:21:53.711594 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:53.713793 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 140671us
I20260709 12:21:53.714740 23817 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:53.594013 28041 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:21:53.599529 28040 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:53.505306 23748 rpcz_store.cc:269] 0709 12:21:25.308286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.311740 (+  3454us) service_pool.cc:224] Handling call
0709 12:21:53.456489 (+28144749us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:41.508609 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:41.509311 (+   702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:41.509366 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:21:41.509396 (+    30us) tablet.cc:662] Decoding operations
0709 12:21:41.564317 (+ 54921us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:41.564419 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:41.564457 (+    38us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:21:41.575278 (+ 10821us) tablet.cc:701] Row locks acquired
0709 12:21:41.575333 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:21:41.575547 (+   214us) write_op.cc:270] Start()
0709 12:21:41.575747 (+   200us) write_op.cc:276] Timestamp: P: 1783599701575468 usec, L: 0
0709 12:21:41.575772 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:21:41.660119 (+ 84347us) log.cc:844] Serialized 10515 byte log entry
0709 12:21:42.315285 (+655166us) op_driver.cc:464] REPLICATION: finished
0709 12:21:45.455472 (+3140187us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa2843420ac 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa28ae82ef0
0709 12:21:45.633670 (+178198us) write_op.cc:301] APPLY: starting
0709 12:21:45.633796 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:45.634686 (+   890us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:45.634735 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:45.711104 (+ 76369us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:45.711809 (+   705us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=27
0709 12:21:45.711882 (+    73us) write_op.cc:312] APPLY: finished
0709 12:21:45.712767 (+   885us) log.cc:844] Serialized 182 byte log entry
0709 12:21:46.136500 (+423733us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:46.218656 (+ 82156us) write_op.cc:454] Released schema lock
0709 12:21:46.251094 (+ 32438us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:46.251618 (+   524us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:46.251663 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4830325,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":3317934,"apply.run_cpu_time_us":87525,"apply.run_wall_time_us":617916,"num_ops":27,"prepare.queue_time_us":117912,"prepare.run_cpu_time_us":67220,"prepare.run_wall_time_us":267692,"raft.queue_time_us":100450,"raft.run_cpu_time_us":66013,"raft.run_wall_time_us":3610022,"replication_time_us":716143,"spinlock_wait_cycles":14809472,"thread_start_us":4059817,"threads_started":5,"wal-append.queue_time_us":696557,"wal-append.run_cpu_time_us":16509,"wal-append.run_wall_time_us":2567674}]]}
I20260709 12:21:53.681859 27744 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.727515 27822 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:53.728255 27822 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:53.710568 23893 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:53.705039 27799 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:53.717623 23966 connection.cc:256] RPC call timeout handler was delayed by -1.7746531190000496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
I20260709 12:21:53.736928 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2163) took 1271 ms. Trace:
W20260709 12:21:53.751562 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 65899.8us
I20260709 12:21:53.719169 23995 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:53.758474 27987 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:53.759060 27987 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.759495 27987 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:53.759526 27876 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:53.760651 24004 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:53.762498 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 214291us
I20260709 12:21:53.764076 23818 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:53.764712 27830 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:53.767779 27831 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:53.768386 27831 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:53.769723 27952 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:53.770047 27806 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:53.770506 27744 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.770773 28006 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.771044 27806 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.772457 28006 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:53.773563 27806 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:53.769939 27987 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.734359 27821 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:53.759789 23852 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:53.787210 27744 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:53.743760 23997 rpcz_store.cc:276] 0709 12:21:52.455156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.455307 (+   151us) service_pool.cc:224] Handling call
0709 12:21:52.455594 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.455799 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:52.716989 (+261190us) log.cc:844] Serialized 14 byte log entry
0709 12:21:53.657014 (+940025us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:53.679848 (+ 22834us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:53.690597 (+ 10749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.700440 (+  9843us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.726260 (+ 25820us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":877187,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":18908,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":36519,"thread_start_us":1088270,"threads_started":2,"wal-append.queue_time_us":726640}
I20260709 12:21:53.797694 23854 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:53.809051 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 2168) took 1316 ms. Trace:
I20260709 12:21:53.809664 23995 rpcz_store.cc:276] 0709 12:21:52.482476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.593139 (+110663us) service_pool.cc:224] Handling call
0709 12:21:53.784693 (+1191554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:53.778227 27821 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:53.814168 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 277204us
W20260709 12:21:53.815448 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49580.9us
I20260709 12:21:53.730392 27919 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.711190 27997 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.817909 27821 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:53.821035 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:53.822319 23966 connection.cc:256] RPC call timeout handler was delayed by -1.7737531190000482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 12:21:53.833448 23853 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:53.849231 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2241) took 1453 ms. Trace:
I20260709 12:21:53.853399 27975 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.853969 27975 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:53.855175 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 170881us
I20260709 12:21:53.856127 27989 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:53.849828 23923 rpcz_store.cc:276] 0709 12:21:52.377818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.378065 (+   247us) service_pool.cc:224] Handling call
0709 12:21:53.818923 (+1440858us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b540018abd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:53.831243 (+ 12320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128286080}
I20260709 12:21:53.859189 23850 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:53.866346 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:53.868286 23847 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:53.875821 28040 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:53.878111 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 163490us
I20260709 12:21:53.879205 23817 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:53.880328 28002 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:53.880959 23817 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:53.881937 28002 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:53.883697 24559 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:53.886498 27919 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:53.887732 23818 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:53.887996 27990 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:53.890062 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:53.890841 23995 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:53.891309 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:53.892120 23999 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:53.887787 27987 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:53.893039 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:53.893283 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2169) took 1222 ms. Trace:
I20260709 12:21:53.893504 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:53.889036 28002 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:53.893669 23998 rpcz_store.cc:276] 0709 12:21:52.510637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.717229 (+206592us) service_pool.cc:224] Handling call
0709 12:21:52.717554 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.717817 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:53.315615 (+597798us) log.cc:844] Serialized 14 byte log entry
0709 12:21:53.700652 (+385037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:53.709439 (+  8787us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:53.727056 (+ 17617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.727211 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.732446 (+  5235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":623792,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":15597,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":17425,"thread_start_us":517688,"threads_started":2}
I20260709 12:21:53.843636 27777 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.894968 28002 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:53.899535 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 51775.3us
I20260709 12:21:53.853247 27779 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:53.904110 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:53.945043 24554 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:53.906267 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:53.907346 27997 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:53.908921 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:53.910403 28033 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.911175 27831 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.912288 23818 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:53.913136 27860 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:53.914690 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2333) took 1060 ms. Trace:
I20260709 12:21:53.915594 27777 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.917418 23893 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:53.922984 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:53.927700 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2162) took 1473 ms. Trace:
I20260709 12:21:53.934741 23852 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:53.936129 23966 connection.cc:256] RPC call timeout handler was delayed by -1.7593531190002523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 12:21:53.959440 23966 connection.cc:256] RPC call timeout handler was delayed by -1.7368531190002159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
I20260709 12:21:53.952338 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:53.954869 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:53.962086 23999 raft_consensus.cc:2393] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:53.967085 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:53.970481 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 61705us
I20260709 12:21:53.971660 27952 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:53.972525 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:53.973304 27959 consensus_meta.cc:287] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.003s
I20260709 12:21:53.973760 23929 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:21:53.975841 23846 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:53.977217 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2089) took 1733 ms. Trace:
I20260709 12:21:53.974983 27821 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:53.896661 27853 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:21:53.971509 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:53.950632 23848 rpcz_store.cc:276] 0709 12:21:52.854613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.816798 (+962185us) service_pool.cc:224] Handling call
0709 12:21:53.858469 (+ 41671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.914209 (+ 55740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:53.914250 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:53.914310 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:53.914365 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.914442 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.914597 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:53.955825 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2083) took 1725 ms. Trace:
I20260709 12:21:53.977586 23846 rpcz_store.cc:276] 0709 12:21:52.243994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.551283 (+1307289us) service_pool.cc:224] Handling call
0709 12:21:53.603022 (+ 51739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.976265 (+373243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.976950 (+   685us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400429fd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:53.977137 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856896768}
I20260709 12:21:53.978219 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:54.005678 23854 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:53.982940 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:54.006561 23966 connection.cc:256] RPC call timeout handler was delayed by -1.7188531190001868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 12:21:53.969671 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:53.959600 24004 rpcz_store.cc:276] 0709 12:21:52.454511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.454645 (+   134us) service_pool.cc:224] Handling call
0709 12:21:52.475753 (+ 21108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.761192 (+1285439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.927383 (+166191us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540020eed4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:53.927633 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2731389696}
I20260709 12:21:54.006826 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2334) took 1151 ms. Trace:
I20260709 12:21:54.007790 23854 rpcz_store.cc:276] 0709 12:21:52.854968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.820526 (+965558us) service_pool.cc:224] Handling call
0709 12:21:53.872622 (+ 52096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:54.006539 (+133917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:54.006770 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:54.009382 24563 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:54.010088 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2340) took 1134 ms. Trace:
I20260709 12:21:54.010628 23852 rpcz_store.cc:276] 0709 12:21:52.856920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.934153 (+1077233us) service_pool.cc:224] Handling call
0709 12:21:53.934535 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.991154 (+ 56619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.991436 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:53.984122 27996 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.020581 23920 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:21:53.977507 27779 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:53.948465 28002 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:54.015792 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 46351.9us
I20260709 12:21:53.948298 27990 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.019946 27973 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:53.986397 27902 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:53.981357 28033 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:54.005254 27970 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:53.980593 28040 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:21:54.031348 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.031301 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.031605 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:53.952275 27806 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:53.979573 27822 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:54.038421 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.039675 23929 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:21:54.071373 23929 pending_rounds.cc:85] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 8
I20260709 12:21:54.071718 23929 pending_rounds.cc:107] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:21:54.071972 23929 raft_consensus.cc:2889] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:54.002764 23849 rpcz_store.cc:276] 0709 12:21:52.230877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.277254 (+ 46377us) service_pool.cc:224] Handling call
0709 12:21:52.277647 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:52.286491 (+  8844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:52.286534 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:52.291532 (+  4998us) log.cc:844] Serialized 26 byte log entry
0709 12:21:53.895143 (+1603611us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b1800404c80. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec0d1
0709 12:21:53.895428 (+   285us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:53.895498 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.895605 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:53.895652 (+    47us) raft_consensus.cc:1685] finished
0709 12:21:53.895682 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.955743 (+ 60061us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8306,"raft.queue_time_us":8464,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":43331,"spinlock_wait_cycles":9741696,"thread_start_us":1165398,"threads_started":1,"wal-append.queue_time_us":1183904}
I20260709 12:21:54.041960 23847 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:21:53.984676 27975 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:53.945238 27744 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:21:53.949486 27919 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:21:53.978056 27831 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.025681 27862 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:54.074869 27806 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:54.055732 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 84324.9us
W20260709 12:21:54.068617 23966 connection.cc:256] RPC call timeout handler was delayed by -1.1176531190001242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26720000000000005s for a response
I20260709 12:21:54.072036 23854 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:54.048938 23846 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:53.973790 27959 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.076200 23853 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:54.050855 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.042857 27902 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:21:54.093443 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0789531190000616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2715s for a response
W20260709 12:21:54.093997 23966 connection.cc:256] RPC call timeout handler was delayed by -1.019553119000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2781s for a response
I20260709 12:21:54.082898 27862 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:54.025472 27996 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.028609 27452 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:54.087568 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 170268us
I20260709 12:21:54.069427 27799 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:54.044613 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.097484 23847 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:54.099928 23848 raft_consensus.cc:2410] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:21:54.069263 27814 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:54.092628 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.027683 27860 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.099164 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.048246 27990 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:54.075542 27973 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:54.103873 24559 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:54.088043 27975 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.096395 27902 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:54.114497 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.117257 27990 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:54.101859 27814 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.098426 27862 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:54.092985 28040 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.109378 27799 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:54.131038 27959 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:54.137794 23893 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:54.140523 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.124800 27814 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:54.144196 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.145200 24000 raft_consensus.cc:2410] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:21:54.153246 27452 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:54.158294 27853 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:54.161836 27919 consensus_queue.cc:1059] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:54.162425 27860 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:54.162808 27777 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:54.164579 27996 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:54.166584 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:54.167248 24558 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:54.169963 27973 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.162184 28040 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:54.162938 27919 raft_consensus.cc:3055] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:54.161576 27853 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:54.178417 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.128625 27975 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:54.195824 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.177779 27919 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:54.199187 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.200008 23997 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:54.199724 27919 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.200867 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.201463 23997 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:54.191581 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.202287 27799 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:54.204881 24558 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:21:54.206182 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.206265 23895 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:54.206897 23996 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:54.201004 27919 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:54.210168 24563 raft_consensus.cc:2410] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:21:54.198096 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.183876 27853 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:54.212929 24554 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:54.215197 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:54.219043 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.193816 28040 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.207688 27757 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:54.189512 27452 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:21:54.231851 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.243449 24002 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:54.220743 27821 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:54.252034 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:54.257548 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.262307 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.262573 24000 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:54.263917 24004 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 5.
W20260709 12:21:54.264364 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 105282us
I20260709 12:21:54.230798 28040 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.287846 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.304431 23818 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:54.303861 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 65129us
I20260709 12:21:54.307511 27821 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:54.308084 27821 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.308467 27821 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:54.309510 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:54.317696 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.256783 27452 consensus_queue.cc:1243] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:54.329704 24000 raft_consensus.cc:1240] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:54.267194 27831 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:54.334553 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.249562 28002 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.288281 27806 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:54.322695 28054 log.cc:927] Time spent T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:21:54.345118 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.347234 23853 raft_consensus.cc:2368] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13.
I20260709 12:21:54.348479 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.349321 23853 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:21:54.351029 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.351372 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.316516 27987 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.322009 27963 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:54.355254 23847 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:54.355858 24002 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:54.356513 23849 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:54.360706 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:54.362900 28040 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:54.370442 28053 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:21:54.371699 28057 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.180s	user 0.002s	sys 0.000s
I20260709 12:21:54.372685 27969 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.373351 27969 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:54.375993 27969 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:54.377121 28052 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 12:21:54.379020 28044 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.302s	user 0.000s	sys 0.002s
W20260709 12:21:54.381563 28048 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
W20260709 12:21:54.384058 28050 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.268s	user 0.000s	sys 0.002s
I20260709 12:21:54.385848 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2172) took 1715 ms. Trace:
I20260709 12:21:54.386258 24001 rpcz_store.cc:276] 0709 12:21:52.670628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.717736 (+ 47108us) service_pool.cc:224] Handling call
0709 12:21:52.900270 (+182534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:53.230476 (+330206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:53.230546 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:53.467895 (+237349us) log.cc:844] Serialized 26 byte log entry
0709 12:21:53.664643 (+196748us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:53.664686 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.664762 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:54.383138 (+718376us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:54.385430 (+  2292us) raft_consensus.cc:1685] finished
0709 12:21:54.385451 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:54.385679 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51694,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":238,"spinlock_wait_cycles":155963264,"thread_start_us":488640,"threads_started":2,"wal-append.queue_time_us":647196}
I20260709 12:21:54.389253 23850 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:54.389369 27831 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.390122 27831 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.393153 27831 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:54.393968 27987 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.396301 27987 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:54.357766 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:54.398758 24560 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:54.406766 28058 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:21:54.355814 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.409693 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2093) took 2111 ms. Trace:
I20260709 12:21:54.410116 23845 rpcz_store.cc:276] 0709 12:21:52.298676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.548379 (+1249703us) service_pool.cc:224] Handling call
0709 12:21:53.614099 (+ 65720us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:53.801140 (+187041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:53.801187 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:53.891868 (+ 90681us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b2c00102f08. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa285d45a11 00007fa285d55372 00007fa287487a01 00007fa28744c43a 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2
0709 12:21:53.892415 (+   547us) log.cc:844] Serialized 52 byte log entry
0709 12:21:54.222463 (+330048us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:54.247347 (+ 24884us) log.cc:844] Serialized 14 byte log entry
0709 12:21:54.364944 (+117597us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b18003fcfa0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa284361a40 00007fa28435c4e4 00007fa28435c455 00007fa28ae443c7 00007fa2874569a7 00007fa2874660bf 00007fa287466038
0709 12:21:54.365155 (+   211us) log.cc:844] Serialized 14 byte log entry
0709 12:21:54.365399 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:54.365472 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:54.368222 (+  2750us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b18003fcfa0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:21:54.409472 (+ 41250us) raft_consensus.cc:1685] finished
0709 12:21:54.409493 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:54.409634 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83640,"prepare.queue_time_us":141041,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":22303,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":23938,"spinlock_wait_cycles":21280000,"thread_start_us":329645,"threads_started":1,"wal-append.queue_time_us":503515}
I20260709 12:21:54.415259 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.415899 24000 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:54.417762 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 95688.3us
I20260709 12:21:54.421727 23854 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:54.429602 23996 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:21:54.430995 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.431947 23996 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:54.433135 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.436816 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.462918 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.463466 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.464784 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.469398 23995 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:54.468117 24001 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:54.465795 23999 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:54.423884 27963 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:54.420353 27757 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:54.486491 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.487839 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.488435 23995 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:54.489259 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.483265 27548 raft_consensus.cc:3055] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:54.490458 27548 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:54.491820 27548 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.493325 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:54.504454 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:54.502146 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:21:54.495999 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 159861us
I20260709 12:21:54.495362 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:54.497536 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.516772 24560 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:21:54.518319 23995 raft_consensus.cc:2410] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:21:54.519361 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.466288 26910 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.526445 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.528378 24004 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:54.527383 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:54.525210 23893 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:54.530263 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.530654 24556 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:54.529691 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:54.532887 23923 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:54.493690 27548 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.540782 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:54.505002 27969 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.504676 27975 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:54.546352 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:21:54.563611 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.565407 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.566412 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.566471 23995 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:54.570791 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.537114 27987 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:54.533806 27777 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:54.571655 23996 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:54.573354 23846 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:54.564234 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.578056 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.587558 23853 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:21:54.588682 24001 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:54.585244 23923 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:21:54.586351 24560 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:21:54.584477 24004 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:54.593284 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.587127 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.594053 23851 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:54.525791 27862 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.541687 27853 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.533700 26910 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.597460 23847 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:54.611680 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:54.685142 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:54.598584 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.603005 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.688105 24001 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:54.625511 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:54.688426 23850 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:54.693647 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:54.694676 24556 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:21:54.625180 23854 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.564450 27973 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:54.705338 23920 raft_consensus.cc:2393] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:54.581686 27987 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:54.685016 28062 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:21:54.715943 24000 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:54.718852 23892 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:54.505847 27963 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:54.696323 28065 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:21:54.728832 24002 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 7: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:54.750010 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.717147 27987 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:54.754215 23850 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:54.755087 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.727807 27799 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.707508 27973 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.766791 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:54.760627 23966 connection.cc:256] RPC call timeout handler was delayed by -1.8391963480000868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4082s for a response
I20260709 12:21:54.736377 28002 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:54.758270 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:54.785493 24000 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:54.787456 23847 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:54.753756 27989 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:54.766659 23853 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:21:54.791656 24002 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:54.771574 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.794189 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.594903 27969 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:54.799110 23852 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:54.801221 23995 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:21:54.771718 27973 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:54.793123 27989 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:54.803710 24525 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:54.807894 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.808205 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:54.845082 23846 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:54.820345 23997 consensus_meta.cc:287] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.001s
W20260709 12:21:54.821467 28068 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 12:21:54.818264 27919 consensus_meta.cc:287] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.603s	user 0.014s	sys 0.000s
W20260709 12:21:54.832185 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 193099us
I20260709 12:21:54.747937 27757 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:54.832249 23995 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:54.846823 23997 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
W20260709 12:21:54.806622 24524 connection.cc:256] RPC call timeout handler was delayed by -1.1685317369999666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
I20260709 12:21:54.847992 23854 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
W20260709 12:21:54.852451 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.852598 24524 connection.cc:256] RPC call timeout handler was delayed by -1.1685317369999666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
I20260709 12:21:54.848948 24556 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:54.814945 27959 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.813855 28033 consensus_queue.cc:1059] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:21:54.794260 27799 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:54.871814 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.868037 23818 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:54.873157 23923 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:54.876014 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:54.882665 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:54.850868 28074 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:54.852986 27777 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:54.886122 23922 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:54.887639 23851 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:54.888358 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:54.896445 23926 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:21:54.853956 27876 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.908402 23929 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:54.884505 27902 consensus_meta.cc:287] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
W20260709 12:21:54.916412 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.918609 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 220689us
W20260709 12:21:54.918670 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 115064us
I20260709 12:21:54.887988 27831 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:54.890136 28074 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:54.909279 27821 consensus_meta.cc:287] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.000s
I20260709 12:21:54.921001 23820 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:54.930414 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:54.951619 23820 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:21:54.961359 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 50549.8us
I20260709 12:21:54.962802 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.963999 24556 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:54.894732 28002 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:21:54.970860 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 99640.3us
I20260709 12:21:54.970583 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:54.971285 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:54.930968 28074 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:54.908955 27876 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:54.953583 27996 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:54.988905 23929 raft_consensus.cc:2368] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9.
W20260709 12:21:54.992164 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 379935us
I20260709 12:21:54.910670 28085 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:21:54.916725 27902 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:54.979354 27862 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:54.981689 27853 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:54.931123 27959 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.013379 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:54.910923 27989 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.018700 23892 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:55.016592 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 52825us
I20260709 12:21:54.956571 27821 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.001415 27975 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:55.004784 26910 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:55.025030 23848 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:55.016552 28076 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
W20260709 12:21:55.026322 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.012054 28092 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:55.034720 23849 raft_consensus.cc:2368] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8.
I20260709 12:21:55.035163 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:55.035503 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:55.035727 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:55.037137 23927 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:55.038240 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:55.039251 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:55.038887 23922 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:55.024034 27777 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.040542 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:55.036108 27975 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:55.043551 27799 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:55.044379 27975 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:55.049269 28082 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:21:55.050240 27973 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.030279 27989 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.054154 27959 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:55.054760 28077 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:21:55.055927 23920 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:55.056111 24524 leader_election.cc:336] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.609s (SENT)
W20260709 12:21:55.056782 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.073312 23925 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:55.073298 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:55.036791 28092 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:55.075239 28092 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.075404 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:55.079360 28097 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:55.070924 27831 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:55.086128 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2031) took 1186 ms. Trace:
I20260709 12:21:55.093226 24003 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:55.094266 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:55.097661 23997 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.096912 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:55.095825 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:55.099890 23925 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:55.102515 23920 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:21:55.103706 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:55.097360 23998 rpcz_store.cc:276] 0709 12:21:53.900540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.152881 (+252341us) service_pool.cc:224] Handling call
0709 12:21:54.153268 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:54.153696 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:54.334928 (+181232us) log.cc:844] Serialized 14 byte log entry
0709 12:21:54.625161 (+290233us) log.cc:844] Serialized 14 byte log entry
0709 12:21:55.085510 (+460349us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b180001a200. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa284361a40 00007fa28435c4e4 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287 00007fa287467208
0709 12:21:55.085700 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:55.085752 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:55.085806 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.085909 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:55.086059 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2860,"prepare.queue_time_us":493225,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":91,"raft.queue_time_us":497219,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"spinlock_wait_cycles":274916992,"thread_start_us":410963,"threads_started":2,"wal-append.queue_time_us":417291}
I20260709 12:21:55.073642 27862 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.082125 28073 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:55.136878 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:55.140053 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:55.139492 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 278832us
I20260709 12:21:55.142320 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:55.173590 23999 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
W20260709 12:21:55.183612 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.126003 28092 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.120936 28074 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.197233 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:55.222581 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:55.224144 23998 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.223307 23925 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:55.232780 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:55.234040 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.234079 24002 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:21:55.238520 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 226589us
I20260709 12:21:55.238806 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:55.241659 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:55.242779 23851 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:55.210629 27862 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.244189 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:55.244935 23848 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:55.247110 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:55.218839 28097 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.241128 27996 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.250982 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:55.274427 23851 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:55.251906 23997 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:55.251976 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:55.275913 23850 raft_consensus.cc:2376] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6. Re-sending same reply.
I20260709 12:21:55.253036 23925 raft_consensus.cc:2410] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:21:55.255542 27862 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:55.259272 27973 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:55.260728 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:55.218689 27969 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:55.219805 28092 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:55.281515 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:55.282663 23999 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:55.292758 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:55.293771 23925 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
W20260709 12:21:55.306385 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.308986 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:55.312831 23997 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:55.236640 27987 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:55.357249 23847 consensus_meta.cc:287] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.000s
I20260709 12:21:55.357630 23847 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
W20260709 12:21:55.358744 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 51514.4us
I20260709 12:21:55.363272 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:55.365906 27902 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:55.367158 23845 raft_consensus.cc:2393] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:55.369115 28107 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.369773 28107 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.372280 28107 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:55.378031 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 100862us
I20260709 12:21:55.379043 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:55.379743 27806 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:55.380275 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 467) took 1059 ms. Trace:
W20260709 12:21:55.310102 27814 consensus_meta.cc:287] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.115s	user 0.009s	sys 0.005s
I20260709 12:21:55.380679 23849 rpcz_store.cc:276] 0709 12:21:54.320856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.360451 (+ 39595us) service_pool.cc:224] Handling call
0709 12:21:55.380012 (+1019561us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54002d50d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:55.380205 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548445952}
I20260709 12:21:55.380914 27814 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.384737 28109 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.385408 28109 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.278555 28097 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.387969 28097 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:55.389741 28074 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:55.390421 27969 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:55.391463 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:55.392112 27969 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:55.390748 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:55.394205 23996 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:21:55.356853 27831 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.395550 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:55.398188 28040 raft_consensus.cc:3055] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:55.398337 27862 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:55.398826 28040 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:55.400790 28040 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.406008 23893 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:55.409044 23996 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:55.447605 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:55.448449 23845 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:21:55.452134 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:55.453071 23996 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:55.409480 27876 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:55.456782 24001 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:21:55.459396 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 185943us
I20260709 12:21:55.436836 23893 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:55.467309 23997 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:55.470593 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:55.469409 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:55.474488 23849 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 9 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:21:55.475304 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 97112.2us
I20260709 12:21:55.479203 28074 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:21:55.480899 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.486300 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:55.490670 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:55.492220 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:55.487036 24557 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:55.462383 27777 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:55.461162 28099 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.504184 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:55.506309 24002 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:55.507555 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:55.512739 23998 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
W20260709 12:21:55.513976 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 135081us
I20260709 12:21:55.504701 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 457) took 1273 ms. Trace:
I20260709 12:21:55.517305 24563 raft_consensus.cc:2393] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:55.517302 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:55.521441 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 67619.8us
I20260709 12:21:55.521859 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:21:55.531025 24525 leader_election.cc:336] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.740s (SENT)
I20260709 12:21:55.508311 23820 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:55.499755 27876 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:55.534122 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:55.537807 24556 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:21:55.536005 23892 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:55.504310 27959 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:55.541195 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:55.515561 24004 rpcz_store.cc:276] 0709 12:21:54.235682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.625044 (+389362us) service_pool.cc:224] Handling call
0709 12:21:54.692199 (+ 67155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:54.725014 (+ 32815us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:54.772214 (+ 47200us) log.cc:844] Serialized 14 byte log entry
0709 12:21:55.291721 (+519507us) log.cc:844] Serialized 14 byte log entry
0709 12:21:55.504278 (+212557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:55.504342 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:55.504397 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.504487 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:55.504636 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158361,"prepare.queue_time_us":44337,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":522138,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":176,"spinlock_wait_cycles":1334528,"thread_start_us":518568,"threads_started":3,"wal-append.queue_time_us":267622}
I20260709 12:21:55.545317 23820 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:55.505430 27777 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.505541 27821 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:55.506238 28040 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:55.518770 27814 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:55.569769 23969 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:55.570873 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.572552 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:55.573158 24556 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:55.505456 27806 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:21:55.576078 23926 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:55.574240 23966 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:55.577942 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:55.546419 27973 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:55.599215 27973 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.599702 27973 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:55.602236 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 75510.8us
I20260709 12:21:55.603228 23892 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:55.604760 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:55.606717 28087 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:55.606299 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:55.579121 28102 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:55.582747 23740 maintenance_manager.cc:643] P 8f9c39c095e54c96a7a90888b94785f5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.691s	user 0.166s	sys 0.115s Metrics: {"bytes_written":29262,"cfile_init":1,"dirs.queue_time_us":665307,"dirs.run_cpu_time_us":600,"dirs.run_wall_time_us":1851,"drs_written":1,"lbm_read_time_us":89236,"lbm_reads_10-100_ms":4,"lbm_write_time_us":151662,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":63,"thread_start_us":364614,"threads_started":1}
I20260709 12:21:55.556010 27876 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:55.562429 27777 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:55.584883 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:55.587802 27799 raft_consensus.cc:3055] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:55.588773 28002 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:55.580013 27959 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:55.585732 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:55.597453 27975 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:55.556537 27862 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:55.635226 23893 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:55.551122 27987 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:55.619958 24525 leader_election.cc:336] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.920s (SENT)
W20260709 12:21:55.648173 24525 leader_election.cc:336] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.100s (SENT)
W20260709 12:21:55.626384 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 56736us
I20260709 12:21:55.537485 28099 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:55.580966 27989 consensus_meta.cc:287] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.003s
I20260709 12:21:55.630394 27821 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:55.630965 23741 maintenance_manager.cc:419] P 8f9c39c095e54c96a7a90888b94785f5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8380 bytes on disk
W20260709 12:21:55.631325 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 108981us
I20260709 12:21:55.642602 24000 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.636186 28111 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:55.643805 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 82762.4us
I20260709 12:21:55.607685 28087 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:55.608124 28068 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:21:55.649288 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.638558 28002 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.651691 23925 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.663517 23929 raft_consensus.cc:2410] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:21:55.655496 24556 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:55.649614 23926 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:55.627494 27799 raft_consensus.cc:740] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:55.659638 23817 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:55.647626 27975 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.678309 23820 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:55.654120 26910 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.684063 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:55.648733 28115 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:55.656999 28111 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.664489 28002 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:55.678612 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:55.690035 23817 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:55.693683 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.709753 27831 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:55.688141 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 52663.3us
I20260709 12:21:55.705372 24000 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:21:55.716879 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:55.717871 23926 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:55.714604 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 66468.7us
W20260709 12:21:55.720182 24525 leader_election.cc:336] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.117s (SENT)
I20260709 12:21:55.706674 28111 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.670380 27996 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:21:55.744475 28099 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:55.745402 28099 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:55.748400 27831 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:55.750422 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.750092 28111 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:55.751251 24525 leader_election.cc:336] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.141s (SENT)
I20260709 12:21:55.753775 28111 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:55.679790 28108 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:55.716910 23893 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:55.694764 27902 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:55.664083 27821 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:55.771970 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 55183.9us
I20260709 12:21:55.776834 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:55.696166 28115 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:55.696633 27806 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:55.714177 28106 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:55.784222 23892 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:55.800578 24524 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.803s (SENT)
I20260709 12:21:55.777438 26910 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:55.812472 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 122569us
W20260709 12:21:55.820457 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 105961us
I20260709 12:21:55.810474 23740 maintenance_manager.cc:643] P 8f9c39c095e54c96a7a90888b94785f5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.139s	user 0.002s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":514,"lbm_reads_lt_1ms":4}
I20260709 12:21:55.835530 23926 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:55.836189 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:55.783056 28115 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:55.838984 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 54884.4us
I20260709 12:21:55.791119 27902 raft_consensus.cc:697] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:55.778230 27959 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:55.853868 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 73736.9us
I20260709 12:21:55.778781 28108 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.785036 28106 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:55.856966 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:55.860128 23997 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:21:55.858662 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:55.816706 28102 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:55.755980 27876 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.790690 27806 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:55.864729 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.848585 26910 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:55.870967 27902 consensus_queue.cc:237] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.872080 23817 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:55.805388 27799 consensus_queue.cc:260] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.871383 28107 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:55.876911 28099 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:55.877498 28099 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.878007 28099 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.882501 27975 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:55.867177 28111 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:55.884825 28111 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:55.885262 28111 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.886238 26910 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.891397 27806 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:55.864244 27862 consensus_queue.cc:1059] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:21:55.894490 27975 raft_consensus.cc:3055] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:55.895020 27975 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:55.895999 27975 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.897724 27975 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:55.898238 28108 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:55.899629 23892 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:55.861941 28106 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:55.919528 27806 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:55.928593 27973 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:55.930161 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 58178.3us
I20260709 12:21:55.931039 23817 leader_election.cc:400] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9.
I20260709 12:21:55.931329 23817 leader_election.cc:403] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:55.932307 23817 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:55.925849 28125 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.934746 27862 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:55.935526 28124 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.935745 27862 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:55.874269 28102 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:55.937574 28102 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.938753 28033 raft_consensus.cc:3055] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:55.939158 28033 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:55.882704 27821 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:55.940047 28033 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.941118 28033 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.926862 28086 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:55.934581 28125 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.943216 24556 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:55.944182 23966 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:55.945533 23925 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:55.933764 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:55.866256 28006 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 12:21:55.950862 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 51315us
I20260709 12:21:55.953049 27814 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.953593 27814 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.955826 27814 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:55.957808 27996 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:55.957235 23817 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:55.964425 28107 raft_consensus.cc:2764] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:21:55.969669 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:55.970304 28114 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.322s	user 0.005s	sys 0.000s
I20260709 12:21:55.970562 27821 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:55.971328 27821 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:55.971666 27821 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.971980 27821 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:55.976826 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:55.977564 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.927685 27806 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:55.922003 27987 consensus_queue.cc:1059] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 12:21:55.963692 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 87358.2us
I20260709 12:21:55.989436 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:55.991150 24554 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.961668 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:55.992149 24000 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:55.982801 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:55.975442 28125 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.004925 28111 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:55.976316 28086 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:55.980398 27973 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:56.016717 23893 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:55.994685 27996 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:56.026388 26910 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:56.026875 26910 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.027231 26910 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:56.029202 28109 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:56.032881 28086 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.034577 23995 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:56.035610 24556 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:56.036013 24556 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:56.036623 24557 raft_consensus.cc:1240] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:56.036803 24556 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.037839 24556 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:56.038667 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:56.039618 23996 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:56.011955 28125 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:56.001554 28002 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.047336 23818 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:56.058228 23818 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:56.062327 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:56.063265 24563 raft_consensus.cc:2410] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:21:56.022825 28111 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:56.065377 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:56.017557 27862 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.071762 24554 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:56.076992 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:56.077850 24562 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.064311 27996 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:21:56.064566 28125 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:21:56.008955 27902 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:21:56.098682 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:56.100445 24001 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.098598 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:56.101871 23995 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
W20260709 12:21:56.104766 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.112881 24556 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:21:56.114171 24556 pending_rounds.cc:85] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 7
I20260709 12:21:56.115645 24556 pending_rounds.cc:107] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:21:56.115993 24556 raft_consensus.cc:2889] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:56.067222 27973 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:56.120385 27806 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:56.121438 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 123226us
I20260709 12:21:56.070286 28127 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:56.100046 27862 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.136067 27862 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.071346 28087 consensus_queue.cc:1059] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:21:56.142769 28102 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:56.144454 28115 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.146713 27757 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.147233 27757 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.118491 27973 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.150437 27973 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.151727 28002 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.157513 28087 raft_consensus.cc:3055] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:56.158020 28087 raft_consensus.cc:740] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:56.159125 27963 raft_consensus.cc:3055] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:56.158872 28087 consensus_queue.cc:260] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.159588 27963 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:56.160358 28087 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.160444 27963 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.161561 27963 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:56.171202 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:56.174288 28069 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:56.175380 28069 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:56.176767 28069 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:56.177184 27989 consensus_queue.cc:1059] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:56.178257 27989 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:56.178580 27989 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:56.179144 28099 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.179395 27989 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.180584 27989 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.188906 23892 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:56.181926 28127 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:56.185820 27987 raft_consensus.cc:3055] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:56.217669 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 234980us
I20260709 12:21:56.218329 24001 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:56.218586 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.201439 24562 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:56.177238 28069 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:56.215967 23892 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:56.214246 28102 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:56.219609 27987 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:56.141860 27777 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.223187 27876 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:56.242853 23817 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.217458 27821 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.224874 28099 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.237458 28124 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9.
I20260709 12:21:56.237378 28102 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.253675 27777 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.253964 28102 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.254855 28074 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:56.248759 23920 raft_consensus.cc:2368] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10.
I20260709 12:21:56.247910 27987 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.259061 27987 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:56.260743 28127 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.264959 28074 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:21:56.269088 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.269938 26910 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:56.277159 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.279317 26910 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.282544 27821 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:56.284845 28126 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.263s	user 0.000s	sys 0.004s
W20260709 12:21:56.288049 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 224505us
I20260709 12:21:56.248888 27757 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.302804 27831 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:56.303376 27831 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:56.304275 27831 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.305433 27831 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:56.308879 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 240084us
W20260709 12:21:56.310297 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 285470us
W20260709 12:21:56.308270 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 56657.3us
I20260709 12:21:56.311236 23818 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:56.311831 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.312230 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:56.314085 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:56.314441 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:56.315956 23969 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:56.312559 23818 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:56.318745 23817 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.319689 28134 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:56.307780 28127 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:56.320482 28115 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:56.331532 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:56.332190 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.331612 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:56.341795 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:56.343956 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.298131 27821 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:21:56.346169 28111 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:56.307317 28069 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.317061 28136 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:56.357088 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:56.365486 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.317013 28099 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:56.369553 24002 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:21:56.371212 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 148993us
I20260709 12:21:56.373955 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:56.374493 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:56.374846 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 62399.4us
I20260709 12:21:56.375299 24002 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:56.375454 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88973us
I20260709 12:21:56.374524 24001 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
W20260709 12:21:56.377774 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 138620us
I20260709 12:21:56.383868 24554 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:56.386121 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:56.387683 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:56.369776 28134 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:56.399293 24562 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:56.369189 28099 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:56.356348 27973 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.382586 23893 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:56.390952 23817 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.403447 24001 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:56.404649 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:56.410071 23997 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:56.368420 28109 consensus_queue.cc:1059] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:21:56.396364 27876 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:56.423929 23817 leader_election.cc:400] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10.
I20260709 12:21:56.383811 27902 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:56.401149 28134 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:56.372895 28115 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:21:56.427655 23817 leader_election.cc:403] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:21:56.426538 24556 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:56.425499 28127 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:56.389906 26910 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:21:56.442927 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:56.431030 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 74052.1us
I20260709 12:21:56.378129 28006 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:21:56.408249 28099 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:56.369987 28040 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:21:56.439006 28138 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:56.462169 27821 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:56.401597 28124 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:21:56.440060 28134 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:56.462796 27821 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.455506 23997 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:56.407684 28125 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:21:56.465052 27821 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:56.465190 23926 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:56.465976 27821 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.466503 23920 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:56.466777 28125 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:56.467046 27975 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.467347 28125 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.467633 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.468279 23929 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:56.427081 28108 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:56.460793 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:56.461493 24002 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:56.467525 27975 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.452741 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:56.472409 23925 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:56.451599 28002 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:56.474990 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.440476 27902 raft_consensus.cc:697] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:56.478721 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 96209.8us
I20260709 12:21:56.460393 28111 raft_consensus.cc:697] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:56.477293 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.485695 23849 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:56.485584 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 83059.1us
I20260709 12:21:56.474680 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.480845 24002 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:56.482440 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.492159 23997 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:56.492640 23846 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:21:56.492776 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.482656 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.430846 28102 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.483683 24524 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:56.483686 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.496505 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.496805 23929 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 15 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:56.497215 23920 raft_consensus.cc:2368] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11.
I20260709 12:21:56.484392 23854 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:56.487032 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.487071 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.487860 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:56.493427 23850 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:56.472680 28113 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.494177 23893 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:56.492388 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.495309 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:56.495472 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.458272 28106 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.495558 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.469179 28146 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:56.509788 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 57149.5us
I20260709 12:21:56.510918 23966 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:56.500052 23928 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:56.500337 23923 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:21:56.500806 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.482422 28148 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:56.512338 23924 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:56.501715 23926 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.510701 23817 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.490331 27806 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:56.519004 23921 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:56.523813 23817 leader_election.cc:400] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11.
I20260709 12:21:56.524310 23817 leader_election.cc:403] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:56.520334 23893 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:56.466504 27821 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.526857 23995 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:56.515410 27862 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:21:56.527680 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:56.509356 28146 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.536675 28155 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:56.508575 27876 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:21:56.519430 28108 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:56.513396 28125 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.519759 28148 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:21:56.560384 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 76786.9us
I20260709 12:21:56.567898 23845 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:21:56.525461 28127 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:56.569058 24524 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:56.562680 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:56.575949 23926 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:56.533427 28006 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:56.509529 28113 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:56.581470 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 61275.9us
I20260709 12:21:56.581993 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:21:56.580303 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44676.1us
I20260709 12:21:56.542840 28146 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:56.588338 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.568435 28108 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:56.595023 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:56.582657 28155 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:56.595829 23847 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:56.596385 28155 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.600841 23847 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:56.603235 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:56.604362 23854 raft_consensus.cc:2410] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:56.581465 27806 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:56.580899 28125 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:21:56.607972 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.613065 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.613744 23846 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:56.615876 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.616524 23854 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:56.618763 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.622331 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:56.593871 28006 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:56.606046 27973 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.630942 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.624059 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.625118 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:56.632053 23853 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.619913 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:56.627267 23848 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:56.605822 28108 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:56.638527 28154 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.638898 28151 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:56.639211 28154 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.640102 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.640837 23846 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:56.654222 23846 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:56.661648 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.641819 28154 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:56.672422 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 56803.6us
I20260709 12:21:56.568284 27902 consensus_queue.cc:237] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.676128 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:56.589928 28111 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.642882 28006 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:56.702121 23847 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
W20260709 12:21:56.702674 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 91070.7us
I20260709 12:21:56.665994 27975 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.632292 28087 consensus_queue.cc:1059] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:21:56.710971 23922 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:56.672735 28138 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.716037 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:56.716640 23853 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:21:56.672127 28151 raft_consensus.cc:697] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:56.719125 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.720335 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.722388 23922 raft_consensus.cc:2368] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7.
I20260709 12:21:56.724502 23929 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:56.704234 28040 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.733302 23849 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:21:56.710063 28153 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:56.747947 23926 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:56.749293 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.750700 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.738610 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.724133 28138 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.726085 28106 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:56.720290 27806 raft_consensus.cc:697] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:56.783370 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.786743 23853 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:56.784195 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.797899 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.798771 23926 raft_consensus.cc:2393] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:56.800318 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:56.800549 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:56.801213 23849 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:21:56.803742 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 108591us
I20260709 12:21:56.803970 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:56.804649 23846 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.754279 27973 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:56.788439 28141 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.228s	user 0.000s	sys 0.003s
I20260709 12:21:56.808967 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:56.788502 28162 log.cc:927] Time spent T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:21:56.730306 28150 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:56.788655 28158 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.819796 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.821064 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.821828 23929 raft_consensus.cc:2368] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13.
I20260709 12:21:56.663053 28148 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.819167 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:56.744887 28153 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.825125 23853 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:21:56.734763 28102 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.825946 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.827481 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.753131 28040 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.743798 28154 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:21:56.832073 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.839823 23849 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:21:56.837520 23924 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:56.832155 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:56.842537 23966 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.927s (SENT)
I20260709 12:21:56.842955 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:21:56.844193 23966 leader_election.cc:336] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.947s (SENT)
I20260709 12:21:56.847609 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:56.847931 28164 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:21:56.819141 27821 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:56.831560 28160 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:56.825666 28151 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.850495 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.844413 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.854789 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.810568 28006 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.826689 28153 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:56.840601 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 121768us
I20260709 12:21:56.857295 23925 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:56.878085 27806 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.864765 23924 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
W20260709 12:21:56.863152 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.850064 23846 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:21:56.849179 28148 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:56.818943 27973 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.865994 23920 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
W20260709 12:21:56.886380 23966 connection.cc:256] RPC call timeout handler was delayed by -1.6733095009999488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2698s for a response
W20260709 12:21:56.892761 23966 connection.cc:256] RPC call timeout handler was delayed by -1.4915095010001096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29s for a response
W20260709 12:21:56.891273 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 367649us
I20260709 12:21:56.887655 23846 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:21:56.852201 27799 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:56.890367 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.901114 23925 raft_consensus.cc:2376] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13. Re-sending same reply.
I20260709 12:21:56.851646 28150 raft_consensus.cc:697] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:56.894778 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:56.905718 23996 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:56.907435 28108 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.909686 28040 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:56.910645 28138 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.913129 23853 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:56.852371 28157 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.894090 23817 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.898605 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:56.916715 24002 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:56.859086 28113 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:56.902204 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.917268 23817 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.918030 23920 raft_consensus.cc:2393] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:56.919809 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:56.920490 23997 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.914582 24000 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:56.896559 24004 raft_consensus.cc:1240] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:56.915403 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:56.915853 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.907466 23924 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:56.921693 23847 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.921798 24001 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:21:56.926695 23925 raft_consensus.cc:2376] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11. Re-sending same reply.
I20260709 12:21:56.920317 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.927680 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:56.928814 27821 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:56.931977 27973 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:56.932359 28138 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.932914 28138 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.933779 24556 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:56.929629 27831 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:56.935853 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.936614 23925 raft_consensus.cc:2368] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13.
I20260709 12:21:56.937551 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:56.938140 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.934427 28157 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:56.940016 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:56.938194 23925 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
W20260709 12:21:56.945504 24524 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.562s (SENT)
I20260709 12:21:56.957856 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.958551 23925 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:56.959657 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:56.855007 28165 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:21:56.909777 28108 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:56.965000 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:56.965782 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:56.966588 24560 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:56.966599 24556 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:56.966827 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.959901 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.961967 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.969120 23920 raft_consensus.cc:2393] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:56.966877 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:56.969820 27975 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:56.970214 28150 consensus_queue.cc:237] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:56.970849 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.969062 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:56.971454 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:56.972652 23997 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:56.973340 23847 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:56.980738 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:56.998436 24001 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:21:56.981616 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:56.993769 24554 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:56.999400 23924 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:56.995358 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.001161 23923 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:21:57.001766 23925 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:56.851696 28158 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.005713 23920 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:57.011091 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.020576 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:57.021351 23925 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.023573 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.024296 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:57.025074 23924 raft_consensus.cc:2368] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12.
I20260709 12:21:56.963719 28040 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:21:57.034317 23929 raft_consensus.cc:2376] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11. Re-sending same reply.
I20260709 12:21:57.025962 23920 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:57.032459 27862 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.968695 27821 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:21:57.042989 24524 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:57.044870 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:57.046696 23924 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:56.955502 28134 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.026531 27876 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:57.055711 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:57.064558 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:57.030275 28108 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:57.066468 23854 raft_consensus.cc:2393] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:57.070755 28163 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:57.071370 28163 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:57.071745 28157 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:57.074107 28168 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:57.073668 28160 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:57.075630 28160 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:57.076210 28160 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:57.042521 23817 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:57.071877 28163 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:57.067057 23925 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
W20260709 12:21:57.077425 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.081719 24525 leader_election.cc:336] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.514s (SENT)
I20260709 12:21:57.042387 28125 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11.
I20260709 12:21:57.090939 23850 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:57.099498 28146 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.101660 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:57.102232 23922 raft_consensus.cc:2368] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10.
I20260709 12:21:57.102504 23925 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:21:57.105845 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 138132us
I20260709 12:21:57.030844 27975 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 12:21:57.082321 28002 consensus_meta.cc:287] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.590s	user 0.002s	sys 0.009s
W20260709 12:21:57.108134 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 116594us
I20260709 12:21:57.079838 27876 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:57.110760 28099 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.000s
I20260709 12:21:57.107436 28172 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:57.117195 28002 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10.
I20260709 12:21:57.130765 28002 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.131287 28002 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.133932 23851 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:57.136091 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:57.066767 27862 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.139094 27862 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:57.143039 28160 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.144269 28108 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:57.157109 28040 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:57.157562 28160 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:57.145299 28163 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.150226 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:57.151644 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:57.160899 24000 raft_consensus.cc:2410] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:57.152753 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:57.154475 27989 raft_consensus.cc:3055] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:57.126600 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.191213 23925 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:57.124137 28124 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:57.203855 23925 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:57.199554 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:57.205528 24525 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:57.206215 23925 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 12:21:57.201565 23966 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.542s (SENT)
I20260709 12:21:57.126618 28146 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:57.207260 24525 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:57.159719 28113 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.212792 24525 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:57.182825 27989 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:57.217003 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 174564us
I20260709 12:21:57.218775 23925 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:57.260427 23847 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:57.261700 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:57.215867 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:57.222162 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.221709 28172 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:57.213582 27799 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:57.223778 28109 raft_consensus.cc:3055] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:57.217149 27806 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:57.217181 28168 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:57.160198 28099 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.274663 23850 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:57.226672 28158 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:57.227322 28163 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:21:57.227880 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.228961 23817 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:57.214985 28153 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.209187 28160 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:21:57.221849 27876 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:57.254103 28188 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:21:57.255417 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.257349 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.271018 28006 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:57.203323 28138 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:57.268110 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.288581 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:57.268757 23852 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:57.290290 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:57.290939 23852 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:57.292268 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:57.293109 23846 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:57.272671 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:57.274392 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:57.294824 23854 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:57.209364 28124 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.296087 28124 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.221782 28183 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:57.297426 28183 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.297873 28183 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.299252 28165 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:57.275030 28168 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.303606 28168 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:57.217871 28113 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.278071 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:57.279947 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 78412.8us
I20260709 12:21:57.280268 27806 raft_consensus.cc:697] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:57.257527 28134 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:57.284257 23924 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:21:57.273010 28109 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:57.285379 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:21:57.286348 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 57492.4us
I20260709 12:21:57.286341 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.283731 28160 consensus_queue.cc:1243] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:57.277663 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.310431 23846 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:57.313047 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:57.322669 23925 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:57.322861 23847 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:57.323606 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:57.313026 23966 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.551s (SENT) [suppressed 45 similar messages]
I20260709 12:21:57.325132 23925 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:57.326244 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.327201 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:57.327821 23966 leader_election.cc:336] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.619s (SENT)
I20260709 12:21:57.328289 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:57.328873 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.332172 23850 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:57.331831 28109 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.333015 28109 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.335880 28153 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:57.337033 27806 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.345635 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:57.346635 24556 raft_consensus.cc:2410] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:57.350891 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:57.352938 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:57.353619 24563 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:21:57.354765 23854 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:21:57.355495 23850 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:57.316810 28186 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:57.361130 28006 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:21:57.378935 28189 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:21:57.379925 28113 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:57.382941 23895 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:57.383267 27777 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:57.385376 27777 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:57.345858 28136 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:21:57.387099 28137 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:57.369352 24562 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:57.370352 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:57.393420 24563 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:21:57.372624 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:57.373533 23969 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:57.325665 28165 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:21:57.320662 28099 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:57.375524 28106 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:57.375810 28179 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.289s	user 0.003s	sys 0.000s
I20260709 12:21:57.396209 23927 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:57.398037 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:57.401512 24562 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:57.402029 23847 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.403810 23996 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:57.403291 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:57.404685 23920 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.402872 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:57.407070 24004 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:57.408617 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:57.409796 27996 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:57.411062 28002 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:57.411319 27831 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:57.414908 27989 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.416098 27989 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.417042 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:57.418421 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:57.419191 24001 raft_consensus.cc:2368] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11.
W20260709 12:21:57.419996 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 94087.8us
I20260709 12:21:57.425848 24003 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:57.427305 23998 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:57.428892 23999 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:21:57.432137 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:57.432930 23997 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:21:57.434549 23996 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:57.435931 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:21:57.436841 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 46878.9us
I20260709 12:21:57.439039 28084 consensus_queue.cc:1059] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:57.439778 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:57.440310 28084 raft_consensus.cc:3055] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:57.440541 23850 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:57.440836 28084 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:57.401026 28186 raft_consensus.cc:697] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:57.442231 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:57.442848 28186 consensus_queue.cc:237] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.443313 28084 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.441677 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:57.451939 23850 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:57.454559 23966 leader_election.cc:336] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.648s (SENT)
I20260709 12:21:57.457743 24524 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:57.445169 28084 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:57.407156 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:57.477357 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:57.478394 23997 raft_consensus.cc:2410] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:57.479907 23893 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:57.482431 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:57.483034 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:57.483661 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:57.395520 28137 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:57.485505 23996 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:57.498090 23847 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:21:57.499737 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:57.447512 28006 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:57.504823 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:57.507110 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.508262 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 482) took 1038 ms. Trace:
I20260709 12:21:57.508848 23845 rpcz_store.cc:276] 0709 12:21:56.469345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.469755 (+   410us) service_pool.cc:224] Handling call
0709 12:21:57.508002 (+1038247us) spinlock_profiling.cc:243] Waited 74.3 ms on lock 0x7b54001e3cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:57.508181 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170836736}
W20260709 12:21:57.518909 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.507009 24001 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
W20260709 12:21:57.533406 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 78876.1us
W20260709 12:21:57.534142 23966 leader_election.cc:336] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.684s (SENT)
I20260709 12:21:57.534524 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:57.500452 28137 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:57.539808 23850 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:57.499920 28153 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:57.406302 28106 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.549500 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:57.556869 23820 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:57.562897 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:57.571998 23920 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:57.478713 28069 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 12:21:57.577782 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.527345 28074 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:57.493847 26910 consensus_queue.cc:1059] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:21:57.590713 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:57.502492 27831 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:21:57.540350 28160 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:57.482933 23846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:21:57.609308 23846 raft_consensus.cc:606] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:57.609822 23846 raft_consensus.cc:614] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:57.538683 28006 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:57.550092 28102 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:57.616894 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 82744.7us
I20260709 12:21:57.554483 28153 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.546402 27799 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:57.573009 28086 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:57.575719 28127 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.550902 28185 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:57.639788 23966 leader_election.cc:336] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.717s (SENT)
I20260709 12:21:57.641004 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:57.604655 27821 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:57.645117 23852 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:21:57.611754 28002 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.611507 27814 raft_consensus.cc:3055] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:57.660259 24558 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:57.652328 28150 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:21:57.666501 28200 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:21:57.655529 28185 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.669140 28185 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:57.669713 27996 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:57.622045 28153 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:57.673779 23818 leader_election.cc:400] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11.
I20260709 12:21:57.678131 23995 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:57.681026 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:57.681991 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.682766 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:57.682974 28006 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.647784 28127 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.693065 28127 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:57.695041 28106 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:57.675020 23818 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:57.647054 28208 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:57.712066 23969 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:57.712971 28168 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.715106 28108 consensus_queue.cc:1059] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:57.716302 28108 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:57.716729 28108 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.717010 24563 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:57.717231 28150 raft_consensus.cc:3055] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:57.717707 28150 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:57.718801 28113 raft_consensus.cc:3055] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:57.719375 28113 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:57.625532 28102 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.720559 28113 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.722082 28102 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:57.718566 28150 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.725108 28150 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:57.725956 28154 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:57.726548 28154 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.728776 28154 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:57.730389 24524 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:21:57.730553 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 55646.4us
I20260709 12:21:57.731665 23818 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:57.740154 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.740818 23818 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:57.770241 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:57.771075 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 288114us
I20260709 12:21:57.771927 23892 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:57.649708 27821 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:57.774384 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 263721us
I20260709 12:21:57.717075 28108 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.664384 27814 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:21:57.783078 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 100387us
I20260709 12:21:57.635727 27799 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.807394 23846 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:21:57.807911 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 67224.6us
I20260709 12:21:57.809690 24557 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:57.814625 23818 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:57.773922 28125 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:57.739880 28099 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:57.809527 23893 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:57.773144 28113 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:57.767788 28154 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:57.848840 28154 raft_consensus.cc:697] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:57.809224 27975 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.849519 27975 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.849959 28154 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.812691 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:57.672473 28002 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.803318 27821 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.812171 27963 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:57.855659 28156 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:21:57.813907 28134 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.858562 24002 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:21:57.813709 28183 consensus_meta.cc:287] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.002s
W20260709 12:21:57.847502 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 75671us
I20260709 12:21:57.867312 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:57.867527 24002 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:57.822083 28102 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:21:57.871094 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:57.818053 27831 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:57.873031 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.810613 28040 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:57.874971 24002 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:21:57.879535 24001 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:57.883857 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:57.846145 28127 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:57.860169 28194 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:21:57.894870 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.876381 28160 raft_consensus.cc:697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:57.856797 28074 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:57.901434 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:57.867579 27996 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.905608 23846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:21:57.935093 23846 raft_consensus.cc:606] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:57.935571 23846 raft_consensus.cc:614] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:57.861328 27876 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:21:57.847069 27806 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:21:57.871008 26910 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:21:57.871834 28146 consensus_queue.cc:1059] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:21:57.909148 28127 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.908566 28099 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:57.921023 28086 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:57.979720 28210 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:57.922329 28158 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.881942 28134 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.936939 28074 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.901553 27963 consensus_queue.cc:1059] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:21:57.936667 27862 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:57.989359 28156 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.958925 27996 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.920954 27814 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.994611 28146 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:57.995321 28158 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:57.996002 28102 raft_consensus.cc:3055] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:57.877478 28183 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.028367 28108 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:57.987003 28127 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:57.981479 27902 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:21:58.031462 28109 consensus_meta.cc:287] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.004s
I20260709 12:21:58.116884 27814 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:58.117527 28209 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 12:21:58.118969 28201 log.cc:927] Time spent T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:21:58.120937 28224 log.cc:927] Time spent T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:21:58.122855 28002 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:58.124526 28108 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:58.127231 27996 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:58.091740 28102 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:58.128438 28102 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.130421 28102 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:58.132795 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.133100 28183 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:58.132308 27989 consensus_meta.cc:287] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.716s	user 0.012s	sys 0.000s
W20260709 12:21:58.134886 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:58.032080 28194 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:21:58.145000 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:58.145915 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:58.146237 24563 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:58.147651 23997 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:58.148061 23997 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:57.983698 28160 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.148895 23997 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:58.151095 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.152115 23997 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:58.092780 28146 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:58.032531 28074 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.191888 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:58.134966 28084 consensus_meta.cc:287] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.641s	user 0.007s	sys 0.004s
W20260709 12:21:58.220852 24524 leader_election.cc:336] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.514s (SENT)
I20260709 12:21:58.269011 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:21:58.134863 28124 consensus_meta.cc:287] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.838s	user 0.015s	sys 0.000s
W20260709 12:21:58.273801 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 53018.6us
I20260709 12:21:58.276639 23818 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:58.277287 24002 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:58.093139 27862 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:58.279045 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 377682us
W20260709 12:21:58.280814 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.190356 27902 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:21:58.300896 24524 leader_election.cc:336] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.584s (SENT)
I20260709 12:21:58.304488 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:58.301415 24003 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:21:58.287315 28137 consensus_meta.cc:287] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.703s	user 0.011s	sys 0.000s
W20260709 12:21:58.314141 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.277868 28183 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:58.102586 28156 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:58.322784 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.290191 28185 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:58.292572 28099 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.289548 28125 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:58.308243 28158 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:58.335472 23926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
W20260709 12:21:58.335170 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 467900us
I20260709 12:21:58.341166 23926 raft_consensus.cc:606] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:58.341773 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:21:58.340392 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.333979 23997 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 12:21:58.343305 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.343569 23997 pending_rounds.cc:85] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 5
I20260709 12:21:58.273308 28124 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.297572 26910 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:21:58.343990 23925 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:21:58.345363 27902 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:58.345966 28212 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:21:58.346673 28229 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:21:58.347323 28216 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:21:58.315802 28146 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.341121 28125 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.331398 28185 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.328219 28137 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.348984 23892 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:58.343454 23922 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:58.301322 28084 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:21:58.343968 23997 pending_rounds.cc:107] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:21:58.367379 23853 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:58.392303 28214 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:58.337522 28099 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:58.389984 28113 consensus_meta.cc:287] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.534s	user 0.004s	sys 0.007s
W20260709 12:21:58.377245 28225 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:21:58.378155 28204 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.410352 28204 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.411362 28125 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:58.379113 28170 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 1.526s	user 0.004s	sys 0.000s
W20260709 12:21:58.380862 27821 consensus_meta.cc:287] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.002s
I20260709 12:21:58.414734 27821 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.415923 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2120) took 1786 ms. Trace:
I20260709 12:21:58.412940 28204 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:58.417052 27821 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:58.382249 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2141) took 1017 ms. Trace:
I20260709 12:21:58.418692 27862 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:58.417760 23924 rpcz_store.cc:276] 0709 12:21:57.365111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.366657 (+  1546us) service_pool.cc:224] Handling call
0709 12:21:57.406512 (+ 39855us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:57.442359 (+ 35847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:57.442409 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:57.475403 (+ 32994us) log.cc:844] Serialized 52 byte log entry
0709 12:21:57.805734 (+330331us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:57.846125 (+ 40391us) log.cc:844] Serialized 14 byte log entry
0709 12:21:57.846369 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:57.846449 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:58.382012 (+535563us) raft_consensus.cc:1685] finished
0709 12:21:58.382044 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:58.382190 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35297,"prepare.queue_time_us":40196,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":36227,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":209,"thread_start_us":233619,"threads_started":1,"wal-append.queue_time_us":810715}
I20260709 12:21:58.393606 28185 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:58.363564 23966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.025s	sys 0.030s
I20260709 12:21:58.416455 23848 rpcz_store.cc:276] 0709 12:21:56.629296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.667224 (+ 37928us) service_pool.cc:224] Handling call
0709 12:21:56.699803 (+ 32579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:56.723424 (+ 23621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:56.723459 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:56.743986 (+ 20527us) log.cc:844] Serialized 26 byte log entry
0709 12:21:56.821800 (+ 77814us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:56.847090 (+ 25290us) log.cc:844] Serialized 14 byte log entry
0709 12:21:56.847345 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.847424 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:58.289171 (+1441747us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:58.415613 (+126442us) raft_consensus.cc:1685] finished
0709 12:21:58.415724 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:58.415859 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":360,"prepare.queue_time_us":28327,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":31879,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":18211,"spinlock_wait_cycles":15603584,"thread_start_us":33556,"threads_started":1,"wal-append.queue_time_us":64341}
W20260709 12:21:58.420167 23966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.025s	sys 0.030s
I20260709 12:21:58.418720 27975 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:58.420837 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 608166us
I20260709 12:21:58.421962 28146 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:58.422364 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:58.423641 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:58.354607 27799 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:58.395334 23817 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:58.426227 28099 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:58.426867 28099 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:58.427316 28099 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.427692 28099 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:58.368315 28229 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:58.400643 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 51817.8us
I20260709 12:21:58.429669 23892 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:58.401600 28124 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:58.433523 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.434420 23925 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:58.396178 23997 raft_consensus.cc:2889] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:58.415987 23923 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:58.433566 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:58.407087 28183 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:58.406452 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:58.440548 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:58.447088 23852 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:58.454594 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:58.457193 23892 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:58.462029 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:58.462764 24004 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.464680 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.458455 23925 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:58.466488 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:58.416991 28137 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:58.468042 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:58.469992 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:58.439292 28233 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:58.470294 23854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:21:58.428941 28229 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.472867 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:58.467514 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:58.476156 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.492267 23924 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:21:58.441320 27987 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:58.494634 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:58.467442 28150 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:58.486447 23995 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:58.489866 23854 raft_consensus.cc:606] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:58.490386 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.490845 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.491827 23926 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:58.494750 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:58.500190 23848 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:58.500712 24000 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:21:58.480096 23999 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:58.495419 24558 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 12: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:58.502738 28218 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:58.503235 28218 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:58.503611 28218 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:58.495880 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:58.507349 24554 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:21:58.481267 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:58.462519 28084 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:21:58.462894 28148 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:21:58.460206 28183 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.462088 28204 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:21:58.494222 28163 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:58.474052 28108 consensus_queue.cc:1059] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:21:58.489315 28232 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:58.513760 27987 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:58.474288 28210 consensus_queue.cc:1059] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:21:58.554482 28210 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:58.555064 28210 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:58.556032 28210 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.560770 23922 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:58.531231 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:58.523900 27777 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:21:58.563381 28156 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:58.514451 28234 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:21:58.489399 28231 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:21:58.566304 28137 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:58.566951 28137 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:58.567212 28234 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.567740 28234 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.568588 28137 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.547273 28163 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.515719 27975 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.577093 24554 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:58.537570 28125 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:58.597330 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 66255.1us
I20260709 12:21:58.610936 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.611748 23921 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
W20260709 12:21:58.614261 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 146292us
I20260709 12:21:58.570490 28137 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:58.649366 23848 raft_consensus.cc:1240] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 12 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:58.650669 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:58.659389 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:58.651391 24000 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:21:58.596113 28231 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.663468 23926 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:21:58.665982 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.667886 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:58.668898 24003 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:58.618532 27987 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:58.714780 27987 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:21:58.715773 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.716411 27987 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.723599 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2143) took 1330 ms. Trace:
W20260709 12:21:58.724654 28127 consensus_meta.cc:287] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.000s
W20260709 12:21:58.672988 28235 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:21:58.585954 27975 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.678491 28231 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.615792 28125 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.680583 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:58.736984 24000 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:58.561362 28185 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.642349 28113 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:21:58.689381 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:58.744626 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.691679 28218 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.700942 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:58.701249 23924 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:21:58.745479 23926 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:21:58.747933 23924 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:21:58.702301 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.704118 23996 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:21:58.728101 23927 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:58.724200 23923 rpcz_store.cc:276] 0709 12:21:57.392864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.393025 (+   161us) service_pool.cc:224] Handling call
0709 12:21:57.405759 (+ 12734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:58.439984 (+1034225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.723206 (+283222us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400329454. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:21:58.723473 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2322829056}
I20260709 12:21:58.731398 24004 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:58.574307 28074 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.713186 28099 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:58.660611 28153 consensus_meta.cc:287] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.892s	user 0.009s	sys 0.003s
I20260709 12:21:58.736223 24524 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:58.756201 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:21:58.756497 24524 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.776s (SENT)
I20260709 12:21:58.758381 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:58.733126 28160 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.725274 28127 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.739049 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:58.767503 24000 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:58.739027 28150 raft_consensus.cc:697] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:58.753473 24004 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:58.746593 24002 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:58.768980 23848 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:58.721622 28214 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:58.751049 23996 pending_rounds.cc:85] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 7
I20260709 12:21:58.763612 23818 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:58.765524 23929 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2284) took 1966 ms (client timeout 1781 ms). Trace:
I20260709 12:21:58.772436 23996 pending_rounds.cc:107] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:21:58.772801 23996 raft_consensus.cc:2889] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:58.774296 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:21:58.772608 23929 rpcz_store.cc:269] 0709 12:21:56.798669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.826496 (+ 27827us) service_pool.cc:224] Handling call
0709 12:21:58.765314 (+1938818us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540032a354. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:21:58.765447 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463303424}
I20260709 12:21:58.779575 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.780157 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:58.780900 23926 raft_consensus.cc:2376] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9. Re-sending same reply.
I20260709 12:21:58.782066 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.783603 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.785056 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.786497 23846 raft_consensus.cc:2368] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13.
I20260709 12:21:58.791766 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.797343 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:58.797678 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:58.798367 23927 raft_consensus.cc:2368] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9.
I20260709 12:21:58.765725 28165 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:58.801438 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:58.799311 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:58.819344 23927 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:58.765498 28153 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.773919 28160 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:58.810757 28183 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:58.821070 28148 raft_consensus.cc:3055] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:58.857424 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 83230us
W20260709 12:21:58.860200 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 86659.8us
I20260709 12:21:58.873309 24560 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:58.847093 28102 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.869470 23927 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:58.860433 28124 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:21:58.889196 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 127928us
I20260709 12:21:58.890369 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:58.860973 28148 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:58.863334 28163 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:58.943599 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:58.886633 28245 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:58.962471 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:58.964788 28242 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:58.965464 28242 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:58.966627 28242 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:58.971952 28239 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:21:58.935000 28156 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:21:58.961606 28124 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.892908 28102 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:58.961825 28248 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:58.974890 28245 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.982955 27799 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:58.883989 28150 consensus_queue.cc:237] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.030831 27975 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:59.052811 23927 raft_consensus.cc:2368] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12.
W20260709 12:21:59.042894 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.060230 23921 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:21:59.061600 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:21:59.062929 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 197941us
I20260709 12:21:59.039779 28124 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.042596 28125 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:59.047313 28074 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:59.045042 28245 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:59.107553 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:59.129505 23921 raft_consensus.cc:2410] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:59.094724 28163 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:59.069023 28218 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:59.057386 28231 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:59.069756 28155 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:21:59.038619 28156 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.069098 28185 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:59.102387 28113 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:21:59.044166 28148 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.187748 28148 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:59.166220 28258 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 12:21:59.167200 28249 log.cc:927] Time spent T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:21:59.167994 28264 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:21:59.194461 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.195269 23923 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:21:59.196214 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.196898 23923 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:59.180190 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:59.191254 28253 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260709 12:21:59.198184 28160 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:59.108142 28243 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:21:59.198239 23922 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:21:59.201525 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.201808 28102 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:59.202188 23922 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:59.203104 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.203202 28125 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:21:59.203806 23922 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:59.204703 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.068089 28248 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.197826 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:59.212417 23923 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:59.152707 28163 raft_consensus.cc:697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:21:59.228291 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:59.228993 23995 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:59.229204 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:59.229775 23999 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:21:59.218703 27975 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:59.231343 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.233527 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:59.218590 28231 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.235531 23999 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:59.242075 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:21:59.242986 23848 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:59.248129 23999 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:21:59.252985 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 91891.8us
I20260709 12:21:59.246603 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:59.243351 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:59.261826 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:21:59.262476 24004 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:21:59.262948 23851 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:21:59.242799 28268 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:59.242853 28231 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.243590 28242 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:59.241026 27975 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.208197 28155 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.279843 23995 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:59.280921 23923 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:21:59.243590 23969 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:59.272411 28248 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:59.292326 23922 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:59.294495 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.289857 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:59.279616 28242 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.298416 28242 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:59.302407 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 877513us
W20260709 12:21:59.303336 23966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.008s	sys 0.004s
W20260709 12:21:59.305171 23966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.008s	sys 0.004s
I20260709 12:21:59.275087 28156 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:21:59.289707 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 46225.9us
I20260709 12:21:59.303881 23820 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:59.272806 27975 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:59.290423 28148 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:59.304260 24004 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:21:59.311702 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:59.310142 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:59.315678 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:59.322649 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:59.322971 23923 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:59.323383 24554 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:21:59.264942 28268 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.309022 28248 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.323438 28149 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:59.309087 28247 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:59.394968 28247 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.396644 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.397290 28247 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:59.362170 28168 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:59.399652 28108 raft_consensus.cc:3055] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:59.400321 28108 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:59.363723 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:59.364511 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:59.364600 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.402796 24563 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:21:59.362438 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:59.403004 23929 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:21:59.371116 27831 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.372490 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:59.308177 28242 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:21:59.321694 28106 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:59.324980 28229 consensus_meta.cc:287] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.824s	user 0.014s	sys 0.000s
I20260709 12:21:59.342118 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:21:59.419553 28229 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.319845 28148 raft_consensus.cc:697] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:59.421262 28148 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.422111 28229 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:59.422045 28106 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:59.383029 28263 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:21:59.428155 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:59.389861 28124 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.423516 28248 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.385087 28268 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:59.341612 28277 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:59.387603 28269 log.cc:927] Time spent T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:21:59.432762 28124 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:59.387480 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 75838.7us
I20260709 12:21:59.324920 28183 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:59.309077 28163 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.397576 23920 raft_consensus.cc:2393] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:21:59.399775 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:59.365788 28260 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:59.369640 28272 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.403554 24554 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:59.436483 28183 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:21:59.445710 28183 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.423774 27831 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.439507 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.442976 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:59.443921 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:59.455197 24554 raft_consensus.cc:2410] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:59.438768 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:59.456147 23820 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:59.458448 24563 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:59.407145 23923 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:21:59.408737 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.414268 23850 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:59.469601 23929 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:21:59.417598 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:21:59.419871 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 89341.1us
I20260709 12:21:59.323791 28218 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:21:59.423295 23924 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:59.312919 27975 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:59.422606 28240 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:59.432883 28248 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:59.389818 28155 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:59.428972 24558 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:59.401345 28108 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.477226 28169 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:59.442869 28272 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.477833 28108 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.480197 28272 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:59.480412 23929 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:59.481145 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.481820 23921 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:21:59.482970 23921 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:59.484061 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.484889 23921 raft_consensus.cc:2393] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:21:59.465651 28255 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:59.485920 27975 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.486522 27975 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:59.487468 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:59.489321 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 50618.5us
I20260709 12:21:59.490252 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:59.491080 23996 raft_consensus.cc:2393] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 15: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:59.492971 28262 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:59.465934 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:21:59.439735 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:59.495687 23920 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.477777 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:21:59.481838 23929 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:21:59.467054 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:21:59.498698 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:59.501292 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.501345 24555 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:21:59.503681 23923 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:59.471105 28124 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:59.506860 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:21:59.517282 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:21:59.520321 23966 leader_election.cc:400] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13.
I20260709 12:21:59.494043 27989 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:21:59.494531 28240 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:59.529136 24001 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:21:59.533339 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:59.536621 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.542484 23927 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:59.542507 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:59.543601 24001 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.513257 28124 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.548108 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:59.548944 24002 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:21:59.519549 28160 raft_consensus.cc:2764] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:21:59.442442 28260 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.555393 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:59.505703 28142 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:21:59.556180 23920 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:21:59.527930 27973 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:59.563230 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:59.531639 28240 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:59.550462 28124 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.526026 28169 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:21:59.559227 28142 consensus_queue.cc:1243] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:59.575623 28151 raft_consensus.cc:993] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:21:59.598569 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:21:59.598850 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 60728.7us
I20260709 12:21:59.576040 28106 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:59.579499 27973 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:21:59.580036 27831 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:59.608633 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 78824.5us
I20260709 12:21:59.605758 23920 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:59.596915 28275 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:59.605579 28272 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:59.643816 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 45373.6us
I20260709 12:21:59.646531 27973 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:21:59.647715 28207 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 1.670s	user 0.004s	sys 0.000s
W20260709 12:21:59.652995 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:59.654675 28241 log.cc:927] Time spent T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.981s	user 0.007s	sys 0.002s
I20260709 12:21:59.656796 28134 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:59.658331 28275 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:59.645157 28272 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:21:59.694963 28287 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:59.696228 28272 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:59.697108 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 810) took 2137 ms. Trace:
I20260709 12:21:59.657581 28107 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:59.659417 28285 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:21:59.660388 28282 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:21:59.663676 28260 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:21:59.671284 28238 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.885s	user 0.002s	sys 0.000s
I20260709 12:21:59.677459 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:21:59.676384 28246 raft_consensus.cc:3055] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:59.621862 27989 raft_consensus.cc:1081] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:21:59.712704 28246 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:59.713778 28246 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.714808 28246 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:59.705794 28107 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.716269 28231 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:21:59.692045 28169 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.705168 28160 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:21:59.717847 28107 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:21:59.722543 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:59.728107 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:21:59.728708 28276 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 12:21:59.729197 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:21:59.724797 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:59.730686 24002 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.722395 24000 raft_consensus.cc:3055] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:59.731396 24000 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:21:59.708976 23920 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:21:59.686156 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:21:59.734238 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:21:59.689390 24001 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:21:59.692592 24559 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:59.735850 23817 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:21:59.737061 23817 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:59.693240 28278 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.297s	user 0.001s	sys 0.001s
I20260709 12:21:59.694219 28275 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:21:59.684477 28245 consensus_meta.cc:287] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.004s
I20260709 12:21:59.697512 24556 rpcz_store.cc:276] 0709 12:21:57.559607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.559727 (+   120us) service_pool.cc:224] Handling call
0709 12:21:57.560099 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:57.577852 (+ 17753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:57.577900 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:57.586915 (+  9015us) log.cc:844] Serialized 26 byte log entry
0709 12:21:57.736284 (+149369us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:57.736343 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:57.736439 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:59.647136 (+1910697us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:21:59.696764 (+ 49628us) raft_consensus.cc:1685] finished
0709 12:21:59.696790 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:59.697017 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39268,"raft.queue_time_us":18741,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":23400,"spinlock_wait_cycles":2476288,"thread_start_us":148923,"threads_started":1,"wal-append.queue_time_us":309638}
I20260709 12:21:59.710987 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:21:59.734459 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 165787us
I20260709 12:21:59.740811 24000 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.745121 23927 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
W20260709 12:21:59.747962 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.751611 24000 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.754012 23893 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:21:59.724759 28290 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:21:59.796873 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:21:59.746306 27862 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:59.792817 28260 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.746954 28231 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:59.744601 28275 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:59.794832 27989 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.719573 28183 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.725106 28160 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.724393 28169 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.752880 28245 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.746068 28240 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.879317 24561 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:59.868007 28113 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.856191 27975 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.861228 28260 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:21:59.867718 27989 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:21:59.866245 28124 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:00.055748 28293 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
W20260709 12:22:00.058692 28291 log.cc:927] Time spent T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 12:22:00.060869 28294 log.cc:927] Time spent T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
W20260709 12:22:00.056028 28304 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.179s	user 0.001s	sys 0.001s
W20260709 12:21:59.999198 28295 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:22:00.139472 28245 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:00.141428 28169 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:00.142907 28160 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:21:59.923460 28113 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:00.153371 28300 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
I20260709 12:22:00.155081 27975 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:00.156890 28124 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:00.164753 27989 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:00.167491 28293 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
I20260709 12:22:00.614758 28240 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:00.908376 28246 consensus_meta.cc:287] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.193s	user 0.012s	sys 0.000s
I20260709 12:22:00.899161 28183 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:00.934815 28260 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:00.951434 28183 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:01.003260 28183 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:01.022181 28183 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:01.161772 28113 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:01.190649 28275 consensus_meta.cc:287] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.323s	user 0.014s	sys 0.000s
W20260709 12:22:01.195151 24527 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.012s
W20260709 12:22:01.195619 24527 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.000s	sys 0.012s
I20260709 12:22:01.195665 28275 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.203663 28275 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:01.219411 28315 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.220160 28315 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:01.222720 28315 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:01.226934 24560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36570 (request call id 809) took 3667 ms (client timeout 1759 ms). Trace:
W20260709 12:22:01.227511 24560 rpcz_store.cc:269] 0709 12:21:57.559155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.562522 (+  3367us) service_pool.cc:224] Handling call
0709 12:22:01.226616 (+3664094us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54005901d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:01.226819 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3011073408}
I20260709 12:22:01.348165 28086 raft_consensus.cc:3055] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:01.348758 28086 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:22:01.363018 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 1.67678e+06us
I20260709 12:22:01.365007 23966 leader_election.cc:400] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12.
I20260709 12:22:01.365332 23966 leader_election.cc:403] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:22:01.366134 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2167) took 2096 ms. Trace:
I20260709 12:22:01.368180 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:01.368454 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 495) took 2423 ms. Trace:
I20260709 12:22:01.366619 23929 rpcz_store.cc:276] 0709 12:21:59.269516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.514103 (+244587us) service_pool.cc:224] Handling call
0709 12:21:59.515800 (+  1697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:59.521122 (+  5322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:59.521161 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:59.521680 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:21:59.683184 (+161504us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:59.683226 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:59.683330 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:01.365803 (+1682473us) raft_consensus.cc:1685] finished
0709 12:22:01.365838 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:01.366059 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4828,"raft.queue_time_us":29795,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":14097,"thread_start_us":137433,"threads_started":1,"wal-append.queue_time_us":307036}
I20260709 12:22:01.368994 23924 rpcz_store.cc:276] 0709 12:21:58.945290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.484055 (+538765us) service_pool.cc:224] Handling call
0709 12:21:59.484417 (+   362us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:59.484852 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:59.484884 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:21:59.485661 (+   777us) log.cc:844] Serialized 78 byte log entry
0709 12:21:59.585474 (+ 99813us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:59.744444 (+158970us) log.cc:844] Serialized 14 byte log entry
0709 12:21:59.753771 (+  9327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:59.753851 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:01.368220 (+1614369us) raft_consensus.cc:1685] finished
0709 12:22:01.368251 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:01.368397 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8604,"prepare.queue_time_us":265719,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":17947,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9276,"spinlock_wait_cycles":28115328,"thread_start_us":230078,"threads_started":2,"wal-append.queue_time_us":267882,"wal-append.run_cpu_time_us":3904,"wal-append.run_wall_time_us":1269856}
I20260709 12:22:01.406731 28315 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.407335 28315 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:01.409075 28315 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:01.420115 28234 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:01.427176 28302 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.427904 28302 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:01.429615 24000 consensus_meta.cc:287] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 1.675s	user 0.013s	sys 0.012s
I20260709 12:22:01.430126 28142 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.430773 28155 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:01.430720 28142 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.431636 28155 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:01.434113 28142 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:01.434811 28142 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.435909 28303 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.435451 28142 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:01.436694 28303 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.438807 28142 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:01.439469 28142 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:01.439524 28303 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:01.432034 28302 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:01.435271 28155 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:01.430673 24000 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:22:01.444202 24000 pending_rounds.cc:85] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 6
I20260709 12:22:01.444573 24000 pending_rounds.cc:107] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:22:01.444986 24000 raft_consensus.cc:2889] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:01.445573 28156 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:01.446684 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2109) took 1726 ms. Trace:
I20260709 12:22:01.446307 28156 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:01.448786 28156 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:01.440181 28142 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.451261 28142 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:01.451704 24000 rpcz_store.cc:276] 0709 12:21:59.720618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.721961 (+  1343us) service_pool.cc:224] Handling call
0709 12:21:59.722272 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:01.446363 (+1724091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.446622 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:01.452952 23892 connection.cc:256] RPC call timeout handler was delayed by -1.1922233660000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 12:22:01.453459 23892 connection.cc:256] RPC call timeout handler was delayed by -1.058123366000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
I20260709 12:22:01.453500 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:01.454108 23892 connection.cc:256] RPC call timeout handler was delayed by -1.026888586000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 12:22:01.454257 28127 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:01.454761 24000 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
W20260709 12:22:01.455374 24000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 2114) took 1716 ms (client timeout 2245 ms). Trace:
W20260709 12:22:01.455824 24000 rpcz_store.cc:269] 0709 12:21:59.739307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.453133 (+1713826us) service_pool.cc:224] Handling call
0709 12:22:01.455319 (+  2186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:01.456118 28317 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:01.457122 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:01.458148 24000 raft_consensus.cc:2410] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:22:01.458643 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 2117) took 1718 ms. Trace:
I20260709 12:22:01.458993 24000 rpcz_store.cc:276] 0709 12:21:59.740238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.456853 (+1716615us) service_pool.cc:224] Handling call
0709 12:22:01.458586 (+  1733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:01.456851 28317 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:01.468972 28317 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:01.472882 28243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.086s	user 0.011s	sys 0.015s
W20260709 12:22:01.473457 28243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.087s	user 0.011s	sys 0.016s
I20260709 12:22:01.473893 28185 consensus_queue.cc:1059] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:01.483502 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2144) took 4033 ms. Trace:
I20260709 12:22:01.484071 23928 rpcz_store.cc:276] 0709 12:21:57.449843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.450090 (+   247us) service_pool.cc:224] Handling call
0709 12:21:57.508270 (+ 58180us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:57.510477 (+  2207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:57.510525 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:59.162757 (+1652232us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b2c0005c228. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa285d45a11 00007fa285d55372 00007fa287487a01 00007fa28744c43a 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2
0709 12:21:59.163541 (+   784us) log.cc:844] Serialized 52 byte log entry
0709 12:21:59.248655 (+ 85114us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:59.248704 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:59.248784 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:59.673040 (+424256us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:22:01.483167 (+1810127us) raft_consensus.cc:1685] finished
0709 12:22:01.483196 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:01.483389 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1635,"raft.queue_time_us":2293,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":133846784,"thread_start_us":84548,"threads_started":1,"wal-append.queue_time_us":138120,"wal-append.run_cpu_time_us":5586,"wal-append.run_wall_time_us":1730171}
I20260709 12:22:01.496220 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56180 (request call id 30) took 3063 ms. Trace:
I20260709 12:22:01.503480 23854 rpcz_store.cc:276] 0709 12:21:58.432627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.453694 (+ 21067us) service_pool.cc:224] Handling call
0709 12:22:01.495728 (+3042034us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54004004a0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873c9520 00007fa287446652 00007fa28c41460a 00007fa28599a7d4 00007fa28599a762 00007fa28599a691 00007fa28599a60c 00007fa2859998c2 00007fa28578748c 00007fa2857868c6
0709 12:22:01.496098 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677886336}
I20260709 12:22:01.506646 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2254) took 2017 ms. Trace:
I20260709 12:22:01.507117 23995 rpcz_store.cc:276] 0709 12:21:59.489262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.489395 (+   133us) service_pool.cc:224] Handling call
0709 12:21:59.489720 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:59.490149 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:59.490182 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:59.490675 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:21:59.543955 (+ 53280us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:59.754748 (+210793us) log.cc:844] Serialized 14 byte log entry
0709 12:22:01.506279 (+1751531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.506370 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:01.506416 (+    46us) raft_consensus.cc:1685] finished
0709 12:22:01.506430 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:01.506581 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1761033,"prepare.queue_time_us":429672,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":60,"raft.queue_time_us":2488,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":96,"thread_start_us":249984,"threads_started":2,"wal-append.queue_time_us":81759}
I20260709 12:22:01.509634 28280 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:01.510207 28280 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:01.510591 28280 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:01.517608 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2257) took 2003 ms. Trace:
I20260709 12:22:01.518119 23999 rpcz_store.cc:276] 0709 12:21:59.514598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.514751 (+   153us) service_pool.cc:224] Handling call
0709 12:21:59.519196 (+  4445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:59.525805 (+  6609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:59.525856 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:59.533634 (+  7778us) log.cc:844] Serialized 26 byte log entry
0709 12:21:59.640745 (+107111us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:59.640811 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:59.640921 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:01.517349 (+1876428us) raft_consensus.cc:1685] finished
0709 12:22:01.517372 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:01.517538 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14212,"raft.queue_time_us":8686,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":24236,"thread_start_us":57269,"threads_started":1,"wal-append.queue_time_us":230568,"wal-append.run_cpu_time_us":3319,"wal-append.run_wall_time_us":1333635}
W20260709 12:22:01.521363 28274 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 2.138s	user 0.003s	sys 0.019s
I20260709 12:22:01.538071 28234 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:01.539641 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2116) took 1799 ms. Trace:
I20260709 12:22:01.540031 24000 rpcz_store.cc:276] 0709 12:21:59.739944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.459681 (+1719737us) service_pool.cc:224] Handling call
0709 12:22:01.459998 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:01.460229 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:01.463654 (+  3425us) log.cc:844] Serialized 14 byte log entry
0709 12:22:01.539090 (+ 75436us) log.cc:844] Serialized 14 byte log entry
0709 12:22:01.539289 (+   199us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:01.539334 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:01.539378 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.539449 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:01.539579 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56672,"prepare.queue_time_us":17721,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":20619,"threads_started":2,"wal-append.queue_time_us":15098}
I20260709 12:22:01.543102 28150 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12.
W20260709 12:22:01.537703 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 169573us
I20260709 12:22:01.545264 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:01.549394 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:01.550087 28259 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:01.554787 28259 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:01.554405 23750 catalog_manager.cc:5697] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 4 to 5, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 5 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:01.556037 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:01.556687 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2369) took 4295 ms. Trace:
I20260709 12:22:01.557080 23853 rpcz_store.cc:276] 0709 12:21:57.260861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.261004 (+   143us) service_pool.cc:224] Handling call
0709 12:21:57.279313 (+ 18309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:58.396300 (+1116987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.556396 (+3160096us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400299d54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:01.556592 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501883648}
W20260709 12:22:01.558388 23751 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59378 (request call id 142) took 25377 ms (client timeout 15000 ms). Trace:
I20260709 12:22:01.560570 28259 raft_consensus.cc:2764] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:22:01.559890 23750 catalog_manager.cc:5697] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 5 to 6, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 6 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:01.561972 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:01.565814 28259 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:01.567406 23966 leader_election.cc:400] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9.
I20260709 12:22:01.568905 23966 leader_election.cc:403] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:01.558794 23751 rpcz_store.cc:269] 0709 12:21:36.235221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.246714 (+ 11493us) service_pool.cc:224] Handling call
0709 12:22:01.558299 (+25311585us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:54.145763 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:54.205004 (+ 59241us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:54.205057 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:21:54.205075 (+    18us) tablet.cc:662] Decoding operations
0709 12:21:54.205972 (+   897us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:54.206055 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:54.206078 (+    23us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:21:54.206674 (+   596us) tablet.cc:701] Row locks acquired
0709 12:21:54.206722 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:21:54.206942 (+   220us) write_op.cc:270] Start()
0709 12:21:54.207066 (+   124us) write_op.cc:276] Timestamp: P: 1783599714206847 usec, L: 0
0709 12:21:54.207087 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:21:54.249160 (+ 42073us) log.cc:844] Serialized 2558 byte log entry
0709 12:21:55.055243 (+806083us) op_driver.cc:464] REPLICATION: finished
0709 12:21:55.127751 (+ 72508us) write_op.cc:301] APPLY: starting
0709 12:21:55.127887 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:55.128854 (+   967us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:55.129025 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:55.850565 (+721540us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:55.877213 (+ 26648us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=12
0709 12:21:55.877263 (+    50us) write_op.cc:312] APPLY: finished
0709 12:21:55.877590 (+   327us) log.cc:844] Serialized 89 byte log entry
0709 12:21:55.877761 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:55.877895 (+   134us) write_op.cc:454] Released schema lock
0709 12:21:55.877948 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:55.878416 (+   468us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:55.878444 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5422212,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":72174,"apply.run_cpu_time_us":23114,"apply.run_wall_time_us":750648,"cfile_cache_hit":10,"cfile_cache_hit_bytes":10420,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6211,"cfile_init":1,"lbm_read_time_us":1290,"lbm_reads_lt_1ms":8,"num_ops":6,"prepare.queue_time_us":287660,"prepare.run_cpu_time_us":123122,"prepare.run_wall_time_us":561048,"raft.queue_time_us":176961,"raft.run_cpu_time_us":16291,"raft.run_wall_time_us":127850,"replication_time_us":847965,"thread_start_us":603327,"threads_started":4,"wal-append.queue_time_us":481716,"wal-append.run_cpu_time_us":42292,"wal-append.run_wall_time_us":2160357}]]}
I20260709 12:22:01.570390 28259 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:01.579689 28259 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9.
I20260709 12:22:01.568101 28280 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.582405 24004 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:01.583591 28280 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:01.584200 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2258) took 2065 ms. Trace:
I20260709 12:22:01.584249 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:01.584698 24004 rpcz_store.cc:276] 0709 12:21:59.518517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.518658 (+   141us) service_pool.cc:224] Handling call
0709 12:21:59.525344 (+  6686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:01.582884 (+2057540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.583962 (+  1078us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54002468d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:01.584138 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4730357504}
I20260709 12:22:01.590593 28280 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:01.591720 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:01.599890 28280 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:01.600721 28280 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:01.601104 28280 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:01.602399 23846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 496) took 3173 ms (client timeout 2074 ms). Trace:
W20260709 12:22:01.602887 23846 rpcz_store.cc:269] 0709 12:21:58.428653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.454291 (+ 25638us) service_pool.cc:224] Handling call
0709 12:22:01.602106 (+3147815us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400299354. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:01.602288 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760937216}
I20260709 12:22:01.608196 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:01.609179 23997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 2113) took 1870 ms (client timeout 1884 ms). Trace:
I20260709 12:22:01.599622 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:01.612624 28262 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:01.613186 23966 leader_election.cc:400] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12.
I20260709 12:22:01.613399 28262 consensus_queue.cc:1243] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:01.613924 28262 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:01.614262 28262 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:01.615078 28262 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.616266 28262 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:01.620261 28280 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:01.624095 28317 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:01.624778 28317 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.625387 28280 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:01.626130 28229 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.626374 28275 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:01.626760 28229 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.627007 28275 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.629359 28275 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:01.629422 28229 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:01.630690 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0378216579999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 12:22:01.761498 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:01.761919 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:01.762346 24003 raft_consensus.cc:2393] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:01.763285 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:01.639635 24001 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:01.766265 24000 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:22:01.767501 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:01.768646 23995 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:01.643575 28317 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:01.609555 23997 rpcz_store.cc:269] 0709 12:21:59.739002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.607865 (+1868863us) service_pool.cc:224] Handling call
0709 12:22:01.609099 (+  1234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:01.630265 28275 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:01.630806 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.359242 28275 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.652644 23996 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:02.363021 28280 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.363617 28280 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.660923 28183 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:01.673203 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.365831 28275 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:01.674664 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.367024 24558 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 5.
I20260709 12:22:02.367650 28142 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.367734 28275 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:01.686839 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 1.93334e+06us
I20260709 12:22:01.689114 28319 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:02.368650 28319 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:02.368443 28142 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.701582 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.369158 28319 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.369467 28275 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.371919 28275 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:02.372089 23895 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:01.706650 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 750) took 2234 ms. Trace:
W20260709 12:22:01.715605 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 135512us
W20260709 12:22:01.724725 24524 connection.cc:256] RPC call timeout handler was delayed by -1.4034433739998349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
I20260709 12:22:01.730756 28325 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:01.793803 24002 consensus_meta.cc:287] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 2.053s	user 0.014s	sys 0.012s
I20260709 12:22:02.374145 24002 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:02.373165 24561 rpcz_store.cc:276] 0709 12:21:59.472006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.473652 (+  1646us) service_pool.cc:224] Handling call
0709 12:21:59.474057 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:59.879849 (+405792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.706379 (+1826530us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54004f15d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:01.706583 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928458624}
I20260709 12:22:02.375326 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:02.375582 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:01.817559 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:02.376116 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.376399 24000 raft_consensus.cc:2376] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7. Re-sending same reply.
I20260709 12:22:02.376847 24560 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
W20260709 12:22:02.377156 24524 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.747s (SENT) [suppressed 19 similar messages]
I20260709 12:22:02.373620 28325 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.377544 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:02.378753 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:01.785167 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:01.798669 28252 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:02.379796 24524 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.797s (SENT)
I20260709 12:22:02.380292 28252 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.825160 24003 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:22:02.380832 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.376859 27989 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.385061 28280 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:02.384868 27989 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.386613 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2112) took 2648 ms. Trace:
I20260709 12:22:02.387013 24001 rpcz_store.cc:276] 0709 12:21:59.738595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.738754 (+   159us) service_pool.cc:224] Handling call
0709 12:21:59.739036 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:01.765033 (+2025997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.386343 (+621310us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b540038b154. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:02.386519 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4370405760}
I20260709 12:22:02.387466 27989 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.388067 27989 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.388571 27989 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:02.389149 23923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.690s	user 0.033s	sys 0.050s
W20260709 12:22:02.389672 23923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.690s	user 0.033s	sys 0.050s
I20260709 12:22:02.375968 24557 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:02.391987 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2166) took 3122 ms. Trace:
W20260709 12:22:02.394501 24524 leader_election.cc:336] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.737s (SENT)
I20260709 12:22:02.395599 28259 raft_consensus.cc:2764] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:02.396215 28252 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:01.813846 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.397338 23998 raft_consensus.cc:2410] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:22:02.399037 23922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 493) took 3617 ms (client timeout 2737 ms). Trace:
I20260709 12:22:02.398840 28319 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:01.798362 28317 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.772861 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.280934 28301 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.401309 28319 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.401449 28301 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.404135 28301 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:01.829815 28240 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.405048 28240 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.407637 28240 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:02.295503 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.967321 28303 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.408556 28303 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.409873 23995 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:02.411476 28303 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.299096 28302 consensus_queue.cc:1059] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 12:22:02.328709 24525 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.103s	sys 0.247s
W20260709 12:22:02.412315 24525 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.103s	sys 0.248s
W20260709 12:22:02.412658 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 596753us
W20260709 12:22:02.413108 24525 connection.cc:256] RPC call timeout handler was delayed by -1.3671346549999726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 12:22:02.334547 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.415037 28183 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.415280 28280 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.415839 28280 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.336366 28244 consensus_queue.cc:1059] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:02.416985 28244 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.416843 28317 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.417552 28244 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.419540 28317 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:02.419930 28244 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:02.420531 28244 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:22:02.399520 23922 rpcz_store.cc:269] 0709 12:21:58.781836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.204462 (+422626us) service_pool.cc:224] Handling call
0709 12:22:02.398783 (+3194321us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b54000118d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:02.398925 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199486208}
I20260709 12:22:02.421036 28244 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.346390 28341 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:02.422240 28259 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:02.422185 28341 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.422978 28259 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.424921 28341 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:02.347622 28102 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.426169 28102 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.426946 28315 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:02.427734 28265 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:02.428462 28102 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:01.677436 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:01.678843 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.429596 28301 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:02.429968 24562 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:02.430143 28301 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.368818 23818 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:02.430657 28301 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:02.425580 28341 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:02.432032 28341 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.433259 28240 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.433832 28240 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.434355 28341 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:02.434953 28341 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.435420 28341 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.436247 28240 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:02.436863 28240 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:02.439248 28099 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:02.439815 28244 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:02.439929 28142 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:01.819195 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.379547 28325 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:02.381852 23999 raft_consensus.cc:2410] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:22:01.825590 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.448220 23997 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:02.382164 27799 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.449124 24563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 944) took 2730 ms. Trace:
I20260709 12:22:02.449484 27799 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.452126 27799 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.376137 24561 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:02.379822 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.453100 24000 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:22:02.384207 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.454284 24558 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:01.817443 28229 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.455319 28229 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:02.456454 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 2.70233e+06us
W20260709 12:22:02.321604 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 491975us
I20260709 12:22:02.457864 23893 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:02.437243 28240 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:02.374678 24002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 2110) took 2653 ms (client timeout 3298 ms). Trace:
I20260709 12:22:02.335250 28153 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.415693 28183 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:01.691784 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 1.9447e+06us
I20260709 12:22:02.457590 28229 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.441437 28259 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:02.442102 28280 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:02.437676 28341 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:02.416260 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2159) took 3315 ms. Trace:
I20260709 12:22:02.465122 24561 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:02.392414 23923 rpcz_store.cc:276] 0709 12:21:59.269207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.511712 (+242505us) service_pool.cc:224] Handling call
0709 12:21:59.536075 (+ 24363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:59.678273 (+142198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:59.678323 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:59.678955 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 12:22:02.390149 (+2711194us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:02.390199 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.390279 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.390326 (+    47us) raft_consensus.cc:1685] finished
0709 12:22:02.390340 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.391673 (+  1333us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5400329e50. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:02.391918 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32049,"raft.queue_time_us":68130,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4236,"spinlock_wait_cycles":55017344,"thread_start_us":2800037,"threads_started":2,"wal-append.queue_time_us":238682,"wal-append.run_cpu_time_us":2204,"wal-append.run_wall_time_us":1611504}
I20260709 12:22:02.475879 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:02.462335 24002 rpcz_store.cc:269] 0709 12:21:59.720897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.728990 (+  8093us) service_pool.cc:224] Handling call
0709 12:22:02.374594 (+2645604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:02.471590 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.467115 23817 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:02.479344 24558 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:02.479301 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 95878.5us
I20260709 12:22:02.476135 23921 rpcz_store.cc:276] 0709 12:21:59.101058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.485656 (+384598us) service_pool.cc:224] Handling call
0709 12:22:02.414965 (+2929309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.415244 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:02.415276 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:02.415327 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:02.415371 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.415439 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.416063 (+   624us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b54000118d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:02.416191 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6673529600}
I20260709 12:22:02.449694 24563 rpcz_store.cc:276] 0709 12:21:59.718280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.730649 (+ 12369us) service_pool.cc:224] Handling call
0709 12:21:59.730927 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:59.880387 (+149460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:59.880428 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:59.880478 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:59.880521 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.448848 (+2568327us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54005a46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:02.448906 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.449058 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343259904}
I20260709 12:22:02.463078 23893 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:02.473058 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:02.484380 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 57870.9us
I20260709 12:22:02.479210 28102 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:02.491257 28102 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.492002 28102 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:02.487123 28302 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:02.494711 28302 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.495167 28302 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:02.475301 28155 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:22:02.498718 24525 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:02.500006 28183 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.500159 24525 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:02.500721 28183 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.473284 28069 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:02.486732 28142 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:02.501807 27989 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.509691 23995 pending_rounds.cc:85] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 5
I20260709 12:22:02.510047 24002 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:22:02.510475 24002 pending_rounds.cc:85] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 5
I20260709 12:22:02.511425 24002 pending_rounds.cc:107] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:22:02.513942 24002 raft_consensus.cc:2889] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:02.512887 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.514516 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:02.510169 23995 pending_rounds.cc:107] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:22:02.515177 23995 raft_consensus.cc:2889] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:02.512424 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:02.514618 24003 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:02.518092 28142 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:02.517275 28315 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:02.519217 28142 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.528527 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.527698 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.529567 23926 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:02.530680 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.534279 24557 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:02.534821 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.535449 23929 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:22:02.535483 23969 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:02.536278 24558 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:02.537153 24525 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:02.539129 24525 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:02.544164 24557 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:02.545789 28345 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:02.547833 24525 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:02.549467 28345 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:02.549553 24525 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:02.550231 28345 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:02.550828 28325 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:02.551321 28325 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.551702 28325 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:02.507747 27799 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:02.556308 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.556918 28153 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:02.512319 24001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:22:02.557353 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.558252 27989 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.554575 28244 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:02.550808 28345 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.560110 28156 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.560636 28138 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.554567 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.510757 28259 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.588496 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.589361 23928 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:02.566361 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:02.566361 24001 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.566509 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.567835 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.566918 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.573688 23929 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 16: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:02.593703 28344 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:02.594938 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2106) took 2875 ms. Trace:
I20260709 12:22:02.595320 23996 rpcz_store.cc:276] 0709 12:21:59.719375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.730595 (+ 11220us) service_pool.cc:224] Handling call
0709 12:21:59.790400 (+ 59805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.362838 (+2572438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.594708 (+231870us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540020e9d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:02.594880 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4281694976}
I20260709 12:22:02.596628 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.597198 23996 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:02.599795 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.601488 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:01.633635 28262 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.603770 28262 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.604986 24004 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:02.585281 28244 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.606518 28244 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:02.607961 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.608623 24004 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:02.611145 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.510882 28229 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:22:02.587304 23924 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:02.592252 24001 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.611806 23996 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:02.585052 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.619530 24003 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:02.619781 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:02.609524 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.616266 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.616454 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.621680 24004 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:02.621846 23921 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:02.626178 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.622716 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.624538 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:02.627414 23924 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:02.627822 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:02.625048 23893 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:02.628818 23921 raft_consensus.cc:2393] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:02.609798 28138 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.632019 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:02.652407 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.651901 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.633741 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:02.653910 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.654910 23921 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:02.654948 24004 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:02.656220 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.654042 24003 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:02.632766 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.584410 28153 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:02.632705 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:02.660957 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.662358 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:02.639501 24001 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.554641 28275 consensus_queue.cc:1059] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:22:02.665490 23924 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:02.662818 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:02.660796 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08001785c0 after lost signal to thread 22701
I20260709 12:22:02.632457 28341 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:02.587041 27989 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.611011 28156 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.662895 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:02.666707 23921 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.667127 23893 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:02.667603 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.669921 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:02.671576 24025 debug-util.cc:398] Leaking SignalData structure 0x7b080016c3c0 after lost signal to thread 22704
W20260709 12:22:02.694835 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd760 after lost signal to thread 23786
W20260709 12:22:02.696481 24025 debug-util.cc:398] Leaking SignalData structure 0x7b080016c6e0 after lost signal to thread 23878
W20260709 12:22:02.696847 24025 debug-util.cc:398] Leaking SignalData structure 0x7b080016c760 after lost signal to thread 23879
I20260709 12:22:02.568552 28240 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.617118 28259 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.689603 23893 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:02.670207 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.703497 23893 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:02.704607 23893 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:02.675876 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:02.706712 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:02.690873 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:02.711447 24025 debug-util.cc:398] Leaking SignalData structure 0x7b0800357b80 after lost signal to thread 23953
W20260709 12:22:02.712266 24025 debug-util.cc:398] Leaking SignalData structure 0x7b0800343700 after lost signal to thread 23954
I20260709 12:22:02.718076 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.717538 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.718961 24001 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:02.719146 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.719314 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.719049 23929 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:02.720252 23995 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:22:02.724599 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.727246 24002 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:02.725157 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.730991 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.670388 28155 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.732035 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.672472 28229 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:02.733671 24002 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:22:02.749081 23996 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:02.748121 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.750455 24001 raft_consensus.cc:2410] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:02.750594 28151 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:02.751030 28151 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.751474 28151 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:02.687770 28275 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:02.737401 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.720906 28246 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:02.753782 24004 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:02.674382 28341 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.754786 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:02.721050 28344 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:02.719857 28069 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:02.667914 27799 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 12:22:02.763072 23923 raft_consensus.cc:2393] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:02.746790 23921 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:02.667781 27757 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:22:02.735195 28351 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:02.755983 28275 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.754017 28229 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.763927 28246 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.764266 28341 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:02.794425 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 103632us
I20260709 12:22:02.781124 27757 consensus_queue.cc:1243] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:02.755755 28155 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.784431 27963 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:02.787771 28275 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.788856 28229 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:02.816296 28138 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.817406 28069 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:02.817662 27989 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.817934 28069 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:02.792148 28246 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:02.824446 23928 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:02.831115 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:02.806056 28262 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:02.814181 27963 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.782783 28153 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.836618 28367 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:02.832211 28138 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:02.848039 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 50891.8us
I20260709 12:22:02.827853 28302 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.840602 27963 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.852258 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.868021 24560 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
W20260709 12:22:02.854198 28357 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:22:02.847893 28367 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.859599 28361 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:02.861456 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.869869 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:02.892570 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 188050us
I20260709 12:22:02.874795 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:02.893816 23925 raft_consensus.cc:3055] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:02.889601 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.894164 23925 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:02.894969 23925 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.895213 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.895934 23925 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.896183 28364 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:02.848366 28360 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:02.898062 24555 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:02.899010 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 67976.3us
I20260709 12:22:02.900452 28345 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.849262 28138 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:02.848429 28301 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:02.871371 28347 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:22:02.905369 23926 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:22:02.907227 24562 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:02.890821 28344 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:02.908546 28244 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.906184 28361 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.906569 28156 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.871232 28325 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:02.903257 28259 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:02.915686 28151 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.918004 28360 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.919437 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:02.891808 28367 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:02.921909 28364 consensus_queue.cc:1059] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:02.925135 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:02.925967 24001 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:02.928359 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:02.928956 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.940387 23925 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:02.942654 24562 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:02.930172 28138 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:02.946388 23927 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 6: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:02.955245 28345 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.957238 28183 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:02.960350 23922 raft_consensus.cc:2410] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:22:02.961201 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:02.961349 28151 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:02.946404 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.962322 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.947958 24557 raft_consensus.cc:2410] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:22:02.966197 24561 raft_consensus.cc:2368] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:22:02.966766 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.967664 23922 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:22:02.965739 24563 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
W20260709 12:22:02.970932 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.976768 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:02.947669 28369 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:02.978183 28259 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:03.054600 28246 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.055821 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:03.057044 28246 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:02.941013 28344 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:02.964584 28102 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.058243 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:03.094158 24560 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:02.948239 28360 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:02.947326 28362 consensus_queue.cc:1059] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 12:22:03.091439 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:03.099756 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:03.057592 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:03.100677 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 175584us
I20260709 12:22:03.104126 23922 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:22:03.110560 24025 debug-util.cc:398] Leaking SignalData structure 0x7b0800395580 after lost signal to thread 24028
W20260709 12:22:03.110942 24025 debug-util.cc:398] Leaking SignalData structure 0x7b0800125ec0 after lost signal to thread 24029
I20260709 12:22:03.061286 28369 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:03.111454 28369 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:03.102871 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:02.958781 28275 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.120390 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:03.121417 23925 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:03.123898 24560 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
I20260709 12:22:03.126608 23895 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:03.127038 24025 debug-util.cc:398] Leaking SignalData structure 0x7b080011b120 after lost signal to thread 24587
W20260709 12:22:03.127629 24025 debug-util.cc:398] Leaking SignalData structure 0x7b080023fb40 after lost signal to thread 24588
W20260709 12:22:03.128098 24025 debug-util.cc:398] Leaking SignalData structure 0x7b080018ac80 after lost signal to thread 27902
W20260709 12:22:03.129319 28370 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:22:03.133407 23925 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 12:22:03.134186 28350 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.556s	user 0.003s	sys 0.003s
I20260709 12:22:03.134604 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:03.135200 23925 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.135581 28138 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.135598 28086 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.137089 28086 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:03.138388 23929 raft_consensus.cc:1240] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:03.139878 23929 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:03.087270 28361 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:03.141081 23929 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:03.144451 27963 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.145015 28151 consensus_queue.cc:1059] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:03.146212 28151 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:03.146648 28151 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:03.146750 23920 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:22:03.147603 28151 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.148125 28369 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.148957 28151 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:03.151641 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:03.155472 24029 heartbeater.cc:646] Failed to heartbeat to 127.22.43.126:38021 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.43.126:38021 timed out after 15.000s (SENT)
I20260709 12:22:03.157038 28280 raft_consensus.cc:3055] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:03.081012 28301 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:03.157917 28280 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:03.158931 28280 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.160126 28280 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:03.160861 28069 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.162802 28138 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:03.162999 23920 raft_consensus.cc:1240] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:03.162813 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:03.166442 23925 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:03.157944 28366 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:03.169095 28366 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:03.170009 28366 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.172386 24555 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:03.177004 28275 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:03.185005 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:03.186533 28371 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:03.185678 23923 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.187121 28371 raft_consensus.cc:697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:22:03.189216 24025 debug-util.cc:398] Leaking SignalData structure 0x7b0800396460 after lost signal to thread 27975
I20260709 12:22:03.188128 28371 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.197326 28302 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:03.199962 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:03.215969 28069 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:03.217794 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:03.219357 28351 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:03.219916 28351 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.221220 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:03.219396 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:03.222622 23997 raft_consensus.cc:2393] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 14: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:03.224530 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:03.245323 24525 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:03.218356 27963 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:03.255214 23923 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:03.260497 28102 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:03.262890 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.254524 28183 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:03.246166 28153 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:03.234616 28163 consensus_queue.cc:1059] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:22:03.274142 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:03.274883 24563 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:03.285780 28229 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.264698 28341 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:03.290815 23998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 2118) took 3539 ms (client timeout 1728 ms). Trace:
I20260709 12:22:03.291366 28240 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:03.291319 23998 rpcz_store.cc:269] 0709 12:21:59.751247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.797586 (+ 46339us) service_pool.cc:224] Handling call
0709 12:22:03.290556 (+3492970us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b5400410ad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:03.290736 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86476032}
I20260709 12:22:03.292088 28341 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:03.297823 24563 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:03.302778 28155 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:03.295498 28360 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.307363 28345 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:03.309042 28345 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:03.310003 28344 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:03.310007 28345 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.311435 28345 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.290840 28229 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:03.317176 28244 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:03.308074 28367 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.322536 28143 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:03.323037 28143 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:03.324092 28360 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:03.324322 28143 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.325922 28143 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.317843 28351 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.328665 28367 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:03.329058 28325 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:03.331144 28378 log.cc:927] Time spent T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.266s	user 0.004s	sys 0.000s
I20260709 12:22:03.335086 28369 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:03.339664 28351 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:03.400103 23926 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:22:03.402859 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:03.406752 24025 debug-util.cc:398] Leaking SignalData structure 0x7b0800311200 after lost signal to thread 28124
W20260709 12:22:03.407382 24025 debug-util.cc:398] Leaking SignalData structure 0x7b0800394920 after lost signal to thread 28127
I20260709 12:22:03.335068 28183 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:03.431447 23969 leader_election.cc:400] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:22:03.432045 23969 leader_election.cc:403] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:03.433307 28369 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:22:03.442521 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:03.444106 24563 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:03.448060 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:03.449290 23996 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:03.449628 23997 pending_rounds.cc:85] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 4
I20260709 12:22:03.450135 23997 pending_rounds.cc:107] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:22:03.450484 23997 raft_consensus.cc:2889] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:03.457302 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:03.459189 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.460386 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:03.466331 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:03.467433 24002 raft_consensus.cc:2410] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 12:22:03.462356 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.469476 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:03.470706 24002 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:03.470767 23998 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
W20260709 12:22:03.493817 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.495023 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:03.498540 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 67691.7us
I20260709 12:22:03.500963 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:03.501128 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:03.507061 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:03.514739 28366 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:03.515631 28366 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:03.517308 24558 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:03.535859 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.536342 28244 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:03.537231 28244 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.553455 28244 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:03.556787 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:03.558197 24002 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:03.555567 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:03.559147 24001 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:03.559264 28246 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:03.517202 28366 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.570614 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:03.571415 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:03.571775 23995 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.572475 24003 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:03.574208 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:03.581601 24563 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:22:03.579351 24555 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:03.583184 24001 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:03.585027 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:03.586710 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:03.587723 23996 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:03.590811 24002 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:03.571796 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:03.652982 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.655615 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:03.657226 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 150335us
I20260709 12:22:03.658351 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:03.658762 28246 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:03.659418 28246 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.659672 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:03.659943 28246 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:03.662297 24524 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:03.662526 24000 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:03.664276 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59737.9us
I20260709 12:22:03.683871 28240 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:03.684463 28240 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:03.673621 28369 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:22:03.684880 28240 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:03.686421 28150 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.687197 28150 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.689977 28150 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:03.690723 28280 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:03.691390 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.692481 24001 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 14: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:03.691398 28280 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:03.703143 24003 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:03.703732 28113 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:03.705121 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:03.723877 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2d40 after lost signal to thread 28172
W20260709 12:22:03.724406 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08002d60e0 after lost signal to thread 28185
W20260709 12:22:03.724864 24025 debug-util.cc:398] Leaking SignalData structure 0x7b080036bba0 after lost signal to thread 28231
W20260709 12:22:03.725332 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7f00 after lost signal to thread 28243
W20260709 12:22:03.725682 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08003acd40 after lost signal to thread 28245
W20260709 12:22:03.728240 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0c60 after lost signal to thread 28260
W20260709 12:22:03.728552 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5740 after lost signal to thread 28261
W20260709 12:22:03.727094 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 65221.1us
I20260709 12:22:03.731130 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:03.732395 28367 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.744623 28367 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:03.729408 28102 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:03.749753 28102 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:03.750345 28102 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:03.727581 28280 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:03.754069 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08003641c0 after lost signal to thread 28272
W20260709 12:22:03.755306 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08000509e0 after lost signal to thread 28289
I20260709 12:22:03.755460 24000 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:03.756829 23995 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:03.759305 24002 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:03.773623 23998 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:22:03.786022 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:03.832795 23996 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:03.830917 28280 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:03.852064 23969 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:03.852634 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 94400.3us
I20260709 12:22:03.853030 28150 consensus_queue.cc:1059] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:03.854115 28150 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:03.854200 28369 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:03.854772 28150 raft_consensus.cc:697] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:03.853932 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:03.854511 28366 raft_consensus.cc:3055] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:03.856206 28366 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:03.856063 28150 consensus_queue.cc:237] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.861496 28344 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:22:03.866050 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.864825 23969 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:03.849076 28183 consensus_queue.cc:1059] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:22:03.869827 28183 raft_consensus.cc:3055] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:03.864048 28344 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.874193 28280 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:03.874869 28280 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:03.875878 28280 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.884162 28344 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:03.890165 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2346) took 1282 ms. Trace:
I20260709 12:22:03.890618 23926 rpcz_store.cc:276] 0709 12:22:02.607467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.962324 (+354857us) service_pool.cc:224] Handling call
0709 12:22:03.889789 (+927465us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b540018abd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:03.890037 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991859072}
I20260709 12:22:03.889619 28240 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.857468 28366 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.870232 28183 raft_consensus.cc:740] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:03.904908 28246 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.902962 28366 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.917022 28369 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:03.918907 28246 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:03.902371 28183 consensus_queue.cc:260] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:03.920043 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:03.921628 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:03.920181 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:03.907828 28102 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.929949 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:03.931002 23929 raft_consensus.cc:2376] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10. Re-sending same reply.
I20260709 12:22:03.942220 28246 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:03.942943 28246 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:03.944240 28246 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:03.946774 28183 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:03.950358 23926 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:03.953143 28102 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:03.974073 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 47641us
I20260709 12:22:03.978470 23893 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:03.991276 28344 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:04.033103 28401 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:04.043951 28244 raft_consensus.cc:3055] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:04.044588 28244 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:04.033704 28401 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.998080 28344 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:04.104352 28401 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:04.084699 28240 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:04.202803 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:04.286746 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.061709 28244 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:04.658026 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:04.678794 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:04.803035 28400 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
W20260709 12:22:04.803433 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 1.71541e+06us
I20260709 12:22:04.805112 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:04.845261 28407 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:22:05.060772 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:05.095027 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:05.102087 24524 leader_election.cc:336] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.747s (SENT)
I20260709 12:22:05.102728 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:05.102874 28410 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:05.103559 28410 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:05.104630 24524 leader_election.cc:336] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.840s (SENT)
I20260709 12:22:05.106269 28410 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:05.106328 24524 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.877s (SENT)
I20260709 12:22:05.107081 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:05.109050 28401 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.001s
I20260709 12:22:05.109567 28401 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.112030 28401 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:05.114292 28410 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:05.115190 28410 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.118650 28410 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:05.119295 28410 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:05.120561 28410 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.124176 28410 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:05.125929 28351 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:05.126868 28351 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:05.169080 24561 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:05.171527 28150 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:22:05.173519 23998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34868 (request call id 520) took 1681 ms (client timeout 2067 ms). Trace:
W20260709 12:22:05.174021 23998 rpcz_store.cc:269] 0709 12:22:03.491879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.494648 (+  2769us) service_pool.cc:224] Handling call
0709 12:22:05.173324 (+1678676us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400410fd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:05.173433 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446909696}
I20260709 12:22:03.986400 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:05.176873 28150 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:05.176991 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 1.20794e+06us
I20260709 12:22:05.178610 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:05.180418 28410 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:05.180783 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:05.180982 28410 raft_consensus.cc:697] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:05.182752 28150 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:05.183467 28150 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:05.184821 28150 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.182322 28410 consensus_queue.cc:237] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:05.196242 28246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.230s	user 0.054s	sys 0.052s
W20260709 12:22:05.196655 28246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.055s	sys 0.053s
W20260709 12:22:05.201179 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:05.214433 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.219352 23820 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:22:05.219955 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 2.85085e+06us
I20260709 12:22:05.221313 23820 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:05.214337 28351 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.226501 28351 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:05.230461 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:05.231614 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.233285 28401 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.234210 28401 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.238840 28351 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:05.243476 28351 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.247345 24525 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:05.344465 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 97488.3us
I20260709 12:22:05.344933 28425 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:05.347666 28351 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.269850 28401 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:05.279115 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 57339.7us
I20260709 12:22:05.366626 28425 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:05.368595 28425 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:05.304847 23892 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.348s	user 0.009s	sys 0.030s
I20260709 12:22:05.312870 28410 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.375852 28410 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.313359 28150 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.378350 28150 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.320647 28113 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.395195 28113 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.328260 28183 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.398551 28183 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.250664 27902 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:05.402572 27902 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.403149 27902 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:05.405064 28412 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.405718 28412 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.406179 28183 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:05.408052 28412 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:05.421067 28394 log.cc:927] Time spent T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 1.713s	user 0.028s	sys 0.040s
I20260709 12:22:05.423039 28410 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:05.425822 24563 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:05.434124 28150 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:05.394289 23892 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.438s	user 0.011s	sys 0.032s
W20260709 12:22:05.435345 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 1.47907e+06us
W20260709 12:22:05.436133 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.439487 24555 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:05.443020 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:05.443861 23921 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:05.448848 23893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.450s	user 0.013s	sys 0.033s
W20260709 12:22:05.449373 23893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.451s	user 0.013s	sys 0.033s
W20260709 12:22:05.449683 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 1.4533e+06us
I20260709 12:22:05.450333 28183 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:05.450899 23893 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:05.453303 23893 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:05.464049 23893 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:05.467895 28244 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:05.471544 28430 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:05.472769 28430 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:05.473729 27975 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.474694 27975 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.473510 28430 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:05.478542 27973 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.482400 27973 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:05.485728 28409 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.406s	user 0.003s	sys 0.001s
I20260709 12:22:05.488363 27975 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:05.478744 28430 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.454572 28113 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:05.453336 28074 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:05.493345 28074 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.493867 28074 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:05.455225 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:05.496238 24558 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:05.513518 27996 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:05.514180 27996 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.514611 27996 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:05.451334 28183 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.519207 28002 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:22:05.520264 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.522140 28124 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:05.522734 28124 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:05.523907 28124 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.532450 28231 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:05.533732 28231 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.542662 28242 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:05.543444 28242 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.542748 23748 catalog_manager.cc:5697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 6 to 11, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 11 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:05.544450 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 739444us
I20260709 12:22:05.545840 23817 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:05.556289 23846 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:05.556527 23817 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:05.550652 27876 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:05.557624 28319 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:05.552981 28261 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.558523 28261 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.560766 28261 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:05.550253 28245 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:05.547454 28268 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.562623 28268 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.562424 28245 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.564922 28268 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:05.565201 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.566825 23846 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:05.568296 23851 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:05.569821 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.570070 27876 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:05.571424 27876 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.572131 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.573083 23846 raft_consensus.cc:2410] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:05.547648 28242 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:05.561338 28261 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:05.577067 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.577338 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.577169 23850 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:05.597712 23848 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:05.579484 23852 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:05.591048 28319 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:05.596154 28150 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.554781 28002 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:05.601063 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:05.637023 23921 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
W20260709 12:22:05.650565 28436 log.cc:927] Time spent T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:22:05.651007 23845 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:22:05.651502 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 50556.1us
I20260709 12:22:05.652341 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:05.653085 23929 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:05.545970 23748 catalog_manager.cc:5697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 9, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 9 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:05.668221 23848 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:05.671790 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.672854 23852 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:05.674436 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.675592 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.674495 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.676388 23849 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:05.676517 23847 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:05.677429 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.677801 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.678224 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.678887 23847 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:05.679425 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.681666 23847 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:05.680286 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.684195 23852 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:05.686369 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.687325 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.688102 23845 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:05.688359 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.688841 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.689239 23849 raft_consensus.cc:2376] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12. Re-sending same reply.
I20260709 12:22:05.690223 28228 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:05.690354 28002 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.690724 28228 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.691313 28228 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:05.685832 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.686645 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.693933 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.694718 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.695487 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.695825 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.696519 23850 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:05.697108 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.697325 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.686419 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.691390 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.698351 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:05.698488 23849 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:05.699200 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:05.699920 23926 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:05.700012 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.657966 28150 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.703156 28268 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:22:05.703859 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.704442 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.660691 28113 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.705946 28113 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:05.708200 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44469.4us
I20260709 12:22:05.709561 23818 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:05.701611 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.710794 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.714548 23929 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:05.721812 27862 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:05.721745 28099 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:05.723546 28150 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:05.724128 28242 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:05.724856 27862 raft_consensus.cc:697] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:05.725858 28267 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:05.736246 28267 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:05.737272 28267 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.738900 28267 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:05.739869 23750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43186 (request call id 244) took 60726 ms (client timeout 15000 ms). Trace:
I20260709 12:22:05.742645 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:05.740367 23750 rpcz_store.cc:269] 0709 12:21:05.013814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.016258 (+  2444us) service_pool.cc:224] Handling call
0709 12:21:05.779715 (+763457us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54003129d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b6090 00007fa287454f3a 00007fa28d20ae9c 00007fa28d30904e 00007fa28b7ca2a4 00007fa28b7ca232 00007fa28b7ca161 00007fa28b7ca0dc 00007fa28b7c9392 00007fa28578748c 00007fa2857868c6
0709 12:21:05.938708 (+158993us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b5400002490. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284328640 00007fa28d1ff846 00007fa28d30990e 00007fa28b7ca2a4 00007fa28b7ca232 00007fa28b7ca161 00007fa28b7ca0dc 00007fa28b7c9392 00007fa28578748c 00007fa2857868c6
0709 12:22:05.739613 (+59800905us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:01.571904 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:01.572516 (+   612us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:01.572560 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:22:01.572584 (+    24us) tablet.cc:662] Decoding operations
0709 12:22:01.572997 (+   413us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:01.573082 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:01.573114 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:22:01.573483 (+   369us) tablet.cc:701] Row locks acquired
0709 12:22:01.573504 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:22:01.573663 (+   159us) write_op.cc:270] Start()
0709 12:22:01.573784 (+   121us) write_op.cc:276] Timestamp: P: 1783599721573606 usec, L: 0
0709 12:22:01.573807 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:22:01.574601 (+   794us) log.cc:844] Serialized 919 byte log entry
0709 12:22:01.720435 (+145834us) op_driver.cc:464] REPLICATION: finished
0709 12:22:01.754107 (+ 33672us) write_op.cc:301] APPLY: starting
0709 12:22:01.754191 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:01.755929 (+  1738us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:01.756033 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:01.757201 (+  1168us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:01.757391 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:22:01.757435 (+    44us) write_op.cc:312] APPLY: finished
0709 12:22:01.757667 (+   232us) log.cc:844] Serialized 33 byte log entry
0709 12:22:01.757854 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:01.771637 (+ 13783us) write_op.cc:454] Released schema lock
0709 12:22:01.795395 (+ 23758us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:01.813418 (+ 18023us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:01.813464 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4211514,"reported_tablets":50,"spinlock_wait_cycles":1072322688,"child_traces":[["op",{"apply.queue_time_us":33410,"apply.run_cpu_time_us":4578,"apply.run_wall_time_us":59229,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12463,"num_ops":2,"prepare.queue_time_us":3875,"prepare.run_cpu_time_us":12275,"prepare.run_wall_time_us":147714,"raft.queue_time_us":1358,"raft.run_cpu_time_us":5172,"raft.run_wall_time_us":16596,"replication_time_us":146426,"thread_start_us":167985,"threads_started":4,"wal-append.queue_time_us":141568,"wal-append.run_cpu_time_us":4198,"wal-append.run_wall_time_us":1048410}]]}
I20260709 12:22:05.744364 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.726894 23817 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:05.717032 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.715580 23849 raft_consensus.cc:2410] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:05.715823 23852 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
W20260709 12:22:05.768867 23895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.001s	sys 0.009s
W20260709 12:22:05.769330 23895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.001s	sys 0.009s
W20260709 12:22:05.769614 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 527384us
I20260709 12:22:05.777614 24558 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:05.761468 23926 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
W20260709 12:22:05.782577 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.713390 28351 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:05.788477 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 61692.7us
W20260709 12:22:05.792726 23894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.004s	sys 0.006s
W20260709 12:22:05.793200 23894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.004s	sys 0.006s
W20260709 12:22:05.794375 24524 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.005s	sys 0.005s
W20260709 12:22:05.794813 24524 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.005s	sys 0.005s
W20260709 12:22:05.795161 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 509634us
I20260709 12:22:05.729311 28245 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:05.727777 28242 raft_consensus.cc:697] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:05.789214 23748 catalog_manager.cc:5697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 6 to 11, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 11 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:05.810853 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 339457us
W20260709 12:22:05.811431 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 102017us
I20260709 12:22:05.824476 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:05.829922 23966 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.119s	sys 0.118s
W20260709 12:22:05.830312 23966 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.119s	sys 0.118s
W20260709 12:22:05.832171 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 616912us
I20260709 12:22:05.830624 23893 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:05.701689 28228 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:05.834698 24524 leader_election.cc:336] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.042s (SENT)
I20260709 12:22:05.838528 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:05.832639 23966 connection.cc:256] RPC call timeout handler was delayed by -1.584428189999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 12:22:05.805838 28410 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:22:05.827517 28183 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:05.726034 27862 consensus_queue.cc:237] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.850821 23850 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:05.848208 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:05.846832 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:05.835095 28246 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.088s	sys 0.164s
W20260709 12:22:05.846580 23820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.101s	sys 0.126s
W20260709 12:22:05.853085 23820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.101s	sys 0.126s
I20260709 12:22:05.851751 23848 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:05.839658 28344 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:05.853443 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 632340us
I20260709 12:22:05.842399 28405 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:05.860590 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 45615.1us
I20260709 12:22:05.843624 23748 catalog_manager.cc:5697] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 11 to 14, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 14 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:05.831058 28412 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:22:05.863210 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.850533 28351 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:05.858955 23893 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:05.854717 28246 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.088s	sys 0.165s
W20260709 12:22:05.866029 23966 connection.cc:256] RPC call timeout handler was delayed by -1.3612337219999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 12:22:05.834262 27996 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:05.868432 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.855727 27973 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:05.854660 28113 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:05.882510 23845 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:05.875696 23966 connection.cc:256] RPC call timeout handler was delayed by -1.35403372199994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 12:22:05.885644 24524 leader_election.cc:336] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.070s (SENT)
I20260709 12:22:05.891424 24524 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:05.893361 24562 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.001s	sys 0.009s
W20260709 12:22:05.895654 24562 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.001s	sys 0.009s
W20260709 12:22:05.898404 24524 leader_election.cc:336] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.074s (SENT)
I20260709 12:22:05.900657 23852 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:05.902146 23923 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:05.861843 28344 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.905565 28231 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:05.926517 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.927197 28431 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:05.927328 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.927546 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.927708 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:05.893764 27821 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.000s
I20260709 12:22:05.863426 28397 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:22:05.928004 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.893385 28405 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:05.945895 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.893209 28272 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:22:05.949944 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 99145.9us
I20260709 12:22:05.973953 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.935873 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.931429 23748 catalog_manager.cc:5697] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 6 to 8, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 8 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:05.946601 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:05.935976 23892 connection.cc:256] RPC call timeout handler was delayed by -1.7622305760000927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 12:22:05.950217 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.893707 28150 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:05.869455 27902 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:05.975651 23892 connection.cc:256] RPC call timeout handler was delayed by -1.746930576000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 12:22:05.968448 23852 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
W20260709 12:22:05.976795 23892 leader_election.cc:336] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.544s (SENT)
I20260709 12:22:05.977362 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.978645 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:05.950306 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.979668 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.980232 23852 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
W20260709 12:22:05.971736 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 121184us
I20260709 12:22:05.975680 23851 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:05.931136 28231 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.975874 23849 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:05.994581 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:05.994733 23892 connection.cc:256] RPC call timeout handler was delayed by -1.5456371289999424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 12:22:05.995412 23892 connection.cc:256] RPC call timeout handler was delayed by -1.5292204840000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.53150000000000008s for a response
I20260709 12:22:05.995720 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:05.995879 23892 connection.cc:256] RPC call timeout handler was delayed by -1.4735097210000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 12:22:05.996392 23892 connection.cc:256] RPC call timeout handler was delayed by -1.4510097209999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 12:22:05.996810 23892 connection.cc:256] RPC call timeout handler was delayed by -1.4436305760000323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 12:22:05.996887 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:05.997321 23892 connection.cc:256] RPC call timeout handler was delayed by -1.4024471770001128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
I20260709 12:22:05.950623 28351 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.950919 28242 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:05.997591 23849 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:06.010576 23847 raft_consensus.cc:2393] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:05.931221 27996 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:05.969303 27821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.014s	sys 0.000s
I20260709 12:22:05.990245 28113 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.968564 28404 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:06.043804 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:05.946851 28431 raft_consensus.cc:697] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:05.929487 28420 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.952788 28183 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:05.970562 28240 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.949790 23848 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:06.036811 23748 catalog_manager.cc:5697] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 8 to 11, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 11 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:06.005838 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:05.997923 23892 connection.cc:256] RPC call timeout handler was delayed by -1.377030576000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 12:22:06.044840 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.003647 23893 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:06.044070 23851 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:06.022996 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.079401 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.080107 23846 raft_consensus.cc:2368] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:06.044966 28412 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.970314 28410 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:06.065203 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 113162us
I20260709 12:22:05.972790 28272 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:06.074393 23849 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:06.005102 28442 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 12:22:06.087399 23966 connection.cc:256] RPC call timeout handler was delayed by -1.244228190000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26110000000000005s for a response
W20260709 12:22:06.089193 23966 connection.cc:256] RPC call timeout handler was delayed by -1.2118337219999376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 12:22:06.077795 23892 connection.cc:256] RPC call timeout handler was delayed by -1.3598808970000391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
I20260709 12:22:06.082194 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.002961 28231 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:05.989500 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:05.999609 27902 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:06.092325 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 119240us
I20260709 12:22:06.083724 23845 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:05.945894 28074 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:06.083695 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.085570 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.096812 23846 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
W20260709 12:22:06.089699 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0930337219999728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 12:22:06.091701 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.091101 23748 catalog_manager.cc:5697] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:06.097507 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.099576 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.097301 28451 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:22:06.102299 23875 debug-util.cc:398] Leaking SignalData structure 0x7b080013bb80 after lost signal to thread 22701
W20260709 12:22:06.102684 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2ca0 after lost signal to thread 22704
W20260709 12:22:06.102726 23892 connection.cc:256] RPC call timeout handler was delayed by -1.2411305760001596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 12:22:06.103336 23892 connection.cc:256] RPC call timeout handler was delayed by -1.2186305760001233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 12:22:06.103672 23892 connection.cc:256] RPC call timeout handler was delayed by -1.2013353550000829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 12:22:06.103860 23875 debug-util.cc:398] Leaking SignalData structure 0x7b080009a200 after lost signal to thread 23786
W20260709 12:22:06.104074 23892 connection.cc:256] RPC call timeout handler was delayed by -1.1925305760000811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 12:22:06.104519 23892 connection.cc:256] RPC call timeout handler was delayed by -1.0315284490002341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 12:22:06.104858 23892 connection.cc:256] RPC call timeout handler was delayed by -1.0009284490001846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 12:22:06.032843 28150 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:06.105350 23875 debug-util.cc:398] Leaking SignalData structure 0x7b0800048fc0 after lost signal to thread 23878
W20260709 12:22:06.105679 23875 debug-util.cc:398] Leaking SignalData structure 0x7b0800048f80 after lost signal to thread 23879
I20260709 12:22:06.105955 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:06.106459 28397 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.107329 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:06.107148 28397 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.107831 28150 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:06.108050 24562 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:06.098958 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:06.110953 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08001fd2a0 after lost signal to thread 23953
I20260709 12:22:06.111287 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.109120 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:06.112862 28451 raft_consensus.cc:697] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:06.113085 24558 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
W20260709 12:22:06.111287 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4280 after lost signal to thread 23954
I20260709 12:22:06.114126 28451 consensus_queue.cc:237] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:06.115511 28074 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:06.084618 28420 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.118090 28344 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:06.118746 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:06.119199 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:06.120972 23927 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:06.120877 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:06.122298 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:06.122650 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:06.123359 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.123999 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:06.088864 28272 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:06.089334 28412 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.124290 28431 consensus_queue.cc:237] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:06.128448 23892 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.560s (SENT)
I20260709 12:22:06.130303 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:06.063097 28113 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.084724 28240 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.160640 28344 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.134192 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.161367 28344 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.163134 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.164238 28344 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:06.164846 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:06.134013 28410 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:06.166894 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 70614.4us
I20260709 12:22:06.167936 23818 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:06.168177 28410 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:06.135174 23748 catalog_manager.cc:5697] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 9 to 12, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 12 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:06.168907 27902 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:06.169708 27902 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:06.170359 23748 catalog_manager.cc:5697] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 5 to 10, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 10 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:06.136811 23848 raft_consensus.cc:2410] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:22:06.174609 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:06.175454 23927 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:06.176020 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:06.177196 23848 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:06.137372 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:06.142679 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4be0 after lost signal to thread 24028
I20260709 12:22:06.178145 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:06.179131 23875 debug-util.cc:398] Leaking SignalData structure 0x7b0800344fe0 after lost signal to thread 24587
I20260709 12:22:06.179253 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:06.180400 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:06.180981 28420 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:06.150205 23928 raft_consensus.cc:2368] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:06.145617 23924 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:06.150055 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.086161 28351 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.196849 23927 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
W20260709 12:22:06.150879 23966 connection.cc:256] RPC call timeout handler was delayed by -1.0828271049999785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 12:22:06.151793 23893 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:06.155617 24524 leader_election.cc:336] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.870s (SENT)
I20260709 12:22:06.200873 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:06.155932 28449 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:22:06.155876 28412 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:06.156608 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:06.157495 23922 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:06.160254 28113 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:06.179486 23875 debug-util.cc:398] Leaking SignalData structure 0x7b0800357320 after lost signal to thread 24588
I20260709 12:22:06.179788 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.181157 23926 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:06.086621 28404 raft_consensus.cc:697] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:06.144675 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.149044 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.213928 23852 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:06.213979 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:06.180990 23853 raft_consensus.cc:2368] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
W20260709 12:22:06.181963 23817 connection.cc:256] RPC call timeout handler was delayed by -5.8244956799999272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:22:06.183799 28127 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:06.184789 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:06.187681 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:06.188217 23929 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:06.190778 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:06.200222 23966 connection.cc:256] RPC call timeout handler was delayed by -1.069633721999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 12:22:06.204069 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 108331us
I20260709 12:22:06.205331 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:06.207612 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08000c88a0 after lost signal to thread 27902
W20260709 12:22:06.218796 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0080 after lost signal to thread 27975
I20260709 12:22:06.209858 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:06.173043 23748 catalog_manager.cc:5697] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:06.216883 23848 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:06.208282 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:06.220855 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8e60 after lost signal to thread 28124
I20260709 12:22:06.221033 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:06.221187 23875 debug-util.cc:398] Leaking SignalData structure 0x7b080014e9a0 after lost signal to thread 28127
W20260709 12:22:06.221747 23875 debug-util.cc:398] Leaking SignalData structure 0x7b080038f880 after lost signal to thread 28172
W20260709 12:22:06.222160 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed7a0 after lost signal to thread 28185
W20260709 12:22:06.222545 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd460 after lost signal to thread 28231
I20260709 12:22:06.219465 23920 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:06.225293 23850 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.145493 28231 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:06.225757 23875 debug-util.cc:398] Leaking SignalData structure 0x7b0800249ce0 after lost signal to thread 28243
W20260709 12:22:06.226251 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1f00 after lost signal to thread 28245
I20260709 12:22:06.226409 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:06.222589 23893 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:06.230618 23875 debug-util.cc:398] Leaking SignalData structure 0x7b080036ff00 after lost signal to thread 28260
W20260709 12:22:06.231091 23875 debug-util.cc:398] Leaking SignalData structure 0x7b0800343c00 after lost signal to thread 28261
W20260709 12:22:06.231462 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4160 after lost signal to thread 28272
W20260709 12:22:06.233253 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 77673us
W20260709 12:22:06.234736 23875 debug-util.cc:398] Leaking SignalData structure 0x7b0800388c80 after lost signal to thread 28289
W20260709 12:22:06.235617 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08003ab520 after lost signal to thread 28345
I20260709 12:22:06.238235 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.217312 28420 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:06.239933 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.237334 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:06.240777 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:06.236372 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:06.241268 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:06.243525 28444 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:06.243453 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:06.245523 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.248488 28240 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:06.251288 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:06.259191 28351 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:06.260509 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:22:06.266374 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.263265 28404 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:06.226979 28228 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:06.237637 23875 debug-util.cc:398] Leaking SignalData structure 0x7b08003853c0 after lost signal to thread 28379
I20260709 12:22:06.278297 23845 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
W20260709 12:22:06.311578 23875 debug-util.cc:398] Leaking SignalData structure 0x7b080025dc00 after lost signal to thread 28384
I20260709 12:22:06.285651 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:06.280511 28268 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:06.286859 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:06.313097 24562 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:06.286998 28420 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:06.315871 28420 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:06.287249 28453 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:06.238301 28099 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.228611 28074 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:06.287711 28410 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:06.287901 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:06.287015 28412 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:06.289062 23849 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:06.289383 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 160962us
I20260709 12:22:06.290640 23998 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:06.291106 23748 catalog_manager.cc:5697] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 8 to 9, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 9 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:06.292265 28444 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:06.294306 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:06.296329 23920 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:06.303921 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.346926 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.318795 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:06.319881 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:06.327009 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.348510 23853 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:06.328197 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.349529 23848 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:06.334249 23969 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:06.336256 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:06.351709 23927 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:06.352991 23969 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:06.338400 23925 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.286350 28242 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:22:06.344323 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 159615us
I20260709 12:22:06.344650 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.354518 23924 raft_consensus.cc:2393] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:06.345873 23999 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:22:06.355935 23852 raft_consensus.cc:2368] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:06.358332 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:06.358526 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:06.359040 24555 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:06.343705 23895 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:06.310076 28344 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:06.316804 28268 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:06.326951 28405 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:06.239295 28397 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:06.344966 23929 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:22:06.328931 28240 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:06.362349 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.363240 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.381855 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:06.376394 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.379510 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:06.395090 23926 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:06.380998 24562 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:06.340934 23850 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:06.391391 23922 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:06.379297 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:06.378216 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:06.396833 23999 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:06.378073 28412 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:06.355302 28099 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.402196 28412 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:06.436796 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:06.437268 23892 leader_election.cc:336] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.595s (SENT)
I20260709 12:22:06.403221 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:06.425622 23929 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:06.401600 23853 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:06.432103 23850 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:06.361516 28244 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:06.359200 28150 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:06.446367 23852 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:06.365906 23847 raft_consensus.cc:3055] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:06.442512 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:06.448781 23845 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:06.448956 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.363703 28268 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:06.448977 24563 raft_consensus.cc:3055] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:06.450222 24563 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:06.451087 23920 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:06.447635 23847 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:06.444787 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:06.453536 23995 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:06.440552 23748 catalog_manager.cc:5697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 6 to 9, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 9 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:06.402765 28431 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:06.403887 23998 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:06.447013 23818 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:06.339510 28453 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.487547 23850 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:06.490820 23846 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 12:22:06.446749 28456 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:22:06.502405 23920 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:06.457752 23895 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:06.445923 28244 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:06.504357 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 46750.2us
W20260709 12:22:06.504729 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 138124us
I20260709 12:22:06.506676 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.506724 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:06.511029 24002 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:06.510625 23895 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:06.513912 28367 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:06.514349 28367 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.514149 23847 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.514704 28367 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:06.365453 28242 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.516745 28183 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:06.508044 23748 catalog_manager.cc:5697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:06.535420 23748 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 5 to 8, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 8 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:06.446157 28150 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.538154 28150 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:06.519742 23848 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:06.517427 24563 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.517596 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:06.543442 23995 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:06.517967 28401 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:06.523522 28242 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:06.561700 23852 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:22:06.523574 28458 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:22:06.507339 23926 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: [8.6-11.8]
I20260709 12:22:06.524055 28367 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.568370 23845 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:06.569083 23853 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:06.524304 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 134416us
I20260709 12:22:06.526571 23847 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:06.565485 23852 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:22:06.527451 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 85962.1us
I20260709 12:22:06.528036 28267 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:06.533677 28244 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.537338 23748 catalog_manager.cc:5697] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 5 to 6, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 6 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:06.355473 28410 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:06.551548 23998 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:22:06.437651 28240 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:06.578052 24561 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:06.501708 28431 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.441012 28344 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.589546 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:06.590023 24002 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:06.592183 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:06.559453 28401 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.596426 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.599476 23850 raft_consensus.cc:3055] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:06.597226 23852 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:06.605146 23850 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:06.605229 23845 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
W20260709 12:22:06.613935 23892 leader_election.cc:336] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.612s (SENT)
I20260709 12:22:06.614625 23892 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:06.618007 23748 catalog_manager.cc:5697] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:06.626722 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:06.602380 28431 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.633869 24555 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:06.568217 28464 consensus_queue.cc:1059] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:22:06.607926 28401 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.640199 23748 catalog_manager.cc:5697] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 4 to 6, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 6 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:06.654353 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:06.655092 23996 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:22:06.640522 23850 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:06.658831 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 51249.6us
I20260709 12:22:06.669518 28464 consensus_queue.cc:1243] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:22:06.670187 28455 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.257s	user 0.000s	sys 0.006s
I20260709 12:22:06.674242 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:06.676268 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:06.677147 24555 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:06.678447 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:06.679206 24562 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:22:06.642769 28231 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:06.581933 28444 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:06.683425 23850 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.687983 23969 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:06.643457 28099 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:06.652951 28405 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:06.702564 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:06.703469 23996 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:06.709329 28412 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:06.709841 28412 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.710237 28412 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.710703 28268 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:06.718888 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 117190us
I20260709 12:22:06.715831 23969 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:06.722769 23854 raft_consensus.cc:2393] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 7: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:06.681243 27973 consensus_queue.cc:1059] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:22:06.713245 28268 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:06.741027 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 48049.9us
I20260709 12:22:06.744926 23929 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:06.735500 28457 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.251s	user 0.000s	sys 0.005s
I20260709 12:22:06.731262 28246 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:06.751348 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:06.754842 24525 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:06.755205 23996 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:06.756417 24004 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:06.725662 28099 consensus_queue.cc:1059] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:22:06.768682 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:06.754415 28246 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.790946 24525 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:06.769793 28462 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:22:06.786497 28246 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:06.805365 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:06.799362 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:06.768767 28367 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:06.811939 28454 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:06.812801 28454 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.813412 28454 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.801906 28240 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:06.813946 28260 consensus_queue.cc:1059] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 12:22:06.824858 28465 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:06.825412 28465 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.825773 28465 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:06.827219 28431 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:06.821376 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:06.824883 24562 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:22:06.843429 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 116921us
I20260709 12:22:06.835896 24554 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:06.846493 23996 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:06.798286 28150 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:06.858490 28460 log.cc:927] Time spent T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:22:06.859759 28410 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:06.849740 28367 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 12:22:06.866498 23892 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.769s (SENT)
I20260709 12:22:06.868081 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:06.867076 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:06.878715 28453 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:06.879220 23921 raft_consensus.cc:606] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:06.879683 23921 raft_consensus.cc:614] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:06.880803 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:06.881577 23925 consensus_meta.cc:287] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.004s
I20260709 12:22:06.881976 23925 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:06.883679 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.884228 23848 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:22:06.886591 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.888851 23851 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:06.890069 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.890753 23851 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 16.
I20260709 12:22:06.891721 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:06.892318 23851 raft_consensus.cc:2376] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10. Re-sending same reply.
I20260709 12:22:06.893383 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:06.894109 24555 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:06.895951 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:06.902333 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:06.881415 28272 consensus_meta.cc:287] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.003s
I20260709 12:22:06.905005 24555 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:06.908179 23847 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:06.909202 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:06.913110 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:22:06.921284 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:06.928577 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:06.922924 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 56453.8us
I20260709 12:22:06.924599 23893 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:06.922390 23999 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:22:06.921803 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.923259 23996 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:22:06.933229 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 142399us
I20260709 12:22:06.944193 24554 raft_consensus.cc:2393] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:22:06.957187 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.010550 24525 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:06.923662 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:06.899084 28451 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.032603 24004 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:22:07.052704 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:07.054738 24555 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:07.046543 23969 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:07.044224 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.043588 24525 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:07.063081 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:07.070300 23892 leader_election.cc:336] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.776s (SENT)
I20260709 12:22:07.070890 23892 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:07.032473 28397 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:07.044663 28466 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:07.078562 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:07.098591 24001 raft_consensus.cc:2368] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14.
I20260709 12:22:07.074193 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:07.077531 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.078526 28476 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:22:07.079262 24002 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:07.084192 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:07.087162 28150 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:07.088891 24003 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:22:07.235415 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:07.236846 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:07.094259 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:07.240639 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:07.044973 28410 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.242080 28410 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.242605 23852 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:07.244915 28410 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:07.246040 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:07.246822 23999 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:07.248267 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:07.250448 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:07.252012 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:07.064308 28240 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:07.096931 28466 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.130963 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:07.063935 28452 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.102649 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:07.275027 24000 raft_consensus.cc:2393] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:07.173516 28260 raft_consensus.cc:3055] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:07.174418 28344 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:07.072031 28486 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:07.061981 28431 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:07.176765 28127 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:07.177296 28099 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:07.178876 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:07.299016 23847 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:07.179234 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.161485 24004 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:07.110244 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.294834 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:07.187799 28412 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:07.191373 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 132194us
W20260709 12:22:07.149760 28480 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:22:07.202556 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:07.309710 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:07.161334 28454 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.220661 24563 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.314680 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:07.196097 28244 consensus_meta.cc:287] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.002s
I20260709 12:22:06.914535 28272 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:07.222441 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 325258us
W20260709 12:22:07.224920 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.224821 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 149615us
I20260709 12:22:07.226056 23895 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:07.222391 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:07.228679 28397 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:07.229125 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2196) took 1055 ms. Trace:
I20260709 12:22:07.292467 28486 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:07.309041 28401 consensus_meta.cc:287] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.000s
I20260709 12:22:07.270143 28430 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.294664 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:07.270632 28240 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.274252 28466 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:07.306591 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 363287us
I20260709 12:22:07.310127 24557 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:07.215109 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:07.313922 23892 leader_election.cc:336] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.811s (SENT)
I20260709 12:22:07.316529 24004 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:07.317441 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.276561 28260 raft_consensus.cc:740] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:22:07.335645 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 109680us
I20260709 12:22:07.368126 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:07.368808 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:07.265996 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:07.372165 23998 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:07.343950 24525 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:07.336637 23929 rpcz_store.cc:276] 0709 12:22:06.173662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.444675 (+271013us) service_pool.cc:224] Handling call
0709 12:22:06.486590 (+ 41915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:06.745471 (+258881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.228807 (+483336us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b540005f0d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:07.229043 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593570560}
I20260709 12:22:07.312333 28410 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.357661 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:07.356901 23845 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:07.378788 23926 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:07.379560 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:07.377714 24004 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:07.358691 23921 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:07.380940 23925 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:07.362730 24561 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:07.338510 23817 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:07.378150 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.381779 23849 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:07.382902 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 44546.9us
I20260709 12:22:07.383701 23817 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:07.384809 23852 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:07.385799 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2416) took 1187 ms. Trace:
I20260709 12:22:07.351509 28473 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:22:07.389348 23736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 161334us
I20260709 12:22:07.351698 28231 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:07.391486 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.394555 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.355424 28240 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.353255 28486 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.389027 23852 rpcz_store.cc:276] 0709 12:22:06.198475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.457181 (+258706us) service_pool.cc:224] Handling call
0709 12:22:06.545794 (+ 88613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:07.241999 (+696205us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b580054f2d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873a80aa 00007fa28742a447 00007fa287442fe7 00007fa2874447de 00007fa28744eb49 00007fa28744f416 00007fa28744bd8f 00007fa28744b83e 00007fa28c410419 00007fa285987bd4
0709 12:22:07.385459 (+143460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.385726 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102913792}
I20260709 12:22:07.405462 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.315729 28099 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:07.312340 28452 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.312608 28127 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:07.338581 28244 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.413772 23920 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:07.423851 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:07.442736 23926 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:07.410308 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.351689 28401 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:07.418684 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.422762 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.393723 28351 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:07.444836 23847 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 16.
I20260709 12:22:07.396675 28267 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:07.443280 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 129415us
W20260709 12:22:07.451203 23892 leader_election.cc:336] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.858s (SENT)
W20260709 12:22:07.435070 23966 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.561s (SENT) [suppressed 44 similar messages]
I20260709 12:22:07.402791 28268 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.452718 23921 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:07.452818 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.458961 23892 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:07.411672 28473 raft_consensus.cc:697] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:07.465802 24563 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:22:07.464295 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 108301us
I20260709 12:22:07.466442 23926 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:07.469544 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.476090 23848 raft_consensus.cc:2410] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:22:07.479136 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44119.5us
I20260709 12:22:07.480772 24563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 978) took 1109 ms. Trace:
I20260709 12:22:07.481189 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:07.481748 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.456429 28465 consensus_meta.cc:287] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.630s	user 0.012s	sys 0.000s
I20260709 12:22:07.484613 28113 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:07.485580 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:07.486768 28242 raft_consensus.cc:3055] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:07.489842 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.524426 23852 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:07.491135 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 2183) took 1354 ms. Trace:
I20260709 12:22:07.495401 28452 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:07.495766 28244 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:07.497354 28405 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:07.498749 28490 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 12:22:07.499033 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.499629 28473 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.437191 28231 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.506753 28491 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:07.466089 28267 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:07.462879 27996 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:22:07.507995 28127 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:07.510296 28401 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:07.510658 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.511749 28412 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:07.512797 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.481217 24563 rpcz_store.cc:276] 0709 12:22:06.357055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.357267 (+   212us) service_pool.cc:224] Handling call
0709 12:22:06.381377 (+ 24110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:07.217450 (+836073us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400631120. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873c1a1d 00007fa2873a81a4 00007fa28742a447 00007fa287442fe7 00007fa2874447de 00007fa28744eb49 00007fa28744f416 00007fa28744bd8f 00007fa28744b83e 00007fa28c410419
0709 12:22:07.466308 (+248858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.466501 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247301504}
I20260709 12:22:07.491158 28099 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:07.514806 24003 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:07.452541 28351 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.519070 23818 leader_election.cc:400] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14.
I20260709 12:22:07.396544 28410 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.525004 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2420) took 1263 ms. Trace:
I20260709 12:22:07.591871 23850 rpcz_store.cc:276] 0709 12:22:06.261970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.561793 (+299823us) service_pool.cc:224] Handling call
0709 12:22:06.599324 (+ 37531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:06.765051 (+165727us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:06.885175 (+120124us) log.cc:844] Serialized 14 byte log entry
0709 12:22:07.524677 (+639502us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:07.524734 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:07.524788 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.524853 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:07.524954 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":411154,"prepare.queue_time_us":38497,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1831,"raft.queue_time_us":103027,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":28697,"thread_start_us":540108,"threads_started":3,"wal-append.queue_time_us":625268}
I20260709 12:22:07.475448 28260 consensus_queue.cc:260] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.594185 24002 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: [5.5-9.6]
I20260709 12:22:07.594672 23850 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:22:07.595078 23848 raft_consensus.cc:3055] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:07.595425 28454 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:07.525379 23928 rpcz_store.cc:276] 0709 12:22:06.137091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.206696 (+ 69605us) service_pool.cc:224] Handling call
0709 12:22:07.490919 (+1284223us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400106154. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:07.491049 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2472953088}
I20260709 12:22:07.596242 23850 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:07.547384 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:07.527416 23966 leader_election.cc:336] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.626s (SENT)
I20260709 12:22:07.599304 28410 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:07.599455 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 72082.9us
W20260709 12:22:07.600366 23966 leader_election.cc:336] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.698s (SENT)
W20260709 12:22:07.546878 28246 consensus_meta.cc:287] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.727s	user 0.013s	sys 0.001s
I20260709 12:22:07.602423 28246 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.602598 28267 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:07.605209 28246 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:07.523936 28242 raft_consensus.cc:740] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:07.569432 23924 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:07.605253 28486 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.590425 24003 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:07.565065 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.608665 23845 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:22:07.590983 28351 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:07.594612 28260 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:07.610186 28231 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:07.468360 28397 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:07.595500 23848 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:07.533573 24004 raft_consensus.cc:1240] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:07.525971 28465 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.571290 23846 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:07.607010 28242 consensus_queue.cc:260] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.571898 23996 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:07.574623 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2382) took 1617 ms. Trace:
I20260709 12:22:07.575287 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60702 (request call id 2372) took 1619 ms. Trace:
I20260709 12:22:07.618804 23853 rpcz_store.cc:276] 0709 12:22:05.949283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.444347 (+495064us) service_pool.cc:224] Handling call
0709 12:22:06.568915 (+124568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:06.578109 (+  9194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.566511 (+988402us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400428bd0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:07.566722 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255608704}
I20260709 12:22:07.619812 23854 rpcz_store.cc:276] 0709 12:22:05.946798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.236985 (+290187us) service_pool.cc:224] Handling call
0709 12:22:07.565698 (+1328713us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b5400216454. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:07.565957 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845752704}
W20260709 12:22:07.620018 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 168848us
I20260709 12:22:07.597699 23850 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:07.554661 23999 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:22:07.575549 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2375) took 1620 ms. Trace:
I20260709 12:22:07.579167 24001 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:07.583988 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:07.630708 23847 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:07.586675 23818 leader_election.cc:403] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 12:22:07.632095 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 158837us
I20260709 12:22:07.633071 23818 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:07.570410 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.555397 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 181070us
W20260709 12:22:07.617576 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 226628us
I20260709 12:22:07.629307 23849 rpcz_store.cc:276] 0709 12:22:05.947572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.403459 (+455887us) service_pool.cc:224] Handling call
0709 12:22:06.441403 (+ 37944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:07.383864 (+942461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.567225 (+183361us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b5400298e54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:07.567470 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2162270976}
W20260709 12:22:07.622285 23966 leader_election.cc:336] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.746s (SENT)
I20260709 12:22:07.643494 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:07.645233 23848 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.646281 23848 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:07.648598 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:07.661761 23848 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:22:07.666824 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 266654us
I20260709 12:22:07.675058 24563 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:07.683467 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 214600us
W20260709 12:22:07.684945 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 52006.2us
I20260709 12:22:07.685962 23818 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:07.674502 28242 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.681360 28246 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:07.681151 28231 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.708480 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2317) took 1105 ms. Trace:
I20260709 12:22:07.692816 28473 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.678206 28397 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 12:22:07.715394 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.712607 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 90356.5us
I20260709 12:22:07.713725 23818 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:07.705757 28272 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:07.725455 28495 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:07.727510 28496 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.727771 28495 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:07.727947 28486 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:07.708441 28099 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:22:07.728853 28495 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:07.730075 28495 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:07.730127 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:07.709955 23997 rpcz_store.cc:276] 0709 12:22:06.601109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.601236 (+   127us) service_pool.cc:224] Handling call
0709 12:22:06.613978 (+ 12742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:06.614249 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:06.655944 (+ 41695us) log.cc:844] Serialized 14 byte log entry
0709 12:22:07.560277 (+904333us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b1800404980. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a 00007fa287456a2a
0709 12:22:07.706053 (+145776us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:07.706146 (+    93us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:07.706255 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.706325 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:07.706451 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13380,"prepare.queue_time_us":41661,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":5585,"spinlock_wait_cycles":26774272,"thread_start_us":142157,"threads_started":1}
I20260709 12:22:07.732000 23922 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:07.732990 23818 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:07.734546 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:07.742348 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:07.722518 28397 consensus_queue.cc:1243] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 35a9a1f8b1d847fb8f2063ced2a3c26d log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:22:07.753334 28503 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:22:07.744374 28444 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:07.737722 28506 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14.
I20260709 12:22:07.740602 28401 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:22:07.725389 28473 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.753841 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:07.760015 23966 leader_election.cc:336] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.145s (SENT)
I20260709 12:22:07.768287 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:07.753384 28496 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:07.764504 24557 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:07.765216 23818 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:07.776919 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:07.778632 23997 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:22:07.744844 28268 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:22:07.757504 28497 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:22:07.783402 23997 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:22:07.746197 28367 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:07.785277 24555 pending_rounds.cc:85] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 7
I20260709 12:22:07.788705 24555 pending_rounds.cc:107] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:22:07.789013 24555 raft_consensus.cc:2889] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:07.789407 28505 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:22:07.790778 28516 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:22:07.783097 27973 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:07.786796 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:07.775156 28410 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.756690 28444 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:07.796903 23818 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:07.836942 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 159726us
I20260709 12:22:07.857251 23969 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:07.810109 28465 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:07.798960 28401 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:07.817780 23966 leader_election.cc:336] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.773s (SENT)
W20260709 12:22:07.863898 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 237515us
I20260709 12:22:07.865319 23966 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:07.799077 28503 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 12:22:07.866366 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 69541.6us
I20260709 12:22:07.763378 28351 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.800386 28367 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:07.828037 28240 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:07.879375 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.865322 28505 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.896710 23969 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:07.894419 28244 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:07.863880 28246 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:07.898770 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:07.903820 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:07.903738 23851 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
W20260709 12:22:07.907393 23892 leader_election.cc:336] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.925s (SENT)
I20260709 12:22:07.904947 24558 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:22:07.905791 23818 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:07.908504 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:07.909193 24556 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.909276 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:07.910169 24557 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 9: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:07.911707 23995 raft_consensus.cc:2368] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13.
I20260709 12:22:07.915256 23892 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:07.919334 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:07.921434 23818 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:07.927174 24563 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: []
W20260709 12:22:07.928243 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 110465us
I20260709 12:22:07.859058 28466 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.867666 28502 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:22:07.930682 23818 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:07.907385 28246 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:07.944548 28351 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:07.945300 28466 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:07.932206 28505 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.946530 24562 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 13: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:07.943944 28367 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:07.931572 28444 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:07.953135 24557 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:07.920516 28260 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:07.958020 28268 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:07.958930 28268 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:07.959275 28268 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:07.960143 28268 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:07.961385 28268 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:07.963392 24004 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:22:07.964669 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.965200 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.965672 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.911051 28405 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:22:07.942965 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:07.929337 28495 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:07.924599 28453 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:07.955461 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:07.969009 24563 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:07.928404 28431 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:07.972921 28496 consensus_queue.cc:1059] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:07.968389 24560 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:22:07.976670 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 331448us
I20260709 12:22:07.978506 24003 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:07.982606 28267 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:07.983608 28267 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:07.983989 28267 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:07.986677 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:07.987778 24557 raft_consensus.cc:2393] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
W20260709 12:22:07.990724 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.953372 28246 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.997586 28496 raft_consensus.cc:3055] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:22:07.999540 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 97274.4us
I20260709 12:22:07.994654 24556 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:07.967509 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:07.955706 28505 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:07.957564 28473 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:07.998064 28496 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:08.011243 23966 leader_election.cc:400] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:08.011628 23966 leader_election.cc:403] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:22:08.017377 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:08.018321 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 47832.2us
I20260709 12:22:08.013792 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:07.984848 28267 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.019901 28244 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:08.013583 28242 consensus_queue.cc:1059] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:22:08.030342 28505 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:08.030082 28420 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:08.004177 28453 raft_consensus.cc:697] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:08.043291 24555 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:08.045840 24556 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:08.052403 28240 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:08.053172 28240 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:08.061936 28240 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:08.062666 28240 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:08.061846 28530 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:08.063369 28240 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:08.064792 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 520) took 1333 ms. Trace:
I20260709 12:22:08.065184 23846 rpcz_store.cc:276] 0709 12:22:06.731100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.756088 (+ 24988us) service_pool.cc:224] Handling call
0709 12:22:07.566098 (+810010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:07.618528 (+ 52430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.064597 (+446069us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b5400216450. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:08.064730 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832681344}
W20260709 12:22:08.070406 23892 leader_election.cc:336] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.024s (SENT)
I20260709 12:22:08.071053 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:08.011837 28495 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:22:08.040082 28244 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:08.012671 28260 consensus_queue.cc:1059] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:22:08.073868 28267 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:08.094292 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:08.094799 24555 raft_consensus.cc:1240] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:08.040931 28231 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:22:08.080565 28242 consensus_queue.cc:1243] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:22:08.042651 28099 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:22:08.110795 23969 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:08.091423 28430 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:08.078258 28150 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:22:08.043437 28506 consensus_queue.cc:1175] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" responder_term: 16 status { last_received { term: 11 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:22:08.118119 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 70161.8us
I20260709 12:22:08.087704 28244 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:08.127967 28231 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:08.128890 28231 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:08.130967 24557 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:22:08.132001 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 56966.8us
I20260709 12:22:08.132831 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:08.137188 23817 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:08.121338 27973 consensus_queue.cc:1059] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:22:08.130167 28453 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:08.145433 28524 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:22:08.134050 28530 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:08.121418 28505 consensus_queue.cc:1059] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:22:08.138128 28410 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:08.148815 28410 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:08.149277 28410 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:08.151281 28242 raft_consensus.cc:3055] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:08.151768 28242 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:08.152673 28242 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.154949 28127 raft_consensus.cc:3055] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:08.155346 28127 raft_consensus.cc:740] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:08.156116 28127 consensus_queue.cc:260] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.125960 28495 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:08.157024 28495 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:08.157421 28127 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:08.135155 28150 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:22:08.157943 28495 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:08.159425 28495 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:08.125725 28260 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:22:08.165942 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.166649 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.165701 28412 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:08.167784 28530 raft_consensus.cc:697] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:08.167657 28240 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.079437 28496 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.171154 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:08.175062 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:08.179219 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:08.186726 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.187067 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.186870 23922 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:08.189055 23847 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:08.189180 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.190014 23850 raft_consensus.cc:2376] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14. Re-sending same reply.
I20260709 12:22:08.188925 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:08.170601 27973 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:08.186774 28502 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:22:08.179359 28242 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:08.179148 28150 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:08.200750 23922 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:22:08.202489 23854 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:22:08.208017 28244 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.183292 27996 consensus_queue.cc:1059] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:22:08.224413 27996 consensus_queue.cc:1243] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:08.231890 23853 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:08.211755 28410 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.215312 28240 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:08.216483 28530 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:08.251564 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:08.251966 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:08.259816 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 120803us
I20260709 12:22:08.276319 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:08.246723 23736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8630b76482c543a2a08e289b32b13ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 22996f888daf435398b693481171c18c (127.22.43.65:34895) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:08.225957 28244 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:08.286386 28150 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:08.250051 28410 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:08.237249 28503 raft_consensus.cc:3055] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:08.287822 28503 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:08.288528 28505 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:08.290086 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.282333 23854 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:08.291530 23817 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:08.264930 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.296247 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:08.236557 28529 log.cc:927] Time spent T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:08.299796 28412 consensus_queue.cc:1059] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:08.300386 27996 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:08.300730 28412 raft_consensus.cc:3055] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:08.301014 27996 raft_consensus.cc:697] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:08.301151 28412 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:08.302043 27996 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.302268 28412 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.306897 23847 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 6.
W20260709 12:22:08.307096 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 216077us
W20260709 12:22:08.306901 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 213744us
I20260709 12:22:08.307945 23818 leader_election.cc:400] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13.
W20260709 12:22:08.308441 24524 leader_election.cc:336] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.831s (SENT)
I20260709 12:22:08.300518 23996 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:08.251035 28496 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:08.309026 24524 leader_election.cc:336] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.831s (SENT)
I20260709 12:22:08.315588 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:08.314513 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.316664 23892 connection.cc:256] RPC call timeout handler was delayed by -1.9907775000001493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30920000000000003s for a response
W20260709 12:22:08.317168 23892 connection.cc:256] RPC call timeout handler was delayed by -1.9071962280002026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3829s for a response
W20260709 12:22:08.318454 23892 leader_election.cc:336] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.820s (SENT)
I20260709 12:22:08.319025 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:08.226609 27973 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:08.168910 28537 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.154s
I20260709 12:22:08.303694 28412 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:08.288692 28503 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:08.328498 24524 leader_election.cc:336] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.861s (SENT)
I20260709 12:22:08.351671 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:08.328995 28511 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:22:08.353394 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 45606us
W20260709 12:22:08.374118 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 50293.1us
W20260709 12:22:08.376093 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 59326.2us
W20260709 12:22:08.383821 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 55350.9us
I20260709 12:22:08.312181 28267 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.400727 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:08.401786 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:08.402424 23997 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:08.403302 23995 raft_consensus.cc:1240] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:08.404232 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:08.407558 24004 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
W20260709 12:22:08.409382 24524 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.067s (SENT)
W20260709 12:22:08.410383 24524 leader_election.cc:336] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.123s (SENT)
I20260709 12:22:08.410995 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:08.289129 28505 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:08.454317 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:08.455276 24555 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:08.455423 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:08.456262 23996 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:08.407948 24004 pending_rounds.cc:85] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 8
I20260709 12:22:08.413494 24002 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:08.454320 23820 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:08.459596 24004 pending_rounds.cc:107] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:22:08.461275 24004 raft_consensus.cc:2889] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:08.377231 28367 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:08.484545 28268 consensus_meta.cc:287] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
W20260709 12:22:08.489717 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 82759us
I20260709 12:22:08.490931 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:08.492435 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:08.494300 28410 consensus_queue.cc:1059] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:08.495430 28410 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:08.495314 28526 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:08.495898 28410 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:08.496347 28410 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:08.496974 28526 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:08.498226 28532 raft_consensus.cc:3055] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:08.498703 28532 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:08.499836 28532 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:08.406239 28524 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:22:08.507266 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.386649 28534 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:08.387152 28465 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:08.524369 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 205947us
I20260709 12:22:08.501698 28532 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:08.525103 23892 connection.cc:256] RPC call timeout handler was delayed by -1.1221796270001505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4938s for a response
I20260709 12:22:08.534759 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:08.542493 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 132145us
I20260709 12:22:08.383301 28451 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 12:22:08.478904 28260 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:08.530592 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:22:08.626762 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 182981us
I20260709 12:22:08.411880 28267 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:08.525229 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 146946us
I20260709 12:22:08.405308 28272 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:22:08.516165 28506 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:08.602447 23927 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:08.604329 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.605475 23920 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:08.617385 23921 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:08.518049 28244 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:08.619134 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.619354 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.522240 28537 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.621981 23928 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:08.616170 28511 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:08.679703 23929 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:08.623818 24555 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
W20260709 12:22:08.629710 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 99219.8us
I20260709 12:22:08.685562 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.685838 23966 leader_election.cc:400] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:08.686712 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:08.687561 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.687827 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:08.688887 23926 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:08.690124 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:08.676736 28490 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:08.542312 28240 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.136s
I20260709 12:22:08.683785 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.631557 28150 raft_consensus.cc:2764] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:22:08.683511 28246 consensus_meta.cc:287] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.679s	user 0.005s	sys 0.006s
I20260709 12:22:08.538129 28534 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:08.715072 23920 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:08.716794 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.718183 23929 raft_consensus.cc:2393] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:08.686909 28272 consensus_queue.cc:1243] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:08.701363 28536 consensus_queue.cc:1059] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.296s
I20260709 12:22:08.702257 28453 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:08.632304 28260 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.684468 28367 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:22:08.704963 28344 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:08.717200 28466 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:08.728511 28453 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:08.735468 28540 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 12:22:08.736272 28545 log.cc:927] Time spent T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:22:08.724455 28127 consensus_meta.cc:287] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.000s
I20260709 12:22:08.700805 28537 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:08.766986 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.716253 28246 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:08.771683 28410 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:08.773301 28541 log.cc:927] Time spent T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 12:22:08.773972 28410 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:08.774189 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.760612 28466 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:08.768200 28344 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:08.779049 28344 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.779569 28466 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:08.781796 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.763029 28431 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:22:08.788102 28431 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:08.789743 28401 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:22:08.788933 23849 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:08.768503 27996 consensus_queue.cc:1059] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:22:08.788933 28431 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 12:22:08.795971 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 96344.5us
W20260709 12:22:08.798571 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.800114 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.800863 23924 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:08.803819 23999 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:08.790076 28549 raft_consensus.cc:3055] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:08.808070 23892 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:08.813445 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.814348 23845 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:08.810253 28491 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:08.815850 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.816782 23847 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:22:08.813995 28534 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:08.817960 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.813591 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:08.781038 28420 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:22:08.825361 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:08.826896 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:08.828478 28511 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:08.833576 28127 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:08.834782 28554 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.837898 23920 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:08.857149 23923 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
W20260709 12:22:08.872490 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.840727 28268 raft_consensus.cc:3055] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:08.845521 28272 raft_consensus.cc:3055] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:08.809230 28549 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:08.847913 28246 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:08.790584 28453 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.822424 28466 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:22:08.867257 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:08.880162 23849 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:08.881969 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.882884 23854 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:22:08.883772 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:08.884348 23854 raft_consensus.cc:2376] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13. Re-sending same reply.
I20260709 12:22:08.885177 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.886407 23854 raft_consensus.cc:2410] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:22:08.886267 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.886631 28549 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.887346 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:08.887460 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.887879 28549 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:08.888135 23854 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:08.888254 23853 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:08.888978 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:08.889071 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:08.889303 28496 consensus_meta.cc:287] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
I20260709 12:22:08.870201 28127 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:08.890285 23846 raft_consensus.cc:2410] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:22:08.890362 28127 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:08.874447 28272 raft_consensus.cc:740] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:08.891693 28272 consensus_queue.cc:260] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:08.892987 28272 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:08.893440 28537 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:08.869040 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.874807 27996 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.874701 28268 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:08.894997 27996 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:08.895675 28260 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:08.895628 28268 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:08.896956 28268 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:08.890031 28554 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:08.877381 23850 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:08.868016 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.910209 23847 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:08.898926 24524 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:08.900053 23849 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:08.906613 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.911624 23845 raft_consensus.cc:2410] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:22:08.909377 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.914716 23853 raft_consensus.cc:2368] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:08.913775 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:08.916698 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:08.869868 28267 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:08.918783 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:08.919747 23849 raft_consensus.cc:2410] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:22:08.886626 28546 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:22:08.920253 24002 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:08.897101 27996 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:08.922585 28511 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:08.932250 28511 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:08.932684 28511 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:08.922454 28466 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:08.943240 23854 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
W20260709 12:22:08.950570 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 125295us
I20260709 12:22:08.951535 23892 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:08.930178 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:08.930956 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.936292 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:08.936453 23818 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:08.957381 23818 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:08.939013 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:08.939292 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:08.940222 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:08.961763 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:08.962702 23845 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:08.918792 28473 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:08.942351 28495 consensus_meta.cc:287] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.783s	user 0.012s	sys 0.002s
W20260709 12:22:08.964432 28560 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:22:08.968082 23818 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:08.971365 28506 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:08.975191 28506 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:08.975605 28506 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:08.979046 28242 consensus_meta.cc:287] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.000s
I20260709 12:22:08.979249 23892 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:08.980250 28503 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:08.982043 28491 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:08.982487 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 2340) took 1078 ms. Trace:
I20260709 12:22:08.982656 28491 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:08.982895 23999 rpcz_store.cc:276] 0709 12:22:07.904186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.930195 (+ 26009us) service_pool.cc:224] Handling call
0709 12:22:08.982302 (+1052107us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400411ed4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:08.982425 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919972224}
W20260709 12:22:08.983727 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.985507 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:08.986136 24003 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:08.987033 28551 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:08.987746 28551 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:08.988999 28551 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:08.990469 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:08.991253 24002 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:08.992058 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:08.992483 28505 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:09.000209 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:09.000746 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:09.000880 23849 raft_consensus.cc:2376] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13. Re-sending same reply.
I20260709 12:22:09.001294 23997 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.005589 24003 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:09.006089 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:09.007251 24004 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:09.010313 23850 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
W20260709 12:22:09.014618 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 100926us
I20260709 12:22:08.966976 27996 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:09.024533 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:09.011655 28491 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:09.027473 23892 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:09.014619 28242 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:09.041446 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 50408.5us
I20260709 12:22:09.033406 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:09.030257 23999 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:09.034467 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:09.086541 23849 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.042785 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:09.038821 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:08.972174 28267 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:22:09.088645 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 45917.8us
I20260709 12:22:09.089074 23848 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.089845 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:22:09.092104 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 93624.2us
W20260709 12:22:09.092793 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 72862.8us
W20260709 12:22:09.103111 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 59083.3us
I20260709 12:22:09.073486 28473 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:09.080060 28491 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:09.108208 23848 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:09.109411 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:09.031068 28127 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.110837 23848 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:09.042708 28420 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:22:09.096330 28530 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:09.116438 23849 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
W20260709 12:22:09.118866 28564 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:22:09.128202 23966 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:08.973694 28537 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:22:09.135022 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:09.136835 28558 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 12:22:09.137818 28127 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:09.138756 28565 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:22:09.139271 28526 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:09.142172 23853 raft_consensus.cc:2410] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:22:09.086728 28568 consensus_queue.cc:1059] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:09.145680 28568 raft_consensus.cc:3055] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:09.146108 28568 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:09.146975 28568 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.148437 28568 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:09.150177 28508 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:22:09.135802 23848 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:09.166046 23997 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:09.115152 28530 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:09.168730 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 57831us
W20260709 12:22:09.158890 28532 consensus_meta.cc:287] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.003s
I20260709 12:22:09.180233 23996 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:22:09.172982 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44827.5us
I20260709 12:22:09.197386 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 2206) took 1022 ms. Trace:
I20260709 12:22:09.197970 23846 rpcz_store.cc:276] 0709 12:22:08.174658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.174824 (+   166us) service_pool.cc:224] Handling call
0709 12:22:09.197143 (+1022319us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b5400215554. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:09.197315 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642729728}
I20260709 12:22:09.170666 28530 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:09.115625 28451 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 12:22:09.199734 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 105959us
I20260709 12:22:09.202064 24562 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:22:09.206413 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:09.208694 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:09.209704 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:09.210790 23849 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:09.218199 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.227675 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:09.227855 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:09.228652 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 58972.7us
I20260709 12:22:09.230846 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:09.207067 28506 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:09.231065 23969 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:09.232512 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:09.234313 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:09.238413 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:09.239187 23849 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:09.237676 28244 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:09.241137 28244 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:09.242043 28244 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.238416 28526 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:09.248070 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:09.253260 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.254163 23922 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:09.254304 23920 raft_consensus.cc:2376] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12. Re-sending same reply.
I20260709 12:22:09.236057 28537 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.264312 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.266901 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.267684 23929 raft_consensus.cc:2376] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8. Re-sending same reply.
I20260709 12:22:09.265019 23924 raft_consensus.cc:2376] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14. Re-sending same reply.
I20260709 12:22:09.285593 23849 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:09.287050 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:09.288602 23849 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 6.
I20260709 12:22:09.256341 28246 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:09.292618 28495 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.293207 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:09.293547 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 55068.6us
I20260709 12:22:09.294203 23924 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
W20260709 12:22:09.298768 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 61554us
I20260709 12:22:09.300998 24557 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:09.301505 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:09.302244 24563 raft_consensus.cc:2368] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:22:09.306170 28526 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:09.290565 28242 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:09.307519 28242 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.310847 23966 leader_election.cc:400] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:09.288679 28537 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:09.289296 28505 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.313270 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:09.334553 23845 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:22:09.316896 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:09.332245 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.309646 28242 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:09.340440 23820 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:09.346621 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.347808 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:09.343093 23969 leader_election.cc:400] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:22:09.345937 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:09.349043 23969 leader_election.cc:403] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:22:09.350921 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.352157 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:09.353488 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.354215 23927 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.271376 28511 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.358140 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:09.358124 24555 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:22:09.347541 28578 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:09.359385 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.362680 23928 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.335104 28268 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.358937 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.361747 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.366127 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.293170 28495 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.350790 28127 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:09.353668 28532 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:22:09.353848 28260 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:09.417819 23927 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:09.408609 23849 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:22:09.351770 28246 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:22:09.423082 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:09.352181 28505 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.414817 28506 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:09.409246 23925 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:09.423132 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:09.372570 28268 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:09.426457 28574 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:22:09.410329 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:09.473685 23845 raft_consensus.cc:2410] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:22:09.431764 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:09.474161 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 101951us
I20260709 12:22:09.474617 23854 raft_consensus.cc:2410] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:22:09.474877 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:09.435823 24000 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:09.436095 24002 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:09.448679 23849 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:22:09.466099 28577 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:09.486436 28583 log.cc:927] Time spent T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:22:09.467912 28466 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:09.474494 28530 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:09.480918 28552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.005s	sys 0.013s
W20260709 12:22:09.499543 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 51066.2us
I20260709 12:22:09.502668 23845 pending_rounds.cc:85] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 7
I20260709 12:22:09.503147 23845 pending_rounds.cc:107] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:22:09.503494 23845 raft_consensus.cc:2889] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:09.503679 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.400578 28244 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260709 12:22:09.499296 28552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.005s	sys 0.014s
I20260709 12:22:09.492578 28150 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:09.491925 28246 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:09.525782 23893 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:22:09.520781 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 45970.6us
I20260709 12:22:09.535678 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:09.510895 28532 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.539803 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:09.529984 28523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.019s	sys 0.020s
I20260709 12:22:09.531497 28246 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:09.491703 28577 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.536885 28430 consensus_queue.cc:1059] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 12:22:09.549111 28523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.020s	sys 0.020s
I20260709 12:22:09.557834 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:09.540508 28412 raft_consensus.cc:2764] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:22:09.567121 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:09.567845 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:09.571256 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 45601.6us
I20260709 12:22:09.562058 28246 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.561322 28451 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:09.592300 28451 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:09.593346 28451 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:09.594530 28451 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.550516 28532 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:09.583103 28582 log.cc:927] Time spent T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:22:09.612654 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2211) took 1426 ms. Trace:
I20260709 12:22:09.586229 28503 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:09.571113 28559 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:09.591786 28530 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:09.572268 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:09.626775 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 54590us
I20260709 12:22:09.574478 28537 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:09.600116 28509 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.608433 28532 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:09.608560 28556 log.cc:927] Time spent T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.798s	user 0.006s	sys 0.001s
I20260709 12:22:09.572551 28453 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:09.613240 23852 rpcz_store.cc:276] 0709 12:22:08.186377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.186495 (+   118us) service_pool.cc:224] Handling call
0709 12:22:09.197286 (+1010791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.197600 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:09.197930 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.249143 (+ 51213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:09.249219 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:09.249283 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.249381 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.612402 (+363021us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400215550. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:09.612569 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3289,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":2893,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":7621,"spinlock_wait_cycles":2332744192,"thread_start_us":50772,"threads_started":1,"wal-append.queue_time_us":88248}
I20260709 12:22:09.571756 28244 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:22:09.622567 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 162202us
I20260709 12:22:09.623469 23995 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:09.651629 23848 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:09.621071 28430 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:22:09.636219 24525 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:09.656858 24525 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:09.647778 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:09.660488 28567 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:09.661126 28567 raft_consensus.cc:697] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:09.662261 28567 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.666028 28453 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:09.666982 28074 raft_consensus.cc:3055] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:09.667470 28074 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:09.667198 28453 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:09.668292 28244 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:09.668433 28074 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:09.669324 28244 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:09.669826 28074 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:09.670665 23817 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:09.671058 28505 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:09.671672 28505 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:09.672140 28127 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:09.672614 28127 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:09.673008 28127 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:09.644730 28511 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:09.673997 28577 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:09.674847 28495 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:09.640326 28559 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:09.675603 28465 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:09.676187 28465 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:09.661170 28246 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:09.676558 28559 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:09.677078 28465 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.637910 28571 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:09.685627 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.687664 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.687785 23928 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:09.693674 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.694430 23921 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:22:09.688306 23927 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:22:09.694586 23928 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:09.695227 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.688483 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.695927 23929 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:09.697134 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.697192 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.697832 23921 raft_consensus.cc:2368] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:22:09.698056 23929 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:09.695858 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.698701 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.698997 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.690723 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:09.692924 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.699769 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.700582 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.701152 23926 raft_consensus.cc:2376] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11. Re-sending same reply.
I20260709 12:22:09.695423 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.700944 23928 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.702409 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.696026 23922 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 13: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:09.705582 23926 raft_consensus.cc:2393] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:09.690604 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.708256 23924 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:09.694383 23920 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:09.691886 28430 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:09.710592 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.712030 28246 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:09.713065 28074 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.713670 28074 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.716914 28074 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:09.716838 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:09.709861 28430 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:09.719266 28430 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:09.720475 28430 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:09.680397 28491 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:22:09.726604 23927 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:09.731145 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:09.734238 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.736687 28532 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:09.739610 28577 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:09.740051 28577 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:09.740453 28577 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:09.745309 28586 log.cc:927] Time spent T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:22:09.727679 28508 raft_consensus.cc:2764] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:22:09.759096 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.642222 28509 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:09.737812 28246 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:09.692189 28412 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:22:09.737193 28532 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:09.729023 28526 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:22:09.777114 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.781644 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.782289 23925 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:09.783951 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.778064 23928 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:09.787350 23923 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:09.843086 23929 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
W20260709 12:22:09.868629 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 219867us
I20260709 12:22:09.779644 28532 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:09.869453 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 98989.9us
I20260709 12:22:09.870052 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.872036 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:09.769851 28344 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:22:09.877673 23966 leader_election.cc:400] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:22:09.878603 24562 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:09.880822 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:09.885677 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:09.878913 28567 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:09.889596 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 245296us
I20260709 12:22:09.868044 28246 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:22:09.928861 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:09.931707 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:09.933944 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.935966 23926 raft_consensus.cc:2410] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
W20260709 12:22:09.942561 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 61248.1us
I20260709 12:22:09.944613 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:09.953733 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:09.954771 24562 raft_consensus.cc:2410] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:22:09.956825 28526 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:09.960072 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:09.960875 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.931623 28571 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:09.963011 28526 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:09.938323 28611 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:09.985425 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:09.986163 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:09.965646 28567 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:09.960755 28344 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:09.991365 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:10.000677 23817 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:10.000874 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:09.982410 28466 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.012336 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:09.982048 28596 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:09.976673 28611 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:10.005462 27996 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:10.070365 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:09.998981 28495 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:10.005304 28231 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 12:22:10.080775 28605 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 12:22:10.081703 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2477) took 1039 ms. Trace:
I20260709 12:22:10.082115 28509 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:10.083683 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:10.011268 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:10.002070 28567 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:10.005565 28537 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:10.010015 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:10.048825 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.111109 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:10.054670 28246 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:10.088510 23847 rpcz_store.cc:276] 0709 12:22:09.042257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.544876 (+502619us) service_pool.cc:224] Handling call
0709 12:22:09.558091 (+ 13215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:09.558470 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.558517 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:09.565726 (+  7209us) log.cc:844] Serialized 26 byte log entry
0709 12:22:09.775605 (+209879us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:09.861421 (+ 85816us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.861712 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.861814 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.081429 (+219615us) raft_consensus.cc:1685] finished
0709 12:22:10.081460 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.081627 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":87613,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":2326,"raft.queue_time_us":7173,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":7130,"thread_start_us":147788,"threads_started":1,"wal-append.queue_time_us":480775}
I20260709 12:22:10.087131 28495 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:10.115003 24000 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:10.006636 28127 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.121152 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:10.122872 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:10.104976 27996 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:10.132421 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 203654us
I20260709 12:22:10.112269 28505 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.086541 28466 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.137591 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.083674 28596 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:10.145134 23847 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:10.119709 28495 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:10.115363 28537 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.148593 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:10.130102 28615 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:10.132012 28344 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:10.158249 24562 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:10.136255 28246 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:10.168479 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:10.169449 24557 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:10.170291 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:10.172649 24554 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:10.178841 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:10.181190 28267 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.181813 28267 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.184021 28267 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:10.175333 28537 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.188287 28537 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:10.157728 28509 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.189816 28509 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.136265 27996 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.191146 28246 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:10.192004 28509 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:10.193517 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:10.194262 24563 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:10.174559 28526 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:10.196614 23895 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:10.154834 28596 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:10.207629 28127 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:10.208469 28268 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:10.199460 28621 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:22:10.147214 28505 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.192049 27996 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:10.200677 28509 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:10.224124 23846 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:22:10.134409 28611 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.226702 23846 pending_rounds.cc:85] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 7
I20260709 12:22:10.188408 28495 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.227818 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.234678 23846 pending_rounds.cc:107] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:22:10.235162 23846 raft_consensus.cc:2889] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:10.236544 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:10.229089 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:10.237841 23852 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:10.240429 23845 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:10.242450 23848 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:10.242741 23851 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:10.246706 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:10.248378 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:10.248709 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 1001) took 1058 ms. Trace:
I20260709 12:22:10.248970 23849 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:10.243156 23820 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:10.252315 23847 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:10.252987 23820 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:10.249087 24556 rpcz_store.cc:276] 0709 12:22:09.190646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.191308 (+   662us) service_pool.cc:224] Handling call
0709 12:22:09.191653 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.191873 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:09.213022 (+ 21149us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.248292 (+1035270us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b1800427cc0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287
0709 12:22:10.248386 (+    94us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.248440 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:10.248485 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.248545 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.248655 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21056,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":50,"raft.queue_time_us":12533,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5423,"spinlock_wait_cycles":6975872,"thread_start_us":34579,"threads_started":2}
I20260709 12:22:10.260275 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:10.226367 28509 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.261468 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:10.268211 24554 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:22:10.265981 23852 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:10.270318 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.271580 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.272738 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.273775 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:10.274603 23852 raft_consensus.cc:2368] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15.
W20260709 12:22:10.275380 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:10.280233 23892 leader_election.cc:336] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 1.526s (SENT)
I20260709 12:22:10.280630 23820 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:10.281584 28506 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:10.282004 28506 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.282371 28506 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:10.250963 28612 consensus_queue.cc:1175] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" responder_term: 12 status { last_received { term: 11 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:10.260311 28537 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:10.283411 28537 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.283788 28537 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:10.274165 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:10.285857 24563 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:22:10.286221 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.287421 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.287969 23847 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:22:10.288774 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.290604 23820 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:10.291337 28272 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:10.291700 28272 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.292021 28272 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:10.292862 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.197463 28567 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.294600 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:10.294816 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.297999 23926 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:10.246019 27996 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.306360 23849 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:10.300949 23846 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:10.302088 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.302691 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:10.303519 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:10.303647 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.304746 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.305112 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:10.310101 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.311261 23851 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 14: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:10.307912 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.312530 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:10.315037 23845 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:10.307809 28231 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:10.316609 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.316800 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.317436 23922 raft_consensus.cc:2368] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:22:10.317720 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.320456 28587 consensus_queue.cc:1059] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:10.331734 28506 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.334332 28537 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.335786 28505 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:10.337575 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.267587 28611 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:10.300386 28509 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:10.341053 23850 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 17: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:10.363713 23929 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:22:10.365639 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 50197.2us
I20260709 12:22:10.373364 28613 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:10.374269 23849 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:22:10.374289 23851 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:22:10.387701 23892 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:10.359252 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 182938us
I20260709 12:22:10.305596 28344 raft_consensus.cc:697] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:10.382123 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 186986us
I20260709 12:22:10.370347 28537 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:10.432348 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 70812us
I20260709 12:22:10.308972 27996 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.437263 23849 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:10.398804 28613 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:10.423395 28577 consensus_meta.cc:287] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.004s
W20260709 12:22:10.431380 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.440872 23996 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:10.374001 28532 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:10.451126 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 63493.6us
I20260709 12:22:10.456108 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:10.456599 23847 raft_consensus.cc:2410] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:22:10.443905 28613 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:10.439805 28466 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:10.467505 24003 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:10.469960 23849 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:22:10.445474 28267 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.446213 28551 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:10.445094 28526 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:10.478580 23892 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:10.445704 28577 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:10.488900 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 181712us
I20260709 12:22:10.473038 28491 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:10.477429 28537 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.477778 28495 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:10.491313 28244 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:10.485762 28592 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:10.478716 28267 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.522533 28587 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:10.525146 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:10.525920 28639 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:10.526163 28526 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.511456 28244 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.502854 28453 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:10.502579 28505 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:10.553237 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:10.484084 28344 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.553318 28505 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.499814 28537 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.541285 28491 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:10.560931 28577 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:10.561966 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:22:10.563419 28625 log.cc:927] Time spent T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:22:10.547509 28639 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:10.581432 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.566975 28592 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:10.590031 23892 leader_election.cc:400] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15.
I20260709 12:22:10.541147 28587 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.593346 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.576488 28551 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:10.592021 28636 log.cc:927] Time spent T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:22:10.602037 23927 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:10.637686 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.556447 28453 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.638314 28587 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:10.638453 23927 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:10.639421 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:10.640015 28453 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:10.640136 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:10.640527 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.640985 23847 raft_consensus.cc:2410] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:22:10.641167 23927 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:10.647815 23850 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 12:22:10.627449 28641 log.cc:927] Time spent T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:10.629107 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:10.652911 23847 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:10.630692 28244 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:10.631013 28537 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:10.631646 28272 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.631760 28509 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:10.633589 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 43752.9us
I20260709 12:22:10.635478 28267 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:10.635854 28596 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.664151 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:10.664925 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:10.679901 23892 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:10.665910 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:10.666975 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:10.682014 23997 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:10.660563 23817 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:10.683226 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:10.683359 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 260110us
I20260709 12:22:10.683902 24002 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 6.
I20260709 12:22:10.685755 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:10.685909 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:10.687853 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:10.692044 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:10.693081 23997 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:22:10.686486 24000 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:22:10.688717 24001 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:22:10.692174 23817 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:10.625133 27996 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:10.674618 28633 log.cc:927] Time spent T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:22:10.701936 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:10.702819 24001 raft_consensus.cc:2410] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:10.710121 28150 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:22:10.710819 28634 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:22:10.710595 28629 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:10.711400 28629 consensus_queue.cc:1243] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer 22996f888daf435398b693481171c18c log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:10.713176 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:10.713932 28627 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:10.715763 28627 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:10.716060 28412 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:10.716646 28412 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:10.719205 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:10.719643 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:10.721139 28629 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:10.721623 28629 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:10.723032 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.722596 28629 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:10.725313 28638 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:22:10.661214 28453 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:10.728086 24004 raft_consensus.cc:2410] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:22:10.727599 24525 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:10.733560 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53768.2us
I20260709 12:22:10.735057 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:10.735723 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:10.735796 24525 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:10.733422 23921 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 17: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:10.740290 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:10.742453 28491 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:10.752686 23997 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:22:10.701160 28551 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:10.699186 28577 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:10.706418 28267 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:10.740815 28473 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.761144 28150 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:10.740643 28495 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:10.759629 28491 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:22:10.752046 28537 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:10.754503 28592 consensus_queue.cc:1059] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:22:10.774058 28495 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.777724 28495 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:10.777813 28592 raft_consensus.cc:3055] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:10.778345 28592 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:10.740237 28635 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:10.738679 28511 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:10.779299 28613 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.779299 28592 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.777052 28537 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.781945 28537 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:10.717537 28412 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.770079 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:10.785992 28592 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:10.786810 28596 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:10.789595 28643 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.165s	user 0.003s	sys 0.000s
I20260709 12:22:10.790493 28623 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.791580 28601 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:10.781596 28613 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:10.762210 28267 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.800805 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.800868 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.816279 23927 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:10.762785 28627 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.800050 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:10.745045 28453 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.822495 28595 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:10.823096 28639 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:10.776964 28654 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:10.825139 23922 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:10.765693 28577 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.824263 28267 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:10.854472 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 134348us
I20260709 12:22:10.793193 28150 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.776017 28473 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.841666 28491 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:10.852119 28505 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:10.871508 23997 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:10.873817 23997 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:10.899552 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:10.812836 28623 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.830410 28627 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:10.823192 28595 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.869570 28509 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:10.905445 28613 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:10.921680 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:10.961030 23997 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
W20260709 12:22:10.971987 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.907738 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:10.943866 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.980098 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:10.908295 28272 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:10.981099 23818 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:10.841991 28654 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:10.998621 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 90922.5us
I20260709 12:22:11.007551 23966 leader_election.cc:400] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:22:11.009680 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:10.871572 28491 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:10.906018 28611 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:22:11.017727 28656 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.022550 28639 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:10.964668 28537 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.031265 28665 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:11.045706 28552 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:11.039261 28272 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:11.058601 28626 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:11.095288 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 63136.7us
I20260709 12:22:11.059248 28613 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:22:11.117461 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 100384us
I20260709 12:22:11.119253 23818 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:11.097462 28272 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.102685 28635 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:11.131626 28473 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.131553 28657 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:22:11.137647 28571 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:11.138929 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2362) took 1517 ms. Trace:
I20260709 12:22:11.140134 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 550) took 1121 ms. Trace:
I20260709 12:22:11.140501 24003 rpcz_store.cc:276] 0709 12:22:10.018972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.019174 (+   202us) service_pool.cc:224] Handling call
0709 12:22:10.019646 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.468097 (+448451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.139925 (+671828us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b5400410fd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:11.140081 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029432192}
I20260709 12:22:11.141731 28571 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:11.146378 28268 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:11.104701 28453 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:11.107817 28552 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.170493 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:11.171733 23848 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 17: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:11.160262 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:11.172845 23924 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:11.173120 23929 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:11.163625 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:11.164417 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:11.164885 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:11.178536 23926 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:11.112596 28505 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:11.179576 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:11.179654 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:11.182590 23929 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:11.183207 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.188151 23848 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:11.167929 28526 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:11.188992 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.173449 23924 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:11.183696 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:11.139336 23996 rpcz_store.cc:276] 0709 12:22:09.621309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.621424 (+   115us) service_pool.cc:224] Handling call
0709 12:22:09.621681 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.445719 (+824038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.138717 (+692998us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54002477d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:11.138875 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883556224}
I20260709 12:22:11.124300 28150 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:11.125366 28577 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:11.069435 28656 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.192929 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.227032 23848 raft_consensus.cc:2368] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:22:11.185444 28453 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.228164 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:11.231834 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 48220.5us
I20260709 12:22:11.110049 28626 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:11.238656 28659 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:22:11.222389 28526 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.242049 28526 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:11.219110 28629 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:11.242867 28629 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.245458 28629 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.222630 28473 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:11.248631 28473 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.249372 28453 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.250980 28473 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.251523 28453 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.254887 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.255636 23850 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:11.256568 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:11.257289 23850 raft_consensus.cc:2393] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:11.263538 28595 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.263952 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:11.264545 23847 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:11.217566 28505 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.265511 23848 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:22:11.185678 28552 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.269672 28654 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.267760 23927 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:11.272738 28495 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.287094 23847 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:22:11.290395 23927 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:11.172910 28571 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:22:11.278120 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.303251 23850 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:11.289288 23924 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.305302 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:11.306116 23924 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:11.185007 28662 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 12:22:11.288254 28623 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.313218 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:11.304639 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.173146 28635 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.319420 28658 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:11.320073 28658 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.321346 28635 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:11.302733 28654 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.316720 23850 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:11.325026 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:11.298448 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 167084us
I20260709 12:22:11.328068 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.317946 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.304639 28670 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:11.331298 28670 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.329192 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:11.331671 28670 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:11.334010 23847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23e8987a07704ea192b04366772512e7"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:11.334841 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:11.335505 23847 raft_consensus.cc:606] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:11.337574 23847 raft_consensus.cc:614] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:11.340438 28658 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.337576 28623 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:11.346990 28618 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:11.347549 28618 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:11.348482 28618 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.349632 24002 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:11.350917 23997 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:11.351265 24002 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:22:11.352170 23997 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:11.354720 24000 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:11.358526 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.362062 23818 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:11.363497 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:11.365466 24004 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:11.363822 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:11.382166 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.384374 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:11.367141 23818 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:11.392764 28495 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.383318 28675 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:11.393855 28675 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:11.359301 28506 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.396112 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:11.404562 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 112909us
I20260709 12:22:11.332993 28654 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.410394 23966 leader_election.cc:400] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:22:11.410799 23966 leader_election.cc:403] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:11.364593 28613 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:11.370965 28658 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:11.369412 28526 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:11.413848 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 46804.9us
I20260709 12:22:11.419538 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:11.422008 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.422857 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:11.407747 28665 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:11.427788 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:11.429111 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:11.419529 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:11.430584 28615 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:11.431219 28615 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:11.432780 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.433116 28508 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.419675 28658 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.433758 28244 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:11.433804 28508 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.432957 28660 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:11.435467 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:11.436128 23928 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:11.434540 28658 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:11.444278 23818 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:11.437343 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:11.438601 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:11.423928 28571 raft_consensus.cc:3055] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:11.414119 28611 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:11.456045 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.456890 23851 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:11.462075 28453 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:11.417927 28554 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.425359 28150 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 7. Current term is 8.
I20260709 12:22:11.447593 28571 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:11.436555 28508 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.424623 28526 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.483824 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 2235) took 1184 ms. Trace:
I20260709 12:22:11.483240 28571 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.484277 23921 rpcz_store.cc:276] 0709 12:22:10.299399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.299507 (+   108us) service_pool.cc:224] Handling call
0709 12:22:11.483606 (+1184099us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400329454. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:11.483766 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965033728}
I20260709 12:22:11.485021 28571 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:11.418853 28613 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.432310 28615 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.444012 28662 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:11.480162 23892 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:11.438067 28491 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.436998 28672 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:11.509840 28637 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:11.510600 28637 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.506016 28662 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:11.511937 28662 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:11.512935 28690 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:11.437832 28344 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:11.479568 28689 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.492026 23851 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:22:11.513010 28637 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.427369 28665 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:11.517546 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.477686 28611 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:11.485532 28526 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.513715 28690 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:11.523077 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 85840.8us
I20260709 12:22:11.489280 28613 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:11.528043 28508 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:11.529812 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2231) took 1258 ms. Trace:
W20260709 12:22:11.530913 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 50835.3us
I20260709 12:22:11.506268 28656 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.530308 23846 rpcz_store.cc:276] 0709 12:22:10.271732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.315767 (+ 44035us) service_pool.cc:224] Handling call
0709 12:22:10.356869 (+ 41102us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:10.426550 (+ 69681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.426588 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:10.433753 (+  7165us) log.cc:844] Serialized 52 byte log entry
0709 12:22:10.556779 (+123026us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:10.670971 (+114192us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.685764 (+ 14793us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.685972 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.686040 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:11.464765 (+778725us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b18003c1000. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:22:11.529563 (+ 64798us) raft_consensus.cc:1685] finished
0709 12:22:11.529587 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.529747 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39783,"prepare.queue_time_us":278368,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":88046,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":5639,"spinlock_wait_cycles":25644160,"thread_start_us":185118,"threads_started":2,"wal-append.queue_time_us":250039}
I20260709 12:22:11.565313 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.566283 23846 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:11.537026 28667 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:11.537412 28592 consensus_meta.cc:287] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.003s
I20260709 12:22:11.542754 28688 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.523674 28665 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:11.524048 28689 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.531834 28344 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:11.546854 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:11.579672 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:11.548645 23928 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:22:11.550177 28597 log.cc:927] Time spent T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Append to log took a long time: real 1.679s	user 0.013s	sys 0.006s
I20260709 12:22:11.567749 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.582034 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:11.571395 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:11.574278 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 79708.2us
I20260709 12:22:11.580503 23928 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:11.523007 23924 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:11.585348 28505 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.578266 28688 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.572839 28667 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:11.592990 23892 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:11.611393 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:11.594533 28690 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:11.599861 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 75839.4us
I20260709 12:22:11.601703 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:11.615171 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:11.619619 23846 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:11.615782 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2411) took 1305 ms. Trace:
I20260709 12:22:11.620685 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2401) took 1319 ms. Trace:
I20260709 12:22:11.620882 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2245) took 1331 ms. Trace:
I20260709 12:22:11.621542 23846 rpcz_store.cc:276] 0709 12:22:10.289055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.619005 (+1329950us) service_pool.cc:224] Handling call
0709 12:22:11.619382 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.620454 (+  1072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.620823 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:11.616604 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:11.621307 23923 rpcz_store.cc:276] 0709 12:22:10.300915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.301036 (+   121us) service_pool.cc:224] Handling call
0709 12:22:11.601493 (+1300457us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:22:11.620625 (+ 19132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43381120}
I20260709 12:22:11.628892 23852 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:22:11.621845 23928 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.629674 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2232) took 1357 ms. Trace:
I20260709 12:22:11.630048 23852 rpcz_store.cc:276] 0709 12:22:10.272118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.337177 (+ 65059us) service_pool.cc:224] Handling call
0709 12:22:11.628484 (+1291307us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b5800003398. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:22:11.628675 (+   191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:11.629405 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.629620 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3430144}
I20260709 12:22:11.630576 28670 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.632889 28670 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.634331 23850 raft_consensus.cc:2393] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 17: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:11.635437 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.610775 28526 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:11.613018 28667 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:11.642877 23928 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:11.623634 28559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.747s	user 0.006s	sys 0.002s
I20260709 12:22:11.620772 23920 rpcz_store.cc:276] 0709 12:22:10.307207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.334299 (+ 27092us) service_pool.cc:224] Handling call
0709 12:22:11.488124 (+1153825us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c425fc0 00007fa28c410929 00007fa28c4103d2 00007fa285987bd4
0709 12:22:11.488351 (+   227us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:11.529539 (+ 41188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.529571 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:11.530270 (+   699us) log.cc:844] Serialized 52 byte log entry
0709 12:22:11.577221 (+ 46951us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:11.577266 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.577367 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:11.577655 (+   288us) raft_consensus.cc:1685] finished
0709 12:22:11.577677 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.609995 (+ 32318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36700,"raft.queue_time_us":42054,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7868,"spinlock_wait_cycles":16206080,"thread_start_us":46470,"threads_started":1,"wal-append.queue_time_us":45310}
I20260709 12:22:11.621519 28601 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:11.671424 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2246) took 1382 ms. Trace:
I20260709 12:22:11.684892 23846 rpcz_store.cc:276] 0709 12:22:10.289315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.625603 (+1336288us) service_pool.cc:224] Handling call
0709 12:22:11.670739 (+ 45136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.671000 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.671039 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:11.671099 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:11.671153 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.671229 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.671351 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:11.671823 28571 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:11.694159 28571 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.696587 28571 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:11.643941 28397 consensus_queue.cc:1175] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" responder_term: 10 status { last_received { term: 10 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:11.671805 28530 raft_consensus.cc:476] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 12:22:11.699136 28688 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.626533 28615 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:11.682129 28683 log.cc:927] Time spent T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.264s	user 0.002s	sys 0.001s
I20260709 12:22:11.644299 28526 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:11.719558 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:11.720651 23999 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:11.726686 28681 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:22:11.729347 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2476) took 2701 ms. Trace:
I20260709 12:22:11.729977 23854 rpcz_store.cc:276] 0709 12:22:09.027604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.488450 (+460846us) service_pool.cc:224] Handling call
0709 12:22:09.504585 (+ 16135us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:09.510857 (+  6272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.510902 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:09.520662 (+  9760us) log.cc:844] Serialized 52 byte log entry
0709 12:22:09.698614 (+177952us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:09.698653 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.698714 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:11.549308 (+1850594us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:22:11.719519 (+170211us) raft_consensus.cc:1685] finished
0709 12:22:11.719539 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.729221 (+  9682us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12410,"raft.queue_time_us":6395,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":11574,"spinlock_wait_cycles":12726016,"thread_start_us":149182,"threads_started":1,"wal-append.queue_time_us":220190}
I20260709 12:22:11.733072 23854 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:11.674039 28601 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.734073 28647 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:11.625298 28150 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:22:11.682258 28246 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.734321 28601 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:11.681090 28559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.805s	user 0.011s	sys 0.002s
I20260709 12:22:11.684913 28637 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:11.738082 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2488) took 1003 ms. Trace:
I20260709 12:22:11.756024 23854 rpcz_store.cc:276] 0709 12:22:10.730708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.732342 (+1001634us) service_pool.cc:224] Handling call
0709 12:22:11.732820 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.733616 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.733849 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:11.739300 23928 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:11.740144 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:11.700199 28552 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.760313 28694 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:11.761032 28694 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:11.761528 28694 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:11.768481 23854 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:11.769456 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2491) took 1037 ms. Trace:
I20260709 12:22:11.769909 23854 rpcz_store.cc:276] 0709 12:22:10.731557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.757015 (+1025458us) service_pool.cc:224] Handling call
0709 12:22:11.757449 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.769119 (+ 11670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.769380 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:11.781384 28689 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.684026 28430 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:22:11.735294 28526 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:11.699909 28344 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.756070 28246 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.803969 28246 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.818189 28689 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:11.818907 28689 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.821326 28689 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:11.825076 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 151639us
W20260709 12:22:11.825549 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.735235 28673 consensus_queue.cc:1059] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 12:22:11.794400 28637 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:11.864588 28267 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.001s	user 0.007s	sys 0.011s
I20260709 12:22:11.818291 28662 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:11.876461 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.878933 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:11.879602 23925 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:11.880206 23925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2402) took 1578 ms. Trace:
I20260709 12:22:11.880530 23925 rpcz_store.cc:276] 0709 12:22:10.301317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.301458 (+   141us) service_pool.cc:224] Handling call
0709 12:22:11.878779 (+1577321us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b58001f4a98. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:22:11.880148 (+  1369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44095744}
I20260709 12:22:11.871153 28537 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.851509 28665 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.883631 23998 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:11.898998 28650 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 1.037s	user 0.000s	sys 0.003s
I20260709 12:22:11.900758 28601 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.901178 28665 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:11.899096 28637 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.884681 28658 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.919973 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:11.935786 23927 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:22:11.936375 28618 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:11.916051 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:11.937191 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:11.938328 24001 raft_consensus.cc:2393] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:11.919581 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:11.925762 23848 pending_rounds.cc:85] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 9
I20260709 12:22:11.915306 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:11.912577 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2244) took 1623 ms. Trace:
I20260709 12:22:11.940371 23848 pending_rounds.cc:107] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:22:11.940817 23848 raft_consensus.cc:2889] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:11.930359 28653 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 1.061s	user 0.000s	sys 0.003s
I20260709 12:22:11.940733 23851 rpcz_store.cc:276] 0709 12:22:10.288778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.457606 (+1168828us) service_pool.cc:224] Handling call
0709 12:22:11.470051 (+ 12445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:11.522838 (+ 52787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.912181 (+389343us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b54001f31d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:11.912498 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49752960}
I20260709 12:22:11.927696 28532 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.951125 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:11.956146 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:11.903147 28272 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.877002 28267 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.931166 28551 raft_consensus.cc:3055] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:11.963503 23846 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:11.914067 28150 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:11.904506 28626 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.966478 28637 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:11.964844 28551 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:11.987208 28551 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:11.988979 28551 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:11.935153 28694 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:11.994439 28694 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.998327 23854 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:22:11.999392 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:12.000058 23996 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:11.955976 28601 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.934350 28627 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:11.926703 28662 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:11.966264 24558 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:12.005538 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:11.967828 28658 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:12.026964 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.046674 24555 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:22:12.028177 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.006882 28577 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:12.050702 28577 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.054855 24524 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.055378 28267 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:11.983210 28150 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.056072 28635 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:12.058552 28150 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:12.059109 24524 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.060110 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:12.060917 24559 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:12.061278 28465 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:12.061996 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:12.062915 28511 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:12.063287 28511 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.063619 28511 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:12.010517 28637 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.035266 24556 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:12.067001 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:12.036916 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.067898 28635 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:12.039003 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:12.068104 28637 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:12.068683 24560 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:12.071331 28511 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.073418 28511 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:12.029511 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.074784 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.075870 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.076857 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.048667 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.077410 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2250) took 1762 ms. Trace:
I20260709 12:22:12.077783 24561 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:12.078692 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.079609 28673 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:12.079756 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:12.080040 28673 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:12.080874 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.080984 28673 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:12.081593 24561 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 13: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:12.048748 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.082621 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:12.083159 24557 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:12.083966 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.085523 28701 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:12.085915 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2249) took 1771 ms. Trace:
I20260709 12:22:12.086108 28701 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:12.086681 23852 rpcz_store.cc:276] 0709 12:22:10.314261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.631030 (+1316769us) service_pool.cc:224] Handling call
0709 12:22:11.928806 (+297776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.929021 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.929045 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:11.929108 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:11.929139 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.929209 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.085679 (+156470us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54001e50d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:12.085821 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684042496}
I20260709 12:22:12.088394 28701 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:12.089020 23852 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:22:12.091681 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:12.093325 28502 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:12.093732 28502 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.094666 28502 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:12.095708 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.077788 23846 rpcz_store.cc:276] 0709 12:22:10.314554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.688561 (+1374007us) service_pool.cc:224] Handling call
0709 12:22:11.721141 (+ 32580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.969307 (+248166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.077206 (+107899us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400429ad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:12.077356 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556791040}
W20260709 12:22:12.102485 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.103144 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.103778 28673 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:12.103241 23846 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:12.105634 24556 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 15: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:12.105798 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2497) took 1367 ms. Trace:
I20260709 12:22:12.077426 24554 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:12.106200 23846 rpcz_store.cc:276] 0709 12:22:10.738476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.097306 (+1358830us) service_pool.cc:224] Handling call
0709 12:22:12.097652 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.105545 (+  7893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.105744 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.106823 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.107420 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:12.116343 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.107667 24555 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:22:12.120466 24560 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:22:12.122210 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2496) took 1384 ms. Trace:
I20260709 12:22:12.128108 23852 rpcz_store.cc:276] 0709 12:22:10.738181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.088242 (+1350061us) service_pool.cc:224] Handling call
0709 12:22:12.088674 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:12.089579 (+   905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.089859 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.130210 23852 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:12.131054 24557 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:22:12.123670 23996 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:12.125015 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.125322 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.073161 28667 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:12.133708 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2252) took 1354 ms. Trace:
I20260709 12:22:12.093514 28654 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:12.046370 28694 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.138264 23846 pending_rounds.cc:85] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 5
I20260709 12:22:12.149344 23846 pending_rounds.cc:107] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:22:12.146278 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:12.136998 23852 rpcz_store.cc:276] 0709 12:22:10.776933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.129161 (+1352228us) service_pool.cc:224] Handling call
0709 12:22:12.129500 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.131316 (+  1816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.131589 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.149740 23846 raft_consensus.cc:2889] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:12.151408 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.151901 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.152735 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:12.137660 28587 consensus_queue.cc:1059] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:22:12.160707 24561 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:12.162302 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:12.163470 23895 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:12.165496 23929 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:12.165385 24559 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:12.166364 23895 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:12.168310 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.133286 28577 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:12.169006 23925 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:12.169466 23895 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:12.171893 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:12.173370 23924 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:12.137194 28526 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.183053 24003 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:12.168210 28502 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.191161 23925 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:12.168471 28608 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:12.148789 28631 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:22:12.202633 23895 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:12.210165 23924 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:12.168335 28708 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:12.174887 28689 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:12.177232 28592 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:12.219676 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.190392 28465 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:12.160288 28694 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.177513 28601 consensus_queue.cc:1059] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:22:12.215842 28430 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:12.218789 28473 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:12.278167 28473 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:12.278717 28473 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:12.279328 28502 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:12.231112 28708 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.280463 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:12.281319 23929 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 15: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:22:12.256958 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.177409 28685 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:22:12.282125 28708 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:12.283228 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:12.291901 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.269790 28465 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:12.273684 28694 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:12.218714 28608 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:12.299139 23924 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:12.295181 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.300760 23929 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:12.307888 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2492) took 1576 ms. Trace:
I20260709 12:22:12.312398 23854 rpcz_store.cc:276] 0709 12:22:10.731859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.770849 (+1038990us) service_pool.cc:224] Handling call
0709 12:22:11.998056 (+227207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:11.998843 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.307596 (+308753us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54002d46d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:12.307801 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521406336}
I20260709 12:22:12.291891 28662 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:12.325428 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:12.298857 28430 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:12.353489 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.357497 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.364301 24557 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:12.357396 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:12.356835 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:12.354771 28405 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:12.383162 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 79528.2us
I20260709 12:22:12.388074 23969 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.389473 28672 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:12.390159 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:12.391515 28715 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:22:12.391988 28344 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:12.392524 28344 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:12.392652 28718 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:22:12.392987 28344 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.386394 24559 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:22:12.398715 23969 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:12.399858 28628 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:12.400367 28628 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:12.400818 28628 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.369599 28601 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.402403 28601 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:12.363957 28577 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:12.417204 23969 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.437122 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:12.447290 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2243) took 2158 ms. Trace:
I20260709 12:22:12.448734 23847 rpcz_store.cc:276] 0709 12:22:10.288471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.372028 (+1083557us) service_pool.cc:224] Handling call
0709 12:22:11.372403 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:11.372629 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.372658 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:11.373236 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.432723 (+ 59487us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:11.442408 (+  9685us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.446485 (+1004077us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b1800295ba0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa284361a40 00007fa28435c4e4 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287 00007fa287467208
0709 12:22:12.446743 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.446851 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.446916 (+    65us) raft_consensus.cc:1685] finished
0709 12:22:12.447025 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.447210 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":489,"prepare.queue_time_us":5802,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"spinlock_wait_cycles":4271872,"thread_start_us":19890,"threads_started":1,"wal-append.queue_time_us":117178}
I20260709 12:22:12.368428 28465 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.452538 23928 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:12.452684 28344 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.354843 28662 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:12.457669 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 1.01339e+06us
W20260709 12:22:12.434882 28714 log.cc:927] Time spent T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:22:12.433029 28631 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:12.465521 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:12.445653 28667 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:12.445807 28526 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:12.487390 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:12.488942 24560 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.489795 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2487) took 1760 ms. Trace:
I20260709 12:22:12.490200 23845 rpcz_store.cc:276] 0709 12:22:10.729794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.696164 (+966370us) service_pool.cc:224] Handling call
0709 12:22:11.696525 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.489406 (+792881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.489436 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.489478 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:12.489509 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.489568 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.489739 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":792500}
W20260709 12:22:12.492010 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 631535us
I20260709 12:22:12.457022 28687 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:12.497360 23845 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:12.498445 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2505) took 1325 ms. Trace:
I20260709 12:22:12.498703 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2483) took 2273 ms. Trace:
I20260709 12:22:12.498767 23845 rpcz_store.cc:276] 0709 12:22:11.173419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.492132 (+1318713us) service_pool.cc:224] Handling call
0709 12:22:12.497194 (+  5062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.498208 (+  1014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.498391 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.499234 24560 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:12.463723 28231 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:12.464561 28344 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:12.503130 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:12.503618 23845 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:12.418807 28405 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:12.505182 23892 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:12.508796 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2507) took 1223 ms. Trace:
I20260709 12:22:12.512490 23845 rpcz_store.cc:276] 0709 12:22:11.285369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.500328 (+1214959us) service_pool.cc:224] Handling call
0709 12:22:12.503264 (+  2936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.508479 (+  5215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.508722 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.513298 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.513666 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:12.514981 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.516796 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.517838 23929 raft_consensus.cc:2393] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 16: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:12.459225 28603 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:22:12.518927 23845 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:12.499408 23853 rpcz_store.cc:276] 0709 12:22:10.225722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.225856 (+   134us) service_pool.cc:224] Handling call
0709 12:22:10.226250 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.239515 (+ 13265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.239552 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.251668 (+ 12116us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.600902 (+1349234us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b18004466e0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec0d1 00007fa287407a0f
0709 12:22:11.747965 (+147063us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:11.748275 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.489616 (+741341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.489716 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.489774 (+    58us) raft_consensus.cc:1685] finished
0709 12:22:12.498442 (+  8668us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.498629 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":753863,"prepare.queue_time_us":6541,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":762012,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":8555,"spinlock_wait_cycles":22844672,"thread_start_us":146824,"threads_started":1,"wal-append.queue_time_us":1608648}
I20260709 12:22:12.466503 28473 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.522660 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:12.523042 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:12.527784 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2259) took 1103 ms. Trace:
I20260709 12:22:12.497275 28554 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.529956 23845 rpcz_store.cc:276] 0709 12:22:11.427151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.513442 (+1086291us) service_pool.cc:224] Handling call
0709 12:22:12.518748 (+  5306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.526951 (+  8203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.527725 (+   774us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.530654 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:12.532881 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.532941 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.533576 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.531985 23927 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 15: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:12.497932 28631 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:12.534382 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:12.535203 23929 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:22:12.540753 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:12.536610 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.539222 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.539302 23853 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:12.542173 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2509) took 1063 ms. Trace:
I20260709 12:22:12.542438 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2510) took 1063 ms. Trace:
I20260709 12:22:12.543174 23845 rpcz_store.cc:276] 0709 12:22:11.479084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.532671 (+1053587us) service_pool.cc:224] Handling call
0709 12:22:12.540469 (+  7798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.540642 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.540670 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.540714 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:12.540751 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.540810 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.542369 (+  1559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.542549 23853 rpcz_store.cc:276] 0709 12:22:11.478776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.527183 (+1048407us) service_pool.cc:224] Handling call
0709 12:22:12.527504 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.541912 (+ 14408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.542109 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.546371 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2238) took 2272 ms. Trace:
I20260709 12:22:12.548709 23925 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 12: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:12.550901 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.547014 23849 rpcz_store.cc:276] 0709 12:22:10.273838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.480499 (+206661us) service_pool.cc:224] Handling call
0709 12:22:10.490951 (+ 10452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.497313 (+  6362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.497362 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.497975 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.891457 (+1393482us) spinlock_profiling.cc:243] Waited 9.03 ms on lock 0x7b18003e60e0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec0d1 00007fa287407a0f
0709 12:22:11.970804 (+ 79347us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:12.045717 (+ 74913us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.535441 (+489724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.535593 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.535656 (+    63us) raft_consensus.cc:1685] finished
0709 12:22:12.546111 (+ 10455us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.546299 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":489340,"prepare.queue_time_us":44820,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":500001,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":24212,"spinlock_wait_cycles":20761472,"thread_start_us":79191,"threads_started":1,"wal-append.queue_time_us":1472868}
I20260709 12:22:12.553851 23845 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:12.554553 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2511) took 1075 ms. Trace:
W20260709 12:22:12.552796 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 94396.5us
I20260709 12:22:12.554898 23845 rpcz_store.cc:276] 0709 12:22:11.479358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.548502 (+1069144us) service_pool.cc:224] Handling call
0709 12:22:12.553529 (+  5027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.554331 (+   802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.554503 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.492282 28430 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.568109 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.574072 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:12.574950 24001 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:12.527830 28612 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:12.573546 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.579954 23997 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:12.528091 28549 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:12.583065 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.584947 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.587594 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2262) took 1050 ms. Trace:
I20260709 12:22:12.588310 23849 rpcz_store.cc:276] 0709 12:22:11.537503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.553976 (+1016473us) service_pool.cc:224] Handling call
0709 12:22:12.587072 (+ 33096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.587256 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.587284 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.587326 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:12.587361 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.587422 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.587536 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.590518 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.506916 28628 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.539958 28601 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:12.598383 23999 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:12.545923 28548 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:22:12.595520 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:12.604974 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2495) took 1872 ms. Trace:
I20260709 12:22:12.605562 23850 rpcz_store.cc:276] 0709 12:22:10.732634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.995097 (+1262463us) service_pool.cc:224] Handling call
0709 12:22:11.995448 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.995696 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:12.191600 (+195904us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.604505 (+412905us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.604581 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:12.604657 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.604750 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.604895 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269783,"prepare.queue_time_us":29863,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"thread_start_us":328848,"threads_started":2,"wal-append.queue_time_us":334936}
I20260709 12:22:12.609127 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.611897 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.615978 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.568063 28690 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.583454 28608 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:12.593334 28656 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.619164 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:12.619766 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.596272 28706 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:22:12.640185 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.579072 28708 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:12.596571 28687 raft_consensus.cc:697] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:12.537838 28509 consensus_queue.cc:1059] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:22:12.554858 28554 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.637125 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.638065 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:12.626179 24001 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:12.643078 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:12.599131 28612 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:12.593219 28626 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:12.647531 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:12.652822 28626 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:12.653811 28724 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:22:12.645572 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.647061 28708 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:12.655674 28626 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:12.658546 28687 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:12.664122 28734 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:22:12.664268 28509 raft_consensus.cc:3055] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:12.664825 28509 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:22:12.665571 28723 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:22:12.665448 28612 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.665845 28509 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:12.667382 28473 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:12.668248 23849 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 15: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:12.669275 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.669422 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:12.669968 23849 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:12.670265 23999 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 12: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:12.670372 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:12.670953 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:12.671258 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:12.671715 23849 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 15: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:12.672188 24557 raft_consensus.cc:2393] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 9: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:12.672684 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.671380 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.676244 23892 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:12.677665 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:12.678898 28689 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:22:12.679636 28618 consensus_meta.cc:287] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.743s	user 0.012s	sys 0.000s
I20260709 12:22:12.680346 24558 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
W20260709 12:22:12.643916 28720 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:22:12.682420 23820 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:12.683687 23820 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.685149 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.686024 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.680353 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:12.698907 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 63018.2us
I20260709 12:22:12.699854 23818 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.707505 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2500) took 1545 ms. Trace:
I20260709 12:22:12.708295 23854 rpcz_store.cc:276] 0709 12:22:11.162281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.313790 (+1151509us) service_pool.cc:224] Handling call
0709 12:22:12.365496 (+ 51706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.365767 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:12.366165 (+   398us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.706970 (+340805us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.707065 (+    95us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:12.707142 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.707237 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.707410 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112908,"prepare.queue_time_us":2789,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":40,"thread_start_us":227412,"threads_started":1}
I20260709 12:22:12.711959 28272 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:12.716629 23820 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:12.718053 28675 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:12.718124 28127 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:12.718704 28675 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:12.719231 28675 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:12.719519 27996 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:12.719957 27996 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:12.721532 28701 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:12.726923 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:12.741559 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.682449 28549 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:12.698787 28657 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:22:12.833390 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 89012.8us
I20260709 12:22:12.839576 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.679662 28689 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:12.638664 28690 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:12.838465 23846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2251) took 2068 ms. Trace:
I20260709 12:22:12.748760 28272 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:12.718089 28670 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:12.643824 28656 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.844754 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:12.841470 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.846923 23846 rpcz_store.cc:276] 0709 12:22:10.770361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.107011 (+1336650us) service_pool.cc:224] Handling call
0709 12:22:12.138077 (+ 31066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:12.150817 (+ 12740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.150847 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:12.153596 (+  2749us) log.cc:844] Serialized 26 byte log entry
0709 12:22:12.216320 (+ 62724us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:12.216651 (+   331us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.547644 (+330993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.547724 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.838233 (+290509us) raft_consensus.cc:1685] finished
0709 12:22:12.838256 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.838403 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":383489,"prepare.queue_time_us":265,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":335778,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":26050,"thread_start_us":62412,"threads_started":1,"wal-append.queue_time_us":191388}
I20260709 12:22:12.855108 23854 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:12.836145 28505 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:12.858667 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.841202 28268 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:12.833931 28623 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:22:12.867897 23818 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:12.848986 28689 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:22:12.870759 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 297804us
I20260709 12:22:12.699786 28631 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.847870 28662 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:12.873417 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.833176 28701 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.878870 23818 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:12.876159 28127 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:12.846063 28657 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:12.872624 28551 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:12.866739 28647 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:12.930523 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 51758.6us
I20260709 12:22:12.857059 28552 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:12.940023 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.937959 23854 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:12.865288 28635 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:12.942176 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:12.884550 28268 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:22:12.950651 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 66980us
I20260709 12:22:12.955497 23892 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:12.956899 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.966151 23849 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:12.967602 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:12.968421 23849 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:12.864820 28670 raft_consensus.cc:697] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:12.881771 28689 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.964701 23893 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:12.977042 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 46186.3us
I20260709 12:22:12.982473 23848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2493) took 2250 ms. Trace:
I20260709 12:22:12.984525 23892 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:12.988299 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2263) took 1375 ms. Trace:
W20260709 12:22:12.988642 23847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.012s	sys 0.051s
W20260709 12:22:12.989142 23847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.012s	sys 0.051s
I20260709 12:22:12.989639 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:12.991055 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:12.982940 23848 rpcz_store.cc:276] 0709 12:22:10.732102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.924929 (+1192827us) service_pool.cc:224] Handling call
0709 12:22:11.925450 (+   521us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:12.521371 (+595921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.521419 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:12.522034 (+   615us) log.cc:844] Serialized 52 byte log entry
0709 12:22:12.832922 (+310888us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:12.834167 (+  1245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.834265 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.982234 (+147969us) raft_consensus.cc:1685] finished
0709 12:22:12.982256 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.982408 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":625744,"raft.queue_time_us":590531,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":15039,"thread_start_us":260412,"threads_started":1,"wal-append.queue_time_us":360529}
I20260709 12:22:12.988821 23845 rpcz_store.cc:276] 0709 12:22:11.612609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.557518 (+944909us) service_pool.cc:224] Handling call
0709 12:22:12.571199 (+ 13681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.571431 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:12.571738 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.987932 (+416194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.987988 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:12.988041 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.988111 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.988241 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7881,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"thread_start_us":415473,"threads_started":1}
I20260709 12:22:12.992606 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.993772 23892 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:12.948382 28654 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:12.948580 28623 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:12.999606 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:13.001343 23845 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:13.005522 23847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2504) took 1837 ms. Trace:
I20260709 12:22:13.009017 23849 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 7.
I20260709 12:22:13.012708 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:13.018821 23921 raft_consensus.cc:606] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:13.019375 23921 raft_consensus.cc:614] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:13.019658 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.982090 28491 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:12.987402 28549 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:13.018062 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.992461 28685 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:13.035238 28685 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:13.035756 28685 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.036845 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:13.015115 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:13.038445 23854 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:22:13.038537 23845 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:13.039532 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:13.040215 23854 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:13.020570 23849 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:12.996734 28397 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.956472 28551 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.000406 28401 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:12.992698 28267 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:13.007916 23847 rpcz_store.cc:276] 0709 12:22:11.168288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.450645 (+1282357us) service_pool.cc:224] Handling call
0709 12:22:12.451041 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.451329 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:12.455458 (+  4129us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.998027 (+542569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.998081 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:12.998145 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.005301 (+  7156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.005444 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8119,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":8865,"thread_start_us":534028,"threads_started":1}
I20260709 12:22:13.040278 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:13.058055 23845 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:13.059290 23820 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.68:43439 timed out after 1.663s (SENT) [suppressed 52 similar messages]
I20260709 12:22:13.044202 23849 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:13.061394 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:12.963129 28647 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.020545 28742 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:13.065912 23854 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:13.066627 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2514) took 1453 ms. Trace:
I20260709 12:22:13.050164 28552 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.059316 28397 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.056758 28684 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:22:13.063467 28267 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.080454 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:13.083523 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:13.088070 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:13.090826 28344 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:13.094511 28732 log.cc:927] Time spent T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:22:13.068512 28675 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.099473 28675 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:13.100936 28701 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:13.101478 24558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36552 (request call id 1016) took 1074 ms. Trace:
I20260709 12:22:13.102051 24558 rpcz_store.cc:276] 0709 12:22:12.027085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.036647 (+  9562us) service_pool.cc:224] Handling call
0709 12:22:13.101232 (+1064585us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54002c5e54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:13.101371 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408510848}
I20260709 12:22:13.104084 28742 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.106761 28742 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.072759 28676 raft_consensus.cc:3055] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:13.111868 28647 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:13.069078 28552 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.114243 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2494) took 2381 ms. Trace:
I20260709 12:22:13.114902 28657 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:13.074029 28665 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:13.116287 28665 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.114797 23851 rpcz_store.cc:276] 0709 12:22:10.732341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.942980 (+1210639us) service_pool.cc:224] Handling call
0709 12:22:11.943348 (+   368us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:12.538408 (+595060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.538450 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:12.558010 (+ 19560us) log.cc:844] Serialized 78 byte log entry
0709 12:22:12.856164 (+298154us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:12.920479 (+ 64315us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.922495 (+  2016us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.924056 (+  1561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.924153 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.113953 (+189800us) raft_consensus.cc:1685] finished
0709 12:22:13.113983 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.114170 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":612408,"prepare.queue_time_us":19550,"prepare.run_wall_time_us":48,"raft.queue_time_us":595893,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":37927,"spinlock_wait_cycles":88355968,"thread_start_us":242258,"threads_started":1,"wal-append.queue_time_us":430280}
I20260709 12:22:13.067021 23854 rpcz_store.cc:276] 0709 12:22:11.613687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.041020 (+1427333us) service_pool.cc:224] Handling call
0709 12:22:13.063790 (+ 22770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.066371 (+  2581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.066569 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:13.071053 28401 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:13.119531 28401 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.107335 28676 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:13.123150 28676 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.124575 28676 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:13.074067 28735 log.cc:927] Time spent T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:22:13.126969 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:13.129079 23851 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:13.133229 24524 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:13.135026 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:13.136971 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:13.141206 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:13.142470 24558 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 7: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:13.138324 28465 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:13.042379 28491 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.076215 28628 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:13.066654 28740 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:13.143301 28737 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:22:13.070961 28397 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:13.152673 24004 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:13.115321 28552 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.114264 28656 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:13.143405 28637 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:13.071732 28551 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:13.138757 28684 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:13.156251 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:13.178820 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:13.158545 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:13.141866 28267 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.152165 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:13.086092 23845 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:13.057966 28670 consensus_queue.cc:237] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.175479 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:13.152288 28740 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.181581 23849 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:13.180621 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 182194us
I20260709 12:22:13.188650 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:13.155083 28690 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:13.198477 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 201545us
I20260709 12:22:13.151845 28662 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:22:13.206111 23817 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:13.152694 28647 consensus_queue.cc:1059] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:22:13.177553 28656 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:13.191226 28615 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:13.207340 28420 raft_consensus.cc:3055] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:13.225508 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:13.224509 23893 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:13.229501 28701 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.231232 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:13.216333 28657 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:13.186257 28740 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:13.226461 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:13.235558 24001 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:13.220016 28665 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:13.215476 28267 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:13.235020 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:13.233827 23817 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:13.239238 24000 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:13.239667 28552 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:13.241469 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:13.243264 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:13.243775 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:13.244022 23925 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.244364 23921 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:13.232055 28615 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:13.230436 28420 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:13.235962 28690 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:13.250236 23845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
W20260709 12:22:13.249280 28748 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
I20260709 12:22:13.250186 28615 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:13.251434 23922 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:13.245921 28267 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.252907 28690 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.246321 28657 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:22:13.254514 28747 log.cc:927] Time spent T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 12:22:13.255264 28745 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:22:13.254712 28420 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.233371 28701 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:13.267526 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.237154 28750 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:13.291652 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2254) took 2454 ms. Trace:
I20260709 12:22:13.296530 23852 rpcz_store.cc:276] 0709 12:22:10.836945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.150672 (+1313727us) service_pool.cc:224] Handling call
0709 12:22:12.151002 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:12.547043 (+396041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.547075 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:12.558478 (+ 11403us) log.cc:844] Serialized 52 byte log entry
0709 12:22:12.941845 (+383367us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:13.162821 (+220976us) log.cc:844] Serialized 14 byte log entry
0709 12:22:13.180879 (+ 18058us) log.cc:844] Serialized 14 byte log entry
0709 12:22:13.181164 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.181251 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.291425 (+110174us) raft_consensus.cc:1685] finished
0709 12:22:13.291444 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.291587 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":409102,"prepare.queue_time_us":372670,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":404144,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":17485,"spinlock_wait_cycles":54007552,"thread_start_us":503356,"threads_started":2,"wal-append.queue_time_us":491477}
W20260709 12:22:13.293623 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 53902.7us
I20260709 12:22:13.271657 23925 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:13.233078 28656 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.240869 28549 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:22:13.292608 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 106730us
I20260709 12:22:13.270699 23845 raft_consensus.cc:606] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:22:13.302927 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 110034us
I20260709 12:22:13.306216 23845 raft_consensus.cc:614] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:13.308719 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:13.311162 28731 log.cc:927] Time spent T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.470s	user 0.003s	sys 0.000s
I20260709 12:22:13.305017 28689 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:13.312894 28746 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 12:22:13.314383 28689 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:13.289260 28690 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:13.305119 28628 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:22:13.330492 28246 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:13.331511 28246 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:13.331874 28246 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:13.330472 28665 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:13.335598 24563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 814) took 1288 ms. Trace:
I20260709 12:22:13.333702 23893 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:13.283792 28708 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.278375 28491 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.343696 23920 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:13.339829 24563 rpcz_store.cc:276] 0709 12:22:12.046969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.069052 (+ 22083us) service_pool.cc:224] Handling call
0709 12:22:12.069538 (+   486us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:12.291436 (+221898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.291470 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:12.292200 (+   730us) log.cc:844] Serialized 52 byte log entry
0709 12:22:12.528156 (+235956us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:12.528244 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.716932 (+188688us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54004e2354. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:12.717011 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.297855 (+580844us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:22:13.335325 (+ 37470us) raft_consensus.cc:1685] finished
0709 12:22:13.335355 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.335529 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16333,"raft.queue_time_us":16606,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":479083008,"thread_start_us":234929,"threads_started":1,"wal-append.queue_time_us":353704}
I20260709 12:22:13.345500 23921 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
W20260709 12:22:13.346129 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 286848us
I20260709 12:22:13.387411 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:13.388329 24558 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:13.389537 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:13.289038 28267 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.391927 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:13.393631 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59986.5us
I20260709 12:22:13.394606 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:13.398947 23997 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:13.399832 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:13.400527 24004 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:13.400802 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2390) took 1315 ms. Trace:
I20260709 12:22:13.390974 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:13.401296 23998 rpcz_store.cc:276] 0709 12:22:12.085221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.107097 (+ 21876us) service_pool.cc:224] Handling call
0709 12:22:12.143809 (+ 36712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.144104 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:12.167690 (+ 23586us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.986741 (+819051us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b1800026620. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a 00007fa287456a2a
0709 12:22:13.169588 (+182847us) log.cc:844] Serialized 14 byte log entry
0709 12:22:13.170878 (+  1290us) log.cc:844] Serialized 14 byte log entry
0709 12:22:13.275403 (+104525us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b1800026620. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa284361a40 00007fa28435c4e4 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287 00007fa287467208
0709 12:22:13.280957 (+  5554us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b1800026620. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:22:13.400462 (+119505us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:13.400523 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:13.400569 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.400632 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.400750 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122438,"prepare.queue_time_us":61291,"prepare.run_cpu_time_us":162,"prepare.run_wall_time_us":2758,"raft.queue_time_us":118362,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":8654,"spinlock_wait_cycles":37945728,"thread_start_us":301050,"threads_started":2,"wal-append.queue_time_us":1051523}
I20260709 12:22:13.403669 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:13.408124 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:13.404826 23893 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:13.412056 24561 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:13.407310 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:13.406755 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:13.279737 28685 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.414713 23820 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:13.416131 23892 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:13.423931 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 91761.8us
I20260709 12:22:13.405958 28708 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:13.410246 28491 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.369470 28628 consensus_queue.cc:1059] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:22:13.418232 28401 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:13.277801 27996 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.418555 28505 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:13.420931 28686 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:13.429088 28673 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:13.411026 28612 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:22:13.439144 28401 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:13.433415 28708 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:13.438400 28670 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:13.421201 28592 consensus_queue.cc:1059] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:22:13.439718 28397 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:13.455353 28673 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:13.463203 23854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:13.471961 23854 raft_consensus.cc:606] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:13.472388 23854 raft_consensus.cc:614] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:13.409641 28246 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.422367 28615 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.460740 28401 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:13.459378 27996 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.463415 28708 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:13.455962 28764 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.473115 28673 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:13.473105 28548 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:13.487398 28615 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:13.489154 28755 log.cc:927] Time spent T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:13.490518 28635 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:13.492681 28770 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:22:13.493119 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.460584 28657 consensus_queue.cc:1175] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" responder_term: 13 status { last_received { term: 12 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:13.475524 28772 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.502955 28246 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:13.497610 28548 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:13.561194 28635 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.616300 28509 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:13.639322 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.628798 28571 raft_consensus.cc:3055] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:22:13.591698 28763 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:22:13.619833 28631 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:22:13.639776 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 204459us
I20260709 12:22:13.640771 24554 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:13.582023 28772 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.480273 28764 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.613772 28701 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.629290 28740 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.640820 28571 raft_consensus.cc:740] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:13.644281 28631 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:13.660569 28656 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:13.650782 28685 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.665859 28571 consensus_queue.cc:260] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.667359 28571 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:13.669687 28708 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.671533 28764 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:13.672523 28631 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.673666 28631 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:13.675009 28771 raft_consensus.cc:3055] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:13.675114 28708 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.675490 28771 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:13.676438 28771 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.677591 28771 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:13.687597 28772 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:13.651800 28548 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.689956 28548 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.691047 28405 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.710928 28673 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.715167 28690 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.727758 28740 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.730489 28673 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.732086 28690 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:13.753041 28635 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.968906 28635 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:13.796344 23820 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:22:13.825106 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.970472 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 174703us
I20260709 12:22:13.971216 28505 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:13.971855 28505 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.972381 28505 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:13.829720 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 184265us
I20260709 12:22:13.830096 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:13.832417 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:13.835167 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.835016 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:13.839900 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:13.842332 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:13.852110 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:13.855278 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:13.856175 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:13.857297 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:13.858407 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:13.859163 23852 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:22:13.861145 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.862452 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.906352 28267 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:13.937022 28654 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.942523 28656 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:14.001240 28656 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.002851 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:13.944344 28684 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:13.954404 28630 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:14.004379 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:14.004906 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:14.005184 28630 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:13.956789 28631 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:22:13.961670 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.962421 28667 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:13.972546 28508 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:13.973382 28708 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:22:13.826668 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 409176us
I20260709 12:22:13.975296 28344 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:13.978531 28612 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:13.979727 28405 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:13.957760 28272 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:13.984297 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.013356 23847 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:13.988919 28601 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:14.015174 28654 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:13.985996 23924 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:14.012866 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:14.032807 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.014694 28630 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.040161 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:14.037312 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:14.054286 28405 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.058054 28601 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.058355 28267 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.058054 24000 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:14.066000 28742 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.066089 28508 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.066942 28742 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.068975 28508 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.069429 28742 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.070608 28708 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.074644 28776 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:22:14.070228 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44427.1us
I20260709 12:22:14.063187 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:14.079322 28667 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.057771 28405 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.073640 28272 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.082490 28657 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:14.083487 28657 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.079067 23845 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:14.085862 23847 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:14.082710 28272 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.089048 23845 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:22:14.096284 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.004487 28684 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.099888 23852 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:14.100833 23848 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:14.104184 28551 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:14.105338 28554 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.105078 28551 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.075664 28344 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.077965 28656 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.113941 28405 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:14.122531 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.112021 28601 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.111900 28667 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.138015 23998 raft_consensus.cc:1240] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:14.138206 28267 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:14.118999 28628 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.068s	sys 0.081s
W20260709 12:22:14.161857 28246 consensus_meta.cc:287] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.005s
I20260709 12:22:14.130956 28537 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:14.159068 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:14.152598 28628 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.069s	sys 0.082s
W20260709 12:22:14.162017 27996 consensus_meta.cc:287] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.009s
I20260709 12:22:14.170758 28537 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.174166 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.175431 23999 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:14.177788 28654 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.157339 28405 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.183560 28508 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:14.185051 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.184659 28508 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.186280 23846 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:14.144726 28657 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.144990 28344 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.186110 23928 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:14.186342 28537 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.138005 28684 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.187780 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.146152 28742 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.181666 28405 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.197554 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:22:14.205343 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53116.2us
I20260709 12:22:14.199160 28667 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:14.216454 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.214965 24554 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:22:14.226732 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.230078 23924 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:22:14.221720 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 192683us
I20260709 12:22:14.234592 28657 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.235569 28657 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.238459 28657 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.244294 28397 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:14.244925 28397 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:14.247867 28420 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:14.255012 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:14.258436 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.264274 23852 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:14.232813 24004 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:14.270804 28508 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:14.274387 28548 consensus_meta.cc:287] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.010s
W20260709 12:22:14.276448 28491 consensus_meta.cc:287] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.007s
I20260709 12:22:14.283027 28491 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:14.286566 23848 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:14.290846 28505 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.280617 23995 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:22:14.282361 28401 consensus_meta.cc:287] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.803s	user 0.013s	sys 0.007s
I20260709 12:22:14.294869 23851 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:22:14.295334 28754 consensus_queue.cc:1059] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
W20260709 12:22:14.279594 23846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 562) took 1690 ms (client timeout 1941 ms). Trace:
W20260709 12:22:14.296865 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 180229us
W20260709 12:22:14.300907 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.300181 28708 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.266520 23893 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:14.308398 23892 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:14.310587 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:14.312507 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:14.313760 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 47321.3us
I20260709 12:22:14.265684 28742 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.298139 28662 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 12:22:14.307034 28401 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.323688 23893 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:14.329104 28548 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:14.317266 28754 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:14.342805 23995 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:14.311285 28667 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.348762 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:22:14.300908 23846 rpcz_store.cc:269] 0709 12:22:12.588896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.885482 (+296586us) service_pool.cc:224] Handling call
0709 12:22:14.279332 (+1393850us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001e3cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:14.279515 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2863201024}
I20260709 12:22:14.353161 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.341375 28548 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:14.340922 28754 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.359422 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.358454 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.354923 23929 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:14.361397 23920 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:14.366245 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.375943 24002 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:14.373925 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.373590 28675 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:14.347210 28551 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.377940 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.381785 28675 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.382442 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:14.383911 23995 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:14.385828 24556 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:14.385823 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:14.388562 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.393301 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:14.394225 23921 raft_consensus.cc:606] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:14.394595 23921 raft_consensus.cc:614] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:14.395954 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.396876 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 569) took 1242 ms. Trace:
I20260709 12:22:14.372367 28754 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:14.358234 28548 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:14.407740 28548 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:14.410111 24003 raft_consensus.cc:1240] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:14.411065 28401 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.413339 28665 raft_consensus.cc:3055] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:14.413908 28665 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:14.415252 28665 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.417346 28665 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:14.397389 23851 rpcz_store.cc:276] 0709 12:22:13.154929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.160901 (+  5972us) service_pool.cc:224] Handling call
0709 12:22:14.294218 (+1133317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.300429 (+  6211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.396594 (+ 96165us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001e3cd0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:14.396784 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2605080320}
W20260709 12:22:14.427640 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 123106us
I20260709 12:22:14.389730 28708 raft_consensus.cc:3055] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:14.434819 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:14.421588 28675 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.449214 23924 raft_consensus.cc:2393] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:14.462229 23998 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:14.461447 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:14.463651 24004 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:22:14.464798 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.465811 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.447280 28708 raft_consensus.cc:740] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:14.467327 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:14.476325 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:14.483879 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:14.485440 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:14.473318 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:14.486514 24556 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 15: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:14.487697 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:14.490581 28742 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:14.492406 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:14.493101 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.493690 23893 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:14.494628 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.496146 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.497170 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.505378 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.506381 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.494063 24002 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
W20260709 12:22:14.506968 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.506630 23924 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:14.475481 28505 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.513559 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.511893 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.510459 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.527806 23995 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:14.509846 23853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2260) took 2932 ms. Trace:
I20260709 12:22:14.531723 23893 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:14.527027 23997 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:14.494838 28667 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.534924 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.535463 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.538219 24561 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:14.539460 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:22:14.542254 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 87802.5us
I20260709 12:22:14.544472 24556 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:14.514067 28742 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:14.536989 28675 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:14.547463 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.545903 23998 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:22:14.551213 24000 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:14.548137 28551 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:14.554971 28551 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:14.555450 28551 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:14.558167 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:14.559065 24563 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:14.564631 28708 consensus_queue.cc:260] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.565135 28272 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:14.565933 28272 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.570715 28708 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:14.572242 28272 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.573978 28571 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.574664 28571 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.577107 28571 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.538434 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:14.579445 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:14.583125 24561 raft_consensus.cc:2410] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:14.586066 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:14.587568 24558 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:22:14.588284 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.591646 23928 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:14.546685 28742 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:14.594533 23895 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:14.596062 24000 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:14.601975 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.530177 23853 rpcz_store.cc:276] 0709 12:22:11.536823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.975553 (+2438730us) service_pool.cc:224] Handling call
0709 12:22:13.976186 (+   633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.047613 (+ 71427us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:14.265548 (+217935us) log.cc:844] Serialized 14 byte log entry
0709 12:22:14.427440 (+161892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:14.427496 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:14.447536 (+ 20040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.468733 (+ 21197us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54001e46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:14.468781 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:14.468931 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":257627,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":10732,"raft.queue_time_us":161,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":12019,"spinlock_wait_cycles":83407104,"thread_start_us":250687,"threads_started":2,"wal-append.queue_time_us":163461}
I20260709 12:22:14.609668 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:14.611457 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.612990 28675 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.615751 28675 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.610888 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.619078 23924 raft_consensus.cc:1240] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:14.605685 28742 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:14.621133 28420 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:14.620126 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:14.586854 28754 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.627157 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 1023) took 1969 ms. Trace:
I20260709 12:22:14.630218 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:14.638890 24560 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:14.639436 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.641753 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:14.642743 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.646431 28508 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:14.623417 28401 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260709 12:22:14.656760 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.657400 24563 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:14.661589 28231 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.662127 28420 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:14.662564 23817 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:14.663679 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 82791.3us
I20260709 12:22:14.658577 23922 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:14.662261 28231 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.655885 28508 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.662658 28420 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.628679 28548 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.668387 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.664858 23893 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:14.638347 24555 rpcz_store.cc:276] 0709 12:22:12.539613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.539925 (+   312us) service_pool.cc:224] Handling call
0709 12:22:12.540224 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.540448 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:12.567964 (+ 27516us) log.cc:844] Serialized 14 byte log entry
0709 12:22:13.625766 (+1057802us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b180025cf00. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a 00007fa287456a2a
0709 12:22:14.303564 (+677798us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b180025cf00. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a
0709 12:22:14.454564 (+151000us) log.cc:844] Serialized 14 byte log entry
0709 12:22:14.458523 (+  3959us) log.cc:844] Serialized 14 byte log entry
0709 12:22:14.469164 (+ 10641us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:14.473915 (+  4751us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:14.478213 (+  4298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.490612 (+ 12399us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b180025cf00. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:22:14.509306 (+ 18694us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:14.509432 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9616,"prepare.queue_time_us":65370,"prepare.run_cpu_time_us":155,"prepare.run_wall_time_us":4754,"raft.queue_time_us":24816,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":16792,"spinlock_wait_cycles":28183040,"thread_start_us":514808,"threads_started":2,"wal-append.queue_time_us":1458254}
I20260709 12:22:14.674451 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:14.669935 28420 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:14.649085 28267 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 12:22:14.677029 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:14.677219 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 65354.2us
I20260709 12:22:14.669808 28624 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:14.665279 28508 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:14.682286 23892 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:14.685997 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:14.687888 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.692118 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:14.696929 23921 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:14.715505 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.691828 28231 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.695298 28667 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:22:14.720356 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 58012.3us
I20260709 12:22:14.718623 23895 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:14.696417 28601 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:14.729135 28628 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:14.730275 28603 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:14.730916 28603 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:14.725699 28784 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.176s	user 0.000s	sys 0.003s
W20260709 12:22:14.735321 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53161.9us
I20260709 12:22:14.736829 23818 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:14.737834 23818 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:14.738358 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.738600 28272 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:14.738983 28272 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:14.739212 23924 raft_consensus.cc:2410] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:22:14.739372 28272 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:14.740689 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:14.741271 23924 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:14.742080 28657 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:14.742539 28657 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.742941 28657 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:14.746531 23818 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:14.747500 28231 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:14.748757 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:14.736948 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:14.751819 28231 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:14.752252 28231 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.752803 28231 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:14.736137 23820 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:14.757151 23928 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:22:14.716132 28675 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:22:14.758671 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:14.761026 23924 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:14.761183 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:14.762753 23921 raft_consensus.cc:2410] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:22:14.733539 28667 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:14.757619 28491 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.768429 28626 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:14.771296 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 56823.1us
I20260709 12:22:14.770501 23969 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:14.762090 28601 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:22:14.774036 23748 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59378 (request call id 143) took 19839 ms (client timeout 15000 ms). Trace:
I20260709 12:22:14.770641 28673 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:14.781826 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:14.770679 28626 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.783924 28626 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:14.772706 28491 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:14.815302 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:14.802883 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 122480us
W20260709 12:22:14.815752 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 93202us
I20260709 12:22:14.817224 23895 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:22:14.832333 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 105379us
W20260709 12:22:14.803216 28397 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.003s
I20260709 12:22:14.810392 28548 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:14.804901 28786 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:22:14.826187 28624 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:14.817670 28628 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:14.838603 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:14.802572 28505 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:14.843786 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:14.831811 28231 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:14.845558 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 79022.9us
W20260709 12:22:14.849300 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 112455us
I20260709 12:22:14.817639 28754 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.833374 28397 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.786672 28673 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:14.833359 28601 raft_consensus.cc:2764] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:22:14.860013 28231 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.863962 28397 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.875633 28673 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.868165 28630 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:22:14.878309 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 61238.5us
I20260709 12:22:14.869191 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:22:14.776954 23748 rpcz_store.cc:269] 0709 12:21:54.821217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.851131 (+ 29914us) service_pool.cc:224] Handling call
0709 12:22:14.656604 (+19805473us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:06.810647 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:06.811340 (+   693us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:06.811407 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:22:06.811433 (+    26us) tablet.cc:662] Decoding operations
0709 12:22:07.079164 (+267731us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:07.079335 (+   171us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:07.079382 (+    47us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:22:07.081475 (+  2093us) tablet.cc:701] Row locks acquired
0709 12:22:07.081530 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:22:07.081731 (+   201us) write_op.cc:270] Start()
0709 12:22:07.107582 (+ 25851us) write_op.cc:276] Timestamp: P: 1783599727081653 usec, L: 0
0709 12:22:07.201872 (+ 94290us) op_driver.cc:348] REPLICATION: starting
0709 12:22:07.203010 (+  1138us) log.cc:844] Serialized 6676 byte log entry
0709 12:22:07.816021 (+613011us) op_driver.cc:464] REPLICATION: finished
0709 12:22:08.019661 (+203640us) write_op.cc:301] APPLY: starting
0709 12:22:08.022837 (+  3176us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:08.047406 (+ 24569us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:08.051119 (+  3713us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:08.785524 (+734405us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:08.795006 (+  9482us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 12:22:08.801371 (+  6365us) write_op.cc:312] APPLY: finished
0709 12:22:08.826180 (+ 24809us) log.cc:844] Serialized 156 byte log entry
0709 12:22:09.413406 (+587226us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa2843420ac 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b
0709 12:22:09.573443 (+160037us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:09.590126 (+ 16683us) write_op.cc:454] Released schema lock
0709 12:22:09.590217 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:09.590804 (+   587us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:09.590841 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":111556,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":180739,"apply.run_cpu_time_us":65333,"apply.run_wall_time_us":1589425,"cfile_cache_hit":70,"cfile_cache_hit_bytes":74983,"num_ops":17,"prepare.queue_time_us":89326,"prepare.run_cpu_time_us":15465,"prepare.run_wall_time_us":634787,"raft.queue_time_us":96760,"raft.run_cpu_time_us":19443,"raft.run_wall_time_us":110854,"replication_time_us":613932,"spinlock_wait_cycles":88550144,"thread_start_us":1071838,"threads_started":5,"wal-append.queue_time_us":1070087,"wal-append.run_cpu_time_us":16161,"wal-append.run_wall_time_us":2238762}]]}
I20260709 12:22:14.866240 28491 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.879570 28397 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 12:22:14.884420 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.835454 23747 catalog_manager.cc:5697] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:14.893697 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 55350.8us
I20260709 12:22:14.896564 24560 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:14.815378 28551 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.813225 28420 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.855553 28628 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.904413 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:14.909116 24001 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:14.786214 28603 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:14.907310 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 50219.7us
I20260709 12:22:14.907119 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:14.906275 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:14.910789 24000 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:14.900341 28231 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:14.806718 28667 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.918715 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:22:14.926492 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 82874.9us
I20260709 12:22:14.927145 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:14.920363 28630 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:14.932950 28665 consensus_queue.cc:1059] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:14.933521 23747 catalog_manager.cc:5697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:14.923116 23920 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:14.936499 28662 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:14.917388 28628 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:14.945078 23747 catalog_manager.cc:5697] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c reported cstate change: term changed from 5 to 7, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 7 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:14.956830 23747 catalog_manager.cc:5697] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 3 to 4, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 4 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:14.959090 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:14.958984 23747 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:14.952430 28624 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:14.960134 28624 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.960613 23747 catalog_manager.cc:5697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:14.962306 28624 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.963778 28708 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.964341 28708 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:14.964033 23747 catalog_manager.cc:5697] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 3 to 6, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 6 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:14.918562 28508 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:14.972091 28708 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:14.972527 28508 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.975000 28657 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:14.984520 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 160415us
I20260709 12:22:14.985570 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:14.987762 23892 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:14.983536 28505 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:22:14.999377 28505 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:22:15.002772 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 234125us
W20260709 12:22:15.032821 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.037350 23817 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:14.953472 28789 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:15.041858 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:14.979683 28657 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:14.990386 28624 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.050177 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:15.050207 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 62565.9us
I20260709 12:22:14.949350 28635 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:22:15.053283 24554 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:15.055244 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:15.059124 23892 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:15.002951 28231 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:14.990725 28508 consensus_queue.cc:1059] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:22:14.991246 28776 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:22:15.073985 24002 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:14.993990 28708 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:22:15.081674 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.056686 28401 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:15.082762 24561 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:15.049086 28673 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.070393 28505 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:15.081919 28420 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.061189 28657 consensus_queue.cc:1059] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 12:22:15.100217 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 45972.9us
W20260709 12:22:15.097317 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 139279us
I20260709 12:22:15.062552 28624 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.114984 23895 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:15.115203 28397 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.115897 28551 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.116506 23895 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:15.118005 28401 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:15.117630 28708 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:15.105985 28657 raft_consensus.cc:3055] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:15.134174 28657 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:15.105921 28790 consensus_queue.cc:1059] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.202s
I20260709 12:22:15.135051 28272 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.135210 28628 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.098938 28791 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.136770 28791 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.139254 28791 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.106863 28508 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.107036 28794 raft_consensus.cc:3055] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:15.115900 28397 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.109987 28754 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.110626 28797 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:15.116570 28551 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:15.153746 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:15.102793 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 65538.1us
W20260709 12:22:15.101433 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 142409us
I20260709 12:22:15.159439 23820 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:15.119103 28401 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.102929 24000 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:15.105631 28792 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:15.142980 24001 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:15.140043 28508 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.148034 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.141085 28790 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:15.116417 28624 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:15.166865 23820 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:15.171737 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.137650 28628 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:15.148777 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 144851us
I20260709 12:22:15.169207 23845 raft_consensus.cc:2368] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13.
I20260709 12:22:15.169206 23853 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:15.172708 23848 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:15.140882 28708 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.170876 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.176086 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.176636 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:15.168699 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.142356 28794 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:15.179484 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.185828 23852 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:15.182367 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:15.181393 23846 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:15.180570 23851 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:15.150735 28797 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:15.154708 28662 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.168038 28505 consensus_queue.cc:1059] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:22:15.186715 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.196398 23847 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:15.135164 28657 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.171054 28790 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:15.183611 28792 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:15.184181 28708 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:15.179946 28799 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:15.206312 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.197338 23922 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:15.189373 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.198966 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:15.179781 28675 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:15.198482 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.216279 24001 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:22:15.216893 23854 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:22:15.197372 28789 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:15.222368 28789 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.206296 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:15.165390 28754 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.211304 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.225360 28789 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:15.227171 28754 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.212812 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:15.215718 24561 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:15.176142 28635 consensus_queue.cc:1059] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:22:15.237706 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:15.238672 24563 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:15.236725 23849 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:15.242169 24001 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:15.249641 23850 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:15.187258 28624 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:22:15.250897 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:15.257673 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:15.258013 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:15.259969 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:15.214741 28630 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:15.264796 24001 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:22:15.229000 28805 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:15.268792 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.252076 28789 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.199433 28626 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.273566 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:15.273767 23928 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:15.274359 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:15.274565 23929 raft_consensus.cc:1240] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:15.275352 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:15.277072 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:15.277834 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.278155 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:15.278914 23996 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:22:15.278784 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:15.279703 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:15.275388 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:15.266655 28800 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:15.281383 28799 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:15.266481 28742 consensus_meta.cc:287] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.002s
W20260709 12:22:15.282341 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 129892us
I20260709 12:22:15.197942 28662 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.304804 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:15.287014 23995 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:15.290556 28792 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.292758 28793 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.336967 28508 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:15.286933 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.336817 28793 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.337906 23850 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:15.338687 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.339067 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.339344 24557 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:15.293953 23847 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:15.288429 24003 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:15.339579 28793 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:15.297003 24000 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:15.296653 23893 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:15.340299 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:15.302541 28397 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:15.302321 28630 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.340663 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:15.340873 23847 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:15.303081 28272 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.303918 28231 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:15.341650 28231 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.342177 28272 consensus_queue.cc:1059] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:15.342531 28601 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:15.343127 28601 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.344029 28231 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:15.269604 28667 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.334712 23849 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:15.361009 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.367679 23924 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:22:15.297508 28799 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:22:15.371927 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 213448us
I20260709 12:22:15.370438 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:15.375590 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.375768 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.377430 23845 raft_consensus.cc:2368] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13.
W20260709 12:22:15.378432 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 81874.2us
I20260709 12:22:15.266762 28797 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.379199 28624 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.383317 28624 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.385779 28624 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:15.387300 28662 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:15.388648 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.390369 24556 raft_consensus.cc:2410] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:22:15.346392 28231 raft_consensus.cc:3055] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:15.403416 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:15.406179 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.407058 23852 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
W20260709 12:22:15.408208 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 67621.3us
I20260709 12:22:15.298089 28789 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.346717 28800 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:15.377799 28548 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:15.333818 28742 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.299697 28790 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.378059 28799 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:15.451565 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:15.388818 28397 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:15.294615 28805 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.403890 28231 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:22:15.458220 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 86825.7us
I20260709 12:22:15.420912 28792 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:15.449842 28773 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:15.469853 23850 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:22:15.372491 28667 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.299124 28794 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.457183 28548 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:15.461895 28792 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.470620 28675 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:15.481009 28805 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:15.486768 28810 consensus_queue.cc:1059] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:15.488247 28810 raft_consensus.cc:3055] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:15.488718 28810 raft_consensus.cc:740] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:15.490011 28810 consensus_queue.cc:260] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.491484 28810 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:15.493709 28792 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:15.482851 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:15.495453 23817 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:15.498173 23849 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:15.503439 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:15.503799 23847 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:15.505035 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:15.506511 24002 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:15.509048 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 208376us
I20260709 12:22:15.518784 28491 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:15.519484 28491 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.520663 23817 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:15.476342 28790 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:15.522431 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:15.522511 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 71066.2us
I20260709 12:22:15.479051 28601 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.551491 24563 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:22:15.515638 28673 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:15.527810 28491 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:15.528407 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:15.509507 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.530040 28801 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:15.529729 28548 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.524335 23817 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:15.530558 28626 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.531419 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:15.525298 23893 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:15.555685 24559 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:22:15.522809 28805 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:15.564096 24002 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:15.506672 28813 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:15.566084 24562 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:22:15.554091 23818 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:15.560413 28397 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:15.574882 23997 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:15.582655 28811 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:22:15.583992 28825 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.590404 28829 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:15.590718 28673 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:22:15.591789 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 66587.7us
I20260709 12:22:15.592236 28805 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:15.592528 28791 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:15.553489 28800 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:15.598335 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 112285us
W20260709 12:22:15.599748 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 45737.8us
I20260709 12:22:15.601244 28789 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.603238 28667 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:15.604090 28742 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.644351 28776 raft_consensus.cc:3055] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:15.607028 28810 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:15.644471 23818 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:15.644876 28776 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:15.645201 28810 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:15.645947 28776 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.646414 28810 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.642094 28657 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:15.553454 28708 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.615324 28272 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:15.650293 28829 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:15.650689 28272 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.651189 28272 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:15.651500 28796 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:15.509609 28231 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.621199 28797 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:15.622375 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.623193 23820 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:15.642825 23893 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:15.605839 28675 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.647018 28776 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:15.662233 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.662629 28742 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:15.663183 28742 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:15.663662 23847 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 12:22:15.664098 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:15.662336 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:15.665705 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:15.617725 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 93467.7us
I20260709 12:22:15.653977 23925 raft_consensus.cc:2368] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 13. Current term is 14.
I20260709 12:22:15.667906 23817 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:15.663678 24562 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:15.671356 23999 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 15: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:15.650368 28708 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:15.679250 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:15.653678 28791 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.677202 23820 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:15.681030 23996 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:15.683619 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:15.670666 28626 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:15.695698 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:15.696584 23929 raft_consensus.cc:2410] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:22:15.695757 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:15.697741 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.698176 23928 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:15.699115 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:15.699359 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:15.701015 28231 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:15.706166 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:15.682616 28624 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:15.708056 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:15.708606 23997 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:15.696762 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:15.682869 28791 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:15.720386 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.721042 24563 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 7.
I20260709 12:22:15.722994 23895 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:15.696264 28626 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.725466 28626 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:15.725755 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:15.726167 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:15.726421 23926 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 7.
I20260709 12:22:15.725548 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:15.727165 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:15.727603 24562 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:15.727185 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.726447 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:15.674871 28792 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.739717 23846 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:15.742025 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:15.741017 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:15.742923 24554 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:15.742868 23929 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:15.664119 28742 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.723829 28603 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.691143 28635 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:22:15.761813 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:15.767752 23997 raft_consensus.cc:3055] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:15.770922 23997 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:15.772207 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.772939 23846 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:15.756542 28708 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:15.680045 28825 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.787667 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.733702 28665 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:22:15.789947 23846 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 7.
I20260709 12:22:15.766932 28267 raft_consensus.cc:3055] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:15.792129 23893 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:15.788751 23997 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.793736 23997 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:15.794323 28267 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:15.724716 28397 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.805859 28814 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:15.807049 28548 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:15.778046 28708 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.848850 23817 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:15.851229 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.851907 23846 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:15.897701 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:15.772388 28603 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:15.900940 28833 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:22:15.901181 23817 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:15.902575 28813 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:15.902642 23817 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:15.904922 24554 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:15.905833 28630 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:15.760990 28673 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:15.919812 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 223268us
I20260709 12:22:15.906410 28630 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.907140 28793 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:15.907737 28813 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:15.910172 28267 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.849450 28708 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:15.934500 28603 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.935184 28603 consensus_queue.cc:1059] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:22:15.936118 28808 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.553s	user 0.004s	sys 0.000s
I20260709 12:22:15.938889 28825 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:15.941679 28571 raft_consensus.cc:3055] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:15.942133 28571 raft_consensus.cc:740] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:15.943189 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.943342 28571 consensus_queue.cc:260] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:15.944463 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.944808 28571 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:15.945221 23847 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 9: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:15.821192 28814 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:15.947041 28814 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:15.948482 28773 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:15.948889 28773 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:15.928699 23966 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:15.953277 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.954123 23845 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:15.955159 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.955662 28801 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:15.955837 23999 raft_consensus.cc:2393] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:15.956225 28801 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:15.956723 28801 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:15.858543 28809 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:15.962250 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:15.962247 23817 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:15.963361 23847 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:22:15.928627 23997 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:22:15.966393 23997 pending_rounds.cc:85] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 6
I20260709 12:22:15.822041 28401 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 12:22:15.955788 23845 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
W20260709 12:22:15.973812 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 121130us
I20260709 12:22:15.970564 23995 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:15.966670 23997 pending_rounds.cc:107] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:22:15.980844 23997 raft_consensus.cc:2889] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:15.981995 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.980803 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:16.003228 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.007284 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:16.008196 23847 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:16.014707 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:16.017233 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:16.015647 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:16.016398 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:16.019573 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:16.020200 23922 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:22:16.020953 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.949688 28773 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:15.979100 28793 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.021402 28836 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:16.022436 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:16.043604 23929 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:16.043900 24555 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:16.025437 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:16.021682 28831 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:22:16.024057 28626 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.009859 28842 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:16.048017 28842 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:16.049278 28626 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:16.049064 28842 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.050103 23846 raft_consensus.cc:2368] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8.
I20260709 12:22:16.049925 28814 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.050312 28842 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:16.054239 28790 consensus_meta.cc:287] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 12:22:16.055871 23854 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:16.055583 28272 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:16.057627 28838 log.cc:927] Time spent T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:16.059720 23853 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:16.068823 24555 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
W20260709 12:22:16.061074 28799 consensus_meta.cc:287] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
I20260709 12:22:16.069737 28799 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.070952 23852 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:16.071039 28814 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:16.071373 23818 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:16.072628 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:16.068020 23929 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
W20260709 12:22:16.069067 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:16.073619 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.022688 28792 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:16.059871 28630 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:16.066751 28624 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.045825 23926 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
W20260709 12:22:16.088207 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.078145 23969 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:16.073828 23818 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:16.074959 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:16.072729 28272 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:16.075739 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:16.076714 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:16.078722 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.095268 23997 raft_consensus.cc:2410] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:22:16.045470 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:16.096632 23847 raft_consensus.cc:2410] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:22:16.086010 23845 raft_consensus.cc:2368] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 15. Current term is 16.
I20260709 12:22:16.075441 28665 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.075886 28809 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:16.073755 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:16.102730 28665 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.103420 28624 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.104380 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:16.105206 23852 raft_consensus.cc:2393] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:16.106087 28773 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:16.106621 24004 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:16.109233 28807 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.727s	user 0.001s	sys 0.001s
I20260709 12:22:16.110631 24560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 1044) took 1042 ms. Trace:
I20260709 12:22:16.110724 28800 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:16.111452 28800 raft_consensus.cc:697] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:16.111065 24560 rpcz_store.cc:276] 0709 12:22:15.068505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.068658 (+   153us) service_pool.cc:224] Handling call
0709 12:22:15.068987 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:15.081579 (+ 12592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:15.081619 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:15.092275 (+ 10656us) log.cc:844] Serialized 26 byte log entry
0709 12:22:15.229104 (+136829us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:15.229153 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.229218 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:16.108403 (+879185us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:22:16.110301 (+  1898us) raft_consensus.cc:1685] finished
0709 12:22:16.110327 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:16.110544 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7779,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3421,"spinlock_wait_cycles":17944320,"thread_start_us":100319,"threads_started":1,"wal-append.queue_time_us":235973}
I20260709 12:22:16.112762 28800 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.074050 28836 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:16.114259 28840 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.206s	user 0.002s	sys 0.000s
I20260709 12:22:16.115455 28799 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.115728 28793 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:16.118152 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:16.118842 23849 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:16.119692 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:16.120436 23849 raft_consensus.cc:2410] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:22:16.105829 28624 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.118187 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:16.123697 23853 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:16.125608 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:16.126210 23852 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:16.101408 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 84627.2us
W20260709 12:22:16.130214 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 137606us
I20260709 12:22:16.132575 23847 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:16.105559 28665 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:16.135695 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:16.135504 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:16.135795 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:16.136600 23997 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:16.138417 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:16.139266 23847 raft_consensus.cc:2393] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:16.140091 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:16.141072 23999 raft_consensus.cc:2410] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:22:16.136128 28796 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:16.146306 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:16.146662 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:16.146943 23928 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:22:16.147203 28844 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:22:16.147234 23925 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:16.146181 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:16.149842 23927 raft_consensus.cc:2410] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:22:16.158545 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:16.130497 28626 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:16.151628 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:16.170823 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.171932 24003 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:22:16.172329 24003 pending_rounds.cc:85] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 7
I20260709 12:22:16.173254 23997 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:16.175979 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:16.177735 23847 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:16.178298 24003 pending_rounds.cc:107] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:22:16.178606 24003 raft_consensus.cc:2889] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:16.179445 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:16.140415 28809 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:16.185853 23928 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
W20260709 12:22:16.192075 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60960.2us
I20260709 12:22:16.192166 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:16.169981 28571 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:16.195026 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:16.198220 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 60579us
I20260709 12:22:16.197714 23847 raft_consensus.cc:1217] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Deduplicated request from leader. Original: 12.6->[14.7-15.8]   Dedup: 14.7->[15.8-15.8]
I20260709 12:22:16.199235 23847 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16. Ops: [14.7-15.8]
I20260709 12:22:16.204066 23852 raft_consensus.cc:2410] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:22:16.203969 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:16.206501 23920 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:22:16.177871 28635 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:16.212551 23847 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:22:16.146880 28796 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.218430 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:16.170094 28793 consensus_queue.cc:1059] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:22:16.221906 23920 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:22:16.221909 23999 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:22:16.201408 28626 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:16.197664 28829 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:16.206432 28624 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:16.207669 28776 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:16.251549 23851 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:16.215617 28844 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:16.253845 23853 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: [10.5-11.6]
I20260709 12:22:16.210930 28803 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:22:16.210260 28791 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.275816 23853 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:16.226552 28673 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.252765 28844 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:16.282625 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 89481.9us
I20260709 12:22:16.335744 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:16.286134 28801 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.268833 28809 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.260703 28829 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:16.345563 23852 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:16.347740 23921 raft_consensus.cc:2393] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 18: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:16.354696 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:16.364064 28846 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:22:16.366039 28850 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:22:16.338678 28844 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:16.364233 28853 log.cc:927] Time spent T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:22:16.376585 24004 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
W20260709 12:22:16.377023 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 149097us
I20260709 12:22:16.380108 23850 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:16.357764 28635 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:16.411085 23850 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:16.391227 28801 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:16.374280 28626 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.399860 28829 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.401867 28856 raft_consensus.cc:3055] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:22:16.405078 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 69403.7us
I20260709 12:22:16.399933 28708 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.348595 28673 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:16.411067 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.382905 23922 raft_consensus.cc:1240] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:16.414299 23925 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:16.435906 23929 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:16.411527 28635 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:16.427541 23895 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:16.436561 23923 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:16.445676 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:16.451658 23926 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:16.454221 23927 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:16.444380 28635 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:16.432965 28856 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:16.449524 28825 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:16.464597 28267 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:16.464660 28708 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:16.466199 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:16.467443 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.467588 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:16.468227 24556 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:16.451599 28667 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:16.481261 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:16.489559 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:16.501103 28820 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:22:16.446542 28803 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:22:16.507826 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:16.510985 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.487506 28796 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:16.491314 28810 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:16.503304 28825 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:16.506942 28799 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:16.524412 28673 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:16.524982 23928 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:22:16.506942 28667 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:16.540818 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:16.523095 28810 raft_consensus.cc:697] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:16.549103 28825 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.542989 28856 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.582053 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:16.547374 28667 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.568548 24556 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:22:16.589956 23927 raft_consensus.cc:2393] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:16.597018 28847 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.597985 28847 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.601243 28847 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:16.607138 28810 consensus_queue.cc:237] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.609830 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:16.617045 23920 raft_consensus.cc:2393] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:16.618294 23920 raft_consensus.cc:1240] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:16.610761 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:16.620038 23892 leader_election.cc:400] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13.
I20260709 12:22:16.620939 23892 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:16.621650 28491 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:16.622056 28491 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:16.622412 28491 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:16.624460 28742 raft_consensus.cc:2764] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:22:16.625748 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:16.613111 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:16.626613 23922 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:16.612346 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:16.627579 23924 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:16.628579 28742 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:16.628980 28742 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:16.629341 28742 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:16.631590 28665 raft_consensus.cc:3055] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:16.632202 28665 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:16.635243 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:16.638360 28708 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:16.638772 28708 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:16.639132 28708 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:16.644219 28571 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:16.648289 23892 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:16.690070 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.710666 28505 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:16.711663 28839 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.811s	user 0.006s	sys 0.001s
I20260709 12:22:16.711440 28505 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.714123 28505 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.693070 28842 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:16.716878 28842 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.719213 28842 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.633358 28665 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.577788 28844 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.684082 28856 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:16.692987 28673 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:16.692566 28809 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:16.725199 23895 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:16.736042 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:16.741742 23847 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 15 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:16.747233 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 297275us
I20260709 12:22:16.748266 24524 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:16.733436 28673 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:16.740038 28809 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:16.756580 28872 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:22:16.758472 28809 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.758648 28799 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:16.756520 28673 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:16.772593 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:16.782229 24524 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:16.779997 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:16.781625 28868 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:16.786811 28868 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:16.787279 28868 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.787602 28868 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:16.787973 28844 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.760296 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:16.799052 23926 raft_consensus.cc:2393] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:16.801102 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2461) took 1141 ms. Trace:
I20260709 12:22:16.743113 28827 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:16.747263 28823 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:16.759891 28842 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:16.810441 28810 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:16.811147 28810 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.814285 28665 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:16.810484 28875 log.cc:927] Time spent T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:22:16.816123 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:16.775906 28571 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:16.818581 28791 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.801683 24003 rpcz_store.cc:276] 0709 12:22:15.660007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.661967 (+  1960us) service_pool.cc:224] Handling call
0709 12:22:15.662365 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:16.188140 (+525775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.800780 (+612640us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54001a81d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:16.800989 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168445952}
W20260709 12:22:16.825805 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 43699.3us
I20260709 12:22:16.828756 24524 leader_election.cc:400] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 13. Current term is 14.
I20260709 12:22:16.830431 24524 leader_election.cc:403] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:16.817349 28491 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.840819 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:16.813723 28810 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.777135 28847 consensus_queue.cc:1059] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:22:16.843932 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:16.827593 28776 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:16.835487 28626 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.845286 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:16.836807 28827 raft_consensus.cc:697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:16.813803 28708 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.835566 28842 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.841109 28878 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 13. Current term is 14.
I20260709 12:22:16.827950 28742 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.843488 28571 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:16.848445 28776 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:16.858230 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 106301us
I20260709 12:22:16.932080 23892 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:16.882344 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2519) took 1229 ms. Trace:
I20260709 12:22:16.936081 23851 rpcz_store.cc:276] 0709 12:22:15.658358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.672436 (+ 14078us) service_pool.cc:224] Handling call
0709 12:22:15.681986 (+  9550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:16.252244 (+570258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.882080 (+629836us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54002fadd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:16.882275 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304641792}
W20260709 12:22:16.894263 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 440991us
I20260709 12:22:16.938968 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:16.902590 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:16.902890 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:16.903384 23999 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:16.904042 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.904747 23818 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:16.905035 24004 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:16.942946 24004 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:16.907583 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:16.923653 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:16.949128 24555 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:16.926795 24554 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:16.902287 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:16.922645 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:16.922088 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:16.909215 23998 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:16.913393 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:16.908643 23893 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:16.919045 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:16.956285 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 51622.7us
I20260709 12:22:16.939934 23892 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:16.957919 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.960237 24560 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:22:16.960397 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 86572.6us
I20260709 12:22:16.962399 23995 raft_consensus.cc:2393] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:16.963160 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:16.951257 24004 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.965003 24563 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:16.972414 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:16.972681 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:16.969543 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.976506 24002 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:16.960001 28882 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:16.884809 28571 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.978271 28882 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:22:16.980324 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.863359 28708 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:16.980929 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.871863 28842 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.965075 28267 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:16.883764 28742 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.994958 28267 raft_consensus.cc:697] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:16.859372 28626 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.995911 28267 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.998080 28792 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:16.908488 28673 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:16.999228 24000 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:16.915421 28794 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:16.923345 28603 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:16.985947 24004 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:16.986478 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:16.987715 28571 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.988440 28856 raft_consensus.cc:3055] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:16.989842 28795 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:16.885653 28635 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:16.965615 28799 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:16.878685 28491 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.889834 28823 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:17.004683 28754 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:17.001982 23998 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:17.002573 24002 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:16.881184 28868 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.048251 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:17.045920 24004 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:22:16.904170 28797 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:16.858675 28810 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:16.984175 24555 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:17.006424 24561 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:17.008191 23999 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:17.059824 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:17.012730 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:17.019866 23929 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:17.060766 23929 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:16.994217 28867 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:17.064767 24562 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:17.015874 28856 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:17.024453 23817 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:17.019675 28803 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:16.997761 28626 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:16.978794 28675 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:17.036093 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:17.083724 24556 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:17.048041 28505 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.084147 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:17.020242 28813 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:22:17.042388 28795 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:17.062193 23998 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:17.064079 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:17.023267 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:17.030884 24000 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:17.066493 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:16.877341 28827 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.020248 28673 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:16.978770 28882 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:17.031389 28773 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.047295 28624 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.085134 28803 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.160143 28624 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:17.089522 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.049068 24004 pending_rounds.cc:85] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 4
I20260709 12:22:17.162298 24004 pending_rounds.cc:107] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 8.5
W20260709 12:22:17.162554 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.162633 24004 raft_consensus.cc:2889] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:17.092105 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:17.054189 28754 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:17.020584 28603 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.054226 28792 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:22:17.047468 28799 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.065675 28797 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.141362 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:17.157037 23892 leader_election.cc:400] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13.
I20260709 12:22:17.091771 28836 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.158644 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:17.093328 28505 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.090185 23847 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:17.051975 24524 leader_election.cc:400] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8.
I20260709 12:22:17.202927 24524 leader_election.cc:403] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:22:17.172448 23996 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:17.076342 28810 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.165447 28773 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.162369 28789 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:17.174932 28826 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.174s
I20260709 12:22:17.147248 28776 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.082646 23929 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.232679 23929 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:17.185541 23999 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 18.
I20260709 12:22:17.193934 28635 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:17.235885 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 211506us
W20260709 12:22:17.197872 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 105849us
W20260709 12:22:17.240262 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 205008us
I20260709 12:22:17.198331 28844 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.242251 28844 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.244587 28844 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.246054 28708 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:17.078174 28867 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:17.199118 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 141309us
I20260709 12:22:17.248750 28708 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:17.249133 28603 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:17.153131 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 376465us
I20260709 12:22:17.251271 28799 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:17.251848 28799 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:17.253121 28799 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.165793 28754 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:17.141767 28809 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:17.226064 28673 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:17.266798 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:17.091620 28793 raft_consensus.cc:2764] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:22:17.142009 28877 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
I20260709 12:22:17.197301 23892 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:17.246176 28813 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:17.091507 28675 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.256069 24561 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:17.256431 23846 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:17.198606 28856 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.241811 23893 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:17.273154 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:17.276173 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:17.276371 24558 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:17.276743 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:17.289969 23999 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:17.281260 23969 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:17.239178 28571 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8.
I20260709 12:22:17.253551 28799 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.284379 23847 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: [10.5-11.6]
I20260709 12:22:17.226683 24001 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:17.282582 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:17.296991 24556 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:17.278095 23929 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
W20260709 12:22:17.292959 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.225404 28836 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:17.294783 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 97570.7us
W20260709 12:22:17.297794 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 56047.5us
I20260709 12:22:17.303508 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:17.268680 28791 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.298214 23929 pending_rounds.cc:85] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 9
I20260709 12:22:17.307708 23929 pending_rounds.cc:107] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:22:17.308723 23929 raft_consensus.cc:2889] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:17.238880 28789 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.312040 28796 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.312702 28796 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:17.313417 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59746.8us
I20260709 12:22:17.314646 24525 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:17.316174 28842 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:17.315258 28796 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:17.318701 23892 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:17.319348 24525 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:17.309532 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 72533.3us
I20260709 12:22:17.322520 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:17.293541 28891 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:17.328017 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 84109.6us
I20260709 12:22:17.329192 23892 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:17.330540 23820 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:17.332890 24525 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:17.300920 28792 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:17.278836 28857 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:22:17.308468 28673 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:22:17.346711 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 44435.6us
I20260709 12:22:17.291900 28809 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 12:22:17.360097 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.319761 28742 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:22:17.362002 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.322154 28842 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:22:17.352150 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60170.1us
I20260709 12:22:17.343674 28491 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:17.348362 28792 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.343385 28626 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.383029 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:17.383726 23849 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:17.376197 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:17.385200 23845 raft_consensus.cc:2410] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 12:22:17.344683 28810 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.317795 28791 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:17.386375 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 47459.1us
I20260709 12:22:17.387741 28791 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:17.353170 28571 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:17.390357 28571 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.390774 28571 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:17.357959 28856 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:17.393532 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:17.322170 28801 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:22:17.363543 28825 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:17.336393 28844 consensus_queue.cc:1059] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:22:17.352972 28505 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.290823 28795 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.367641 28673 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:17.384033 28792 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:17.379004 28491 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:17.347748 28891 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.423456 28491 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:17.402426 28626 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.423478 28825 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:17.441252 23847 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:17.430614 28773 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:17.436259 28857 raft_consensus.cc:3055] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:17.437026 28890 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:17.453660 28803 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:17.453945 28867 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.455330 28868 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.456877 28797 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:17.457477 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.458138 28898 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:17.433164 28908 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.465541 28895 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:17.467090 28886 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:22:17.471390 28891 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.472254 28825 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.479506 28626 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:17.492856 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 163723us
W20260709 12:22:17.539090 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 168571us
I20260709 12:22:17.436060 28801 consensus_queue.cc:1059] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:22:17.500707 23751 catalog_manager.cc:5697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:17.516110 28397 consensus_queue.cc:1059] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:17.501749 28882 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.519971 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:17.521083 24556 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:17.461258 28857 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:17.533044 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 202560us
I20260709 12:22:17.479509 28508 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:17.554306 23895 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:17.539143 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:17.461647 28888 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:22:17.483651 28742 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:17.539433 28799 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:17.451277 28892 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.213s
I20260709 12:22:17.439990 28859 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.210s
I20260709 12:22:17.451251 28673 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.553565 28624 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.549181 28801 raft_consensus.cc:3055] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:17.537613 28675 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.558032 28508 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:17.545035 28789 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:17.558401 28794 consensus_meta.cc:287] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.004s
I20260709 12:22:17.573402 23751 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:17.562011 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.561635 28836 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.665431 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:17.673638 28917 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:17.675076 28773 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.558673 28868 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.632527 28882 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.559669 28803 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:22:17.694677 28491 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.696892 28792 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.702387 28909 raft_consensus.cc:3055] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:17.580687 28801 raft_consensus.cc:740] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:17.668911 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 102231us
I20260709 12:22:17.773454 28829 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.790709 28885 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.536981 28908 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.643651 28742 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.567942 28791 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:17.570607 28877 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:17.683646 28776 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:17.706889 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 336809us
I20260709 12:22:17.871776 23817 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:17.620946 28897 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:22:17.642809 28878 raft_consensus.cc:3055] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:22:17.768604 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.770638 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:17.772765 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 215943us
I20260709 12:22:17.768186 28397 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:17.835261 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.790869 28842 raft_consensus.cc:3055] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:22:17.669516 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 102303us
I20260709 12:22:17.845852 28836 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:22:17.846392 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.842943 28508 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.856590 28491 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.906589 23892 leader_election.cc:400] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 15. Current term is 16.
I20260709 12:22:17.906930 23892 leader_election.cc:403] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:17.905612 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:17.857815 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:17.834486 28868 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:17.876175 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.836598 28859 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.881276 23845 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:17.881749 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:17.836081 28773 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.888242 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:17.888844 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:17.840059 28909 raft_consensus.cc:740] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:17.898485 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:17.773873 28626 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:17.880890 28877 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.917784 28877 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:17.918290 28794 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:17.919907 28794 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:17.921339 28794 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 15. Current term is 16.
I20260709 12:22:17.922302 28708 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.922070 28626 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.922844 28708 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.924468 28626 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.836155 28571 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.878489 28898 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:17.915874 23850 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:17.925450 28898 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.926962 28571 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:17.928123 28898 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:17.892922 28842 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:17.929419 28791 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:17.930225 28791 consensus_queue.cc:1243] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Peer 22996f888daf435398b693481171c18c log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:22:17.909096 28836 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.933226 28836 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:17.934053 28903 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:17.934219 28859 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.934705 28903 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.936715 28859 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:17.936954 28903 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:17.911592 28801 consensus_queue.cc:260] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.880702 28878 raft_consensus.cc:740] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:17.938799 28801 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:17.867261 28885 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.939365 28877 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.943682 28800 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:17.944278 28800 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.884725 28675 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:17.908450 28799 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:17.955125 23850 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:17.944631 28895 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:17.945616 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:17.948323 23853 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:17.952090 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:17.989614 23999 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:17.946907 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:17.947577 23854 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:17.980484 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:17.994063 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:17.995994 23851 raft_consensus.cc:2393] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 8: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:17.867723 28829 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.993333 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:17.985327 28491 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:17.999234 23925 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:18.001482 23852 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:17.999640 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:18.006954 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:18.009542 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.009721 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.010643 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.011541 23926 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 15: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:17.963829 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.012372 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.013413 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.012506 24556 raft_consensus.cc:2393] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 10: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:18.000085 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:17.898115 28397 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:17.956820 28754 consensus_meta.cc:287] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.003s
I20260709 12:22:17.916020 28925 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.020951 23927 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:18.023402 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:18.027426 28868 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:18.028374 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:18.029681 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:17.993245 28917 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.030349 28917 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.031275 23922 raft_consensus.cc:1240] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:17.985445 28794 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.956616 28809 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.916415 28789 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:18.035411 24560 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:18.036685 23848 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 18.
I20260709 12:22:18.040405 24556 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:18.044148 23928 raft_consensus.cc:2393] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:17.947237 28908 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:18.052198 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:18.056226 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 109272us
I20260709 12:22:18.056524 23927 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:17.985718 28799 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:17.939515 28878 consensus_queue.cc:260] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:17.954113 28842 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.057444 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:18.045193 28789 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.069262 28789 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:18.069464 28825 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.059346 28673 consensus_queue.cc:1059] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:22:18.031621 28491 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.061477 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.064805 28800 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.070082 28825 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.073578 28491 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.081640 28917 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:18.082363 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.082063 28825 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.084460 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.087291 28397 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.087524 28908 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:18.088344 28908 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:18.089035 28908 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:18.095145 28773 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:18.036590 28754 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.096705 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:18.097999 28754 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.098245 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:18.099699 28800 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:18.100278 28800 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:18.100828 28800 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:18.104996 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 222891us
I20260709 12:22:18.052220 28882 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:22:18.103572 28914 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:18.111222 28914 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.168591 28914 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:18.054100 28809 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.133275 28857 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.175460 28857 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:18.176297 28931 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.112s	user 0.003s	sys 0.000s
W20260709 12:22:18.168593 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53584us
I20260709 12:22:18.181604 28909 consensus_queue.cc:260] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.111963 28890 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.183367 28890 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.184959 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:18.186070 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.187664 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.188551 23999 raft_consensus.cc:2393] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 8: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:18.189584 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.190985 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.191677 23996 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:18.048457 28794 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.112673 28882 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:18.118752 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.119607 28626 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:18.121512 23927 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:18.124063 28708 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.127568 28885 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.128588 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.213163 24556 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:18.124102 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:18.135082 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.213680 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.049121 28925 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.138454 28799 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.140774 28842 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:18.148218 28908 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.150450 28877 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.113494 28878 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:18.158738 28884 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:18.159585 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:18.236197 23926 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:18.161221 28792 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.113679 28920 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:18.195297 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.198915 23818 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:18.199752 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:18.200392 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 492905us
I20260709 12:22:18.197310 23751 catalog_manager.cc:5697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 11 to 14, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 14 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:18.201355 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.259271 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:18.199680 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:18.260418 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60815.3us
I20260709 12:22:18.212149 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:18.137099 28829 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:18.215888 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 91859.9us
I20260709 12:22:18.217571 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.257676 23895 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:18.265164 23929 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:18.219121 28508 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:18.275058 28624 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:18.275565 28624 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:18.275977 28624 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:18.276139 23893 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:18.201406 28903 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:18.278285 28903 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.220613 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.280082 24003 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:22:18.220836 23923 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:18.221462 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.231223 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.232285 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.234333 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:18.241899 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.210584 28773 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:18.286739 28773 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:18.281755 28914 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:18.266537 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 67729.2us
I20260709 12:22:18.265496 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:18.289167 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:18.289579 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:18.290975 23892 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:18.291303 23818 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:18.292183 23892 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:18.292575 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:18.292954 28667 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:18.293291 28505 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:18.294126 28827 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:18.270426 28825 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:18.308314 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:18.310711 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.271441 28754 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:18.280743 28903 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.287349 28773 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:18.267601 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:18.346228 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:18.346406 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.346511 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.295011 24000 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:18.293399 23892 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:18.296221 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:18.269827 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.349503 23927 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 15: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:18.253592 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.299625 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.302392 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:18.312986 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:18.309307 23751 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 7 to 12, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:18.313596 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.256992 28675 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.314872 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.358997 23921 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:18.226410 28708 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:18.315755 23893 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:18.305437 28505 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:18.298743 23966 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.547s (SENT) [suppressed 10 similar messages]
W20260709 12:22:18.366127 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 67433.2us
I20260709 12:22:18.331789 28909 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:18.368825 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.332278 28847 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.333046 28624 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.334275 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:18.305223 28829 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:18.293741 28667 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:18.314188 28795 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:18.335493 28914 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:18.336460 24002 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 15: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:18.401002 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.402015 23921 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:18.313582 23846 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
W20260709 12:22:18.354710 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 61392.1us
I20260709 12:22:18.402910 23846 pending_rounds.cc:85] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 8
I20260709 12:22:18.403164 23846 pending_rounds.cc:107] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:22:18.403368 23846 raft_consensus.cc:2889] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:18.210518 28882 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.352484 23751 catalog_manager.cc:5697] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:18.295807 28796 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:18.317242 28754 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.369554 24003 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
W20260709 12:22:18.374910 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.367931 28505 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:18.387238 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 71569.4us
I20260709 12:22:18.362591 28791 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:18.400128 23926 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:18.350835 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:18.394294 28825 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:18.411566 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:18.377652 28801 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:18.386477 28829 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:18.417205 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 66503.1us
I20260709 12:22:18.286837 28920 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.404943 28803 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.368270 28675 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.425741 24524 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:18.426169 23921 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:18.404748 28626 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.427251 23818 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:18.385353 28847 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.418697 28754 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:18.421785 28868 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:18.437014 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:18.449343 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:18.418352 28673 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:18.428396 28829 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:18.470031 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.422071 28796 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:18.429407 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:18.508720 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 71811.9us
I20260709 12:22:18.431981 28905 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:18.525965 23926 raft_consensus.cc:2393] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:18.527897 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.436401 28571 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:18.428210 28801 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.531162 28893 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:18.493707 28491 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:18.494870 28794 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.527209 28420 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:18.436167 28626 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.437354 28803 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.537564 28895 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.531927 28890 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:18.552805 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.538904 28868 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:18.552412 28794 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:18.548290 28905 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:18.570119 28794 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.572316 28794 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.543694 28893 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:18.574049 28893 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:18.574777 28882 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.542964 28624 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.565765 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:18.566962 28920 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.567579 28809 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.553318 28420 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.576109 23751 catalog_manager.cc:5697] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 8 to 11, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 11 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.583384 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.558881 28908 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:18.611763 23751 catalog_manager.cc:5697] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 10 to 13, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 13 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:18.540608 28800 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.543084 28571 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.563195 28868 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:18.618232 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:18.629244 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 203594us
W20260709 12:22:18.630646 23747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43178 (request call id 254) took 54100 ms (client timeout 15000 ms). Trace:
I20260709 12:22:18.618901 23751 catalog_manager.cc:5697] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:18.621272 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.611987 28420 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:18.557943 28491 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.630575 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:18.614969 28791 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.654831 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.655159 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.657846 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.658638 24559 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:22:18.655575 24558 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:22:18.564451 28895 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.655994 24561 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:18.639642 23751 catalog_manager.cc:5697] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:18.629402 28868 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:18.631129 23747 rpcz_store.cc:269] 0709 12:21:24.524563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.530646 (+  6083us) service_pool.cc:224] Handling call
0709 12:22:18.625052 (+54094406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:15.282784 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:15.283462 (+   678us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:15.283509 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:22:15.283527 (+    18us) tablet.cc:662] Decoding operations
0709 12:22:15.284457 (+   930us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:15.284565 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:15.284590 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:22:15.285291 (+   701us) tablet.cc:701] Row locks acquired
0709 12:22:15.285340 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:22:15.285539 (+   199us) write_op.cc:270] Start()
0709 12:22:15.285689 (+   150us) write_op.cc:276] Timestamp: P: 1783599735285461 usec, L: 0
0709 12:22:15.285724 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:22:15.457844 (+172120us) log.cc:844] Serialized 2849 byte log entry
0709 12:22:16.047381 (+589537us) op_driver.cc:464] REPLICATION: finished
0709 12:22:16.258275 (+210894us) write_op.cc:301] APPLY: starting
0709 12:22:16.274119 (+ 15844us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:16.406933 (+132814us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:16.407054 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:16.550613 (+143559us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:16.596907 (+ 46294us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:22:16.596973 (+    66us) write_op.cc:312] APPLY: finished
0709 12:22:16.597322 (+   349us) log.cc:844] Serialized 73 byte log entry
0709 12:22:16.597511 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:16.597632 (+   121us) write_op.cc:454] Released schema lock
0709 12:22:16.597705 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:16.598196 (+   491us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:16.598226 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":109373,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":169615,"apply.run_cpu_time_us":16261,"apply.run_wall_time_us":369816,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33303,"num_ops":7,"prepare.queue_time_us":233585,"prepare.run_cpu_time_us":14446,"prepare.run_wall_time_us":414250,"raft.queue_time_us":144808,"raft.run_cpu_time_us":41061,"raft.run_wall_time_us":130100,"replication_time_us":761482,"thread_start_us":532426,"threads_started":4,"wal-append.queue_time_us":291277,"wal-append.run_cpu_time_us":95081,"wal-append.run_wall_time_us":1858861}]]}
I20260709 12:22:18.690448 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.693944 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:18.689834 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.694486 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.694998 24554 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:18.690985 23921 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:18.699708 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.696087 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:18.689179 23751 catalog_manager.cc:5697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 9 to 10, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 10 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.703855 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.707340 24561 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:18.706633 23751 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:18.615001 28796 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.677027 28842 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:18.734184 28842 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:18.734668 28842 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:18.734277 28829 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.735132 28571 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.735931 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:18.711381 28936 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 12:22:18.697536 28911 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:22:18.713970 28505 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.688055 28925 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:18.690088 28920 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.740236 28920 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.675902 28791 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:18.738713 28893 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:18.744078 28791 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.723776 28754 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:18.726184 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.751382 23925 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:18.757266 28754 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.759690 28491 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.761288 28801 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:18.762264 28847 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.763761 23751 catalog_manager.cc:5697] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 10, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:18.765791 28626 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.768438 28800 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:18.771595 28773 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:18.775996 28508 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.001s
I20260709 12:22:18.809114 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:22:18.814042 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.780376 23854 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:18.787868 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:18.779476 28931 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:22:18.828843 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.819545 23922 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:18.829787 23926 raft_consensus.cc:2393] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:18.783439 23751 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 8 to 10, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:18.823587 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:18.768554 28842 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:18.781870 28857 consensus_meta.cc:287] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.000s
I20260709 12:22:18.832044 23851 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:18.824915 23846 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:18.841665 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:18.845158 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.845736 23999 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:18.833600 23751 catalog_manager.cc:5697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 7 to 12, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 12 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.845829 23921 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:18.850904 23995 raft_consensus.cc:2410] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:22:18.852423 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.853111 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.850939 23751 catalog_manager.cc:5697] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 6 to 7, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 7 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.843101 28893 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:18.857165 24557 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:18.858530 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.858700 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:18.859333 23927 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:18.861680 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.885491 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.886904 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.887707 24002 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:22:18.889231 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:18.895318 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.896579 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:18.897181 23996 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:18.888689 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:18.906109 28675 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.911908 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:18.923436 23929 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 15: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:18.924320 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:18.920912 28829 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.921625 28895 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:18.929498 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.931411 23996 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 15: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:18.847678 28803 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:18.859829 28891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.011s	sys 0.011s
I20260709 12:22:18.914322 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:18.940019 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:18.973174 28891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.011s	sys 0.011s
W20260709 12:22:18.937026 28909 consensus_meta.cc:287] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.002s
I20260709 12:22:18.941810 23998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2262) took 1050 ms. Trace:
W20260709 12:22:18.943779 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 511558us
I20260709 12:22:18.974786 23998 rpcz_store.cc:276] 0709 12:22:17.891101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.891225 (+   124us) service_pool.cc:224] Handling call
0709 12:22:17.891515 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:17.907568 (+ 16053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:17.907597 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:17.914392 (+  6795us) log.cc:844] Serialized 26 byte log entry
0709 12:22:18.232083 (+317691us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:18.232124 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.936529 (+704405us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b54001d2754. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:18.936595 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.936657 (+    62us) raft_consensus.cc:1685] finished
0709 12:22:18.936673 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.941721 (+  5048us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5758,"raft.queue_time_us":7998,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":24861,"spinlock_wait_cycles":9180928,"thread_start_us":224598,"threads_started":1,"wal-append.queue_time_us":529333}
I20260709 12:22:18.917711 23751 catalog_manager.cc:5697] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 3 to 9, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 9 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:18.950299 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:18.976428 23927 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:18.952294 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:18.977905 24560 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:22:18.978053 23928 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:18.978278 23996 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:22:18.953995 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:18.962831 28789 consensus_meta.cc:287] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.893s	user 0.008s	sys 0.004s
W20260709 12:22:18.963847 28945 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:22:18.952832 28548 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.966055 28773 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:18.935537 28893 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:22:18.927930 23818 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:18.978981 23923 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:18.985857 24003 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:18.990495 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:19.000057 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:19.000451 23997 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 13. Current term is 14. Ops: []
W20260709 12:22:19.001899 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88020.1us
I20260709 12:22:19.002772 23817 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.004325 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.006693 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:19.013212 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:19.017154 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 89291.9us
I20260709 12:22:19.017683 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.018997 28895 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:19.019872 28895 consensus_queue.cc:1059] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:19.020845 28895 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:19.021554 28895 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:19.022080 28810 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:22:19.026542 28953 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:22:19.027168 28949 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:19.049535 28961 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:19.057741 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:19.050705 28810 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:19.058660 24555 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:19.059382 28810 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.000005 28548 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.063834 28548 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:19.065761 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:19.066375 24563 raft_consensus.cc:1240] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:19.066496 24562 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:19.067359 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:19.067971 28859 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.068581 28859 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:19.071022 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.011410 28920 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:18.996315 28789 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.038657 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2255) took 1151 ms. Trace:
I20260709 12:22:19.074108 24001 rpcz_store.cc:276] 0709 12:22:17.887178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.887302 (+   124us) service_pool.cc:224] Handling call
0709 12:22:17.906314 (+ 19012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:17.987376 (+ 81062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:17.987416 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:17.997974 (+ 10558us) log.cc:844] Serialized 26 byte log entry
0709 12:22:18.408524 (+410550us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:18.408583 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.038273 (+629690us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b540038b154. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:19.038322 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:19.038367 (+    45us) raft_consensus.cc:1685] finished
0709 12:22:19.038380 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.038594 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1071,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":12470,"spinlock_wait_cycles":185257216,"thread_start_us":355726,"threads_started":1,"wal-append.queue_time_us":536461}
I20260709 12:22:19.076378 24004 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.032509 28842 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:19.041594 23820 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.079867 28960 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:19.080271 28961 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:19.080618 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:19.080715 28961 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:19.080492 28960 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.081427 23895 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:19.081528 23820 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:19.082429 23820 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.082881 28960 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:19.083434 23820 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:19.083995 28949 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:19.084453 28949 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.084823 28949 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.085566 28885 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:19.085712 28267 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:19.086030 28885 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:19.086161 28267 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.086539 28267 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.088744 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:19.089430 28920 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:19.049554 23818 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:19.090252 28920 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:19.090694 28920 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.091054 28920 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.091395 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:19.092020 23923 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.092113 28675 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:19.092686 28675 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.093093 28675 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.040246 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:19.093930 23928 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:19.094838 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:19.066628 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:19.096844 24554 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.038486 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:19.098806 24560 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:19.076244 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:19.099720 24555 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:19.079246 28801 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.086498 28885 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.100368 28801 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.085294 28826 consensus_queue.cc:1059] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:19.104231 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:19.086325 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 109384us
I20260709 12:22:19.066514 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:19.061468 28810 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.081295 28961 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:19.122246 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:19.046679 24524 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.126662 28954 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:19.127933 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 81321.3us
I20260709 12:22:19.107337 23998 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:19.050936 28895 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.131069 28895 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:19.131745 24004 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:19.108379 28842 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.134279 28842 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.110726 28826 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:19.138096 28826 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:19.139217 28826 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.140679 28826 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.112365 28801 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:19.115899 23818 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:19.128657 28868 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.107774 23895 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:19.130163 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.121315 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:19.146485 24554 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:19.048161 23817 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:19.170483 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 122374us
I20260709 12:22:19.166312 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.168391 23854 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 15: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:19.168478 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 60778.4us
I20260709 12:22:19.167611 23848 raft_consensus.cc:2393] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:19.178462 23895 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:19.179168 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.180064 23853 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 8.
I20260709 12:22:19.184365 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.184635 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.188344 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.189155 24524 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:19.190601 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:19.192080 24524 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.195528 23817 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.198232 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:19.201706 23999 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 12:22:19.203855 24527 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.208691 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:19.211184 24001 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:22:19.211823 24001 pending_rounds.cc:85] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 5
I20260709 12:22:19.212297 24001 pending_rounds.cc:107] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:22:19.212697 24001 raft_consensus.cc:2889] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:19.147943 28954 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.217816 24556 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:19.114506 28859 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:19.220297 24558 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:19.151345 28836 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:19.179610 28909 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:19.249490 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 47583.5us
I20260709 12:22:19.221360 23852 raft_consensus.cc:606] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 15 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.226833 23849 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:19.054481 28420 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.181757 28809 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:19.261686 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.174769 28799 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:19.230863 28842 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:19.245894 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.248401 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.254382 23999 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:19.194507 28491 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:19.279395 23923 raft_consensus.cc:2468] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:19.201685 28571 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:19.147403 28891 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:22:19.204531 28796 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:19.143951 28920 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.213863 28878 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:19.290897 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.265630 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2325) took 1139 ms. Trace:
I20260709 12:22:19.267385 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:19.269304 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 73901.3us
I20260709 12:22:19.195863 28847 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:19.286907 24001 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.195115 28960 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:22:19.253840 28909 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:19.288818 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 96830.9us
I20260709 12:22:19.214110 28626 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:22:19.271164 28905 consensus_queue.cc:1059] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:19.292495 23817 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.291746 23922 rpcz_store.cc:276] 0709 12:22:18.116275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.116483 (+   208us) service_pool.cc:224] Handling call
0709 12:22:18.135895 (+ 19412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.830412 (+694517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.230498 (+400086us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b5400105c54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:19.255680 (+ 25182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1571319680}
W20260709 12:22:19.294862 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 78425us
I20260709 12:22:19.300447 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.286417 28842 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:19.313830 23817 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:19.318059 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:19.263185 28836 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.250113 28954 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.343590 23847 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:19.358055 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:19.294921 28571 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:19.290467 28491 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:19.301609 28909 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.325454 28925 raft_consensus.cc:3055] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:19.330490 28847 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.374070 28925 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:19.374204 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:19.374423 28847 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.374981 23923 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:19.375241 28925 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.375993 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:19.376792 28925 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:19.377494 28847 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:19.341987 28920 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:19.342429 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.389407 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.295418 28878 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.394099 28878 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.395884 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:19.396786 23852 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 15: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:19.396983 28895 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.298225 28892 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:19.303869 28890 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:19.356438 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:19.406896 24001 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:19.407950 23925 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:19.397776 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.409669 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:19.410319 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:19.348789 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.357394 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:19.412513 23927 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:19.412358 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:19.321547 23999 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:19.413398 24000 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:19.357281 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:19.303138 28917 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.347747 24525 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:19.416800 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 69166.7us
I20260709 12:22:19.361488 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:19.418620 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 57275.4us
I20260709 12:22:19.420485 23892 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.409754 23852 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:19.423820 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.431643 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:19.433579 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:19.435943 23850 raft_consensus.cc:2368] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:19.368122 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:19.369279 28491 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.448794 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:19.372335 28836 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:19.338728 28967 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:22:19.377746 28954 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:19.378075 28799 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:19.378201 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:22:19.378799 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 65095.2us
I20260709 12:22:19.379441 23845 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:22:19.385638 23996 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:19.494998 23817 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.320326 28842 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:19.415652 28571 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.439348 28420 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:19.439515 28795 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:19.440686 28825 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:19.385408 28773 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.407243 28960 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.444496 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:19.445089 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.445237 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.507437 23849 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:19.443843 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.309607 28665 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 12:22:19.366487 23847 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 12:22:19.447094 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 148870us
W20260709 12:22:19.516079 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 72337.1us
I20260709 12:22:19.424170 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.449604 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.516821 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.408682 28859 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:19.454447 23846 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:19.446768 28847 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:19.498287 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.449194 28920 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:19.511044 23849 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:19.513022 23817 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.507308 24000 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 16.
I20260709 12:22:19.516497 24524 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:19.534307 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:19.535665 23820 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.521862 23922 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 15: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:19.516677 23893 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:19.446767 28917 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.528465 23847 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:19.529693 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:19.497686 28842 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.498411 28891 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:19.609670 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:19.609962 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:19.610574 24554 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.610606 24557 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
W20260709 12:22:19.543917 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 119817us
I20260709 12:22:19.511595 28809 raft_consensus.cc:697] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 10 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:19.514514 28868 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:19.615558 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:22:19.617923 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 82342us
I20260709 12:22:19.626217 24556 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:19.626885 23820 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.546425 23966 leader_election.cc:400] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:19.632709 23966 leader_election.cc:403] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:22:19.544596 24561 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:19.547768 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:22:19.637146 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 124211us
I20260709 12:22:19.638024 24554 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:19.639575 23817 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.644240 28548 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:19.609367 28825 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:19.647389 28949 consensus_meta.cc:287] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 12:22:19.647928 28949 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.649309 23853 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:19.530821 28836 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:19.530404 28857 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:19.621752 28969 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260709 12:22:19.624773 28675 consensus_meta.cc:287] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.002s
I20260709 12:22:19.514176 28773 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.623437 28795 raft_consensus.cc:2764] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:22:19.549522 28954 raft_consensus.cc:2804] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:22:19.684051 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 44594.6us
I20260709 12:22:19.530042 28920 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:19.542440 28905 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:19.565920 28803 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:19.630110 28976 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:19.685783 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 139528us
I20260709 12:22:19.656734 28624 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:19.564512 28801 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 12:22:19.698711 24556 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 17.
I20260709 12:22:19.706725 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:19.543607 28983 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.162s
I20260709 12:22:19.673187 28626 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:19.529913 28960 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.687005 28665 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.651031 28891 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.699174 28920 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:19.698014 23966 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:19.687516 28898 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:19.699362 28803 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.700412 28954 raft_consensus.cc:697] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:19.721235 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:19.726969 28803 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:19.728106 28986 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:19.728737 28986 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:19.729233 28986 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.723228 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:19.737855 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:19.715538 28987 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:19.745172 28665 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:19.723490 28983 consensus_queue.cc:1243] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 14.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:22:19.683488 28982 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:22:19.682605 28675 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.679303 28961 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.765545 28949 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:19.736413 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:19.776420 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:19.724298 28905 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:19.758662 28954 consensus_queue.cc:237] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.759474 28505 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:19.734616 28898 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.760547 28891 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:19.761041 28809 consensus_queue.cc:237] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.766077 23845 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:19.784931 24560 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 8.
I20260709 12:22:19.758438 28991 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:19.772085 28917 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:19.724790 28624 raft_consensus.cc:993] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:19.724656 28978 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:19.765863 28267 consensus_meta.cc:287] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.000s
W20260709 12:22:19.773448 28826 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.000s
W20260709 12:22:19.781208 28810 consensus_meta.cc:287] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.002s
W20260709 12:22:19.779274 28970 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.486s	user 0.006s	sys 0.003s
I20260709 12:22:19.725843 28895 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:19.793231 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 276611us
I20260709 12:22:19.831837 28803 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:19.767366 28961 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:19.776690 28789 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:19.765570 28675 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:19.822644 28991 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:19.793069 28905 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.864559 28905 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.771150 28960 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:19.843940 23851 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
W20260709 12:22:19.862625 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 234096us
I20260709 12:22:19.749673 28909 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.882572 23996 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:19.874950 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.901028 23998 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:19.903604 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:19.880061 23893 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:19.776859 28878 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.926614 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:19.927477 24001 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:19.863907 28810 raft_consensus.cc:1081] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 15 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
W20260709 12:22:19.917032 28925 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.540s	user 0.002s	sys 0.010s
W20260709 12:22:19.936625 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 61736.3us
I20260709 12:22:19.943902 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.949908 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:19.950759 23850 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:19.845438 28795 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:22:19.846078 28792 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:22:19.844013 28267 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:19.918023 28882 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:22:19.972899 23848 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:19.959941 28885 consensus_meta.cc:287] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.859s	user 0.011s	sys 0.000s
I20260709 12:22:19.921007 28917 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:22:19.977226 24001 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:19.975171 28420 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:19.959470 28773 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:19.978312 23845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:19.935756 28789 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:22:19.940558 28959 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:22:19.992256 23845 raft_consensus.cc:606] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:19.971264 28877 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:19.974216 28491 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:22:19.996060 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 289413us
I20260709 12:22:19.998829 23845 raft_consensus.cc:614] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:19.988767 28885 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.000149 28491 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.999246 23817 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:20.000598 28491 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:20.020090 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 263115us
W20260709 12:22:20.033924 28992 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:22:20.035810 28976 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:19.988235 28791 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:22:20.039669 28885 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:20.041828 28898 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:20.042635 28803 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:20.048496 28796 consensus_meta.cc:287] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.757s	user 0.006s	sys 0.004s
I20260709 12:22:20.048666 28905 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.050525 28878 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:20.020570 28891 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:22:20.053977 28909 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:20.056650 28905 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:20.018884 28810 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:20.049180 28796 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:20.041671 28892 consensus_meta.cc:287] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.619s	user 0.003s	sys 0.007s
I20260709 12:22:20.060226 23820 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:20.060976 23969 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:20.071587 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:22:20.066336 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 117845us
I20260709 12:22:20.073693 23820 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:20.075524 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:20.081400 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:20.096920 24554 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 8.
I20260709 12:22:20.101536 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:20.102632 24556 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:20.098627 23820 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:20.124066 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:20.125206 24554 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 14: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:20.074761 28905 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:20.074581 28810 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:20.091635 28667 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:20.091840 28976 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:20.090978 28892 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:20.108909 23969 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:20.132273 23892 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:20.128571 28903 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:20.144291 28796 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:20.147070 28796 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:20.143671 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 202399us
I20260709 12:22:20.127110 28267 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:20.147495 28796 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:20.146231 23849 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:20.104669 28665 consensus_queue.cc:1059] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:22:20.151073 23845 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:22:20.100742 28491 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:20.150483 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49225us
I20260709 12:22:20.152755 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:20.156599 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:20.157172 23845 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:20.158090 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:20.158830 24559 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 14: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:20.159678 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:20.157454 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:22:20.158357 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 278338us
I20260709 12:22:20.165632 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:20.166522 24004 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:20.127089 28877 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:22:20.126904 28803 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:22:20.168726 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:20.169060 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:20.176349 23851 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:20.169744 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:20.177649 24000 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:20.170800 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:20.178367 24556 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:20.173483 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:20.178722 23854 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:20.181344 23996 raft_consensus.cc:1217] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Deduplicated request from leader. Original: 12.12->[13.13-13.13]   Dedup: 13.13->[]
I20260709 12:22:20.182128 23996 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:22:20.144026 28976 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:20.186242 24004 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:20.150596 28891 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:20.190057 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:20.136157 28708 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:22:20.136476 28792 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:22:20.192495 23997 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:22:20.142964 28397 consensus_queue.cc:1059] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:22:20.197749 23847 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:20.142791 28885 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:22:20.193152 24004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:49640
I20260709 12:22:20.246063 24004 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.246484 24004 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:20.210021 28999 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:20.169291 28903 raft_consensus.cc:697] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:22:20.218209 28842 consensus_meta.cc:287] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.004s
I20260709 12:22:20.210618 28990 consensus_queue.cc:1059] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:22:20.208798 28810 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.171801 28667 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:20.269907 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:20.277190 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:20.244024 23851 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:20.141952 28986 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.248767 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:20.279444 24000 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:20.258898 24004 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:20.265271 28920 consensus_meta.cc:287] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 12:22:20.297467 24004 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:20.291465 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:20.264199 28792 consensus_queue.cc:1243] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 22996f888daf435398b693481171c18c log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:22:20.305025 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 129362us
I20260709 12:22:20.309959 24561 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:20.286371 28999 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 17 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:22:20.308646 28836 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.002s
I20260709 12:22:20.318305 23818 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:20.268285 28842 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.308897 29005 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:20.328991 23818 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:20.305528 28920 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.324616 28836 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:20.347772 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:20.325529 28827 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.331372 28978 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:20.329978 28826 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.362875 24555 raft_consensus.cc:1240] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:20.382246 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:20.385668 24563 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:20.355589 28809 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:20.358107 28792 raft_consensus.cc:3055] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:20.314409 28976 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.353565 28491 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:20.400085 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:20.404449 23846 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:20.404783 23846 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:20.386197 28978 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:20.413419 28955 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.425313 23845 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:20.396441 28803 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:20.407406 23846 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.427531 23846 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:20.394191 29007 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:20.398643 28792 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:20.366222 28827 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.384737 28826 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.394659 28571 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 13.13, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:22:20.452831 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:20.406432 28809 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:20.440613 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:20.443637 23925 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:20.444401 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:20.456871 23926 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:20.351320 29005 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.397490 28857 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:22:20.347433 28903 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.455806 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:20.456437 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:20.439440 28801 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:20.463109 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:20.464701 23923 raft_consensus.cc:2393] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:20.464867 23920 raft_consensus.cc:2393] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:20.434962 28803 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:20.471841 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 89655.9us
I20260709 12:22:20.474323 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:20.475394 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:20.475536 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:20.476033 23851 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:20.438993 29007 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:20.478839 29013 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:22:20.479722 28827 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:20.483151 28809 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.486940 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:20.491531 24561 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
W20260709 12:22:20.463867 29010 log.cc:927] Time spent T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:22:20.459648 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:20.466748 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:20.459672 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:20.493909 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:20.501605 23851 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:20.461791 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:20.536334 23851 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:20.538255 23922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:20.538894 23922 raft_consensus.cc:606] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:20.539233 23922 raft_consensus.cc:614] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:20.494732 23926 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:20.523234 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:20.545858 23920 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:20.498659 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:20.489501 28571 consensus_queue.cc:1243] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 14.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:22:20.502591 29011 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:22:20.470459 28801 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:20.489923 28803 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:20.411898 28999 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.493691 29018 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:22:20.555058 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 56505.1us
I20260709 12:22:20.439185 28955 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.493943 28986 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:20.501905 28857 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:20.567463 29012 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:22:20.557799 29016 log.cc:927] Time spent T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:22:20.569279 23854 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:20.572336 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:20.556679 28789 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:22:20.570335 29000 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.431s	user 0.003s	sys 0.000s
I20260709 12:22:20.502632 28892 consensus_queue.cc:1059] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:22:20.568794 28801 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:20.593827 23893 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:20.595072 23817 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:20.599498 23846 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:22:20.558714 28878 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 12:22:20.607789 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 132324us
I20260709 12:22:20.611760 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:20.503022 28792 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.591907 29018 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:20.618950 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:20.587636 28667 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:22:20.662665 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 43787.8us
W20260709 12:22:20.663177 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.663486 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:20.586747 28857 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.590363 28827 consensus_queue.cc:1059] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:22:20.552124 28978 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.600719 28997 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:20.613492 28571 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:20.618587 28986 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:20.723652 28986 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.726280 23923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:20.726954 23923 raft_consensus.cc:606] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:20.728790 28997 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:20.729138 28986 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:20.730429 29020 log.cc:927] Time spent T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
W20260709 12:22:20.702443 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 107474us
I20260709 12:22:20.621282 28959 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.621095 29024 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.733026 23817 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:20.612784 28920 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:20.708952 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 45530.5us
I20260709 12:22:20.692567 29018 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:20.713737 29009 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:20.618335 28397 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:20.715155 28857 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:20.722532 28571 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.735271 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:20.739197 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:20.770975 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:20.743062 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:20.764403 24524 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:20.693753 29017 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.628994 28990 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:22:20.774960 29017 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.774294 28571 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:20.777340 24556 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:20.781430 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:20.782330 23922 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:20.706256 28987 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:20.602788 29007 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.609683 29025 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.165s
I20260709 12:22:20.753238 29024 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.753968 29018 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:20.803812 28857 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:20.806694 28826 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:20.817656 28571 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:20.822084 28829 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:20.804319 28986 consensus_queue.cc:1059] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:22:20.822191 29024 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:20.828190 29007 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:20.753065 28959 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:20.833453 29027 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.854709 29039 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:20.837653 29005 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:20.800365 29009 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:20.880280 29030 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:22:20.856319 28667 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:20.882503 29023 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 12:22:20.883188 28993 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.947320 28993 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.879585 29029 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.882862 29026 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:20.889341 28796 consensus_meta.cc:287] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.741s	user 0.006s	sys 0.007s
I20260709 12:22:20.897109 29041 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:20.859622 28955 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:20.897681 29027 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:20.883471 28959 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:20.899221 29017 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:20.900301 29032 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:22:20.909062 29005 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.909678 29040 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:20.913306 23926 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:20.913829 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.917802 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 871) took 1377 ms. Trace:
I20260709 12:22:21.023463 24555 rpcz_store.cc:276] 0709 12:22:19.540845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.540995 (+   150us) service_pool.cc:224] Handling call
0709 12:22:19.551120 (+ 10125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.367440 (+816320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.917423 (+549983us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54004e43d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:20.917697 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866270592}
I20260709 12:22:20.929458 28925 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:20.932425 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2581) took 1549 ms. Trace:
I20260709 12:22:20.925487 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:20.943667 28917 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:20.944646 28877 raft_consensus.cc:3055] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:20.880309 28986 raft_consensus.cc:3055] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:20.952804 24556 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:22:20.898352 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 127481us
I20260709 12:22:21.032425 24001 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:22:21.032969 24001 pending_rounds.cc:85] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 8
I20260709 12:22:21.033342 24001 pending_rounds.cc:107] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:22:21.033838 24001 raft_consensus.cc:2889] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:20.966436 23996 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:22:21.017277 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 52360.2us
I20260709 12:22:20.956192 28809 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:20.960929 29019 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.407s	user 0.005s	sys 0.000s
I20260709 12:22:21.025172 23849 rpcz_store.cc:276] 0709 12:22:19.382742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.533125 (+150383us) service_pool.cc:224] Handling call
0709 12:22:19.533352 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.148032 (+614680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.932066 (+784034us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400071f54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:20.932331 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409081088}
I20260709 12:22:21.035776 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:21.029327 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:21.032523 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 227551us
I20260709 12:22:21.036877 24000 raft_consensus.cc:2368] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 14. Current term is 15.
I20260709 12:22:21.016155 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.039119 23922 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:21.039887 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.041903 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.043871 23846 raft_consensus.cc:2393] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:21.043332 23817 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:21.050750 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.051606 23925 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:21.028234 28917 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:21.030411 28789 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:20.968148 28803 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.037365 28986 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:21.040197 28877 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:20.962234 28796 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.064327 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.065688 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:21.066605 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.056607 28892 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:20.959488 29029 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.045214 28997 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:21.068287 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.069921 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.057421 28810 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:21.028647 29005 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.066658 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.153635 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.031484 28925 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.057997 28397 raft_consensus.cc:697] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:22:21.162017 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 118757us
I20260709 12:22:21.063690 28993 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.028832 29040 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.049862 28809 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.096735 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.166465 23925 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:21.057385 28903 consensus_queue.cc:1059] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:22:21.169577 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:21.131319 23995 raft_consensus.cc:2368] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9.
I20260709 12:22:21.134222 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.077020 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:21.171576 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 94641.1us
W20260709 12:22:21.173933 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.174851 28925 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:21.176142 29037 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:22:21.178026 29045 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:21.178643 29045 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.180008 29040 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:21.180965 29045 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.182358 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:21.183162 24556 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 15: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:21.149712 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.183759 28809 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:21.184365 29044 log.cc:927] Time spent T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:22:21.184442 28803 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:21.185463 29035 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:22:21.185665 23996 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:21.188246 28987 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:21.189667 23926 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:21.094475 28892 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.072757 28789 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.192065 28892 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.192622 28789 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.131251 28917 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.194983 28917 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:21.195729 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.170444 23922 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:21.196156 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:21.196342 24002 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:21.196871 23925 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:21.183058 28796 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:21.197688 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:21.197944 23893 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:21.198307 29027 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:21.194911 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:21.156803 23998 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:22:21.172891 23966 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:21.199726 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:21.201563 29064 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:21.202095 29064 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.202164 29042 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:21.172686 28986 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.202592 29064 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:21.203222 28986 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:21.203446 29052 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:21.204144 29052 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:21.204959 29052 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.204985 24001 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:21.206161 28859 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:21.206647 28859 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:21.207006 29017 consensus_queue.cc:1059] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:21.162129 28810 raft_consensus.cc:697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:21.207520 28859 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.202759 29042 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:21.210258 29041 raft_consensus.cc:3055] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:21.210173 29042 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.199095 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:21.210744 29041 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:21.207345 29029 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.211611 28959 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:21.211786 29041 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.213068 29041 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:21.213337 29031 raft_consensus.cc:3055] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:21.213769 29031 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:21.214363 23925 raft_consensus.cc:2368] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:21.214676 29031 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.215467 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:21.215893 29031 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:21.190845 29005 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:21.208786 28810 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.199077 24556 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:21.217382 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.219399 23922 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:21.221540 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.222484 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.223893 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.228229 23924 raft_consensus.cc:2393] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:22:21.221011 28801 consensus_meta.cc:287] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.608s	user 0.007s	sys 0.004s
I20260709 12:22:21.230129 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.232529 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.233214 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.233577 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.237761 23847 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:21.237411 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:21.233666 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:21.234375 24002 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:21.239135 23852 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:21.239749 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.258323 24556 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:22:21.258760 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.259688 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.261022 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.263067 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.264243 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:21.265566 23852 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:21.222374 28920 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:21.270623 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 43897.6us
I20260709 12:22:21.271791 24525 leader_election.cc:400] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 14. Current term is 15.
I20260709 12:22:21.272512 24525 leader_election.cc:403] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:22:21.158535 28997 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.277592 24003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2546) took 1110 ms. Trace:
I20260709 12:22:21.163940 28877 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.278029 24003 rpcz_store.cc:276] 0709 12:22:20.167231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.167374 (+   143us) service_pool.cc:224] Handling call
0709 12:22:20.178610 (+ 11236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.286887 (+108277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.286922 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:20.297679 (+ 10757us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.744113 (+446434us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:20.744172 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.744268 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.277383 (+533115us) raft_consensus.cc:1685] finished
0709 12:22:21.277402 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.277533 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43208,"raft.queue_time_us":69358,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":5623,"thread_start_us":487965,"threads_started":2,"wal-append.queue_time_us":648055}
I20260709 12:22:21.280731 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:21.282384 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.268339 29009 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:21.292821 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 68332.8us
I20260709 12:22:21.296450 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:21.303190 29070 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:22:21.305054 28823 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:21.305538 28823 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:21.306515 28823 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.310278 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:21.310699 29048 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:22:21.310971 28823 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:21.262367 28801 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.314200 24003 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:21.314884 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.315151 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.292840 28877 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:21.324594 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.326119 23924 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:21.283114 28892 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:22:21.296450 29029 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:21.327507 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 56024.6us
I20260709 12:22:21.272936 28920 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.273489 28991 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.306031 29060 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:22:21.329497 23924 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: [11.9-13.10]
I20260709 12:22:21.329432 23925 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:21.344947 23924 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:21.274222 28397 consensus_queue.cc:237] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.351261 28991 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:21.357689 23848 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:21.354961 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:21.330760 29018 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.368214 23853 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
I20260709 12:22:21.370406 23853 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: [8.6-11.8]
I20260709 12:22:21.371469 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.375662 23853 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:22:21.376179 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.376813 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.372943 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:21.382586 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.384706 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.387676 23853 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 17 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:22:21.388165 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:21.385689 23845 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:21.360780 29009 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.342859 29029 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.398180 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.403087 23846 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:21.403112 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.365458 28801 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:21.399964 23845 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:21.407755 28997 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.411480 28920 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:21.424310 29069 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:22:21.432013 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.404950 29009 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.427919 29064 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.437561 29009 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:21.437991 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:21.439517 29064 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:21.450696 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:21.452922 23920 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:21.454257 24003 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:21.422492 29018 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:21.456396 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.458279 29076 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 14. Current term is 15.
I20260709 12:22:21.459339 29076 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:21.459787 29076 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.460213 29076 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:21.465948 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:21.451259 29074 log.cc:927] Time spent T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.179s	user 0.002s	sys 0.000s
I20260709 12:22:21.471956 23920 raft_consensus.cc:1240] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:21.432998 29029 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:21.476295 23920 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:21.454002 28954 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.482306 29073 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 12:22:21.483968 28954 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.500726 28954 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:21.482059 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 248902us
I20260709 12:22:21.503846 28809 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:21.504289 28809 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:21.505122 28809 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.506155 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:21.511731 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.514153 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:21.519292 23920 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:21.530345 29036 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.657s	user 0.004s	sys 0.000s
I20260709 12:22:21.531569 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2548) took 1360 ms. Trace:
I20260709 12:22:21.531985 23997 rpcz_store.cc:276] 0709 12:22:20.171248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.171737 (+   489us) service_pool.cc:224] Handling call
0709 12:22:20.192243 (+ 20506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.201506 (+  9263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.531368 (+1329862us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b540014ad50. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:21.531507 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46370048}
W20260709 12:22:21.532923 29038 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.484s	user 0.000s	sys 0.001s
I20260709 12:22:21.533157 23927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2368) took 1054 ms. Trace:
I20260709 12:22:21.533545 23927 rpcz_store.cc:276] 0709 12:22:20.479087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.479903 (+   816us) service_pool.cc:224] Handling call
0709 12:22:20.480218 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.480545 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.480577 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:20.481039 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.695470 (+214431us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:20.914729 (+219259us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b48002601d8. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28c375aa1 00007fa28c36cb37 00007fa28c36c9ca 00007fa28c46426f 00007fa28c463f37 00007fa28c47855c 00007fa28c478508 00007fa28c478488 00007fa28c478443 00007fa28c4776ec 00007fa28b3a1a96
0709 12:22:21.001352 (+ 86623us) log.cc:844] Serialized 14 byte log entry
0709 12:22:21.031423 (+ 30071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.031848 (+   425us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.530054 (+498206us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b240009ae68. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa2841e59c4 00007fa2841e3acb 00007fa28439edc9 00007fa28439ea55 00007fa28439e09d 00007fa286fd010e 00007fa286fe788c 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221
0709 12:22:21.532954 (+  2900us) raft_consensus.cc:1685] finished
0709 12:22:21.532975 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.533101 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68816,"prepare.queue_time_us":245285,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":29595,"raft.run_cpu_time_us":1457,"raft.run_wall_time_us":433493,"spinlock_wait_cycles":22892160,"thread_start_us":414144,"threads_started":2,"wal-append.queue_time_us":350967}
W20260709 12:22:21.552165 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.555157 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:21.555814 24563 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:21.559566 23850 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:21.521267 28773 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:21.560860 28773 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.561120 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2360) took 1119 ms. Trace:
W20260709 12:22:21.561715 29066 log.cc:927] Time spent T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.409s	user 0.004s	sys 0.000s
I20260709 12:22:21.561632 23929 rpcz_store.cc:276] 0709 12:22:20.441804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.441939 (+   135us) service_pool.cc:224] Handling call
0709 12:22:20.455283 (+ 13344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.472698 (+ 17415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.472739 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:20.481849 (+  9110us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.483989 (+  2140us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b48002601d8. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28c375aa1 00007fa28c36cb37 00007fa28c36c9ca 00007fa28c46426f 00007fa28c463f37 00007fa28c47855c 00007fa28c478508 00007fa28c478488 00007fa28c478443 00007fa28c4776ec 00007fa28b3a1a96
0709 12:22:20.694743 (+210754us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:20.845322 (+150579us) log.cc:844] Serialized 14 byte log entry
0709 12:22:21.138139 (+292817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.138247 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.532389 (+394142us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa286fe786e 00007fa286fe6bb6 00007fa286fe67d8 00007fa286ff0221 00007fa286ff01d9 00007fa286ff0169
0709 12:22:21.560930 (+ 28541us) raft_consensus.cc:1685] finished
0709 12:22:21.560950 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.561064 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8603,"prepare.queue_time_us":245738,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":78277,"raft.run_cpu_time_us":1956,"raft.run_wall_time_us":13510,"spinlock_wait_cycles":24789248,"thread_start_us":614139,"threads_started":3,"wal-append.queue_time_us":545634}
I20260709 12:22:21.572129 28809 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:21.578052 29018 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:21.578327 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:21.579314 24557 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
W20260709 12:22:21.579924 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 65838.5us
I20260709 12:22:21.581205 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:21.561204 23927 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:21.583668 23927 raft_consensus.cc:1240] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:21.586424 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 2297) took 1413 ms. Trace:
I20260709 12:22:21.587049 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:21.588024 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:21.590338 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:21.586817 23995 rpcz_store.cc:276] 0709 12:22:20.173029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.173256 (+   227us) service_pool.cc:224] Handling call
0709 12:22:21.586216 (+1412960us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54002472d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:21.586345 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2107007232}
I20260709 12:22:21.592531 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.593521 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.598482 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:21.593740 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:21.606295 23995 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:21.600497 23848 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:21.609156 23995 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:21.610718 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:21.594156 29076 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.614275 23922 raft_consensus.cc:2410] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:22:21.614455 29076 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.615796 23927 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:21.615914 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:21.619304 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:21.621115 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:21.621798 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:21.621925 24560 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:21.561256 28773 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:21.624698 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:21.600296 24003 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:21.601447 29018 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:21.662906 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 290087us
I20260709 12:22:21.722105 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:21.620759 29077 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:21.623958 29017 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:21.620002 29052 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:21.754765 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:21.754774 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:22:21.755508 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 229354us
I20260709 12:22:21.620882 29009 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:21.659739 28800 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:21.762259 24557 raft_consensus.cc:2368] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12.
I20260709 12:22:21.721961 29027 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:21.763572 28987 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:21.770429 28987 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.772069 28773 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.772760 28987 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.658155 28801 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:22:21.773802 24560 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:21.760221 28892 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.776340 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:21.773353 29027 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.780529 23818 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:21.774829 29017 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:21.775494 29087 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:21.774055 28920 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:22:21.781410 28987 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:21.781988 29027 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:21.797107 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.775120 29077 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.786685 29063 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:21.789253 29017 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:21.779736 28892 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:21.792515 29083 log.cc:927] Time spent T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:22:21.791530 28891 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:22:21.804960 24558 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:22:21.806675 28868 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.807446 29077 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:21.807184 28868 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.808537 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45224 (request call id 23) took 1086 ms. Trace:
I20260709 12:22:21.810968 28868 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.815495 28892 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.808964 23923 rpcz_store.cc:276] 0709 12:22:20.722642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.726118 (+  3476us) service_pool.cc:224] Handling call
0709 12:22:21.439660 (+713542us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5400086c20. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873c9520 00007fa287446652 00007fa28c41460a 00007fa28599a7d4 00007fa28599a762 00007fa28599a691 00007fa28599a60c 00007fa2859998c2 00007fa28578748c 00007fa2857868c6
0709 12:22:21.808206 (+368546us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b5400086c20. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873c75e7 00007fa287446c68 00007fa28744684a 00007fa28c41460a 00007fa28599a7d4 00007fa28599a762 00007fa28599a691 00007fa28599a60c 00007fa2859998c2 00007fa28578748c
0709 12:22:21.808438 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126504192}
W20260709 12:22:21.897338 29085 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:22:21.901628 29034 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 1.061s	user 0.002s	sys 0.000s
I20260709 12:22:21.903704 23928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2364) took 1433 ms. Trace:
I20260709 12:22:21.904254 23928 rpcz_store.cc:276] 0709 12:22:20.470348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.471575 (+  1227us) service_pool.cc:224] Handling call
0709 12:22:20.474037 (+  2462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.500441 (+ 26404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.500500 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.500558 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:20.500608 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.903386 (+1402778us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b5400329e54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:21.903451 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.903629 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60148992}
I20260709 12:22:21.906724 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:21.907831 29040 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:21.908335 29040 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:21.909065 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.823144 28868 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:21.922947 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:21.916811 28890 raft_consensus.cc:3055] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:21.920550 28987 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:21.941593 28892 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:21.921082 28868 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:21.947947 28868 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.919747 29052 consensus_queue.cc:1059] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:22:21.929852 28773 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:21.954303 28773 raft_consensus.cc:3055] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:21.954685 28773 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:21.955572 28773 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.950634 28987 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.925359 28890 raft_consensus.cc:740] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:21.958024 29008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.602s	user 0.021s	sys 0.016s
I20260709 12:22:21.957079 29040 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:21.977603 28987 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:21.978582 28800 raft_consensus.cc:3055] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:21.979130 28800 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:21.980171 28800 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:21.983609 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.988328 29027 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:21.990092 29055 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.835s	user 0.012s	sys 0.001s
I20260709 12:22:21.981731 28800 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:22.002388 28890 consensus_queue.cc:260] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:21.969848 29008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.617s	user 0.022s	sys 0.017s
I20260709 12:22:21.998245 29009 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:22.004009 29063 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:22.008293 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.010248 28885 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:22.003547 28890 raft_consensus.cc:3060] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:22.000998 29017 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:22.011626 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88803us
W20260709 12:22:22.011999 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:22.012071 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 96880us
I20260709 12:22:22.013232 28742 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.057204 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:22.014721 23893 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:22.015499 28877 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.015655 24558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 874) took 1947 ms. Trace:
W20260709 12:22:22.016160 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 414146us
W20260709 12:22:22.017395 29014 log.cc:927] Time spent T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 1.661s	user 0.001s	sys 0.001s
I20260709 12:22:22.018754 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35824 (request call id 597) took 1001 ms. Trace:
I20260709 12:22:22.026679 28836 raft_consensus.cc:3055] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:22.061334 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:22.027168 29094 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.060111 23926 rpcz_store.cc:276] 0709 12:22:21.017788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.029091 (+ 11303us) service_pool.cc:224] Handling call
0709 12:22:22.018593 (+989502us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400011dd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:22.018701 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350972800}
I20260709 12:22:22.030153 28955 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:22.032362 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:22.068521 23852 raft_consensus.cc:606] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:22.069015 23852 raft_consensus.cc:614] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:22.052173 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.053964 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:22.054440 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:22.071509 23848 raft_consensus.cc:2368] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 14. Current term is 15.
I20260709 12:22:22.054878 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:22.055362 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:22.056298 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:22.073230 23845 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 17.
I20260709 12:22:22.044270 28548 raft_consensus.cc:3055] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:22.075168 23854 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:22.045356 29027 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:22.029182 23892 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:22.065326 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 50696.9us
I20260709 12:22:22.066876 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:22.087008 23850 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:22.074297 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:22.075971 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:22.086547 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 57466us
I20260709 12:22:22.050081 28885 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:22.058838 24558 rpcz_store.cc:276] 0709 12:22:20.068575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.068769 (+   194us) service_pool.cc:224] Handling call
0709 12:22:20.069188 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.806495 (+1737307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.015422 (+208927us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54005b1dd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:22.015596 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3979421056}
I20260709 12:22:22.092561 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:22.078171 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:22.049445 28810 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:22.081547 23845 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:22.081997 23852 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:22.101429 24524 leader_election.cc:400] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 14. Current term is 15.
I20260709 12:22:22.089320 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:22.102952 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:22.105039 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:22.075011 28548 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:22.071363 28791 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:22.097057 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:22.106897 24554 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:22.109750 23848 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:22.110270 23926 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:22:22.110921 23926 pending_rounds.cc:85] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 6
I20260709 12:22:22.107256 24558 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:22.111244 23926 pending_rounds.cc:107] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:22:22.111614 23926 raft_consensus.cc:2889] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:22.108507 24557 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:22.113055 23923 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:22:22.114615 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:22.117561 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:22.118530 23928 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:22.063390 28836 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:22.063505 28742 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.131652 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:22.131929 28885 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.133970 24560 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:22:22.135569 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:22.139678 23892 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:22.140362 23817 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:22.150338 23998 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:22.155772 23998 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:22.079972 29005 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:22.156109 23892 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:22.160620 23892 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:22.090392 29009 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:22.092304 29063 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:22.107120 28868 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:22.091715 29092 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:22.121506 23820 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:22.137583 28885 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:22.123162 29025 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:22.168733 23850 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:22.154341 28791 raft_consensus.cc:697] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:22.157217 28491 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:22.069960 28877 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.077530 28955 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.123638 28997 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:22.175035 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.071537 29094 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:22.179188 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 57822.5us
I20260709 12:22:22.160795 28920 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:22.153849 28959 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:22.133693 28801 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:22:22.125408 28571 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:22.161000 28859 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.194471 23848 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:22.168325 28827 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:22.168154 29024 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:22.129187 28810 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:22.213351 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:22.137897 28857 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:22:22.158596 28825 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:22:22.187477 28987 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:22.165798 29005 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.229758 28842 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:22.230304 29094 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:22.201491 28997 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.232707 28997 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:22.172138 28978 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:22:22.235423 29027 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:22.235785 28810 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:22.175201 29063 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.236725 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:22.237077 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:22.171916 29009 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.238306 24001 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:22:22.239820 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.237046 23849 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 8.
I20260709 12:22:22.211138 28571 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:22.236768 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:22.235908 29027 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:22.245103 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2552) took 1504 ms. Trace:
I20260709 12:22:22.223783 29093 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:22:22.238547 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 73654.9us
I20260709 12:22:22.245564 24004 rpcz_store.cc:276] 0709 12:22:20.740269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.740449 (+   180us) service_pool.cc:224] Handling call
0709 12:22:20.740870 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.941942 (+201072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.941995 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.942075 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:20.942132 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.244838 (+1302706us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54003d7cd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:22.244888 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.245035 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461676288}
I20260709 12:22:22.249734 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:22.253695 23999 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:22.227248 28742 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:22.256810 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:22.259353 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 98845.4us
I20260709 12:22:22.259377 24560 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:22.222944 28892 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:22:22.260186 23892 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:22.258203 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:22.263406 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.246487 28571 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:22.267297 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 124686us
I20260709 12:22:22.219278 28859 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:22.282220 29063 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:22.283677 28859 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:22.283843 29017 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:22.263602 29093 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:22.285712 29093 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.290040 28791 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:22.271600 28877 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:22.297544 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.297837 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:22.298715 23852 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 9.
I20260709 12:22:22.268863 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:22.275521 28987 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:22.305668 28987 consensus_queue.cc:1243] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Peer e8bc734d763e4ddf87f7b930e35cbaa7 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:22:22.305725 28891 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:22.306367 28891 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:22.306814 28891 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:22.307296 28773 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:22.306391 28792 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:22.312237 24002 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:22.277657 29009 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:22.279418 29005 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:22.238155 28920 consensus_queue.cc:1059] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 12:22:22.314989 23996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 2561) took 1238 ms (client timeout 1591 ms). Trace:
I20260709 12:22:22.313364 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:22.218953 28836 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.317137 23920 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:22:22.317512 28868 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:22.322523 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:22.318473 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:22.323042 29027 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:22.319707 24561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36558 (request call id 878) took 2043 ms (client timeout 1700 ms). Trace:
I20260709 12:22:22.324034 29027 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:22.324160 24561 rpcz_store.cc:269] 0709 12:22:20.276743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.276915 (+   172us) service_pool.cc:224] Handling call
0709 12:22:22.319504 (+2042589us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b54004e2354. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:22.319618 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72909568}
I20260709 12:22:22.301753 28842 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:22:22.326164 28842 raft_consensus.cc:3055] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:22.326467 28836 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:22.326545 28842 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:22.327581 28842 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:22.328758 28842 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:22.330767 29063 raft_consensus.cc:3055] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:22.331184 29063 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:22.332123 29063 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:22.316812 24525 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:22.316023 23996 rpcz_store.cc:269] 0709 12:22:21.076472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.092995 (+ 16523us) service_pool.cc:224] Handling call
0709 12:22:22.314833 (+1221838us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b54001d2254. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:22.314932 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33307904}
I20260709 12:22:22.321846 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:22.335608 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:22.336896 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:22.339208 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:22.341094 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 78601.5us
W20260709 12:22:22.342698 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 82578.7us
I20260709 12:22:22.343812 23999 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:22.336717 28868 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:22.356658 23926 pending_rounds.cc:85] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 10
I20260709 12:22:22.357132 23926 pending_rounds.cc:107] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:22:22.357460 23926 raft_consensus.cc:2889] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:22.364817 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 163014us
I20260709 12:22:22.350289 29092 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:22.373265 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2516) took 1346 ms. Trace:
I20260709 12:22:22.390316 23895 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:22.396263 23892 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:22.397769 23895 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:22.397720 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:22.408612 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:22.419224 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.409940 29004 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:22.384864 23924 rpcz_store.cc:276] 0709 12:22:21.027175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.346204 (+319029us) service_pool.cc:224] Handling call
0709 12:22:21.346676 (+   472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:21.347122 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.347164 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:21.356731 (+  9567us) log.cc:844] Serialized 52 byte log entry
0709 12:22:21.429802 (+ 73071us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:21.471510 (+ 41708us) log.cc:844] Serialized 14 byte log entry
0709 12:22:22.008287 (+536777us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b18003d9ea0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa284361a40 00007fa28435c4e4 00007fa28435c455 00007fa287444060 00007fa287456716 00007fa287467287 00007fa287467208
0709 12:22:22.163245 (+154958us) log.cc:844] Serialized 14 byte log entry
0709 12:22:22.361417 (+198172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.361502 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:22.373009 (+ 11507us) raft_consensus.cc:1685] finished
0709 12:22:22.373044 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.373210 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11014,"prepare.queue_time_us":305082,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":1363,"raft.queue_time_us":583805,"raft.run_cpu_time_us":476,"raft.run_wall_time_us":15389,"spinlock_wait_cycles":87843072,"thread_start_us":407841,"threads_started":3,"wal-append.queue_time_us":113181}
W20260709 12:22:22.429582 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44454.3us
I20260709 12:22:22.429394 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:22.440904 29105 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:22.442395 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44772.4us
I20260709 12:22:22.443411 23892 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:22.444891 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:22.446822 29029 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:22.449236 29029 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:22.425565 28976 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:22:22.450182 28491 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:22.450719 28491 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.451145 28491 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:22.452257 29092 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:22.425477 29004 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.455554 29004 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:22.460470 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:22.460902 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:22.462442 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:22.463214 23996 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:22.468580 23921 raft_consensus.cc:2410] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:22:22.388022 29006 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:22:22.425249 28810 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.449757 29029 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.495939 23820 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:22.482888 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 51869.1us
I20260709 12:22:22.487206 24002 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:22.499307 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:22.458431 28825 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:22.484647 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:22.421334 28997 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
W20260709 12:22:22.512439 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 213383us
I20260709 12:22:22.513684 24525 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:22.514967 23849 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:22.501372 29029 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:22.458640 29102 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:22:22.522946 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:22.504738 29094 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:22.534390 29017 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:22.513801 29005 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:22.512799 28868 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:22.496511 28810 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.501052 28571 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:22.536401 29042 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:22.524560 29009 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:22.550397 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.589020 23929 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:22:22.589617 23929 pending_rounds.cc:85] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 7
W20260709 12:22:22.569813 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:22.590751 23921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 2363) took 2111 ms (client timeout 2048 ms). Trace:
W20260709 12:22:22.591686 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.589974 23929 pending_rounds.cc:107] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:22:22.593223 23929 raft_consensus.cc:2889] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:22.591259 23921 rpcz_store.cc:269] 0709 12:22:20.445431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.445575 (+   144us) service_pool.cc:224] Handling call
0709 12:22:22.557036 (+2111461us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b540039b054. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:22.557266 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4524040576}
W20260709 12:22:22.608368 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:22.613480 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.528837 29024 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:22:22.539979 29005 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.539631 28868 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:22.650995 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 206223us
I20260709 12:22:22.546797 29042 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:22.630785 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.628212 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:22.558944 28809 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:22.656342 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2373) took 1437 ms. Trace:
I20260709 12:22:22.661278 23929 rpcz_store.cc:276] 0709 12:22:21.218571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.564024 (+345453us) service_pool.cc:224] Handling call
0709 12:22:22.557991 (+993967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.594091 (+ 36100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.656033 (+ 61942us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b540039b050. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:22.656255 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285130496}
I20260709 12:22:22.622184 29092 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:22.669872 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 148987us
I20260709 12:22:22.659224 28905 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:22.672698 28905 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.675362 28905 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:22.588521 29009 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:22.682420 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.656153 29042 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:22.654318 29005 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:22.685691 23818 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:22.650287 28890 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:22.659843 28997 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:22.659003 28801 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.668819 28868 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:22.682485 29105 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:22.664031 28976 consensus_queue.cc:1059] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:22:22.695817 28789 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:22.713076 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 213827us
I20260709 12:22:22.717738 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:22.668299 28809 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:22.707019 29107 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:22:22.720850 24557 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:22.722127 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:22.723145 24558 raft_consensus.cc:2393] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 15: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:22.688371 28885 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:22:22.723687 24560 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:22.689687 29092 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:22.682911 28891 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.724464 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:22.739306 24559 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:22.694058 29106 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:22:22.705816 28801 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.751278 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:22.752204 23850 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:22.715863 29121 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:22:22.762405 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.701979 28890 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:22.709077 28960 consensus_queue.cc:1059] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:22:22.777514 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48096
I20260709 12:22:22.778283 23920 raft_consensus.cc:606] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Received request to transfer leadership
I20260709 12:22:22.778664 23920 raft_consensus.cc:614] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:22.738312 28789 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:22.784546 23850 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 18.
I20260709 12:22:22.789143 29052 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:22.789800 29052 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.792773 29052 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:22.793139 28548 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.822170 28827 raft_consensus.cc:993] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:22.337704 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:22.834082 28955 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:22.834510 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:22.837129 28978 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:22.839699 28857 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:22.840602 28857 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.881474 23996 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:22.716471 29105 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.778728 28905 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
W20260709 12:22:22.902840 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 243428us
W20260709 12:22:22.898300 29115 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:22:22.912496 29117 log.cc:927] Time spent T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 12:22:22.914634 29111 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:22:22.780036 29118 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.135s
I20260709 12:22:22.885766 28791 consensus_queue.cc:1059] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
W20260709 12:22:22.922572 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.900651 28571 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:22.890372 28789 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:22.932143 28842 consensus_meta.cc:287] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.004s
I20260709 12:22:22.933384 29125 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:22.933724 24561 raft_consensus.cc:2410] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:22:22.934480 29093 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.934995 29093 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.937002 29093 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:22.907725 29102 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:22.938515 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 55020.8us
I20260709 12:22:22.907781 29123 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:22.946054 23969 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:22.914572 28801 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:22.975090 23969 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:22.918610 28810 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:22.945459 28773 consensus_meta.cc:287] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.004s
I20260709 12:22:22.933815 29125 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:22.919440 28491 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.933410 29092 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:22.945245 29121 raft_consensus.cc:697] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
W20260709 12:22:23.005702 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.008173 29126 consensus_queue.cc:1059] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:23.010982 29125 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:22.970860 28868 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.015317 28891 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.015843 28885 consensus_queue.cc:1059] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:22:22.976282 29123 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.019369 28905 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:23.019981 29009 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:23.027890 28826 raft_consensus.cc:1081] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:23.030352 28571 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:22.971652 29102 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:23.031591 29027 consensus_meta.cc:287] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.004s
I20260709 12:22:23.032264 28809 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.048156 29125 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:23.092267 28789 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.088534 28885 consensus_queue.cc:1243] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:23.078228 28791 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.094664 28791 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:23.098012 29004 consensus_meta.cc:287] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
I20260709 12:22:23.098587 29004 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.099807 29005 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.101020 29004 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:23.098551 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 157610us
I20260709 12:22:23.077421 29024 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:23.114740 23998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:22:23.116358 23998 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:23.116806 23998 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:23.118863 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:22.987178 23969 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:23.064687 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.042598 29131 log.cc:927] Time spent T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.055s	user 0.001s	sys 0.002s
I20260709 12:22:23.138186 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:23.138787 24001 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.141451 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:23.055091 28868 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:23.109934 28791 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.101773 29005 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.123457 28491 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.134855 28773 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:23.137164 23999 raft_consensus.cc:2410] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:22:23.108989 28789 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:23.075618 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:23.138684 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:23.168476 24557 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.142187 24554 raft_consensus.cc:2410] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:22:23.109383 28905 raft_consensus.cc:3055] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:23.154006 24560 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:23.156340 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:23.171872 23995 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:23.111251 28890 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.134584 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:23.118072 29027 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:23.113157 28809 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.163278 24001 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:23.043999 28801 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:23.173056 24000 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.088547 28571 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.178661 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:23.136801 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 149723us
I20260709 12:22:23.184032 23995 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:23.189282 23923 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:23.190295 23969 leader_election.cc:400] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12.
I20260709 12:22:23.190623 23969 leader_election.cc:403] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:22:23.191942 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.187000 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:23.197515 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:23.198359 23850 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:23.192651 23928 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:23.170586 29009 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:23.207581 23893 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:23.124014 29024 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.216253 23850 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:22:23.216491 23893 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:23.173200 28905 raft_consensus.cc:740] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:23.218824 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.221701 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:23.223768 28997 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:23.225365 28997 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:23.218087 28905 consensus_queue.cc:260] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.228422 28905 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:23.231199 29106 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:23.231742 29106 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.233872 29106 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.225705 28997 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.235059 28997 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:23.246546 23926 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:23.249614 23920 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:23.259110 24000 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
W20260709 12:22:23.255367 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 53267.1us
I20260709 12:22:23.170564 28773 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.265870 23893 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:23.276027 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:23.266821 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:23.269745 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:23.276034 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:23.280990 23850 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:23.269366 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:23.281692 24560 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:22:23.282152 24561 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:23.283922 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:23.284448 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:23.285657 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:23.286289 24001 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:23.288064 24003 raft_consensus.cc:1240] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:23.291344 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:23.292690 24000 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 15: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:23.293946 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:23.296218 23852 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:23.300156 23852 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
I20260709 12:22:23.215807 28708 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:23.313720 23848 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:22:23.263161 28826 raft_consensus.cc:2804] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:23.208273 28801 raft_consensus.cc:697] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:23.332827 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:23.253598 28857 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:23.303095 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:23.312351 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:23.215946 29130 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:23.174265 28789 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.315173 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:23.185568 29027 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.188033 28809 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.317473 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:23.248396 28891 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.195396 28791 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:22:23.319507 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:23.326488 29018 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:22:23.327008 28960 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.000s	sys 0.027s
I20260709 12:22:23.156915 29121 consensus_queue.cc:237] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.341436 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:23.342326 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:23.343202 23845 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:22:23.344621 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.349577 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:23.350313 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:23.350589 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:23.315325 29120 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:23.263648 29133 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:23.357605 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:23.334064 28877 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:23.365448 23849 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:23.264000 28810 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:23.263921 29136 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12.
W20260709 12:22:23.403223 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 61010.6us
W20260709 12:22:23.371279 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 95345.5us
I20260709 12:22:23.403100 23847 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:23.405512 23997 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:23.422371 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:23.334656 29138 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:23.404248 29018 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.421089 23820 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:23.279758 29009 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.113s
I20260709 12:22:23.416494 23853 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:23.426060 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:23.356503 28826 raft_consensus.cc:697] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:23.332945 28842 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:23.431320 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:23.437247 23847 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 9.
I20260709 12:22:23.392364 28267 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.436992 23820 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:23.410812 29106 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:23.392398 29130 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:23.438633 24524 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:23.405678 29137 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:23.429466 29042 consensus_meta.cc:287] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.728s	user 0.006s	sys 0.006s
I20260709 12:22:23.478574 23998 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.480967 23998 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.335729 28890 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 12:22:23.463956 28842 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.490761 28809 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.492004 28826 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.493094 28789 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.494936 28773 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:23.437755 29018 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:23.435518 29135 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.436009 29123 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.392403 28891 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.428206 29134 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:23.463250 29133 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:23.481947 29137 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.455499 29102 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.476433 28868 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:23.499142 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.454916 28836 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:22:23.469996 28999 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:23.540834 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 110305us
I20260709 12:22:23.432096 28810 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:23.523835 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.526129 24557 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:23.487530 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:23.491945 28571 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:23.466459 28267 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.513602 29135 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.485801 29136 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 12:22:23.485932 28801 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.483763 29042 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.586669 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:23.607952 24555 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:23.607323 23847 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 18.
I20260709 12:22:23.527186 29123 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:23.592775 24524 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.667s (SENT) [suppressed 14 similar messages]
I20260709 12:22:23.605422 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:23.619634 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:23.592707 29029 consensus_meta.cc:287] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 1.064s	user 0.008s	sys 0.002s
I20260709 12:22:23.541523 28809 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:23.559377 29102 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.640203 29102 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.643400 29102 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.644600 29102 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.531088 28868 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:23.646153 28868 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:23.540731 29134 raft_consensus.cc:697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:23.559092 28999 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:23.650553 28999 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:23.645262 29102 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.663841 29102 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.456092 29138 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.695711 24555 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:23.611536 28905 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:23.677019 24004 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:23.582083 29106 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:23.616120 28877 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:22:23.710973 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.635210 29009 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:23.711977 29115 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:22:23.722106 28905 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.735704 29105 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.736320 29105 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.736501 28905 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.736805 29105 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:23.738662 29160 log.cc:927] Time spent T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:22:23.738828 28842 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:23.741647 29024 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.742763 28868 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.744647 28999 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.751358 28868 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:23.753006 29169 log.cc:927] Time spent T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:22:23.752192 28999 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.762621 29137 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.763530 28877 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.767228 29134 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.771515 29021 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:22:23.771858 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.773343 23817 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:23.774835 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:23.775535 23848 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 15.
I20260709 12:22:23.636729 28997 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.623356 29123 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.779003 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:23.766762 29153 log.cc:927] Time spent T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:22:23.681921 29029 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.790634 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.589811 29130 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.791873 23923 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 15: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:23.794256 29029 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.804967 29139 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.805594 29139 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.806767 28892 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.807266 28892 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.808246 29139 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.808769 29139 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.809285 28892 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.809181 29139 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.780349 29148 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:23.781253 28891 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.771916 29021 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:23.820215 29148 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:23.820683 29148 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:23.820755 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.821026 29021 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.821619 29006 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:23.822069 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.822455 29021 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:23.822209 29006 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.824947 29006 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.587929 29133 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.825491 29006 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.826864 23923 raft_consensus.cc:1275] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:22:23.817049 29166 log.cc:927] Time spent T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:22:23.817368 29175 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:23.725198 29009 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.819311 29105 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:23.834568 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 61343.5us
I20260709 12:22:23.828768 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.782693 29027 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:23.829275 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.839622 23925 raft_consensus.cc:2410] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:22:23.837703 29137 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.840469 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.840822 29137 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.841521 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.842015 28891 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:23.817710 29063 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:23.833676 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.843940 23922 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:23.844864 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.828279 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.838218 23929 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:23.833861 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.845870 23928 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:23.830683 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.846649 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.847787 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.849630 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.850757 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.851456 23929 raft_consensus.cc:2393] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 15: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:23.854130 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.855425 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.855871 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.856156 23929 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:23.856714 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.857412 23922 raft_consensus.cc:2393] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:23.862905 28810 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:23.863610 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:23.864107 29042 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:23.873116 23929 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:23.877439 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.878453 23922 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 15: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:23.879712 23928 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 15.
I20260709 12:22:23.880690 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.881263 23928 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:23.834142 29175 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.881968 23999 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:23.882557 29175 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:23.893934 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.879278 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.897709 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:23.901516 29137 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.904105 28976 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:23.905305 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:23.905305 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.894623 23921 raft_consensus.cc:2376] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14. Re-sending same reply.
I20260709 12:22:23.906158 23999 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:23.882081 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.851406 29138 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.909983 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.909186 23928 raft_consensus.cc:2393] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:23.911227 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:23.911996 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.914849 23928 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:23.917649 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.918296 23928 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:23.895485 28891 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:23.936244 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:23.904737 29139 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.844290 29106 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.846817 29006 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.924523 28548 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:23.953493 29148 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:23.956789 29148 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:23.926141 29052 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:23.935536 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:23.962311 23998 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:23.962694 23999 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:23.937716 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:23.907822 29068 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.907078 28976 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.946873 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:23.947544 23925 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 18.
I20260709 12:22:23.945652 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:23.949266 23818 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:23.935292 28892 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:23.951892 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:23.936489 28891 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.950546 28999 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:23.948486 28857 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:22:23.966538 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 373766us
I20260709 12:22:23.990249 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:22:23.990630 24524 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.690s (SENT)
I20260709 12:22:23.991343 24524 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:23.993229 23999 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:23.962303 29052 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:23.972700 23920 raft_consensus.cc:2410] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:22:23.958822 29125 consensus_meta.cc:287] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.005s
I20260709 12:22:23.978572 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:24.001765 23922 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:23.976573 23893 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:23.976570 28976 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.940706 23923 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:23.949059 29135 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:24.022261 24524 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.790s (SENT)
I20260709 12:22:24.030157 29009 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.003088 28857 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:23.999666 29018 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.036456 29018 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.022832 24524 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:23.987630 28891 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:24.041864 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:24.043157 29135 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:23.981537 29025 consensus_queue.cc:1059] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:22:24.045828 28809 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:24.046387 28809 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:24.043380 29137 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:24.047041 29137 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.021937 28826 raft_consensus.cc:2764] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:22:23.995172 29180 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:24.042732 23893 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:24.040005 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:24.017261 28997 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:24.003628 29174 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:24.056169 29025 raft_consensus.cc:3055] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:24.056449 29123 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:24.056814 29156 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:24.061766 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:24.063867 24561 raft_consensus.cc:2393] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 10: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:23.987478 28892 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.064697 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.066648 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.049795 29137 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:24.077790 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:24.081208 23999 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:24.074573 23922 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:24.075522 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.084335 24555 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:24.059939 29174 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.058619 29180 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.086599 29180 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:24.043874 29175 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.087494 29174 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:24.057763 29006 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:23.988072 29068 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.094576 28892 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:24.044099 29105 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:22:24.003139 28999 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.109257 28891 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.110532 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2589) took 1459 ms. Trace:
I20260709 12:22:24.110402 28267 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.110883 24004 rpcz_store.cc:276] 0709 12:22:22.651139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.651318 (+   179us) service_pool.cc:224] Handling call
0709 12:22:22.651616 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.712769 (+1061153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.110284 (+397515us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001c84d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:24.110455 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2357604608}
I20260709 12:22:24.111882 28891 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:24.059561 29025 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:24.108950 29068 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.112000 28999 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.077868 28836 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.060171 29135 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:24.113628 24558 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:24.143088 24554 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:24.114866 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:24.115427 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.077446 29179 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:24.151332 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.152704 23995 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:24.102800 28827 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:22:24.101763 28976 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.164105 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:24.167101 28976 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.167838 29179 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:24.171149 28827 consensus_queue.cc:1059] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:22:24.151805 29135 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:24.161289 28836 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:24.181958 24524 leader_election.cc:336] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.940s (SENT)
I20260709 12:22:24.182559 24524 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:24.189280 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:24.190342 23925 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:24.180460 29135 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:24.209656 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:24.213289 23850 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.027s	sys 0.060s
I20260709 12:22:24.168984 29179 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.194520 29123 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:22:24.215447 23850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.027s	sys 0.060s
I20260709 12:22:24.220520 23925 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:22:24.222971 24556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.008s	sys 0.023s
W20260709 12:22:24.224053 23895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.010s	sys 0.006s
W20260709 12:22:24.231447 24556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.008s	sys 0.024s
W20260709 12:22:24.231653 23895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.011s	sys 0.006s
I20260709 12:22:24.237919 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:22:24.251113 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.252359 23925 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:24.257573 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.265998 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.267033 24561 raft_consensus.cc:2393] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 15: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:24.249096 29138 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:24.290326 23966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.011s	sys 0.008s
I20260709 12:22:24.292129 23925 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:22:24.293259 23966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.011s	sys 0.009s
W20260709 12:22:24.295264 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 616808us
I20260709 12:22:24.298455 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:24.181295 29025 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.319651 29175 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:24.326599 28789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.010s
W20260709 12:22:24.340340 29182 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 12:22:24.361267 29181 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:24.345714 28836 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.360489 28548 raft_consensus.cc:3055] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:24.379743 28548 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:22:24.331393 29134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.011s	sys 0.006s
W20260709 12:22:24.404956 23969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.030s	sys 0.029s
W20260709 12:22:24.405467 23969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.030s	sys 0.029s
W20260709 12:22:24.381201 28789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.010s
W20260709 12:22:24.391980 29130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.018s	sys 0.023s
W20260709 12:22:24.410027 29121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.019s	sys 0.042s
W20260709 12:22:24.432747 29134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.012s	sys 0.006s
W20260709 12:22:24.537957 29184 log.cc:927] Time spent T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:22:24.452601 29130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.018s	sys 0.024s
I20260709 12:22:24.446851 29175 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:24.550248 29121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.020s	sys 0.047s
W20260709 12:22:24.562112 29196 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:22:24.419598 29180 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.566255 29174 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.569689 29174 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:24.571007 29180 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:24.565223 29175 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.572899 29175 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:24.618391 23794 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.010s	sys 0.021s
W20260709 12:22:24.619544 23794 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.010s	sys 0.021s
W20260709 12:22:24.619928 23820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.002s	sys 0.014s
W20260709 12:22:24.620460 23820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.002s	sys 0.014s
W20260709 12:22:24.620968 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 632384us
W20260709 12:22:24.621965 23818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.003s	sys 0.011s
W20260709 12:22:24.622577 23818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.003s	sys 0.011s
W20260709 12:22:24.623051 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 637107us
W20260709 12:22:24.621325 23817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.003s	sys 0.010s
W20260709 12:22:24.626590 23817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.003s	sys 0.010s
W20260709 12:22:24.627136 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 646597us
I20260709 12:22:24.631345 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:24.624598 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:24.636598 23850 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:24.640905 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.642215 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.643406 23846 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:24.644028 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.647734 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.648108 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.649080 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:24.654673 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:24.655686 23846 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:24.658411 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.648228 23818 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:24.660177 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:24.661727 23849 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:24.661764 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.663520 23818 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:24.663966 23853 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:24.665282 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:24.666532 23850 raft_consensus.cc:2393] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:24.668841 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.670295 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.670509 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.309626 23895 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:24.671686 23850 raft_consensus.cc:2410] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:22:24.671597 23849 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
W20260709 12:22:24.672132 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 362499us
I20260709 12:22:24.673007 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.677538 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:24.677590 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:24.678279 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:24.679272 23925 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:24.679653 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:24.679903 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:24.680480 23922 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:24.682042 23848 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:24.683298 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:24.683877 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:24.684283 23851 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:24.686439 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.687762 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:24.688126 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:24.688624 23928 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:24.690948 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:24.691787 23848 raft_consensus.cc:3060] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:24.688899 23853 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:24.680797 23921 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:24.704095 23851 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:24.707466 23921 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
W20260709 12:22:24.308262 23966 leader_election.cc:336] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.739s (SENT)
I20260709 12:22:24.714859 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:24.716148 23848 raft_consensus.cc:2468] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
W20260709 12:22:24.717020 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 408798us
W20260709 12:22:24.724010 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.729691 23969 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:24.734642 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36552 (request call id 1127) took 1212 ms. Trace:
I20260709 12:22:24.740477 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:24.741004 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.742318 28267 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.742385 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.735401 24556 rpcz_store.cc:276] 0709 12:22:23.522254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.522654 (+   400us) service_pool.cc:224] Handling call
0709 12:22:23.523129 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:23.561130 (+ 38001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:23.561163 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:23.561673 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:22:24.232021 (+670348us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:24.232082 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.236374 (+  4292us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:24.733913 (+497539us) raft_consensus.cc:1685] finished
0709 12:22:24.733970 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:24.734284 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20646,"raft.queue_time_us":21462,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":30349,"thread_start_us":637674,"threads_started":1,"wal-append.queue_time_us":816227}
I20260709 12:22:24.743274 28267 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.744244 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.744300 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.745301 24556 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:22:24.742704 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:24.741626 24562 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:24.747220 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.380637 28548 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.748591 24559 raft_consensus.cc:2410] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:22:24.749841 28548 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:24.752985 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.754251 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.760962 28827 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:24.763669 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 2412) took 1419 ms. Trace:
I20260709 12:22:24.764173 23924 rpcz_store.cc:276] 0709 12:22:23.344606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.350359 (+  5753us) service_pool.cc:224] Handling call
0709 12:22:24.763181 (+1412822us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54000e6854. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:24.763453 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937490176}
I20260709 12:22:24.769997 28773 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:24.771210 28773 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:24.772048 28773 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:24.772651 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:24.773298 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.775429 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.776836 24561 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
W20260709 12:22:24.778621 28809 consensus_meta.cc:287] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.732s	user 0.012s	sys 0.016s
I20260709 12:22:24.779213 28491 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:24.780093 28800 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:24.780177 28491 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.781034 28800 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.777671 28792 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:24.783003 28792 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.787986 28491 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.788437 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:24.789649 23999 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 15: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:24.790518 28773 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:24.792644 28800 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:24.792893 28773 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:24.794073 28800 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:24.779376 28809 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:24.799666 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.793721 28773 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:24.805150 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.812608 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33822 (request call id 2416) took 1021 ms. Trace:
I20260709 12:22:24.848253 23920 rpcz_store.cc:276] 0709 12:22:23.791453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.791634 (+   181us) service_pool.cc:224] Handling call
0709 12:22:24.812044 (+1020410us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54003cf854. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:24.812373 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292915968}
I20260709 12:22:24.814975 24562 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:24.857754 23750 catalog_manager.cc:5697] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 7 to 12, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 12 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:24.859084 28810 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.861295 28267 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:24.859915 28810 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.816386 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.878980 23999 raft_consensus.cc:2393] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 16: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:24.815032 23847 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:24.880223 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.880232 28810 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.796554 28800 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.887923 28810 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:24.888875 28800 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.823403 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.908321 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.909381 24003 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:24.826195 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.910535 23997 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:24.837536 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:24.820511 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.841174 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.811088 23928 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:24.902870 29132 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:24.803001 24554 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:24.868593 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:24.814182 23929 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:22:24.914525 23929 pending_rounds.cc:85] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 7
I20260709 12:22:24.914923 23929 pending_rounds.cc:107] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:22:24.915369 23929 raft_consensus.cc:2889] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:24.821617 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.917642 29126 consensus_queue.cc:1059] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:24.918448 23998 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:24.831069 23846 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:22:24.812947 28773 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.906224 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:24.872792 28829 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:24.875622 23751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59378 (request call id 144) took 10153 ms. Trace:
I20260709 12:22:24.876441 23750 catalog_manager.cc:5697] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 8 to 11, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 11 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:24.461292 28877 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.023s	sys 0.053s
I20260709 12:22:24.889822 28836 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:24.890383 28792 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.893997 28809 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.801815 23922 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:24.881649 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:24.896008 28857 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.898386 29134 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:24.898712 29106 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:24.899016 28891 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:24.900375 28920 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.901063 29063 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:22:24.866274 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 45866.6us
I20260709 12:22:24.926999 29186 raft_consensus.cc:3055] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:22:24.927872 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 59444.6us
I20260709 12:22:24.931512 29175 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:22:24.937168 28877 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.023s	sys 0.056s
I20260709 12:22:24.936861 28836 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.937901 29134 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:24.938416 29128 log.cc:927] Time spent T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 2.009s	user 0.008s	sys 0.000s
I20260709 12:22:24.938469 23999 raft_consensus.cc:2393] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:24.937937 23845 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:24.956583 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.932192 28829 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:24.947664 29186 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:24.913677 29132 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.970604 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.969570 23921 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:24.965675 29186 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.971958 28920 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.973773 29186 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:24.975587 28920 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.962931 28857 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:24.979524 28857 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:24.981304 29134 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:24.992041 29063 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:24.993542 29132 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:24.994622 29063 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:24.929004 23751 rpcz_store.cc:276] 0709 12:22:14.729477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.729809 (+   332us) service_pool.cc:224] Handling call
0709 12:22:24.875379 (+10145570us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:19.440778 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:19.441508 (+   730us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:19.441548 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:22:19.441569 (+    21us) tablet.cc:662] Decoding operations
0709 12:22:19.564617 (+123048us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:19.613694 (+ 49077us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:19.616281 (+  2587us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:22:19.751016 (+134735us) tablet.cc:701] Row locks acquired
0709 12:22:19.751041 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:22:19.751240 (+   199us) write_op.cc:270] Start()
0709 12:22:19.751380 (+   140us) write_op.cc:276] Timestamp: P: 1783599739751176 usec, L: 0
0709 12:22:19.751404 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:22:19.752210 (+   806us) log.cc:844] Serialized 6358 byte log entry
0709 12:22:21.214174 (+1461964us) op_driver.cc:464] REPLICATION: finished
0709 12:22:21.239089 (+ 24915us) write_op.cc:301] APPLY: starting
0709 12:22:21.239181 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:21.250890 (+ 11709us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:21.250998 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:21.614505 (+363507us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:21.616455 (+  1950us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 12:22:21.616508 (+    53us) write_op.cc:312] APPLY: finished
0709 12:22:21.749009 (+132501us) log.cc:844] Serialized 148 byte log entry
0709 12:22:21.760647 (+ 11638us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:21.765171 (+  4524us) write_op.cc:454] Released schema lock
0709 12:22:21.765250 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:21.765711 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:21.765750 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":275,"mutex_wait_us":1090718,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":24596,"apply.run_cpu_time_us":28913,"apply.run_wall_time_us":526623,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70815,"num_ops":16,"prepare.queue_time_us":174469,"prepare.run_cpu_time_us":29766,"prepare.run_wall_time_us":576322,"raft.queue_time_us":438488,"raft.run_cpu_time_us":2834,"raft.run_wall_time_us":91133,"replication_time_us":1414531,"thread_start_us":567235,"threads_started":4,"wal-append.queue_time_us":348854,"wal-append.run_cpu_time_us":29117,"wal-append.run_wall_time_us":2675473}]]}
I20260709 12:22:24.970300 29175 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:24.995008 28857 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:24.960925 23750 catalog_manager.cc:5697] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 3 to 6, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 6 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:24.997504 28836 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:25.004815 29052 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.005420 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:24.966361 28829 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:25.007287 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:25.016661 23750 catalog_manager.cc:5697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 7 to 11, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 11 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:25.052346 23929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2545) took 1103 ms. Trace:
I20260709 12:22:25.052891 23929 rpcz_store.cc:276] 0709 12:22:23.948910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.971493 (+ 22583us) service_pool.cc:224] Handling call
0709 12:22:24.813309 (+841816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.916285 (+102976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.051995 (+135710us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54003cf850. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:25.052200 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1934868736}
I20260709 12:22:25.054788 24555 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
W20260709 12:22:25.057612 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.060581 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:25.054190 23750 catalog_manager.cc:5697] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:25.106386 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.155836 24563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.038s	sys 0.070s
W20260709 12:22:25.155939 29192 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.593s	user 0.007s	sys 0.013s
W20260709 12:22:25.156433 24563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.038s	sys 0.070s
I20260709 12:22:25.105266 29052 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:25.168184 23750 catalog_manager.cc:5697] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 8 to 12, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 12 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:25.171237 29132 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:25.217636 29197 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.656s	user 0.000s	sys 0.002s
I20260709 12:22:25.220454 24004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2619) took 1048 ms. Trace:
W20260709 12:22:25.220855 29195 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.659s	user 0.001s	sys 0.002s
I20260709 12:22:25.221066 29025 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:25.221017 24004 rpcz_store.cc:276] 0709 12:22:24.172051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.172186 (+   135us) service_pool.cc:224] Handling call
0709 12:22:24.172576 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:24.172964 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.173004 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:24.173511 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:22:24.456472 (+282961us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:24.456531 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.456633 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.219845 (+763212us) raft_consensus.cc:1685] finished
0709 12:22:25.219892 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.220186 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2421,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3083,"thread_start_us":282448,"threads_started":1,"wal-append.queue_time_us":1043625}
W20260709 12:22:25.242304 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.243428 29105 consensus_queue.cc:1059] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:25.244760 29105 consensus_queue.cc:1243] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 35a9a1f8b1d847fb8f2063ced2a3c26d log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:25.245476 29105 raft_consensus.cc:3055] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:25.246150 29105 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:25.247787 29105 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.250089 29105 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:25.251111 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.256079 23921 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:25.255049 23750 catalog_manager.cc:5697] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 7 to 11, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 11 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:25.259526 29146 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:22:25.278633 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.292101 23750 catalog_manager.cc:5697] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:25.293805 23894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.001s	sys 0.014s
W20260709 12:22:25.296937 23894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.001s	sys 0.014s
W20260709 12:22:25.293296 23852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.007s	sys 0.011s
W20260709 12:22:25.299706 23852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.007s	sys 0.011s
I20260709 12:22:25.279412 29146 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:25.299220 23849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.003s	sys 0.011s
W20260709 12:22:25.305869 23849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.003s	sys 0.011s
I20260709 12:22:25.273412 29132 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:25.308079 23818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.014s	sys 0.006s
W20260709 12:22:25.308496 23818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.014s	sys 0.006s
W20260709 12:22:25.302588 23966 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.013s	sys 0.023s
W20260709 12:22:25.314128 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.316342 23966 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.013s	sys 0.026s
W20260709 12:22:25.320835 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 602740us
W20260709 12:22:25.322062 24001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.002s	sys 0.010s
W20260709 12:22:25.354269 24001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.003s	sys 0.011s
W20260709 12:22:25.322469 28789 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.002s	sys 0.012s
W20260709 12:22:25.326364 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 663094us
I20260709 12:22:25.339298 29132 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:25.307323 29146 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:25.340217 23820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.026s	sys 0.100s
W20260709 12:22:25.363329 23820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.026s	sys 0.100s
I20260709 12:22:25.315207 29126 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.259786 29175 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:25.321461 23817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.011s	sys 0.030s
I20260709 12:22:25.298602 28857 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:25.355429 28789 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.002s	sys 0.012s
W20260709 12:22:25.369441 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.368151 23817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.011s	sys 0.030s
W20260709 12:22:25.371328 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.370515 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 700977us
I20260709 12:22:25.368815 28857 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.376737 23750 catalog_manager.cc:5697] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:25.380434 23820 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:25.381192 28857 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:25.372066 28836 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:25.382449 28789 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:25.382184 28836 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.382848 28789 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.383213 28789 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:25.384471 28836 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:25.384406 28829 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.381522 23820 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:22:25.393420 23966 leader_election.cc:336] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.924s (SENT)
W20260709 12:22:25.387431 23892 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.005s	sys 0.011s
W20260709 12:22:25.395233 23892 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.006s	sys 0.011s
I20260709 12:22:25.401403 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:25.402217 23845 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:25.404331 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:25.405290 23854 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:25.406858 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:25.410794 29123 consensus_queue.cc:1048] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:25.411784 23845 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
W20260709 12:22:25.393311 23893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.010s	sys 0.022s
W20260709 12:22:25.416195 23893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.010s	sys 0.022s
W20260709 12:22:25.416074 23926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.014s
W20260709 12:22:25.419703 23926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.000s	sys 0.015s
I20260709 12:22:25.419579 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:25.423413 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:25.432508 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:25.458719 23818 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:25.481276 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.475065 29126 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.489226 29126 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:25.489724 29135 consensus_meta.cc:287] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 1.260s	user 0.011s	sys 0.009s
I20260709 12:22:25.490265 29135 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:25.494243 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 116346us
I20260709 12:22:25.494637 29189 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:25.494663 28792 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:25.495317 29189 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.495977 28792 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.496635 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:25.497296 24004 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
W20260709 12:22:25.498086 24557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.012s	sys 0.014s
W20260709 12:22:25.498596 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 71409.8us
I20260709 12:22:25.498834 23750 catalog_manager.cc:5697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 7 to 12, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 12 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:25.499595 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:25.501106 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:25.500620 23750 catalog_manager.cc:5697] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 9 to 13, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 13 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:25.501917 28801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.022s	sys 0.015s
W20260709 12:22:25.502295 28801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.022s	sys 0.016s
I20260709 12:22:25.497988 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:25.504513 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.506420 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:25.506579 28792 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:25.507246 24003 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:25.508311 29216 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:25.510035 29068 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:25.510533 29068 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.510944 29068 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:25.510984 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:25.514704 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:25.515609 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 127058us
I20260709 12:22:25.515756 29216 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:25.516436 29216 raft_consensus.cc:697] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:25.516790 23817 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:25.517952 29139 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:25.518610 29206 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:22:25.520679 29135 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:25.517637 29216 consensus_queue.cc:237] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:25.527292 23996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49640 (request call id 2326) took 2241 ms (client timeout 2127 ms). Trace:
W20260709 12:22:25.527812 23996 rpcz_store.cc:269] 0709 12:22:23.286012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.291043 (+  5031us) service_pool.cc:224] Handling call
0709 12:22:25.526934 (+2235891us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54002472d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:25.527093 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5124252544}
I20260709 12:22:25.511121 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:25.498632 24557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.013s	sys 0.015s
W20260709 12:22:25.506667 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 80228.1us
I20260709 12:22:25.538982 23999 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:25.575045 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:25.575402 24563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 893) took 1472 ms. Trace:
I20260709 12:22:25.586130 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:25.546777 28800 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.605685 23750 catalog_manager.cc:5697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 7 to 10, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 10 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:25.609089 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:25.609956 29123 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:25.610752 29123 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.613195 29144 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.613935 29144 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.614552 29123 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:25.615445 29029 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:25.616138 29029 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.616621 29105 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.617324 29105 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.613804 29031 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.620333 29031 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.621062 28829 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:25.621773 29052 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:25.622398 29052 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.622889 29031 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:25.619251 29029 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:25.619688 29105 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:25.624541 29052 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:25.575551 29025 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.625640 29025 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.627812 29025 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:25.632468 28792 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.633221 28792 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.635596 28792 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:25.638049 28800 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:25.642483 29209 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:22:25.619724 23817 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:25.645352 23817 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:25.646270 29211 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:25.646899 29211 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:25.647960 29211 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.625031 23995 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:22:25.668571 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.672935 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.575870 24563 rpcz_store.cc:276] 0709 12:22:24.103544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.103863 (+   319us) service_pool.cc:224] Handling call
0709 12:22:24.104304 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:24.104790 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.104835 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:24.105421 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:22:25.157008 (+1051587us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:22:25.475940 (+318932us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.482769 (+  6829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.564819 (+ 82050us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.564886 (+    67us) raft_consensus.cc:1685] finished
0709 12:22:25.564902 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.575343 (+ 10441us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7534,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":168,"thread_start_us":1343379,"threads_started":2,"wal-append.queue_time_us":1218790}
W20260709 12:22:25.688315 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 113298us
I20260709 12:22:25.699790 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:25.701179 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:25.701964 23845 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
W20260709 12:22:25.702603 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59765.1us
I20260709 12:22:25.582768 29189 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:25.708887 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.714040 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 68769.3us
I20260709 12:22:25.657781 28800 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:25.706295 23996 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:25.727758 23817 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:25.620370 29103 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.662029 29126 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:25.746236 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 46770.8us
W20260709 12:22:25.746687 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.737732 28836 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:25.791594 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 63930.9us
I20260709 12:22:25.793129 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:25.745225 23750 catalog_manager.cc:5697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 9 to 11, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 11 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.757697 29126 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.813297 29123 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:25.814142 29200 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:25.814241 29123 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.817929 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:25.819710 29103 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.822605 28789 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.825137 29029 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.750906 29221 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:25.826483 28789 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:25.827252 29209 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:22:25.833680 23817 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:25.828413 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53613.2us
I20260709 12:22:25.835420 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:25.836828 29052 raft_consensus.cc:2764] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:22:25.837643 29052 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:25.838085 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:25.756841 28857 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:25.839884 28857 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:25.840356 28857 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:25.763612 28792 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.842402 28792 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.843472 28997 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:25.846212 29221 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:25.847714 29221 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.851089 29215 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:25.855351 29200 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:22:25.860101 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 67702.6us
I20260709 12:22:25.861099 29210 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:25.861855 29210 raft_consensus.cc:697] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:25.863183 29210 consensus_queue.cc:237] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:25.884801 23967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.742409 29144 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:25.805107 23852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2651) took 1121 ms. Trace:
W20260709 12:22:25.911049 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 118035us
I20260709 12:22:25.912631 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:25.856933 29200 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:25.907565 29215 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:25.931968 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 124448us
I20260709 12:22:25.888062 23852 rpcz_store.cc:276] 0709 12:22:24.650698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.650841 (+   143us) service_pool.cc:224] Handling call
0709 12:22:24.651347 (+   506us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:24.652105 (+   758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.652136 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:24.653213 (+  1077us) log.cc:844] Serialized 78 byte log entry
0709 12:22:25.313945 (+660732us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:25.736578 (+422633us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.771381 (+ 34803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.771563 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.771670 (+   107us) raft_consensus.cc:1685] finished
0709 12:22:25.771689 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.771990 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71994,"raft.queue_time_us":294015,"raft.run_cpu_time_us":530,"raft.run_wall_time_us":40559,"thread_start_us":1020301,"threads_started":2,"wal-append.queue_time_us":781389}
I20260709 12:22:25.939113 24557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 896) took 1211 ms. Trace:
I20260709 12:22:25.825821 29029 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:25.918314 29139 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.950117 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:25.951269 23921 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:25.941609 24557 rpcz_store.cc:276] 0709 12:22:24.727527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.734091 (+  6564us) service_pool.cc:224] Handling call
0709 12:22:24.734922 (+   831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:24.735810 (+   888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.735865 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:24.736816 (+   951us) log.cc:844] Serialized 26 byte log entry
0709 12:22:25.545806 (+808990us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:25.936551 (+390745us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.937971 (+  1420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.938809 (+   838us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.938869 (+    60us) raft_consensus.cc:1685] finished
0709 12:22:25.938886 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.939041 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72248,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":166381,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":220,"thread_start_us":1148662,"threads_started":2,"wal-append.queue_time_us":1112359}
W20260709 12:22:25.968780 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.950902 23923 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 18.
W20260709 12:22:25.987123 23926 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.019s	sys 0.053s
W20260709 12:22:25.975220 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 121966us
I20260709 12:22:25.978089 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:25.940366 29126 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:25.994881 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.004243 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.005477 23922 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:26.001442 23925 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:26.008675 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:26.009249 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.010056 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2410) took 2666 ms. Trace:
I20260709 12:22:26.011816 29103 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:26.010541 23926 rpcz_store.cc:276] 0709 12:22:23.343890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.344515 (+   625us) service_pool.cc:224] Handling call
0709 12:22:23.344815 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:23.345156 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:23.345202 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:24.761025 (+1415823us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b2c0005c228. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa285d45a11 00007fa285d55372 00007fa287487a01 00007fa28744c43a 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2
0709 12:22:24.761857 (+   832us) log.cc:844] Serialized 26 byte log entry
0709 12:22:25.427497 (+665640us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:25.987870 (+560373us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.993432 (+  5562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.009581 (+ 16149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:26.009637 (+    56us) raft_consensus.cc:1685] finished
0709 12:22:26.009769 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.009959 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17103,"raft.queue_time_us":19891,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":12993,"spinlock_wait_cycles":52836224,"thread_start_us":1160948,"threads_started":2,"wal-append.queue_time_us":1083157}
I20260709 12:22:26.014027 29123 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:26.014863 23892 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:26.023823 29175 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:26.024596 29029 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:26.025436 29029 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:26.029268 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:26.034580 23927 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:26.037635 29175 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.038591 29175 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:26.040912 29175 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:26.042979 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:26.044597 29103 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:26.046442 29103 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:22:26.047058 29225 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:22:25.989720 29215 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:26.050920 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 103063us
I20260709 12:22:26.081630 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:26.082334 24557 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:25.971582 29068 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:26.084648 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:26.085367 29144 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:26.086289 29068 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:26.087260 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47066 (request call id 2422) took 1410 ms. Trace:
I20260709 12:22:26.088666 23895 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:26.092890 23750 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:26.099177 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 280337us
I20260709 12:22:26.096755 23750 catalog_manager.cc:5697] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 7 to 12, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 12 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.058547 28792 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:26.105340 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:26.098600 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 120635us
I20260709 12:22:26.087684 23849 rpcz_store.cc:276] 0709 12:22:24.677089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.689122 (+ 12033us) service_pool.cc:224] Handling call
0709 12:22:24.689637 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:25.320504 (+630867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.320536 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:25.366951 (+ 46415us) log.cc:844] Serialized 26 byte log entry
0709 12:22:25.737495 (+370544us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:25.737532 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.737623 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:26.086968 (+349345us) raft_consensus.cc:1685] finished
0709 12:22:26.086998 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.087191 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":209479,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":231,"thread_start_us":971195,"threads_started":2,"wal-append.queue_time_us":605159}
I20260709 12:22:26.132264 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:26.134085 23845 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:25.994237 29222 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 12:22:26.050060 28857 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:26.130383 23750 catalog_manager.cc:5697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 4 to 13, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 13 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:25.999513 29139 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:26.108451 29029 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:22:26.129843 29220 log.cc:927] Time spent T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:26.108773 29123 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:26.156148 29068 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:26.157079 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:26.157871 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:26.167174 24003 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:26.159188 24004 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:26.170830 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:26.156597 23750 catalog_manager.cc:5697] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 7 to 10, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:26.134428 29135 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:26.201619 23846 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:22:26.174783 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:26.175685 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:26.130481 28792 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:22:26.190434 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 105905us
I20260709 12:22:26.160028 29216 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:26.171356 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:26.161181 29146 consensus_meta.cc:287] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.003s
I20260709 12:22:26.180532 24557 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:26.202951 23998 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:26.150691 29029 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.208648 23996 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:26.220667 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:26.224423 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60154.4us
I20260709 12:22:26.231278 23852 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 15: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:26.231303 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.244437 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:26.218143 29029 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:26.248514 24557 raft_consensus.cc:2410] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:22:26.170395 29123 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:26.253085 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 131965us
I20260709 12:22:26.229161 29215 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:26.213080 29135 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:26.264849 23892 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:26.262185 29102 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:26.267522 29102 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:26.270304 28397 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:22:26.276808 23892 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:26.277563 28792 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:26.280776 28792 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:26.282636 28792 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:26.283011 28792 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:26.283938 28792 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:26.285598 28792 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:26.286162 29102 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:26.288978 23892 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:26.224664 29068 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:26.223222 29146 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:26.296023 28397 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:26.300503 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:26.310468 23920 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:26.311136 29139 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:26.294840 29031 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:26.298569 23750 catalog_manager.cc:5697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 4 to 10, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:26.313764 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.322592 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:26.323374 24002 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:26.304755 28397 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.326857 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:26.328469 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.329114 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.329794 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.330236 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.349041 23923 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:26.330564 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:26.331068 23921 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:26.334722 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.336807 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2339) took 1586 ms. Trace:
I20260709 12:22:26.339522 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:22:26.342341 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 75961.4us
I20260709 12:22:26.344571 29146 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:26.351457 23927 raft_consensus.cc:2368] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 15. Current term is 16.
I20260709 12:22:26.352905 23924 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:26.358281 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:26.361325 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:26.351145 24001 rpcz_store.cc:276] 0709 12:22:24.750026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.750182 (+   156us) service_pool.cc:224] Handling call
0709 12:22:24.750759 (+   577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:25.365157 (+614398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.365194 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:25.386294 (+ 21100us) log.cc:844] Serialized 26 byte log entry
0709 12:22:25.790323 (+404029us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:25.790359 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.790442 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:26.336535 (+546093us) raft_consensus.cc:1685] finished
0709 12:22:26.336557 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.336719 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42229,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":227,"thread_start_us":970419,"threads_started":2,"wal-append.queue_time_us":937099}
I20260709 12:22:26.349287 28397 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:26.367125 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.364176 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:26.370584 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:26.370708 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.370803 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.362887 23750 catalog_manager.cc:5697] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 6 to 11, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 11 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:26.374504 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.384812 23996 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:26.385162 23750 catalog_manager.cc:5697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:26.388618 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:26.387310 23927 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 16.
I20260709 12:22:26.425092 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:26.425212 23818 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:26.427718 24002 raft_consensus.cc:2393] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:26.432936 23750 catalog_manager.cc:5697] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 3 to 7, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 7 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:26.455792 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:26.432634 29186 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:26.468986 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:26.442593 29211 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:26.455173 23750 catalog_manager.cc:5697] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 5 to 8, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 8 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.473165 23817 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:26.476332 29173 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:26.462625 29123 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:26.484978 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:26.486265 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.513737 23923 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:26.483978 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:26.551112 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 186891us
I20260709 12:22:26.554158 23847 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:22:26.553618 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 69709.5us
W20260709 12:22:26.555243 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 69718.4us
I20260709 12:22:26.481309 29031 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.481648 29216 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:26.486913 29173 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.558681 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.558799 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.481844 29135 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:26.592097 23920 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:26.551893 29123 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:26.558630 29175 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:26.561530 29216 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.556974 29068 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:26.618209 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.607373 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.485517 29186 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:26.608079 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:26.607389 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.619537 23847 raft_consensus.cc:2410] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:22:26.559608 29139 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:26.611135 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.565081 29173 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:26.611912 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.612784 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.608891 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.602440 23928 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 18.
I20260709 12:22:26.563210 28829 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:22:26.620776 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:26.562655 29031 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:26.623456 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:26.625525 23929 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:26.620343 23848 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:26.633312 23922 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:26.618767 29216 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:26.645833 23853 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
W20260709 12:22:26.646494 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59040.9us
I20260709 12:22:26.653293 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.621182 29139 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:26.656105 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.656862 23849 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 9.
I20260709 12:22:26.669023 29249 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:26.625931 29175 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:26.685827 23928 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:26.666988 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.645341 29068 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:26.653450 28789 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:26.672961 28829 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:26.670027 29139 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:26.647683 28836 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:22:26.693126 29135 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:26.641743 29123 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:26.719794 28789 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:26.729710 29135 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.751564 29135 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:26.797058 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 82346.8us
W20260709 12:22:26.786587 23966 connection.cc:256] RPC call timeout handler was delayed by -2.2235136959998272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
I20260709 12:22:26.742672 28829 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:26.780719 29249 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:22:26.870175 23818 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:26.873394 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.874985 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.873477 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.880239 23848 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:26.876013 23852 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
W20260709 12:22:26.894168 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 264854us
I20260709 12:22:26.859337 29186 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:26.871229 29243 log.cc:927] Time spent T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 12:22:26.870565 29029 consensus_meta.cc:287] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.607s	user 0.013s	sys 0.000s
W20260709 12:22:26.875007 28792 consensus_meta.cc:287] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.004s
I20260709 12:22:26.800486 29175 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:26.923724 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.912213 24561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36570 (request call id 956) took 1519 ms. Trace:
I20260709 12:22:26.920825 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:26.922223 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 133111us
I20260709 12:22:26.922869 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.914441 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:26.935460 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.925716 24561 rpcz_store.cc:276] 0709 12:22:25.392780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.396289 (+  3509us) service_pool.cc:224] Handling call
0709 12:22:25.419570 (+ 23281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.460256 (+ 40686us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:22:25.952808 (+492552us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.694001 (+741193us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.911914 (+217913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.911955 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:26.912000 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.912065 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.912161 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":129922,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":485964,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7795,"thread_start_us":1330120,"threads_started":4,"wal-append.queue_time_us":620910}
I20260709 12:22:26.935130 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:26.898469 29031 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:26.856848 28789 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:26.935460 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 235288us
I20260709 12:22:26.965698 23845 raft_consensus.cc:1240] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:27.034631 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 195631us
W20260709 12:22:27.080518 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 229036us
I20260709 12:22:27.028806 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:26.946382 24558 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:26.999888 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.004769 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.058602 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:26.943776 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.027536 23893 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:27.086066 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:22:27.088248 23966 connection.cc:256] RPC call timeout handler was delayed by -2.1720174010001756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 12:22:27.062948 29243 log.cc:927] Time spent T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:22:27.091403 23853 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:27.090884 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.096176 23845 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:26.924070 29263 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:22:27.086938 29250 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.325s	user 0.001s	sys 0.001s
I20260709 12:22:27.061957 29144 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:27.092579 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 65160.8us
I20260709 12:22:27.000432 29265 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.092183 23847 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:27.087720 24563 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:27.045118 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2448) took 1076 ms. Trace:
I20260709 12:22:27.110088 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:27.036427 29123 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:27.118975 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.115871 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:26.932745 29029 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.098073 29025 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:27.127728 23893 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:27.036677 29257 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
W20260709 12:22:27.141475 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 53082.9us
W20260709 12:22:27.142181 23923 consensus_meta.cc:287] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.003s
I20260709 12:22:27.142769 23923 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:27.120405 29102 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:27.020859 23922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:27.121393 23926 rpcz_store.cc:276] 0709 12:22:25.968503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.013255 (+ 44752us) service_pool.cc:224] Handling call
0709 12:22:26.013706 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.014112 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:26.367731 (+353619us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.044445 (+676714us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:27.044537 (+    92us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:27.044609 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.044723 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.044917 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12119,"prepare.queue_time_us":250494,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":130211,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":10083,"thread_start_us":960902,"threads_started":3,"wal-append.queue_time_us":452249}
I20260709 12:22:27.145354 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:27.136816 29246 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:27.147153 23922 raft_consensus.cc:606] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:27.150521 23925 raft_consensus.cc:2368] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 15. Current term is 16.
W20260709 12:22:27.143375 29256 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 12:22:27.118455 29263 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.140058 29025 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.153604 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.180765 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:27.137065 28829 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:27.176955 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49319.7us
I20260709 12:22:27.195021 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:27.207587 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:27.155639 29246 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.225332 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:27.226235 23848 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:27.226648 29275 log.cc:927] Time spent T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:22:27.226832 29263 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:27.229094 29272 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:22:27.240139 28397 consensus_meta.cc:287] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.857s	user 0.009s	sys 0.002s
I20260709 12:22:27.240648 28397 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:27.224857 29254 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 12:22:27.243985 29029 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:27.176985 28857 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:27.126885 29265 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.208998 23853 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
W20260709 12:22:27.257655 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 45964us
I20260709 12:22:27.247205 23893 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:27.258601 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:27.270125 23966 leader_election.cc:336] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.067s (SENT)
I20260709 12:22:27.265794 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:27.264972 23969 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:27.285116 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:27.266234 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.274904 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:27.289563 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:27.290737 23893 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:27.219285 29210 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:27.195823 29278 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:27.337298 23926 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:27.210947 29025 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:27.252079 29246 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:27.338362 23925 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:27.337699 23820 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:27.337499 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.304438 23848 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 19.
I20260709 12:22:27.348055 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:27.348417 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 233195us
W20260709 12:22:27.346469 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 55883.7us
I20260709 12:22:27.290679 29102 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:27.292920 23817 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:27.359172 23853 raft_consensus.cc:1240] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:27.360278 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 67696us
I20260709 12:22:27.290351 29257 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:27.359462 29102 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:27.362308 28792 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:27.363157 29270 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:22:27.365693 24524 leader_election.cc:336] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.667s (SENT)
I20260709 12:22:27.362219 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.293047 29126 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:27.370745 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.374910 24524 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:27.375406 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.341212 29278 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:27.374315 29102 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:27.266569 29186 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:22:27.293471 29283 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:27.349577 28789 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:27.362273 29259 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:22:27.366964 28857 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:27.382957 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.372035 29261 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:27.395720 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:27.451979 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 45869.7us
W20260709 12:22:27.405753 24524 leader_election.cc:336] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.685s (SENT)
I20260709 12:22:27.377544 23818 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:27.396909 29139 consensus_meta.cc:287] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.657s	user 0.006s	sys 0.005s
I20260709 12:22:27.340930 29210 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:27.404583 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.455197 23853 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:27.372406 28829 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:27.406155 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.469686 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:27.382186 29126 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.472308 23853 raft_consensus.cc:2393] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 12: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:27.402454 29283 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.402181 29263 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:27.387418 29278 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:27.479678 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.468612 29210 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:27.472802 28836 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:27.472484 29261 raft_consensus.cc:697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:27.490088 29248 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:27.489996 29261 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.490777 29248 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:27.491987 29213 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.201s
I20260709 12:22:27.472553 29257 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.475709 29126 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:27.499040 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:27.502527 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 232428us
I20260709 12:22:27.495069 23928 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:27.503949 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:27.505079 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 106284us
W20260709 12:22:27.505826 24524 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.720s (SENT)
I20260709 12:22:27.506286 24524 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:27.506513 29135 consensus_meta.cc:287] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.692s	user 0.008s	sys 0.004s
I20260709 12:22:27.507146 29263 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:27.506943 29135 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.508225 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:27.508478 29282 log.cc:927] Time spent T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:22:27.509549 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:27.512545 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:27.513280 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:27.469496 29139 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:27.476969 29283 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:27.515430 24524 leader_election.cc:336] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.735s (SENT)
I20260709 12:22:27.519703 29068 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:27.520334 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:27.493643 29102 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:27.521202 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 147562us
I20260709 12:22:27.523568 23893 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:27.523916 23925 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:27.524819 24001 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:27.526175 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.526326 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:27.536262 24562 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:27.509799 28397 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:27.530440 24556 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 15: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:27.532136 28792 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:27.510418 28857 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.521754 29029 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.553364 23851 raft_consensus.cc:2393] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 17: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:27.556819 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.554447 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:27.560322 23966 leader_election.cc:336] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 2.070s (SENT)
I20260709 12:22:27.524536 29105 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:27.562337 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:27.564307 29105 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:27.566023 29288 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:22:27.567203 29105 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:27.567672 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.561421 29103 raft_consensus.cc:993] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:27.510124 29257 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:27.576982 29173 consensus_meta.cc:287] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.935s	user 0.013s	sys 0.000s
I20260709 12:22:27.577448 29102 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:27.577575 29173 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.571457 29068 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.580552 29173 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:27.581760 23850 raft_consensus.cc:2393] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 19: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:27.577024 29265 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:27.585175 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:27.586790 29257 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:27.561918 29029 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:27.597954 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.598101 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.600777 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.604751 23849 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:22:27.605149 23850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 2446) took 1014 ms. Trace:
I20260709 12:22:27.605518 23850 rpcz_store.cc:276] 0709 12:22:26.590906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.591049 (+   143us) service_pool.cc:224] Handling call
0709 12:22:27.604886 (+1013837us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b5400403154. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:27.605047 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212062720}
W20260709 12:22:27.606842 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 83371.1us
I20260709 12:22:27.607493 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:27.608570 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:27.601892 29126 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.610427 23852 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:22:27.611842 29258 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:27.612346 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.613065 23926 raft_consensus.cc:2393] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 16: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:27.614483 23929 raft_consensus.cc:2393] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 18: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:27.614850 29258 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:27.615586 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.616972 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:27.617190 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:27.617664 23997 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:27.617770 23998 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:27.617204 29103 raft_consensus.cc:1081] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:27.619238 23996 raft_consensus.cc:2393] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 16: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:27.620587 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:27.621156 23998 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:27.621321 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:27.624593 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:27.625106 24000 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:27.626344 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:27.626665 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.627868 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.630808 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.627892 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:27.596336 29068 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:27.641147 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:27.613811 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.663272 23922 raft_consensus.cc:2368] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:27.675628 23997 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:27.666935 23929 raft_consensus.cc:2393] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:27.678061 23923 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:27.678308 23920 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:22:27.675853 23893 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:27.557428 28857 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.689960 23851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 2444) took 1085 ms. Trace:
I20260709 12:22:27.690589 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:27.691787 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:27.690438 23851 rpcz_store.cc:276] 0709 12:22:26.590239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.591750 (+  1511us) service_pool.cc:224] Handling call
0709 12:22:27.628318 (+1036568us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54001e46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:27.675425 (+ 47107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2141779328}
I20260709 12:22:27.719444 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:27.732399 23999 raft_consensus.cc:2393] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 12: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:22:27.732584 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 132601us
I20260709 12:22:27.738417 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:27.736147 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:27.734426 24525 leader_election.cc:336] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.646s (SENT)
I20260709 12:22:27.761246 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:27.765512 23925 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:27.767869 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:27.769002 23999 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
W20260709 12:22:27.781677 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 105906us
I20260709 12:22:27.782630 23893 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:27.730845 29289 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:27.793735 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:27.817653 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 262521us
I20260709 12:22:27.644039 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:27.820729 24556 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:27.768798 29239 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:27.820690 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 309823us
I20260709 12:22:27.824561 24000 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:27.796445 28397 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:27.825371 23854 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:27.786000 29271 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:27.827350 23998 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:27.829347 29135 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:27.829272 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 94915.7us
I20260709 12:22:27.830921 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:27.832593 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:27.831061 23895 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:27.830955 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:27.831882 24524 leader_election.cc:336] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.802s (SENT)
I20260709 12:22:27.837708 24002 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:27.796096 29215 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:22:27.874919 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:27.825157 29257 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:27.887241 24525 leader_election.cc:336] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.573s (SENT)
I20260709 12:22:27.801112 29261 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:22:27.890451 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:27.830595 28397 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.884413 24562 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:27.830871 23999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:22:27.896893 23999 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:27.897346 23999 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:27.817747 29289 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.874229 29249 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.873453 29052 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:27.896108 24525 leader_election.cc:336] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.629s (SENT)
I20260709 12:22:27.886966 29029 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:27.923252 24525 leader_election.cc:336] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.774s (SENT)
I20260709 12:22:27.899084 28397 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:27.933108 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 110540us
W20260709 12:22:27.935490 24524 leader_election.cc:336] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Timed out: RequestConsensusVote RPC to 127.22.43.66:33453 timed out after 1.941s (SENT)
I20260709 12:22:27.900857 28829 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:27.875809 29239 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:27.909950 29139 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:27.930306 24525 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:27.940652 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 109845us
I20260709 12:22:27.913527 29258 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:27.914995 29271 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:27.952298 23892 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:27.950151 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 119157us
I20260709 12:22:27.958796 23999 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.894052 29257 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:27.978323 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:27.959769 23927 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:22:27.986018 23892 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:27.987628 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 64435.3us
W20260709 12:22:27.992971 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 155720us
W20260709 12:22:27.993748 23966 connection.cc:256] RPC call timeout handler was delayed by -2.0359922229999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 12:22:27.994120 23966 connection.cc:256] RPC call timeout handler was delayed by -2.0039499409999735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 12:22:27.994395 23966 connection.cc:256] RPC call timeout handler was delayed by -1.980317401000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
W20260709 12:22:27.994668 23966 connection.cc:256] RPC call timeout handler was delayed by -1.8550512809999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260709 12:22:27.997105 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:27.998095 23927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:27.978511 29274 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:28.013624 23966 connection.cc:256] RPC call timeout handler was delayed by -1.4419512810000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 12:22:28.015880 23999 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:28.015936 24000 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
W20260709 12:22:28.016242 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 80799.3us
I20260709 12:22:27.931911 29249 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:27.930722 29052 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.025413 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:27.960458 29135 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:27.983512 29248 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:27.962440 29271 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.988371 29212 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:27.963622 29126 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:28.003068 29246 consensus_meta.cc:287] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.629s	user 0.012s	sys 0.013s
I20260709 12:22:28.025017 23895 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:28.028761 29210 consensus_meta.cc:287] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.006s
W20260709 12:22:28.046046 28789 consensus_meta.cc:287] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.637s	user 0.013s	sys 0.005s
W20260709 12:22:28.046604 29294 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 12:22:28.046957 29246 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.047896 29052 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:28.050413 29296 log.cc:927] Time spent T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 12:22:28.051102 29298 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 12:22:28.051779 29295 log.cc:927] Time spent T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 12:22:28.052318 29283 consensus_meta.cc:287] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.506s	user 0.002s	sys 0.016s
I20260709 12:22:28.075942 29283 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.053478 29212 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:28.078919 23921 raft_consensus.cc:2368] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:22:28.057075 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.059481 29306 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:28.062165 29289 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:28.062891 24525 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.907s (SENT)
W20260709 12:22:28.070304 29025 consensus_meta.cc:287] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.007s
W20260709 12:22:28.038681 29278 consensus_meta.cc:287] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.010s
I20260709 12:22:28.106292 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:28.106478 29278 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.108736 29278 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.109479 23926 raft_consensus.cc:2393] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 10: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:28.024328 28857 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:28.068051 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:28.110816 23929 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:28.023947 23739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73d2fbc1f30749eba64903d7e79de8a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 35a9a1f8b1d847fb8f2063ced2a3c26d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:28.079855 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 64728.8us
I20260709 12:22:28.062680 29271 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:28.063256 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.086241 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.086596 23928 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 16: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:28.086714 29306 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:28.087589 29246 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.089059 29239 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.089836 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:28.091409 29257 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.091773 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:28.123343 23921 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:28.098428 29216 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 1.381s	user 0.020s	sys 0.011s
I20260709 12:22:28.098621 23854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2656) took 1242 ms. Trace:
I20260709 12:22:28.080428 29212 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:28.084372 29309 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:22:28.102478 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 77559.3us
I20260709 12:22:28.078187 29283 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:28.115483 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 74941.4us
I20260709 12:22:28.124035 23854 rpcz_store.cc:276] 0709 12:22:26.856748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.856949 (+   201us) service_pool.cc:224] Handling call
0709 12:22:27.682220 (+825271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.835134 (+152914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.098388 (+263254us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54001e46d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:28.098549 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853050752}
W20260709 12:22:28.114228 23739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 117804us
I20260709 12:22:28.087594 29289 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:28.133831 23892 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:28.067711 29210 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.114337 29248 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:28.152385 23921 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 17.
I20260709 12:22:28.165400 24001 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:28.166384 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:28.170553 24563 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:28.110543 29025 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.174469 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:28.172350 23997 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:28.178591 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.173485 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:28.164577 29222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.007s	sys 0.018s
W20260709 12:22:28.185839 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 99676.8us
I20260709 12:22:28.131982 29216 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.195276 23997 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:28.179237 29309 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:28.202875 23924 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:28.203337 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:28.222532 23845 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:22:28.182533 29222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.008s	sys 0.018s
I20260709 12:22:28.200919 29139 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:28.191466 29248 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:28.226451 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:28.196800 29200 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:28.226595 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:28.238111 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:28.241015 23800 auto_rebalancer.cc:893] Removing replace marker failed: Replica e8bc734d763e4ddf87f7b930e35cbaa7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:28.241528 23800 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:22:28.241868 23800 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:22:28.247735 23966 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.221791 29307 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 12:22:28.239463 29139 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 17 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:28.238083 29200 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.286648 29126 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:28.281265 29248 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:28.294920 28397 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.297904 29200 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.299826 29308 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:28.301021 29139 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.302353 24000 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:28.307752 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:28.345588 23818 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.294440 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:28.348472 29221 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:28.349476 29221 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:28.349982 29221 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:28.350476 29221 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:28.352994 23929 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:28.354362 23817 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:28.359903 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:28.317993 28789 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:28.319854 29216 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.325103 29309 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:28.325268 29271 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:28.328760 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:28.329617 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:28.367940 23847 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 18.
I20260709 12:22:28.390400 23927 raft_consensus.cc:606] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:28.394385 23927 raft_consensus.cc:614] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:28.356593 29068 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:22:28.406527 24525 leader_election.cc:336] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.116s (SENT)
I20260709 12:22:28.407056 24525 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:28.390908 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:28.402549 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:28.412451 23929 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
W20260709 12:22:28.412789 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44163.8us
W20260709 12:22:28.408594 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 161031us
I20260709 12:22:28.390472 29200 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.410559 23922 raft_consensus.cc:1240] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:28.418273 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:28.420528 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:28.420586 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:28.404480 29306 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:28.405311 29210 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.422817 23929 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 15: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:28.430720 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:28.414851 29068 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:28.395627 28789 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:28.432824 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 265960us
I20260709 12:22:28.466909 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:28.435503 29322 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:28.551667 29265 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:28.553198 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 117836us
W20260709 12:22:28.553669 29328 log.cc:927] Time spent T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:22:28.550369 29068 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.556161 29271 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:28.428220 28857 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 12:22:28.559211 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:28.559437 29025 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.450676 29126 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:22:28.562719 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 93719.9us
I20260709 12:22:28.561249 29326 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:22:28.574564 29325 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.106s	user 0.003s	sys 0.000s
I20260709 12:22:28.576809 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:28.418371 29212 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.419692 29200 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:28.607885 29135 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:22:28.613772 29200 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:28.615950 29212 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.620097 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2578) took 1091 ms. Trace:
I20260709 12:22:28.620704 23924 rpcz_store.cc:276] 0709 12:22:27.529071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.567422 (+ 38351us) service_pool.cc:224] Handling call
0709 12:22:28.619791 (+1052369us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b5400106b54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:28.620014 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454228736}
I20260709 12:22:28.623226 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.624197 23845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60702 (request call id 2672) took 1511 ms. Trace:
I20260709 12:22:28.624645 23966 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.624747 23845 rpcz_store.cc:276] 0709 12:22:27.112992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.113459 (+   467us) service_pool.cc:224] Handling call
0709 12:22:27.113927 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.223088 (+1109161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.623838 (+400750us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400429fd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:28.624112 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2544666368}
W20260709 12:22:28.584647 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 170572us
I20260709 12:22:28.630872 23818 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:28.584987 23925 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:28.602272 24563 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:28.565764 29222 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:28.608522 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.626143 29126 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:28.626392 29289 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:28.627229 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.580200 28789 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.626402 23923 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 12. Ops: []
I20260709 12:22:28.633661 23818 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:28.642347 23818 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:28.655836 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.670985 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 62603.5us
I20260709 12:22:28.677632 28397 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.607476 29265 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.637132 29222 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:28.638543 29200 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:28.639125 28857 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:28.798949 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:28.804718 29304 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:28.808001 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:28.804545 29248 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:28.809039 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.808913 29248 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:28.809168 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 183230us
I20260709 12:22:28.810086 29324 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:28.810572 29324 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:28.810971 29324 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:28.811224 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.811751 29265 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.798683 28789 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:28.813683 29262 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:28.814075 29326 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:28.814172 29262 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:28.814733 29326 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:28.815215 29326 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:28.815331 29262 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.801838 29135 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:28.800160 29289 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:28.796898 29322 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:28.818739 29322 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:28.808049 29304 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:28.822100 29322 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.824604 29304 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:28.822747 29322 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:28.825932 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:28.821455 29222 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:28.831437 29248 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.837330 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:22:28.803669 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 161445us
I20260709 12:22:28.804538 29211 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:28.840942 23818 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:28.839912 29249 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.842686 29324 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:28.843921 23927 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:28.844245 24555 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:28.845016 29211 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:28.849267 23921 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 19.
I20260709 12:22:28.851486 23818 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:28.851719 29126 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:28.851526 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.859269 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.839809 29326 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:28.866822 29326 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:28.860628 29319 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.566s	user 0.002s	sys 0.000s
I20260709 12:22:28.854079 29324 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:28.868556 23893 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:28.869659 29222 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:28.869982 29135 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:28.861655 29211 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:28.872470 23817 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:28.864171 28836 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:28.873484 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.874294 28836 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:28.874135 29139 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:28.874913 28836 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 19 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:28.875021 29308 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:28.849128 29313 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.606s	user 0.001s	sys 0.000s
I20260709 12:22:28.876024 29139 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:28.876751 29308 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:28.878054 29210 raft_consensus.cc:3055] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:28.878476 29210 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:28.878728 23966 leader_election.cc:400] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:28.879071 23966 leader_election.cc:403] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:22:28.876087 28836 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:28.871577 29330 consensus_queue.cc:1059] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:28.880923 29308 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14.
I20260709 12:22:28.881371 29330 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:28.881785 29330 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:28.882985 29262 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:28.860004 29126 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:28.879403 29210 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.883886 23927 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:28.899483 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:28.900429 24002 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:28.832828 29221 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:28.861382 23926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2570) took 1345 ms. Trace:
I20260709 12:22:28.904141 23926 rpcz_store.cc:276] 0709 12:22:27.516263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.613588 (+ 97325us) service_pool.cc:224] Handling call
0709 12:22:28.861186 (+1247598us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b540018a1d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:28.861322 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990211328}
I20260709 12:22:28.882874 29330 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:28.910404 23928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35558 (request call id 2566) took 1645 ms (client timeout 1973 ms). Trace:
I20260709 12:22:28.911441 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:28.912137 23997 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:28.915663 23925 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:28.917131 23818 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:28.911031 23928 rpcz_store.cc:269] 0709 12:22:27.264522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.503705 (+239183us) service_pool.cc:224] Handling call
0709 12:22:28.910138 (+1406433us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54003746d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:28.910327 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338379520}
I20260709 12:22:28.924799 23997 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:28.807278 29200 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:28.919355 23817 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:28.926715 23818 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:28.929364 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:28.931213 23966 leader_election.cc:400] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:22:28.931571 23966 leader_election.cc:403] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:22:28.939046 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:28.920122 29210 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:28.945354 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:28.914256 28397 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:28.930130 29173 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:28.934888 29330 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:28.934161 29200 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:28.958426 24004 raft_consensus.cc:1240] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:28.959761 23928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:28.941851 29213 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:28.943442 29068 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:28.960512 23928 raft_consensus.cc:606] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:28.975301 23923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2562) took 1711 ms. Trace:
I20260709 12:22:28.975153 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:28.975800 23923 rpcz_store.cc:276] 0709 12:22:27.263431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.692440 (+429009us) service_pool.cc:224] Handling call
0709 12:22:28.626138 (+933698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.640761 (+ 14623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.972798 (+332037us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400106b50. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744b8ad 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:28.975231 (+  2433us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047869824}
I20260709 12:22:28.975997 24004 raft_consensus.cc:2376] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10. Re-sending same reply.
I20260709 12:22:28.987339 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:28.987413 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:28.988857 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:28.987599 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:28.990932 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:28.991528 24000 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:28.994527 29291 log.cc:927] Time spent T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 1.280s	user 0.003s	sys 0.009s
W20260709 12:22:28.995604 29315 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.745s	user 0.001s	sys 0.002s
I20260709 12:22:29.011067 29221 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:28.956621 28397 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.014456 28397 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:29.015842 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:28.994554 23999 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:28.968321 29068 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:29.029398 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:29.039893 23923 raft_consensus.cc:2368] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12.
W20260709 12:22:29.033442 23892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.668s (SENT) [suppressed 33 similar messages]
I20260709 12:22:29.036253 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:29.040939 23997 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:29.038898 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:29.043591 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.044296 24003 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:29.044459 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.051061 29213 consensus_queue.cc:1059] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:29.052379 29213 raft_consensus.cc:3055] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:29.052772 29213 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:29.053663 29213 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.069204 29213 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:29.077395 29200 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.079795 29271 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:29.082623 29068 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.084719 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.085427 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.091403 24002 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:29.086640 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.090250 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:29.091392 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.042333 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.102871 24562 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:29.126674 23995 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:29.129163 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.103413 24000 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:29.108120 23928 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:29.108115 23817 leader_election.cc:400] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12.
I20260709 12:22:29.130750 23817 leader_election.cc:403] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:22:29.110950 29248 consensus_queue.cc:1059] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:29.089453 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.127203 23996 raft_consensus.cc:2376] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10. Re-sending same reply.
I20260709 12:22:29.130808 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:29.136548 23997 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:29.138247 23923 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:29.128578 29271 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:29.139240 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.139937 23999 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:29.140457 29212 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:29.140703 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.140895 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.141083 29212 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:29.142881 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.143265 29283 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:29.143664 29283 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:29.144531 29283 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.128960 29289 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 10. Current term is 11.
I20260709 12:22:29.139536 29271 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:29.147209 23739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73d2fbc1f30749eba64903d7e79de8a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 35a9a1f8b1d847fb8f2063ced2a3c26d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:29.163380 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.166023 29283 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:29.167050 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.167858 29200 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:29.171895 29200 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:29.157778 29210 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:29.174582 29200 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:29.175169 29200 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.142817 29248 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:22:29.178122 29200 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:29.184499 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:29.184630 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:29.185662 23921 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:29.179030 23923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:29.189098 23923 raft_consensus.cc:606] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.189572 23923 raft_consensus.cc:614] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:29.209353 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 400345us
I20260709 12:22:29.210664 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.206466 23893 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:29.233292 24525 leader_election.cc:336] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.672s (SENT)
I20260709 12:22:29.233958 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.234645 23893 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:29.182413 29200 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:22:29.252527 24525 leader_election.cc:336] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.524s (SENT)
I20260709 12:22:29.273129 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.262871 23921 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
W20260709 12:22:29.271497 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60930.7us
I20260709 12:22:29.275921 29324 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:29.279158 24524 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.282327 29326 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:29.282728 29326 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.283051 29326 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:29.284961 29324 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:29.286352 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.291508 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.237814 29135 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:29.294940 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 261515us
I20260709 12:22:29.240350 29262 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:29.242533 29246 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:29.274243 29322 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:22:29.297952 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.296124 24524 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.305755 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:29.294715 29222 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:29.207785 29212 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.295241 28857 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:29.311731 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 375394us
I20260709 12:22:29.310622 23892 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:29.334950 29025 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:22:29.335858 29334 log.cc:927] Time spent T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:22:29.334484 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2475) took 1261 ms. Trace:
I20260709 12:22:29.336642 24524 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.337724 23925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:29.338363 23925 raft_consensus.cc:606] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:29.338699 23925 raft_consensus.cc:614] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:29.338755 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.340899 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.340997 29324 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:29.342180 29324 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:29.342653 29324 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:29.343097 29324 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:29.346223 29135 consensus_queue.cc:1059] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:29.346508 29173 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:29.348349 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:29.349253 29173 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:29.350046 29249 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:29.350468 29249 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:29.351465 29249 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.352865 29249 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:29.293848 29126 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
W20260709 12:22:29.337181 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.358516 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 62249.2us
I20260709 12:22:29.359295 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.360710 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.361568 23847 raft_consensus.cc:2410] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 12:22:29.363535 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.368090 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.368364 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:29.369340 23845 raft_consensus.cc:2410] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:22:29.361559 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.365960 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.307008 29262 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:29.364969 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:29.386847 23925 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:29.388160 23997 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:22:29.388218 23966 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:29.394546 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:29.395188 23845 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:29.397094 23846 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:29.402246 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.403060 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:29.404055 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.406213 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.410915 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:29.412123 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.413185 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.413949 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.413381 23853 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:29.416296 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.426317 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:29.427914 28857 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:29.430974 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.374203 29308 raft_consensus.cc:2764] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:22:29.416920 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.423478 24001 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:29.436098 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:29.383630 28397 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:29.450940 23846 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:29.458901 23999 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:29.460201 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:29.415196 29289 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:29.403209 29338 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:29.467746 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:29.469027 24000 raft_consensus.cc:2368] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16.
I20260709 12:22:29.394176 29173 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:29.467810 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.475888 24003 raft_consensus.cc:2368] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12.
I20260709 12:22:29.443496 29135 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:29.487073 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:29.487886 24563 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:29.484874 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:29.493561 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:29.494657 24563 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:29.500869 28809 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.501623 28809 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.504657 28809 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:29.505365 28809 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.506129 29200 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:29.506876 29200 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.510550 23845 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:29.512118 29200 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:29.513032 28809 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.517108 28809 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:29.518980 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:29.519930 24555 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:29.443341 29330 consensus_queue.cc:1059] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:22:29.482304 28397 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:29.483649 29068 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:29.496953 29213 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.543874 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:29.544684 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:29.553237 23845 raft_consensus.cc:2410] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 12:22:29.546027 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 157887us
I20260709 12:22:29.558379 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.482797 29173 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.569407 24556 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:29.567142 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:29.543493 29319 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:22:29.496019 29135 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.581941 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:29.582885 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
W20260709 12:22:29.570791 29352 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:22:29.591717 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:29.592608 23848 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:29.593003 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:29.559772 28809 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:29.594792 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:29.597712 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:29.598419 23925 raft_consensus.cc:2376] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15. Re-sending same reply.
I20260709 12:22:29.599160 24563 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:29.576999 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.596900 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:29.601051 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:29.602046 23845 raft_consensus.cc:2410] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 12:22:29.594242 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 187758us
I20260709 12:22:29.570850 29304 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:29.594074 29354 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:29.605077 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:29.616062 24563 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:29.559260 29246 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:29.611166 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.547135 29068 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.564940 29308 consensus_queue.cc:1059] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:22:29.619721 24563 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:29.561240 29213 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.621649 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:29.543277 29262 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.625936 24563 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:29.631582 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:29.633401 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:29.635334 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:29.637403 29135 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:29.643002 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.647464 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:29.643153 23820 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:29.636394 29173 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:29.650154 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 47479.5us
W20260709 12:22:29.631628 29337 log.cc:927] Time spent T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:22:29.657585 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.660773 23848 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:29.629488 29364 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:29.620100 28809 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.620071 29354 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.622747 29304 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.715492 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.709407 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:29.715448 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 64564.8us
I20260709 12:22:29.651777 29360 raft_consensus.cc:2764] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:22:29.656466 29330 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:29.648325 29211 consensus_queue.cc:1059] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:22:29.674805 29364 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:29.628294 28397 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.733410 23924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2476) took 1567 ms. Trace:
W20260709 12:22:29.748883 29355 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:22:29.734815 23924 rpcz_store.cc:276] 0709 12:22:28.166338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.630998 (+464660us) service_pool.cc:224] Handling call
0709 12:22:28.631471 (+   473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:28.636650 (+  5179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.636703 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:28.651240 (+ 14537us) log.cc:844] Serialized 52 byte log entry
0709 12:22:29.186979 (+535739us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:29.187042 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.187155 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.733125 (+545970us) raft_consensus.cc:1685] finished
0709 12:22:29.733150 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.733342 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":163,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":4256,"thread_start_us":378323,"threads_started":1,"wal-append.queue_time_us":498058}
I20260709 12:22:29.733557 29364 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:29.760679 29353 log.cc:927] Time spent T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 12:22:29.761333 29356 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:22:29.761322 29373 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:29.689838 29261 consensus_queue.cc:1059] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:22:29.762797 28809 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:29.762933 29068 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:29.763407 29357 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:22:29.764786 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.769428 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:29.691301 29200 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:22:29.780537 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.778827 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:29.805370 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.725946 29330 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.798743 29373 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:29.808115 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.803650 23850 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:29.806042 23924 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
W20260709 12:22:29.807585 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 86139.6us
W20260709 12:22:29.803958 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 192883us
W20260709 12:22:29.795629 29366 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:22:29.807672 23851 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:29.808954 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.805990 23892 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.810398 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.809688 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:29.811645 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.815503 23969 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:29.807181 29345 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.265s	user 0.000s	sys 0.002s
I20260709 12:22:29.729000 29246 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.817850 23969 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:29.817389 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:29.808419 29308 consensus_queue.cc:1243] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer 22996f888daf435398b693481171c18c log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:29.825350 23924 raft_consensus.cc:2368] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15.
I20260709 12:22:29.823295 29144 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:29.809968 29330 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:29.839025 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:29.801940 29362 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:29.843923 28857 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:29.811060 29365 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:29.793649 29212 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:22:29.810238 29373 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:29.832859 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:29.835106 29354 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:29.835613 29324 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.836244 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:29.854749 23928 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 15.
I20260709 12:22:29.837421 29213 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:29.829979 29210 consensus_meta.cc:287] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.004s
I20260709 12:22:29.846932 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:29.851291 23892 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.844461 28857 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.867477 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:29.864291 23892 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.862223 29383 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:29.862366 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:29.875015 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.876151 23920 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:29.878621 23892 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:29.415139 23922 rpcz_store.cc:276] 0709 12:22:28.073408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.627607 (+554199us) service_pool.cc:224] Handling call
0709 12:22:28.635536 (+  7929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.635824 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:29.186575 (+550751us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.333931 (+147356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.334008 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:29.334078 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.334226 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.334392 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3373,"prepare.queue_time_us":634858,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":4518,"raft.queue_time_us":5376,"spinlock_wait_cycles":57365760,"thread_start_us":526492,"threads_started":2,"wal-append.queue_time_us":247254}
I20260709 12:22:29.862933 29210 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12.
I20260709 12:22:29.883167 29303 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:29.883857 29303 raft_consensus.cc:697] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:29.883895 29354 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:29.885058 29303 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:29.886360 29369 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:22:29.886674 29354 raft_consensus.cc:993] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:29.887730 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:29.894347 29326 consensus_meta.cc:287] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.003s
I20260709 12:22:29.895283 23928 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:22:29.896731 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:29.923868 23926 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 15: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:29.899102 23846 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:29.865301 29365 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:29.907307 23920 raft_consensus.cc:1240] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15. Ops: [10.7-14.9]
I20260709 12:22:29.900413 29248 raft_consensus.cc:1081] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:29.869382 28857 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:29.925015 23892 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.926102 23922 raft_consensus.cc:1217] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 15.9->[16.10-16.10]   Dedup: 16.10->[]
W20260709 12:22:29.926692 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 66789.5us
I20260709 12:22:29.931988 23922 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:22:29.936029 23928 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:22:29.936733 24525 leader_election.cc:336] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 1.605s (SENT)
I20260709 12:22:29.937211 24525 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.939518 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.940901 23926 raft_consensus.cc:1217] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 12.6->[13.7-13.7]   Dedup: 13.7->[]
I20260709 12:22:29.942023 29322 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:29.943565 23926 raft_consensus.cc:1240] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:22:29.929759 29354 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:29.947283 23928 raft_consensus.cc:1240] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:22:29.945636 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.952975 23924 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
W20260709 12:22:29.954793 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 136659us
I20260709 12:22:29.960247 29330 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.961777 23845 raft_consensus.cc:2393] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:29.928160 29326 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:29.955667 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.963294 23928 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:22:29.947669 29248 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:29.968006 24004 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:29.971792 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:29.973817 29308 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:29.974360 29308 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:29.974824 29308 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:29.980532 29376 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:29.980600 29025 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:29.981451 29358 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:29.981590 29376 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:29.981457 29025 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:29.983704 24560 raft_consensus.cc:1240] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:29.983355 29376 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:29.957712 29289 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:29.966252 29354 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:29.987008 29377 log.cc:927] Time spent T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:22:29.988183 29385 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:29.990514 29246 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.002058 29246 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.003269 23892 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:29.989908 29371 raft_consensus.cc:3055] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:30.030699 29289 consensus_queue.cc:1059] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:22:30.038436 29365 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:30.038748 29289 consensus_queue.cc:1059] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:30.030973 29381 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:30.035495 23892 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:22:30.038080 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.062916 29139 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.063606 29139 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.067823 29139 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:30.033181 29371 raft_consensus.cc:740] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:30.076021 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:30.056196 29365 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:30.074585 24524 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:30.077245 23851 raft_consensus.cc:2410] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:22:30.047413 29324 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:30.043015 29381 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:30.086952 29381 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:30.088217 29025 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.080459 24524 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:30.092530 29372 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:30.092623 29324 consensus_queue.cc:1059] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:30.093225 29372 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:30.077872 29376 raft_consensus.cc:3055] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:30.093768 29372 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:30.094352 29324 raft_consensus.cc:3055] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:30.084288 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:30.086043 23853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:22:30.081023 29326 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:30.096801 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 63837.6us
I20260709 12:22:30.097942 29398 raft_consensus.cc:3055] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:30.102120 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:30.038132 29383 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:22:30.104660 23853 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.119307 23853 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:30.071458 29303 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.106954 29384 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:30.073029 29246 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:30.109804 29330 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:30.112259 29373 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.103322 29322 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:30.115608 29308 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.116586 28857 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.094305 29376 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:30.125965 29322 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:30.131078 29322 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:30.131538 29376 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.133486 29376 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:30.121488 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:30.135560 29381 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.141026 29341 raft_consensus.cc:3055] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:30.141530 29341 raft_consensus.cc:740] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:30.144488 23923 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:30.122187 23851 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:30.123486 29213 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.146082 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.122433 29303 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.104218 29324 raft_consensus.cc:740] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:30.124657 29371 consensus_queue.cc:260] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.166631 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:30.118957 29398 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:30.120930 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:30.118974 29139 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:30.139295 28857 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:30.212152 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 394359us
I20260709 12:22:30.221781 23998 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:30.223635 23969 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:30.226181 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:30.226989 23923 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 19.
I20260709 12:22:30.228272 23818 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.231835 29396 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:30.232450 29396 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:30.233345 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.233505 29396 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.242650 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:30.152104 29326 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:30.248495 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:30.249481 23923 raft_consensus.cc:2393] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:30.250455 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:30.251022 24554 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:30.267474 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:30.267993 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:30.273507 28809 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:30.275347 29381 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:30.227401 29139 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.282819 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:30.152727 29213 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.231499 29364 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.333133 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:30.443168 23927 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 17.
I20260709 12:22:30.363561 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:30.291082 29373 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:30.399250 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:30.345065 29348 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.915s	user 0.003s	sys 0.003s
I20260709 12:22:30.457540 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:30.405138 23997 raft_consensus.cc:3055] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:30.405594 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:30.458595 23997 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:30.405798 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:30.407042 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:30.405745 23929 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:22:30.460444 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:30.410189 24556 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:30.333204 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:30.376272 24525 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Timed out: RequestConsensusVote RPC to 127.22.43.67:40331 timed out after 2.043s (SENT)
I20260709 12:22:30.462085 24525 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:30.419152 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:30.463445 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 87237us
I20260709 12:22:30.298708 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:30.291216 29102 raft_consensus.cc:3055] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:30.290306 28836 raft_consensus.cc:3055] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:30.351673 29303 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:30.347712 29308 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:30.313832 29304 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:30.441432 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:30.346410 29372 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.464934 23995 raft_consensus.cc:2368] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11.
I20260709 12:22:30.465413 23997 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.472260 24559 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:30.472493 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:30.487739 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 244769us
I20260709 12:22:30.490785 23997 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:30.494886 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:30.466455 29102 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:30.329015 29324 consensus_queue.cc:260] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.500607 23997 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:30.341713 29398 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.472455 28836 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:30.502463 23997 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:30.507504 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:30.339536 29341 consensus_queue.cc:260] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.507880 23997 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:30.471769 29373 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:22:30.512692 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:30.516229 23851 raft_consensus.cc:2410] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:22:30.500056 29368 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:30.469579 23999 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:30.498669 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:30.519016 23995 raft_consensus.cc:2393] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:30.498685 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:30.468243 29326 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:30.414834 29383 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:30.502693 24560 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:30.505259 23818 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:30.506616 28789 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.524420 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 78918.8us
I20260709 12:22:30.526075 23997 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.529043 24554 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:30.454463 23853 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.540582 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.541685 24558 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:30.543788 29326 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:30.535895 28789 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.549453 29335 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:30.556115 29371 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:30.558301 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.576560 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.576793 23854 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:30.514889 29221 consensus_queue.cc:1059] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 12:22:30.576911 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.577433 24555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 927) took 1035 ms. Trace:
W20260709 12:22:30.469321 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 350508us
I20260709 12:22:30.587437 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:30.590282 23846 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:22:30.591204 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 56633.7us
I20260709 12:22:30.564380 29404 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:30.533738 29383 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.588586 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:30.599298 23853 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:30.583531 24555 rpcz_store.cc:276] 0709 12:22:29.541834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.541995 (+   161us) service_pool.cc:224] Handling call
0709 12:22:29.566197 (+ 24202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.608326 (+ 42129us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:29.623226 (+ 14900us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.686133 (+ 62907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.686193 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:29.686252 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.559941 (+873689us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b18002823a0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28432d2a6 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419
0709 12:22:30.577078 (+ 17137us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b54006be254. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:30.577157 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.577351 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2117,"prepare.queue_time_us":15080,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":10672,"raft.queue_time_us":438,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":17578,"spinlock_wait_cycles":111170176,"thread_start_us":61994,"threads_started":1,"wal-append.queue_time_us":131789}
I20260709 12:22:30.628440 23817 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.575419 29335 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:30.619822 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 79340.3us
W20260709 12:22:30.631472 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 55693.1us
I20260709 12:22:30.524701 29368 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.641227 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:30.641847 24558 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:30.644248 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.644742 29419 consensus_queue.cc:1059] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:30.646118 29289 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:30.575903 29102 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.639919 29364 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:30.586302 29326 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.646668 23966 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.629902 29213 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:30.721377 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 74807.1us
I20260709 12:22:30.607378 29068 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 12:22:30.706490 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 129017us
I20260709 12:22:30.683665 29139 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:30.640825 29248 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
W20260709 12:22:30.708828 29357 log.cc:927] Time spent T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:22:30.721230 29308 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:30.725558 29409 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:22:30.726130 29408 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:30.743089 23848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 2467) took 1380 ms (client timeout 1753 ms). Trace:
I20260709 12:22:30.743664 23845 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:30.700085 29126 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.728581 29102 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:30.730469 29414 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:30.730967 29415 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:30.731339 29405 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:30.565634 28836 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:30.738830 29412 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:22:30.720191 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 91877us
I20260709 12:22:30.732177 29372 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:30.757293 29414 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.769079 23929 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:30.769451 29414 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:30.769712 29322 consensus_meta.cc:287] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 12:22:30.770184 29322 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.772255 29322 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:30.775118 23893 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:30.778482 29144 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:30.778331 29414 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.779659 29416 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:30.722548 29365 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:22:30.780664 29414 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 20 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:30.781980 23926 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:30.757536 29411 log.cc:927] Time spent T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:22:30.743647 23848 rpcz_store.cc:269] 0709 12:22:29.363095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.364373 (+  1278us) service_pool.cc:224] Handling call
0709 12:22:30.742878 (+1378505us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400429ad4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:30.743022 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434126592}
I20260709 12:22:30.768911 23817 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:30.784526 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.789606 29368 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:30.790387 29402 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:22:30.791118 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 69044.5us
I20260709 12:22:30.794389 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.794878 29068 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:30.795512 29068 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:30.795970 29068 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:30.796274 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.797441 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:30.797724 29415 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:30.798180 23852 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:30.801379 29308 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:30.802161 29308 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:30.806090 23966 leader_election.cc:400] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15.
I20260709 12:22:30.807027 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.807850 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:30.808451 23928 raft_consensus.cc:3055] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:30.808775 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:30.808451 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:30.808785 23928 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:30.810817 23928 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.811323 29414 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.810992 29068 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.812166 23928 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:30.811866 29414 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.814136 29414 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:30.814900 29068 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:30.816326 29405 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:30.816880 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:30.818004 29405 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:30.825479 28789 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:30.754258 29335 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:30.835883 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 192636us
W20260709 12:22:30.836089 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 199730us
W20260709 12:22:30.836688 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 73360.5us
I20260709 12:22:30.836670 29373 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:30.836694 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.837464 29381 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:30.841451 23852 raft_consensus.cc:2468] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 15.
I20260709 12:22:30.843726 23928 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
W20260709 12:22:30.846253 23739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73d2fbc1f30749eba64903d7e79de8a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 35a9a1f8b1d847fb8f2063ced2a3c26d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:30.846432 24524 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:30.855367 24558 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:30.865015 23854 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:22:30.865543 23854 pending_rounds.cc:85] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 7
I20260709 12:22:30.865825 23854 pending_rounds.cc:107] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:22:30.866142 23854 raft_consensus.cc:2889] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:30.867662 23818 leader_election.cc:400] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12.
I20260709 12:22:30.870381 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:30.870957 23925 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:30.870976 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:30.759243 29126 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.874370 23854 raft_consensus.cc:2393] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:30.872255 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 94855.8us
I20260709 12:22:30.835528 29405 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:30.876819 23818 leader_election.cc:400] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16.
I20260709 12:22:30.877358 23818 leader_election.cc:403] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:22:30.880578 23846 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:30.881652 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:30.882902 29126 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:30.883205 23846 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:30.883394 29428 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.883956 29428 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.869419 29434 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:22:30.891307 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:30.892889 23850 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:30.893268 29428 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:30.893870 29373 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:30.895009 29373 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.897146 29373 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:30.897864 29373 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:30.898308 29335 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:30.898476 29373 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:30.901301 29373 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:30.847329 29368 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:30.904356 29368 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.904837 29368 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.907217 29368 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:30.868400 29381 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.884250 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:30.910548 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:30.889667 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.920480 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:30.921452 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.920104 24001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2407) took 1518 ms. Trace:
I20260709 12:22:30.834052 29308 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:22:30.923658 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:30.923530 23818 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.928040 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.928999 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:30.922785 24001 rpcz_store.cc:276] 0709 12:22:29.406146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.575626 (+1169480us) service_pool.cc:224] Handling call
0709 12:22:30.575987 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.576491 (+   504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.576537 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.597564 (+ 21027us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.764431 (+166867us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:30.919468 (+155037us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.919788 (+   320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.919867 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.919903 (+    36us) raft_consensus.cc:1685] finished
0709 12:22:30.919915 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.920049 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15277,"raft.queue_time_us":225,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8054,"thread_start_us":208656,"threads_started":2,"wal-append.queue_time_us":207717}
W20260709 12:22:30.924883 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 45058.5us
I20260709 12:22:30.931028 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:30.930871 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:30.937546 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:30.933732 23925 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 20.
I20260709 12:22:30.938320 23818 leader_election.cc:400] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11.
I20260709 12:22:30.938977 23818 leader_election.cc:403] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:30.938356 23852 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:30.931792 23893 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:30.930603 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:30.898429 29431 raft_consensus.cc:2804] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:30.835134 29402 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:30.871557 29385 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:22:30.946455 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:30.948572 23818 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:30.949669 23893 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:30.927908 29404 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:30.958305 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:30.959918 23852 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:22:30.962694 29433 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:30.963209 29102 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:30.964428 23893 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:30.965866 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:30.966516 23846 raft_consensus.cc:1240] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:30.967322 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:30.935107 29213 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:30.947201 29359 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:30.945509 29415 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:30.930866 29417 consensus_queue.cc:1059] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:22:30.970126 29381 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:31.009773 24525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.003332 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:30.969483 29431 raft_consensus.cc:697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:30.987962 29031 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:30.984601 29139 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16.
I20260709 12:22:31.021201 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:31.043634 29211 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.044456 29211 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.046670 29406 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11.
I20260709 12:22:31.053916 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:31.048841 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.049438 24525 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:31.022696 29326 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:31.055241 23925 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 17.
W20260709 12:22:31.051971 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 93399.1us
I20260709 12:22:31.055238 24001 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:31.064373 24003 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:31.065456 24525 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:31.065493 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:31.055737 29381 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:31.071101 24003 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:22:31.006421 29405 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.056885 29372 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:31.072861 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.058341 29427 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.090167 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:31.071028 29216 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:31.096755 29308 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:31.068300 29326 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:31.106657 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.106916 29326 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:31.106868 29308 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:31.103703 24003 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:31.107858 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:31.108358 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:31.101702 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:31.108908 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.109165 23925 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:31.109262 29308 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:31.109563 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:31.104230 29421 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:31.111254 29421 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:31.112624 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52314 (request call id 2699) took 1435 ms. Trace:
I20260709 12:22:31.113292 29421 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:31.107450 29326 raft_consensus.cc:3060] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:31.114295 29431 consensus_queue.cc:237] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.115356 29364 raft_consensus.cc:3055] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:31.115820 29364 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:31.116813 29364 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:31.117440 29402 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:31.090286 29381 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:31.119719 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.103082 29443 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:31.120949 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:31.120983 29443 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.123327 29443 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:31.112989 23999 rpcz_store.cc:276] 0709 12:22:29.677571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.678736 (+  1165us) service_pool.cc:224] Handling call
0709 12:22:29.711031 (+ 32295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.523304 (+812273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.112396 (+589092us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54003f6bd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:31.112566 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743979392}
I20260709 12:22:31.124846 23999 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:31.110641 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:31.104728 29404 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.131590 23925 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 18.
I20260709 12:22:31.154690 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:31.158680 29308 consensus_queue.cc:1059] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:22:31.149833 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:31.176508 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.156203 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.183152 24003 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:31.162734 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:31.148684 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:31.184028 23922 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:31.102102 29211 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:31.148939 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:31.187415 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.187551 23928 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:31.143409 23969 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:31.190514 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 47198.3us
I20260709 12:22:31.197415 23922 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:31.154151 29364 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.171459 29381 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:31.201968 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.210132 23929 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:31.211246 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:31.213260 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.214387 23925 raft_consensus.cc:2393] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 15: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:31.196668 29402 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:31.217577 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:31.220034 23929 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:31.220878 23928 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 16.
I20260709 12:22:31.219127 29402 raft_consensus.cc:697] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:31.223838 29402 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.158416 29404 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.226661 23922 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:31.227862 29404 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:31.199170 29373 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:22:31.228629 23925 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:31.229400 29373 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:31.229751 29373 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:31.230593 29373 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.231467 23922 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:31.231789 29373 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:31.232000 29025 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:31.236613 23929 raft_consensus.cc:1240] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:22:31.238304 23851 raft_consensus.cc:2393] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:31.240967 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:31.241777 23999 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:31.271646 29432 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:31.272543 29432 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.285144 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:31.299861 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:31.305285 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:31.305847 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:31.306478 24557 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:31.307513 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:31.308116 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:31.308353 24563 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:31.304616 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:31.313151 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:31.310954 24560 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:31.311755 23818 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:31.316797 29443 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:31.316845 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:31.317306 29443 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.317660 29443 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:31.319489 23999 raft_consensus.cc:2410] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:22:31.320111 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:31.320855 24554 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:31.323698 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:31.324391 24561 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:31.328740 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
W20260709 12:22:31.333279 29437 log.cc:927] Time spent T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.283s	user 0.004s	sys 0.000s
I20260709 12:22:31.333501 24558 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:31.328934 23818 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:31.336205 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:31.337248 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:31.340656 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.340858 29405 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:31.343372 29261 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:31.344059 29261 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.344548 29261 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:31.346868 29421 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:31.347455 29421 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.347888 29421 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:31.352955 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.394729 23820 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:31.396040 23820 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:31.422381 29444 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.325s	user 0.000s	sys 0.002s
I20260709 12:22:31.425539 29432 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:31.433246 24555 pending_rounds.cc:85] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting all ops after (but not including) 12
I20260709 12:22:31.435719 24555 pending_rounds.cc:107] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:22:31.415776 28836 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:31.416056 29211 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:31.414007 29402 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:31.443929 24555 raft_consensus.cc:2889] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:31.420342 29221 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:22:31.447289 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.451692 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.435199 29173 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:22:31.433782 29450 log.cc:927] Time spent T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:22:31.416374 29326 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.449717 29221 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.457523 29211 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:31.461272 29173 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:22:31.463302 29271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.818s	user 0.021s	sys 0.058s
I20260709 12:22:31.475222 24557 raft_consensus.cc:2410] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
W20260709 12:22:31.474289 29271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.836s	user 0.021s	sys 0.058s
I20260709 12:22:31.474572 29173 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:31.453635 29402 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:31.496141 29402 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:31.497618 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.499850 29427 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:31.465505 29221 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:31.524056 29335 raft_consensus.cc:3055] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:31.524600 29335 raft_consensus.cc:740] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:31.539613 29443 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:31.542480 29211 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.544677 29326 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:31.555716 29443 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:31.557228 29421 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.560873 29421 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:31.566740 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:31.582552 23997 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:31.567301 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:31.584878 24557 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.525516 29335 consensus_queue.cc:260] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.568629 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:31.588186 24000 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:31.592860 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:31.600044 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:31.602005 29271 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:22:31.570799 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.610023 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.610131 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:31.577430 29383 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:31.619768 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.622459 24000 raft_consensus.cc:1240] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:31.549350 29173 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.624886 29341 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:31.638613 24557 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:31.625933 29335 raft_consensus.cc:3060] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:31.630585 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:31.671130 23851 raft_consensus.cc:2393] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 10: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:31.659775 24525 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:31.675391 23817 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:31.675498 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:31.676829 23851 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:31.676919 29322 raft_consensus.cc:2764] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:22:31.629848 23818 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:31.679230 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:31.681555 23853 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:31.636775 24004 raft_consensus.cc:2468] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:31.684006 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:31.684626 23999 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:31.685741 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:31.687085 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.687558 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.687448 24004 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.657202 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:31.692474 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:31.695886 24525 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:31.646628 29324 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.679874 23851 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:31.703094 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 651) took 1295 ms. Trace:
W20260709 12:22:31.703815 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 74068.9us
I20260709 12:22:31.705044 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:31.677737 29173 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:31.703554 23921 rpcz_store.cc:276] 0709 12:22:30.407742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.391470 (+983728us) service_pool.cc:224] Handling call
0709 12:22:31.391983 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.392287 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:31.474378 (+ 82091us) log.cc:844] Serialized 14 byte log entry
0709 12:22:31.702760 (+228382us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:31.702809 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:31.702858 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.702920 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.703024 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29831,"prepare.queue_time_us":98938,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":279719,"threads_started":2}
I20260709 12:22:31.705128 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:31.713382 23997 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:31.713464 24004 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:31.714197 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2417) took 1306 ms. Trace:
W20260709 12:22:31.714893 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44550.9us
I20260709 12:22:31.719923 23966 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:31.714557 23997 rpcz_store.cc:276] 0709 12:22:30.407593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.502024 (+ 94431us) service_pool.cc:224] Handling call
0709 12:22:30.502333 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.283540 (+781207us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b5400265320. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873c1a1d 00007fa2873a81a4 00007fa28742a447 00007fa287442fe7 00007fa2874447de 00007fa28744eb49 00007fa28744f416 00007fa28744bd8f 00007fa28744b83e 00007fa28c410419
0709 12:22:31.582153 (+298613us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b58007712d0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2873a80aa 00007fa28742a447 00007fa287442fe7 00007fa2874447de 00007fa28744eb49 00007fa28744f416 00007fa28744bd8f 00007fa28744b83e 00007fa28c410419 00007fa285987bd4
0709 12:22:31.713943 (+131790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.714141 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557690624}
I20260709 12:22:31.724843 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:31.728434 23966 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:31.730374 23847 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:31.731328 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:31.737217 29200 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:31.738432 29248 raft_consensus.cc:3055] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:31.738840 29248 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:31.738860 29404 consensus_queue.cc:1059] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:31.740482 29404 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:31.740882 29404 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:31.632683 29398 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:31.737823 23850 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:31.733749 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:31.746031 23817 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:31.737792 29200 raft_consensus.cc:697] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:22:31.729727 29380 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:22:31.742779 29433 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:22:31.751313 29417 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:31.751451 29200 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.731140 29405 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:31.752576 29433 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:31.731423 29383 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:31.745311 29373 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.720162 28829 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:31.722461 29322 raft_consensus.cc:2804] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:31.709969 29396 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:31.711159 29443 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:31.762188 23999 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 17.
I20260709 12:22:31.754351 29139 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:31.783288 23817 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:31.755321 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:31.789014 24561 raft_consensus.cc:1240] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:31.754915 29102 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:31.741843 29261 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.756280 29360 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:31.813627 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 56560.2us
I20260709 12:22:31.823760 29364 consensus_queue.cc:1059] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:31.824226 29261 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:31.824852 29364 raft_consensus.cc:3055] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:31.825230 29364 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:31.826289 29139 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 20 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:31.827286 29139 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:31.829716 29364 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.837302 29364 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:31.819512 29396 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:22:31.741703 29404 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:31.835320 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 45845.6us
I20260709 12:22:31.756299 29373 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:31.816744 29322 raft_consensus.cc:697] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:31.837944 28809 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:22:31.838814 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 47877us
I20260709 12:22:31.845675 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:31.756470 29173 consensus_queue.cc:1059] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:22:31.842047 29433 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:31.824258 29405 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:22:31.784246 29434 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:22:31.888355 23818 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:31.856420 23893 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:31.763087 29422 consensus_queue.cc:1059] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:22:31.820943 29289 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:31.814178 29385 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:31.908265 29102 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:31.912233 29102 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 17 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:31.908602 23921 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:31.902138 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:31.914903 23997 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:31.860268 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet 01f15f801cf34333ad12954d0b614109: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:31.879091 23817 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:31.875201 29360 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:31.851728 29211 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:31.890496 29216 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:22:31.900656 29289 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:31.815157 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:31.899495 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:31.898500 29322 consensus_queue.cc:237] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.890780 29338 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:31.855268 29265 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:31.911414 29413 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:31.894286 24524 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:31.903180 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.960940 23818 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:31.911075 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 54740.4us
I20260709 12:22:31.939018 29380 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:31.966324 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 72139.2us
I20260709 12:22:31.967070 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:31.967782 29431 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:31.968436 29373 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:31.969244 24524 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:31.949633 29289 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:31.969987 29419 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:31.970311 29324 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:31.970839 29324 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:31.971520 24524 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:31.971755 29324 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:31.974496 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.975373 29419 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:31.975890 29419 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:31.976914 29419 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.979527 24556 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:31.980736 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:31.927501 24559 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:31.888720 29396 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:31.943827 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 64859.8us
I20260709 12:22:31.945930 23997 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:31.853252 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:31.996366 24561 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:31.911260 29304 raft_consensus.cc:3055] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:22:31.948704 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 133648us
I20260709 12:22:31.941009 29360 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:31.945966 28829 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:31.950109 29211 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 18 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:31.955292 29405 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:32.005138 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:31.964289 29265 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:32.007004 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.008558 23966 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:31.980239 29439 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.996752 28836 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:31.909899 29385 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:31.980916 29443 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.998504 29304 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:32.001147 29338 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:32.023213 29211 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.025648 29265 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:31.959281 29221 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.026314 29415 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:32.028080 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:31.999219 29380 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.005797 29373 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:22:32.006862 29405 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:32.031256 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 50622.9us
I20260709 12:22:32.011664 29222 consensus_queue.cc:1059] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:22:32.021077 29362 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:32.019932 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:32.001219 29396 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.037663 24559 raft_consensus.cc:2393] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 15: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:32.012094 29102 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.047060 29396 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:32.054090 29416 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.054770 29416 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.058822 29261 raft_consensus.cc:3055] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:32.057502 29416 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:32.035185 29432 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:32.042192 29405 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:32.029398 29443 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.066563 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:32.072033 29380 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:32.072760 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.073904 23847 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 17 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:22:32.027122 29439 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.059490 29261 raft_consensus.cc:740] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:32.089998 29304 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.092177 29304 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:32.104748 29404 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:32.071067 29432 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.149204 29432 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:32.159708 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:32.173280 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 153433us
I20260709 12:22:32.174507 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:32.218186 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:32.211442 29335 consensus_meta.cc:287] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.546s	user 0.013s	sys 0.000s
W20260709 12:22:32.225329 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 185435us
I20260709 12:22:32.221809 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:32.175879 29388 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:32.227113 24557 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:32.109468 29360 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.217585 29410 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:32.216390 29146 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:32.231895 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:32.222921 29419 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.258903 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:32.263302 24561 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:32.231046 29362 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:32.224308 29222 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:32.287434 23998 raft_consensus.cc:1240] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:32.259137 29487 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:22:32.253993 29388 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.272286 29248 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.292729 29248 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:32.258988 29485 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:22:32.293926 29485 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:32.294749 29485 consensus_queue.cc:1243] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer 35a9a1f8b1d847fb8f2063ced2a3c26d log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:22:32.295476 29485 raft_consensus.cc:3055] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:32.254411 29335 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:32.295872 29485 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:32.274050 29146 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.302821 29485 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.304875 29146 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:32.275209 29398 consensus_meta.cc:287] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.001s
I20260709 12:22:32.275452 29221 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:32.278096 29410 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:32.261843 29483 consensus_queue.cc:1059] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:22:32.285683 23997 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:22:32.286067 24002 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:32.290804 29385 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:32.330031 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:32.297470 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:32.223754 29261 consensus_queue.cc:260] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.332573 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:32.298969 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:32.306609 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.311998 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:32.284663 29419 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.292884 29388 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:32.326285 29486 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:32.326524 29443 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:32.327065 29485 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:32.328320 24556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36558 (request call id 937) took 1005 ms. Trace:
I20260709 12:22:32.328987 29383 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.330315 29380 raft_consensus.cc:3055] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:32.340615 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.273684 29289 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.349993 23998 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:22:32.364476 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.348513 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:32.361758 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.366930 24559 raft_consensus.cc:2393] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:32.367287 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:32.367834 24525 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:32.370728 29283 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:32.371507 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 330250us
I20260709 12:22:32.372885 29283 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:32.373371 29283 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:22:32.374775 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 142518us
I20260709 12:22:32.371001 29415 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:32.347175 29222 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:32.383986 24556 rpcz_store.cc:276] 0709 12:22:31.323368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.323485 (+   117us) service_pool.cc:224] Handling call
0709 12:22:32.328169 (+1004684us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54005f0d54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:32.328264 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506661120}
I20260709 12:22:32.376819 23893 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:32.383963 29373 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.386904 29373 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.389174 29373 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:32.383889 29326 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.344012 29385 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:32.396019 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:32.378684 23996 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:32.360015 29261 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:32.390549 23999 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:32.391939 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.360423 29380 raft_consensus.cc:740] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:22:32.390594 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 380018us
I20260709 12:22:32.396704 24557 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:22:32.375903 29322 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:32.397790 23921 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:32.392997 29025 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:32.411158 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:32.361840 29383 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.379029 29031 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:22:32.429320 29419 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:32.429785 29488 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.378655 29431 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:22:32.469949 29439 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:32.403342 29144 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:32.472113 29144 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.475311 29144 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:32.436282 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.453585 29200 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:32.456230 24556 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:32.482292 23923 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:32.456326 29443 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:32.427484 29405 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.460305 24002 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:22:32.462342 28789 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:32.466027 29488 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.483424 24557 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 18.
I20260709 12:22:32.481583 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:32.493134 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:32.494598 23995 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:22:32.497335 23995 pending_rounds.cc:85] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 8
I20260709 12:22:32.497579 23995 pending_rounds.cc:107] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:22:32.497751 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.497797 23995 raft_consensus.cc:2889] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:32.498740 23920 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:32.404412 29385 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.501320 23820 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:32.399565 29326 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.503813 28789 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.509140 29434 consensus_queue.cc:1059] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:32.509815 28789 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:32.510746 29434 raft_consensus.cc:3055] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:32.511188 29434 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:22:32.512388 29476 log.cc:927] Time spent T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.289s	user 0.001s	sys 0.001s
I20260709 12:22:32.512193 29434 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.512914 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:32.513533 29434 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:32.518013 29146 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:32.516546 29404 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:32.496300 29200 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.501804 29173 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:22:32.586575 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.587244 23923 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:32.589305 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:32.590103 23920 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:32.591769 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:32.581002 29404 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 18 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:32.595216 29404 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.587720 29271 consensus_queue.cc:1059] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:22:32.599462 29271 consensus_queue.cc:1243] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer 22996f888daf435398b693481171c18c log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:22:32.600092 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:32.600796 23853 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:32.605320 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:32.607057 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:32.605502 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:32.608783 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:32.609157 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.610203 29390 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:32.610786 29390 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.613082 29390 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:32.614388 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:32.614977 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:32.615875 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:32.616480 23854 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:32.616830 29200 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:32.622177 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:32.579443 29139 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:32.623890 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:32.586457 28829 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.626359 23966 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:32.633096 23920 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 18.
I20260709 12:22:32.587880 29335 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:32.639050 29222 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:32.640470 23999 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:32.636691 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:32.631026 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:32.514405 29415 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.653360 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:32.591778 29289 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:32.648557 28829 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.664456 28829 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:32.633193 29139 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.666972 29365 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:32.667559 29365 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:32.667980 29365 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:32.669724 29491 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:22:32.626042 29486 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:32.673195 23849 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:32.634395 29388 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:32.660337 29222 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:32.693256 29489 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:22:32.671674 29364 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:32.704819 24003 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:32.702324 29364 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.721946 24003 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:22:32.720237 29211 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.734673 29211 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:32.738582 29494 log.cc:927] Time spent T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:32.739128 29396 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:32.739532 29396 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:32.740386 29396 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.742695 23847 raft_consensus.cc:1275] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:32.746568 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:32.713586 29360 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:32.750686 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.750825 24561 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:32.751456 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.752279 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:32.758895 24557 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:32.755200 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.744508 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:32.759637 23923 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:32.755918 23852 raft_consensus.cc:1275] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:22:32.759738 23922 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:32.750947 23817 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:32.761364 23995 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:32.753387 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:32.765858 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.766247 23926 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:32.766759 23923 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:32.763815 24559 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:32.770387 23820 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:32.742043 29248 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:32.722877 29364 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:32.776007 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:32.780689 23925 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:32.782471 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:32.783039 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:32.783363 23845 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:32.785181 23927 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:22:32.742551 29265 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:32.743412 29405 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:32.742389 29390 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:32.786556 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 120751us
I20260709 12:22:32.747357 29326 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:32.751137 29211 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:32.772475 29344 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:32.768469 29396 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:32.782311 29385 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:32.768884 29443 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 12:22:32.850993 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 86815.5us
I20260709 12:22:32.819922 29344 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.787427 29248 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.826676 29211 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:32.843218 29385 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.820981 29390 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:32.865607 23817 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:32.814275 29265 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.858914 29344 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:32.862203 29211 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.882413 29322 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:32.883424 29322 consensus_queue.cc:1243] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer 22996f888daf435398b693481171c18c log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:32.887418 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:32.901791 23845 pending_rounds.cc:85] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 9
I20260709 12:22:32.902894 23845 pending_rounds.cc:107] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:22:32.903191 23845 raft_consensus.cc:2889] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:32.892874 29485 consensus_meta.cc:287] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 12:22:32.879328 29211 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:32.905155 23928 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:32.890146 29261 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:32.910246 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 82427.6us
I20260709 12:22:32.910756 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:32.912971 23996 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:32.919227 29390 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:32.919229 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:32.897213 29495 log.cc:927] Time spent T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:22:32.869782 29385 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:32.906454 29498 log.cc:927] Time spent T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:22:32.890292 29431 consensus_queue.cc:1048] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:22:32.958114 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:32.998116 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:33.023891 29385 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:32.925516 29261 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.024695 29261 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:33.027024 29265 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:33.029974 28829 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:33.031301 29283 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.031601 29344 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.034164 29365 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.035030 23850 raft_consensus.cc:2393] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:33.046221 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:32.930253 29390 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
W20260709 12:22:33.060601 23739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73d2fbc1f30749eba64903d7e79de8a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 35a9a1f8b1d847fb8f2063ced2a3c26d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:33.071151 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:33.073498 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:33.075193 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:33.076680 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:33.039362 29344 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:33.043668 29474 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:22:33.083629 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 171642us
I20260709 12:22:33.085400 23854 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 17 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:22:33.058283 29326 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:33.093158 29326 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.093629 29326 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:33.055186 29508 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 12:22:33.086323 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:33.091574 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:33.103369 23846 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:33.064599 29485 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.039352 29364 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:33.115063 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 68943.2us
I20260709 12:22:33.058809 29432 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:22:33.058988 29322 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:22:33.103897 29474 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.089188 29365 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:33.074513 29390 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:33.136425 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 196752us
I20260709 12:22:33.129959 29474 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:33.128943 29431 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:33.149209 23817 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:33.157128 29380 consensus_queue.cc:260] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.165555 29380 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:33.168418 29390 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:33.158927 29505 log.cc:927] Time spent T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:22:33.161494 29383 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:33.164675 29364 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:33.182125 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.187032 29434 consensus_meta.cc:287] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.000s
I20260709 12:22:33.180962 29303 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.121789 29485 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:33.188505 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 72274.5us
W20260709 12:22:33.190478 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 105870us
W20260709 12:22:33.196441 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 47397.9us
I20260709 12:22:33.197815 29210 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:33.200965 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:33.201803 23929 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:33.169770 29431 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:33.206017 29303 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.207163 23926 raft_consensus.cc:3055] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:33.207365 29383 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:33.207563 23926 raft_consensus.cc:740] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:33.207901 29383 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.208309 23926 consensus_queue.cc:260] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.206076 29431 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:33.209208 23926 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:33.215958 29261 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.222548 23923 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:22:33.195232 23892 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:33.227569 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:33.229828 23929 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:33.225841 29360 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:33.243556 23817 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:33.226713 29383 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:33.260594 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:33.274580 24557 raft_consensus.cc:2393] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:33.261080 29524 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:33.261395 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
W20260709 12:22:33.261637 29506 log.cc:927] Time spent T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.363s	user 0.003s	sys 0.000s
I20260709 12:22:33.262084 29210 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:33.267066 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:33.246167 29434 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:33.214437 29326 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.275207 23892 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:33.289073 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:33.254132 29518 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:22:33.254577 29360 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.288851 29390 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:33.282783 29524 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.296669 29210 raft_consensus.cc:697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:33.304437 29303 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:33.298082 29211 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.431339 29360 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:33.432788 29210 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.418109 29261 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:33.437245 29432 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.437872 29432 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:33.438371 29520 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:22:33.440250 29432 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:33.442097 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:33.442757 29360 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:33.443349 29360 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.445683 29360 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:33.454409 29522 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:33.454913 29522 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.455242 29522 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:33.390251 29383 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.470747 29383 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.477787 29523 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:33.483040 29485 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:33.373895 29390 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.513370 23926 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 12:22:33.514091 23926 pending_rounds.cc:85] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 7
I20260709 12:22:33.514458 23926 pending_rounds.cc:107] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 12:22:33.514799 23926 raft_consensus.cc:2889] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:33.527169 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:33.525977 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 259463us
I20260709 12:22:33.530267 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:33.505996 29211 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:33.541772 23895 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:22:33.543346 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 254368us
W20260709 12:22:33.538196 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 294745us
W20260709 12:22:33.553418 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 265794us
I20260709 12:22:33.536746 29523 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.540330 29518 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:33.569917 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:33.570528 23924 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:33.571489 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:33.572109 23922 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:22:33.576049 29536 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:33.578117 29475 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:22:33.578869 29524 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:33.580542 29504 log.cc:927] Time spent T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.729s	user 0.003s	sys 0.000s
W20260709 12:22:33.583488 29396 consensus_meta.cc:287] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.754s	user 0.008s	sys 0.006s
I20260709 12:22:33.568849 29523 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.588980 29523 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:33.596483 23924 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
W20260709 12:22:33.604130 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 52340.6us
I20260709 12:22:33.568396 29390 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:33.568274 29383 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:33.609234 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:33.610085 24001 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:33.616990 23922 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:33.585582 29474 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.573414 29518 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.608573 29326 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:33.633652 29139 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:33.637121 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:33.638887 29525 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:33.640573 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:33.644237 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:33.640600 29383 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:33.646396 29383 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.647433 29474 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:33.638492 29431 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.648403 29383 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:33.648991 24561 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:33.650003 29431 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:33.652217 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:33.654491 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:33.655360 23922 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:33.656395 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:33.656636 23966 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:33.657188 23922 raft_consensus.cc:2393] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 16: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:33.657572 29383 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:33.658064 29383 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.658155 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:33.658442 29383 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:33.659289 24559 raft_consensus.cc:2393] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:33.659955 29515 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.660476 29515 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.661240 23817 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:33.664039 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:33.664160 29421 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:33.664721 23925 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:22:33.665743 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:33.666592 29421 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:33.667115 29421 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:33.638159 29210 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:33.668943 29210 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.671059 29210 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:33.671250 29485 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:33.671655 29485 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:33.672001 29485 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:33.672149 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:33.675907 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 653) took 1223 ms. Trace:
I20260709 12:22:33.676419 23996 rpcz_store.cc:276] 0709 12:22:32.452499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.452651 (+   152us) service_pool.cc:224] Handling call
0709 12:22:32.452991 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.923499 (+470508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.644241 (+720742us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400410fd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:33.675827 (+ 31586us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057127296}
I20260709 12:22:33.659376 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:33.680284 23922 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:33.708230 23927 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:33.636157 29432 consensus_queue.cc:1048] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
W20260709 12:22:33.728850 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.709345 29210 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.768579 23922 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
W20260709 12:22:33.774924 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.794744 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:33.795421 23922 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:33.637854 29522 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:33.818171 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:33.700309 29326 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 12:22:33.800525 24001 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:33.794569 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:33.810549 29431 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:33.823216 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:33.803130 29515 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:33.827348 23924 raft_consensus.cc:2368] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16.
I20260709 12:22:33.852556 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:33.822286 29200 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:33.823567 29326 consensus_queue.cc:1243] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer 604755d84b7e4ff8a2b75453dccb6f1b log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:22:33.858601 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:33.814941 29210 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.827953 29487 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:33.828112 29396 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.864529 23846 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:33.836764 29322 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:33.871215 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:33.851262 29364 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:33.865267 23850 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:33.857271 29200 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:33.884375 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.881505 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:33.864188 29380 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:33.816341 29421 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.842206 29431 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:33.887213 29539 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:22:33.879561 29487 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:33.906484 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:33.886731 29200 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:33.913612 23999 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:22:33.914211 23999 pending_rounds.cc:85] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 8
I20260709 12:22:33.914494 23999 pending_rounds.cc:107] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:22:33.914772 23999 raft_consensus.cc:2889] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:33.897213 29380 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.918187 24001 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:33.889930 29518 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:33.892287 29432 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:33.879742 29396 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.881583 29322 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.957079 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:33.960163 23999 raft_consensus.cc:1217] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[6.7-12.10]   Dedup: 8.8->[10.9-12.10]
I20260709 12:22:33.961011 23999 pending_rounds.cc:85] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 8
I20260709 12:22:33.961433 23999 pending_rounds.cc:107] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:22:33.961838 23999 raft_consensus.cc:2889] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:33.963100 29432 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:33.964426 29380 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:33.967999 29432 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:33.979050 29210 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:33.986783 24002 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 14: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:33.997406 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:33.998239 23997 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:22:33.998342 23926 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
W20260709 12:22:34.006707 29547 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:22:33.950405 29542 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:22:34.011792 29485 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:34.012545 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.017870 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:34.019021 29545 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260709 12:22:34.020677 29200 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.021414 29338 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:33.945705 29525 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:34.023469 29543 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:22:34.025056 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47066 (request call id 2532) took 1436 ms. Trace:
I20260709 12:22:34.067490 23849 rpcz_store.cc:276] 0709 12:22:32.589075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.589239 (+   164us) service_pool.cc:224] Handling call
0709 12:22:34.024907 (+1435668us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b5400071a54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:34.025001 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185228032}
I20260709 12:22:34.025445 29396 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:34.021704 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:33.992959 29383 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:34.027702 29522 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.032439 29248 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.034446 29431 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.035404 29485 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:34.038559 23847 raft_consensus.cc:1217] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 20 LEADER]: Deduplicated request from leader. Original: 18.9->[19.10-19.10]   Dedup: 19.10->[]
I20260709 12:22:34.039920 23848 raft_consensus.cc:1240] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16. Ops: []
W20260709 12:22:34.093838 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 72267.5us
I20260709 12:22:34.041074 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:34.095275 23851 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:34.041484 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:34.042116 29533 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:34.043934 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.046285 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:34.099756 23854 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:34.048202 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 62592us
I20260709 12:22:34.061628 29525 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:34.054590 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.058310 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.103314 29525 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.103592 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.104813 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.059516 29322 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.068953 23998 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 12:22:34.073164 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.083901 24001 raft_consensus.cc:1240] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:34.085840 29383 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:34.047683 29554 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:34.094063 23847 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 20 LEADER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:22:34.099166 29533 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.106354 23998 pending_rounds.cc:85] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 9
I20260709 12:22:34.115455 23998 pending_rounds.cc:107] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 12:22:34.115720 23998 raft_consensus.cc:2889] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:34.105844 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.109562 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.111127 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:34.109699 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.119517 23997 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:34.119709 23924 raft_consensus.cc:2393] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:34.111523 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:34.108855 29554 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.110024 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:34.122638 24000 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:34.123379 29554 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:34.099756 29475 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:34.118826 23995 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:34.110594 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:34.125574 29487 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.111061 29533 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:34.126394 28836 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:34.062296 29200 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.110739 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:34.111902 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.131058 24001 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:34.131923 23929 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 14: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:34.110890 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.133211 24002 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:34.135088 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:34.137620 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:34.072531 29364 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:34.139842 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:34.140674 23924 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:34.138005 29210 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:22:34.147511 29485 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.148144 29485 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.149519 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35824 (request call id 666) took 1218 ms. Trace:
I20260709 12:22:34.149967 23921 rpcz_store.cc:276] 0709 12:22:32.931124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.931253 (+   129us) service_pool.cc:224] Handling call
0709 12:22:32.931619 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:33.169771 (+238152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:33.169803 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:33.169847 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:33.169910 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.149284 (+979374us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5400278dd4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:34.149329 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:34.149463 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547219712}
I20260709 12:22:34.151209 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.151827 23848 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:34.152411 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.153065 23998 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:34.155443 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.156208 24001 raft_consensus.cc:2393] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 18: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:34.157931 23846 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:34.159273 23924 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:34.158686 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.161911 24002 raft_consensus.cc:2368] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13.
I20260709 12:22:34.164158 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.162833 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:34.166100 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.166275 23854 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:34.169559 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.170691 23995 raft_consensus.cc:2393] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:34.172123 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.172389 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:34.172788 23854 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:34.173055 24557 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 14: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:34.177657 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.182574 23851 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:34.186072 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.187189 24001 raft_consensus.cc:2393] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:34.187403 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33822 (request call id 2551) took 1438 ms. Trace:
I20260709 12:22:34.187198 24557 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:22:34.188107 23920 rpcz_store.cc:276] 0709 12:22:32.749139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.750953 (+  1814us) service_pool.cc:224] Handling call
0709 12:22:32.771965 (+ 21012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.772212 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:22:32.788721 (+ 16509us) log.cc:844] Serialized 14 byte log entry
0709 12:22:33.982576 (+1193855us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b18003be660. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a 00007fa287456a2a
0709 12:22:34.187039 (+204463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:34.187095 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:34.187142 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.187204 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:34.187336 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20593,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"spinlock_wait_cycles":5595392,"thread_start_us":204188,"threads_started":1}
I20260709 12:22:34.190377 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:34.191213 23892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.43.65:34895 timed out after 2.064s (SENT) [suppressed 4 similar messages]
I20260709 12:22:34.152474 29360 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.201026 29139 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:34.207000 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:34.207692 23851 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:34.209257 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.214161 29485 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:34.218080 29555 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.218662 29555 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.219383 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:34.223677 29360 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.220479 29173 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:22:34.066334 29338 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:34.221354 29261 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:22:34.184005 29443 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:22:34.231269 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.231988 23996 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 20.
I20260709 12:22:34.235205 23851 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:34.227682 23818 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:34.219488 29383 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:34.236907 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.237859 23846 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:22:34.178779 29396 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:34.241183 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.241757 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.242014 23854 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:34.242374 23996 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:34.238196 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:34.243330 24557 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:34.240101 24561 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:34.246011 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:34.241636 29550 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:34.247323 29550 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.249553 29550 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:34.257129 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:34.257936 24560 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:34.264056 29533 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.265339 23853 raft_consensus.cc:2368] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 16. Current term is 17.
I20260709 12:22:34.249969 29396 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:34.221715 29518 consensus_queue.cc:1059] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:22:34.222249 29554 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:34.244031 29383 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.222759 29364 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.226524 29338 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.220867 29555 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:34.236719 29221 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:34.225858 29360 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:34.240744 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.266592 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:34.456738 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.458227 24557 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:34.459910 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.485431 23996 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:34.268621 29550 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:34.510262 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 274557us
I20260709 12:22:34.633741 23966 leader_election.cc:400] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16.
I20260709 12:22:34.634238 23966 leader_election.cc:403] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:22:34.462091 29365 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:34.551576 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:34.635326 23995 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:34.636121 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:34.481920 29221 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:34.554239 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:34.555810 24560 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:22:34.638514 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.556732 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.556782 24559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36570 (request call id 1016) took 1324 ms. Trace:
I20260709 12:22:34.461735 29554 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.641004 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:34.644544 24554 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:34.640218 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:34.504243 29525 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:34.506860 29550 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.615475 24002 raft_consensus.cc:1240] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:22:34.506189 29521 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.641175 24559 rpcz_store.cc:276] 0709 12:22:33.226932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.227199 (+   267us) service_pool.cc:224] Handling call
0709 12:22:34.548881 (+1321682us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54004e3754. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa2874502fa 00007fa28c411b17 00007fa28598c6d4 00007fa28598c662 00007fa28598c591 00007fa28598c50c 00007fa28598b7c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:34.550808 (+  1927us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990124928}
I20260709 12:22:34.644693 23966 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:34.654378 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:34.643240 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:34.664397 23996 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
W20260709 12:22:34.664225 23966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.639969 29221 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:34.672324 24554 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:34.673938 29380 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:34.674552 29380 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:34.675774 29558 log.cc:927] Time spent T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:22:34.676735 29380 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:34.643095 29488 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:34.687045 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:34.687323 23966 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:34.659890 29383 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:34.667025 29555 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.648188 29365 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:34.688498 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 497275us
I20260709 12:22:34.660171 29396 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:34.666800 29487 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:34.699173 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:34.706885 23893 leader_election.cc:400] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13.
I20260709 12:22:34.707293 23893 leader_election.cc:403] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:34.708292 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:34.710043 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:34.710916 23920 raft_consensus.cc:2393] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:34.688488 29488 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:34.711421 29488 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:34.712564 29561 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:22:34.700008 29555 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.716954 23892 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:34.705865 29383 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:34.721171 29434 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:34.708293 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:34.726040 23995 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:34.728333 23997 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:34.659176 29525 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:34.731796 28397 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13.
I20260709 12:22:34.741149 29533 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.717701 29555 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:34.721661 29434 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.721964 29396 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.728161 29380 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:34.759796 24558 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:34.689323 29521 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:32.167659 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:34.734076 29416 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:34.738561 29383 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:34.764379 23751 catalog_manager.cc:5697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 13 to 16, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:34.728096 29566 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16.
I20260709 12:22:34.743837 29487 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:34.765460 29434 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:34.786319 29283 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:34.765969 29555 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:34.773713 29488 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:34.818220 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 590580us
I20260709 12:22:34.824316 23820 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:34.826609 29261 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:34.827085 29261 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.827466 29261 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:34.831991 29139 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:34.832854 29139 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.833861 29518 consensus_queue.cc:1059] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:34.835039 29518 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:34.835708 29139 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.835681 29518 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:22:34.841022 29139 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:34.841562 29139 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:34.842571 29139 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.844486 29139 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:34.848289 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 191391us
I20260709 12:22:34.848732 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.771108 29380 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:34.770741 29396 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:34.776685 29416 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.854024 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:34.852701 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 191187us
I20260709 12:22:34.853372 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.859799 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.841059 29534 raft_consensus.cc:3055] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:34.809743 29555 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:34.879261 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:34.885643 23923 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:22:34.886559 23925 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:34.888370 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:34.852263 29550 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:34.894901 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:34.878079 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 179001us
I20260709 12:22:34.904057 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:34.912189 23929 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:22:34.912039 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:34.913215 23920 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:34.913350 23926 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:34.914714 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:34.920475 29560 log.cc:927] Time spent T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.301s	user 0.000s	sys 0.003s
I20260709 12:22:34.921741 23920 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 17.
I20260709 12:22:34.925025 23925 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:34.927531 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.928490 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:34.933029 29569 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:22:34.936293 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:34.939181 29416 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.940383 29521 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.941632 29365 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:34.942097 29360 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:34.942840 29360 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:34.876843 29534 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:34.943039 23966 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:34.880580 29554 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:34.950501 29550 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:34.951049 29550 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.952018 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:34.952301 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 56249.9us
I20260709 12:22:34.894562 29216 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:34.958752 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:34.960770 23966 leader_election.cc:400] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 16. Current term is 17.
I20260709 12:22:34.961143 23966 leader_election.cc:403] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:34.963588 29485 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:34.963482 29216 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:34.964119 29485 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.965984 23751 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 13 to 14, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 14 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:34.967835 23751 catalog_manager.cc:5697] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:34.985612 23751 catalog_manager.cc:5697] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 14 to 16, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:34.876946 29487 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:34.991675 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:34.937554 29221 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:34.992887 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.951435 29550 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:34.988963 23751 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:34.943249 29360 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:34.997099 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 68863.2us
I20260709 12:22:34.943341 29396 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:35.008288 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 304000us
I20260709 12:22:35.012151 23893 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:35.015448 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:35.016289 23846 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:34.977531 29485 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:34.951784 29525 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:34.977558 29383 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:22:34.895526 29535 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 12:22:35.024530 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:35.017694 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:34.977962 29566 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:35.027187 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:35.020156 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:35.028332 23846 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:34.998871 23751 catalog_manager.cc:5697] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 11 to 17, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 17 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:35.030954 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:35.032480 23751 catalog_manager.cc:5697] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 11 to 13, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 13 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:35.034036 23969 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:35.018352 29380 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:35.045454 23848 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:35.050071 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:35.043711 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:35.059787 29390 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:35.046387 29534 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.070642 29390 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.071231 29534 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:35.072649 29216 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:35.073441 29390 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:35.046269 23893 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:35.059576 29554 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:35.047772 29364 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:35.075778 29365 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:35.076234 29365 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:35.076637 29365 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:35.078012 29380 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:35.078447 29380 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.078804 29380 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:35.047389 29416 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:35.085019 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:35.048396 29102 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:22:35.085901 29261 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.086613 29330 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 12:22:35.086869 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.094516 23751 catalog_manager.cc:5697] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 6 to 10, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 10 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:35.090895 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.091912 29404 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:22:35.096298 23751 catalog_manager.cc:5697] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 9 to 18. New cstate: current_term: 18 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:35.096999 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 50817.8us
I20260709 12:22:35.086589 29365 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.036259 29421 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:22:35.098543 23817 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:35.099287 29518 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:35.099437 23817 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:35.100224 29421 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:35.100582 23893 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:35.100718 29421 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:35.055868 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:35.045179 29396 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:35.101701 29421 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.102370 29396 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.104408 29396 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:35.104701 29364 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:35.099975 29518 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 17 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:35.105154 29364 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.105583 29364 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:35.105805 29518 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:35.109438 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53663.7us
I20260709 12:22:35.018484 29360 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:35.115149 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 386955us
I20260709 12:22:35.123395 23995 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:22:35.125869 23893 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:35.143870 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:35.144164 23854 raft_consensus.cc:2368] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 11. Current term is 12.
W20260709 12:22:35.149179 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 288614us
I20260709 12:22:35.066249 29221 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:35.124980 29416 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:35.155555 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:35.153340 28397 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:35.161576 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:35.126600 29503 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:35.064605 29434 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.191038 29503 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.191717 29383 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 16. Current term is 17.
I20260709 12:22:35.192116 29380 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.193377 29503 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:35.195310 29434 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:35.198837 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:35.170782 29416 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:35.202303 29416 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:35.205686 29354 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.206367 29354 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.206900 29261 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:35.207341 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:35.126706 29396 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 12:22:35.211464 29575 log.cc:927] Time spent T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:22:35.211930 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:35.213310 23999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 664) took 1258 ms. Trace:
I20260709 12:22:35.216223 29555 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:35.217031 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:35.218668 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:35.217300 29380 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:35.219110 29485 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.220137 29550 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.220484 29354 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:35.213717 23999 rpcz_store.cc:276] 0709 12:22:33.954841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.958934 (+  4093us) service_pool.cc:224] Handling call
0709 12:22:33.959816 (+   882us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:22:34.078701 (+118885us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:34.095026 (+ 16325us) log.cc:844] Serialized 14 byte log entry
0709 12:22:34.701962 (+606936us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b180048e8c0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec23a 00007fa287456a2a
0709 12:22:34.818322 (+116360us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b180048e8c0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:22:34.956244 (+137922us) log.cc:844] Serialized 14 byte log entry
0709 12:22:34.964968 (+  8724us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:34.965658 (+   690us) log.cc:844] Serialized 52 byte log entry
0709 12:22:34.965793 (+   135us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:34.965825 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.965908 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:34.964813 (+ -1095us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b180048e8c0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:22:35.072189 (+107376us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b180048e8c0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f522 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:22:35.213085 (+140896us) raft_consensus.cc:1685] finished
0709 12:22:35.213114 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.213252 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133873,"prepare.queue_time_us":17294,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":146637,"raft.run_cpu_time_us":575,"raft.run_wall_time_us":36601,"spinlock_wait_cycles":57635200,"thread_start_us":174899,"threads_started":1,"wal-append.queue_time_us":927564}
I20260709 12:22:35.224462 24001 raft_consensus.cc:2368] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 16. Current term is 17.
I20260709 12:22:35.226790 29550 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:35.235289 23998 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 17.
I20260709 12:22:35.099468 29365 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:35.201472 29364 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:35.317564 23750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43186 (request call id 246) took 25742 ms (client timeout 15000 ms). Trace:
W20260709 12:22:35.318635 23750 rpcz_store.cc:269] 0709 12:22:09.582617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.594046 (+ 11429us) service_pool.cc:224] Handling call
0709 12:22:35.317209 (+25723163us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:27.486884 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:27.487683 (+   799us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:27.487736 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:22:27.487758 (+    22us) tablet.cc:662] Decoding operations
0709 12:22:27.541753 (+ 53995us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:27.547616 (+  5863us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:27.547653 (+    37us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:22:27.835493 (+287840us) tablet.cc:701] Row locks acquired
0709 12:22:27.886985 (+ 51492us) write_op.cc:260] PREPARE: finished
0709 12:22:27.912524 (+ 25539us) write_op.cc:270] Start()
0709 12:22:27.949318 (+ 36794us) write_op.cc:276] Timestamp: P: 1783599747896507 usec, L: 0
0709 12:22:27.979025 (+ 29707us) op_driver.cc:348] REPLICATION: starting
0709 12:22:28.128535 (+149510us) log.cc:844] Serialized 8605 byte log entry
0709 12:22:29.542241 (+1413706us) op_driver.cc:464] REPLICATION: finished
0709 12:22:29.821996 (+279755us) write_op.cc:301] APPLY: starting
0709 12:22:29.822119 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:30.113705 (+291586us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:30.113841 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:31.069349 (+955508us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:31.104771 (+ 35422us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 12:22:31.104833 (+    62us) write_op.cc:312] APPLY: finished
0709 12:22:31.105355 (+   522us) log.cc:844] Serialized 196 byte log entry
0709 12:22:31.199509 (+ 94154us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:31.215031 (+ 15522us) write_op.cc:454] Released schema lock
0709 12:22:31.222713 (+  7682us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:31.326410 (+103697us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:31.329194 (+  2784us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1871063,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":274943,"apply.run_cpu_time_us":45887,"apply.run_wall_time_us":1443146,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95823,"num_ops":22,"prepare.queue_time_us":203071,"prepare.run_cpu_time_us":35067,"prepare.run_wall_time_us":945426,"raft.queue_time_us":663868,"raft.run_cpu_time_us":5898,"raft.run_wall_time_us":184066,"replication_time_us":1511119,"thread_start_us":745190,"threads_started":5,"wal-append.queue_time_us":368713,"wal-append.run_cpu_time_us":36741,"wal-append.run_wall_time_us":2895531}]]}
I20260709 12:22:35.098156 23751 catalog_manager.cc:5697] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 13 to 14, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 14 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.555873 23751 catalog_manager.cc:5697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 10 to 11, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 11 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:35.346505 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 159439us
I20260709 12:22:35.353164 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:35.362216 23967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.000s	sys 0.015s
I20260709 12:22:35.363895 24525 leader_election.cc:400] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 16. Current term is 17.
I20260709 12:22:35.570344 24525 leader_election.cc:403] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:35.371753 23923 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 21 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:22:35.382364 29144 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:35.377092 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:35.385933 29221 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:35.576771 29144 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.390568 29380 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:35.578612 29380 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.580250 29144 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:35.506034 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 68777.5us
I20260709 12:22:35.511117 29364 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:35.514310 29523 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:35.516794 29566 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:35.518391 29503 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:35.251991 29416 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.531009 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:35.343573 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:35.567286 29485 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:35.573007 23967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.001s	sys 0.015s
I20260709 12:22:35.573647 23998 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:35.574604 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 321058us
I20260709 12:22:35.591534 23848 raft_consensus.cc:2393] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 16: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:35.610373 29144 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.608104 23751 catalog_manager.cc:5697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 5 to 9, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 9 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.629170 29523 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.651098 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:35.651502 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:35.653198 24557 raft_consensus.cc:2393] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 12: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:35.642282 29503 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.655563 29216 consensus_queue.cc:1059] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:22:35.656940 29216 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:35.657419 29216 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:35.658059 23922 raft_consensus.cc:1240] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:35.658249 29303 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:35.658572 29330 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:35.660987 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.660310 23751 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:35.661307 29261 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:35.653033 29555 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:35.658571 29144 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.664445 29523 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:35.665129 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:35.666054 23818 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:35.637714 29380 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:35.654460 29431 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:22:35.625101 29566 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:35.676294 29487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.014s	sys 0.033s
W20260709 12:22:35.695341 23820 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a4c451e990244d7a5701e875fa03f62. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:35.713135 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 156899us
I20260709 12:22:35.718314 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:35.686285 29555 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.720932 29416 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:35.690506 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:35.690167 29261 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.691768 29503 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:35.693733 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:35.695447 29364 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:35.734347 29364 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.735448 24558 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:22:35.738552 29261 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:35.738731 29364 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:35.679018 29303 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:35.697217 29330 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.701262 29144 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:35.701779 29421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.004s	sys 0.044s
I20260709 12:22:35.704905 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:35.705577 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:35.695152 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:35.694850 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:35.694267 23751 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 10 to 11, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 11 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:35.740962 29519 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.035s	sys 0.048s
W20260709 12:22:35.763509 23995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.040s	sys 0.161s
I20260709 12:22:35.706779 29216 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:35.725747 29555 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:35.778874 29519 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.035s	sys 0.049s
I20260709 12:22:35.783701 29587 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:35.784006 23751 catalog_manager.cc:5697] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 7 to 9, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 9 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:35.784986 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 119185us
I20260709 12:22:35.785357 29404 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:35.784675 29587 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:35.773222 29421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.004s	sys 0.045s
I20260709 12:22:35.789865 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:35.808077 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:35.765136 29221 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:35.787494 23751 catalog_manager.cc:5697] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 9 to 10, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 10 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:35.816058 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:35.825078 23996 raft_consensus.cc:2393] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 18: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:35.829077 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:35.830046 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:35.816460 29404 consensus_queue.cc:1059] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:22:35.831315 23929 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 15: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:35.832892 29303 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.720988 28789 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 12:22:35.839462 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:35.827602 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:35.827193 23997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.000s	sys 0.016s
I20260709 12:22:35.846153 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:35.866458 24003 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:35.866815 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:35.867498 23846 raft_consensus.cc:3060] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:35.870177 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:35.866653 24561 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:35.870910 24554 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:22:35.872833 23850 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:35.876003 29566 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:35.876664 23846 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
W20260709 12:22:35.876127 29360 consensus_meta.cc:287] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Time spent flushing consensus metadata: real 0.654s	user 0.013s	sys 0.009s
I20260709 12:22:35.878641 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:35.877712 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:35.872879 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:35.895027 29364 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:35.895851 29364 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.898240 29518 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:35.898778 29518 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:35.900077 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:35.901525 29261 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:35.891549 29360 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.906972 29586 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.907759 29586 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:35.912421 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:35.915990 29588 log.cc:927] Time spent T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:22:35.899914 29518 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.905733 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:35.938970 23998 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:35.887538 23751 catalog_manager.cc:5697] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 10 to 12, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 12 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.954846 23996 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:35.877115 29221 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:35.953930 29330 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:35.958534 29221 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:35.959280 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:35.960274 24003 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 15: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:35.965437 29431 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 16. Current term is 17.
I20260709 12:22:35.976521 29518 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:35.992223 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:35.948940 29360 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:36.005612 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:36.000154 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 135049us
I20260709 12:22:36.015017 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.010462 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:35.999795 29587 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:36.026093 23925 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 9.
I20260709 12:22:36.027894 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.034618 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.042275 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.046398 23999 raft_consensus.cc:2393] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 15: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:36.055672 29221 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.056489 29221 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:36.057967 29575 log.cc:927] Time spent T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:22:36.043406 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.059242 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.059857 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.061110 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.061584 29534 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:36.062556 29534 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:36.064538 29599 log.cc:927] Time spent T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:22:36.042739 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:36.068194 29603 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.304s	user 0.006s	sys 0.000s
I20260709 12:22:36.071429 29221 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:36.078218 23853 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:22:36.079916 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 207298us
I20260709 12:22:36.081295 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.087953 29607 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.096719 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.098272 29585 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:36.022697 29431 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:36.098630 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.099182 29493 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.099306 29431 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.100030 29364 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.099987 29493 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:36.101471 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 74830.9us
I20260709 12:22:36.088513 29443 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.098485 29404 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.102712 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.103420 29443 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.103565 29404 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.097467 29607 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.102795 29493 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:36.042558 29601 log.cc:927] Time spent T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 12:22:36.131198 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 338030us
I20260709 12:22:36.125671 23850 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:36.110939 23854 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:22:36.138019 23996 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 21.
I20260709 12:22:36.139362 29443 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.107086 29404 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.038239 29102 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.141196 24554 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:36.142107 28789 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.140277 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:36.152623 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.153816 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.141633 29221 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:22:36.161299 23820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.170238 23999 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:36.159406 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:36.122445 29534 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.132040 29585 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:36.190642 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.163616 23997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2481) took 1104 ms. Trace:
I20260709 12:22:36.177028 29364 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.155165 29102 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:36.202400 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 99812.6us
I20260709 12:22:36.191018 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:36.154165 29431 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:36.211004 24563 raft_consensus.cc:2468] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:22:36.154990 29607 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.215282 23920 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:36.223165 23853 raft_consensus.cc:3060] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:36.224129 23893 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:36.224536 23818 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:36.225699 29261 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:36.226794 29434 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:36.226931 29261 raft_consensus.cc:697] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:36.227860 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.229534 24524 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:36.231113 29431 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:36.231604 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.231977 29431 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:36.232988 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.229483 29261 consensus_queue.cc:237] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.235945 24000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2485) took 1097 ms. Trace:
I20260709 12:22:36.236392 24000 rpcz_store.cc:276] 0709 12:22:35.138684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.138884 (+   200us) service_pool.cc:224] Handling call
0709 12:22:35.139392 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.139943 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.139994 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:35.143449 (+  3455us) log.cc:844] Serialized 26 byte log entry
0709 12:22:35.219404 (+ 75955us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b180048e6e0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa284341e07 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435ec02 00007fa286fe620b 00007fa286febd23 00007fa286fec0d1 00007fa287407a0f
0709 12:22:35.698290 (+478886us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:35.698378 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.698482 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.235369 (+536887us) raft_consensus.cc:1685] finished
0709 12:22:36.235398 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.235683 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5336,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1762,"spinlock_wait_cycles":5889792,"thread_start_us":448396,"threads_started":1,"wal-append.queue_time_us":1060781}
W20260709 12:22:36.238204 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.227349 29102 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:36.232151 24524 leader_election.cc:400] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 11. Current term is 12.
I20260709 12:22:36.226119 29144 raft_consensus.cc:493] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:36.252641 24524 leader_election.cc:403] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:36.225787 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:36.159291 28789 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.256131 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:36.259716 29570 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:36.259440 29144 raft_consensus.cc:515] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.203251 29221 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.197208 23997 rpcz_store.cc:276] 0709 12:22:35.058926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.115491 (+ 56565us) service_pool.cc:224] Handling call
0709 12:22:35.115931 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.121290 (+  5359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.121322 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:35.121857 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:22:35.896445 (+774588us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:36.024171 (+127726us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.053458 (+ 29287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.136949 (+ 83491us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.137019 (+    70us) raft_consensus.cc:1685] finished
0709 12:22:36.137055 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.163538 (+ 26483us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15065,"prepare.queue_time_us":172001,"raft.queue_time_us":26056,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":16795,"spinlock_wait_cycles":90590592,"thread_start_us":793517,"threads_started":2,"wal-append.queue_time_us":878185}
I20260709 12:22:36.266479 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.262595 29221 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:36.217434 29364 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.256896 29431 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.281759 29364 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:36.282001 29416 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:36.283205 23817 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:36.268833 29587 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 11. Current term is 12.
I20260709 12:22:36.284255 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:36.286761 23920 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 15: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:36.271803 29144 leader_election.cc:290] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.292891 23922 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:22:36.290082 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 159152us
I20260709 12:22:36.291316 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.290233 29221 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:36.286094 29416 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:36.303516 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.303169 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:36.306895 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 75211.3us
I20260709 12:22:36.307695 24001 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
W20260709 12:22:36.309454 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 83799.8us
I20260709 12:22:36.314008 24524 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:36.305218 29221 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:36.306453 29416 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:36.325165 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.325620 29364 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:36.325788 29221 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:36.327174 23893 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:36.303411 29431 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.321241 29587 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:36.325795 29593 log.cc:927] Time spent T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.081s	user 0.001s	sys 0.001s
I20260709 12:22:36.339445 29503 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:36.340304 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.326340 29364 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.346829 29518 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.355242 29518 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.363224 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.365975 29421 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.366761 29421 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.373834 23928 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:22:36.379760 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 70698.4us
I20260709 12:22:36.382345 23893 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:36.383909 29144 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:36.384545 29144 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 21 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:36.401082 28789 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:36.402438 29620 log.cc:927] Time spent T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:22:36.403818 29434 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:36.404966 29364 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.391151 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49640 (request call id 2484) took 1260 ms. Trace:
I20260709 12:22:36.377584 29421 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:36.404888 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.390142 23923 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:36.407830 29144 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.417405 23853 raft_consensus.cc:2468] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:36.422866 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:36.423244 23922 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:22:36.434751 29261 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:36.435127 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.435607 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.435914 23820 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:36.436041 23850 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:36.437027 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.438702 23969 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:36.406018 23995 rpcz_store.cc:276] 0709 12:22:35.130479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.130758 (+   279us) service_pool.cc:224] Handling call
0709 12:22:35.131252 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.131715 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.131759 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:35.132335 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:22:35.206522 (+ 74187us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4800270cd8. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28c375aa1 00007fa28c36cb37 00007fa28c36c9ca 00007fa28c46426f 00007fa28c463f37 00007fa28c47855c 00007fa28c478508 00007fa28c478488 00007fa28c478443 00007fa28c4776ec 00007fa28b3a1a96
0709 12:22:35.934821 (+728299us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:36.209873 (+275052us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.258448 (+ 48575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.269125 (+ 10677us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.374305 (+105180us) raft_consensus.cc:1685] finished
0709 12:22:36.379253 (+  4948us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.391045 (+ 11792us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34256,"prepare.queue_time_us":248439,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":6076,"raft.run_cpu_time_us":2131,"raft.run_wall_time_us":59116,"spinlock_wait_cycles":4637056,"thread_start_us":832620,"threads_started":2,"wal-append.queue_time_us":1175681}
I20260709 12:22:36.443162 29364 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:36.444098 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.444203 23969 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:36.383985 29303 consensus_queue.cc:1059] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:22:36.448421 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.453614 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.456332 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.459940 29586 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.461112 29216 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:36.461395 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.461793 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.464171 29221 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.448443 29261 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:36.466944 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.469349 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.470249 23846 raft_consensus.cc:2393] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 15: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:36.470139 29431 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:36.470861 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:36.471719 23852 raft_consensus.cc:2393] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 15: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:36.469746 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:36.474228 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:36.473979 23854 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:36.481304 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:36.482244 23853 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:36.483819 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:36.486461 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:36.490221 23851 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:36.488420 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:36.489574 29364 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:36.491752 29364 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:36.490036 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:36.492230 29364 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:36.492476 24559 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 18.
I20260709 12:22:36.488121 29221 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.494138 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:22:36.494566 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 54356.2us
I20260709 12:22:36.498180 23969 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:36.499261 29566 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:36.501664 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.461299 29416 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.504367 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.506125 29416 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.506443 29518 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:36.494761 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:36.508263 23969 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:36.508905 29518 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.509142 29360 raft_consensus.cc:2804] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:36.509814 29360 raft_consensus.cc:697] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:36.510831 29360 consensus_queue.cc:237] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.513104 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.496109 24554 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:36.514040 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.509483 29518 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.515403 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:36.517249 29518 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.518647 23846 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:36.524256 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.534844 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:36.535360 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 151720us
I20260709 12:22:36.535874 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.537153 23850 raft_consensus.cc:2410] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 12:22:36.537757 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.539716 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.540362 23925 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:36.543594 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:36.544996 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:36.545612 23924 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:36.534086 23892 connection.cc:256] RPC call timeout handler was delayed by -1.5728536460001123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:22:36.529978 29416 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.551949 23923 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 16. Current term is 17. Ops: []
W20260709 12:22:36.553649 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 129195us
I20260709 12:22:36.554203 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.544706 29586 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.555295 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:36.555711 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.556818 29416 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.557859 24004 raft_consensus.cc:1240] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 20. Current term is 21. Ops: [20.10-20.11]
I20260709 12:22:36.559087 29416 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:36.562575 29144 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:36.562635 23893 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:36.563558 23849 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:36.564417 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.555742 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.566226 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.567468 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.568164 23853 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:22:36.570303 29566 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:36.575814 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f9750732564b8ebf9a7d205547b35c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.576421 29566 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:36.577456 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:36.549932 29518 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:22:36.578150 24524 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.579747 24524 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.585812 24524 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.582965 23817 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:36.599661 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.597631 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.603111 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:36.602383 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.584123 29630 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:36.607465 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:36.609333 23846 raft_consensus.cc:2410] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:22:36.592468 29431 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:36.555311 29586 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.654374 29586 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.623489 29518 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:36.657042 29518 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.657490 29518 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:36.623646 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.610733 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:36.595952 29570 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:36.671092 23846 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:36.673929 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.610764 23893 leader_election.cc:304] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:36.623044 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.675184 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.622444 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.624208 24004 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:36.610702 29587 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:36.620970 29364 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.641244 23929 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:36.607461 29630 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:36.613188 23927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
W20260709 12:22:36.642705 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60951.9us
I20260709 12:22:36.646827 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.648864 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.651002 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:36.667012 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 63933.3us
I20260709 12:22:36.628392 23996 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:22:36.685472 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 74803.8us
I20260709 12:22:36.686856 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.688887 23892 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:36.689155 23924 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:36.689862 23921 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:36.693540 23999 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:36.688210 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.697309 29364 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.698541 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:36.699224 24559 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:36.701426 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.697136 29627 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:36.700794 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.684309 29630 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:36.704615 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.705101 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:36.707361 23820 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.707995 24003 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:36.708103 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:36.709311 29635 raft_consensus.cc:2749] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:36.704732 23817 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:36.715953 23999 raft_consensus.cc:2393] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:22:36.716831 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 161202us
I20260709 12:22:36.710270 29431 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:36.717918 29431 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:36.706137 29503 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:36.714630 29617 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:36.720281 29617 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.720839 29617 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:36.699991 29570 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:22:36.726761 29570 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:36.727217 29570 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:36.728338 29570 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.731772 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.703539 29627 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:36.744786 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:36.744952 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 59873.4us
I20260709 12:22:36.730013 29364 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:36.702345 29587 consensus_queue.cc:1059] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:22:36.743942 29261 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:36.751042 23892 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:22:36.754707 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 50192.9us
I20260709 12:22:36.755535 24524 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.752107 29364 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.762341 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:36.762998 24562 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:36.763677 29637 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:36.764333 29364 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:36.764276 29637 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.761474 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.755887 28789 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:36.765564 29627 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.761485 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:36.767112 29360 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:36.767743 29360 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.768214 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.754855 29570 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:36.772598 29566 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:36.773218 29586 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.816092 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 58825.6us
I20260709 12:22:36.773553 29360 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:36.753357 29330 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.774137 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:36.774098 29364 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:36.780988 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49344.2us
W20260709 12:22:36.758988 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 54329.1us
I20260709 12:22:36.829221 23820 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:36.769438 29587 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:36.828907 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:36.832494 29360 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:36.836647 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 91947.8us
I20260709 12:22:36.837368 29566 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.837569 29330 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.837244 29640 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:22:36.836046 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 88885.6us
I20260709 12:22:36.844766 28789 raft_consensus.cc:697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:36.836905 29503 raft_consensus.cc:2749] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:36.864791 23893 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:36.846069 29627 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:36.846537 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.847954 29518 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.815973 29216 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:36.849733 29139 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:36.838671 29638 log.cc:927] Time spent T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:22:36.857735 29637 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:36.880750 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 85902.3us
I20260709 12:22:36.900466 29330 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:36.903194 29566 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:36.890292 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:36.913820 23818 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.838910 29586 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.917217 29431 raft_consensus.cc:3055] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:36.917815 29431 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:36.919006 29431 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.921061 29431 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:36.924234 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 64155us
I20260709 12:22:36.925254 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:36.927078 28789 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.877892 29139 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:36.907306 29630 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:36.931069 29139 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:36.933641 23926 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:36.934757 29586 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:36.936843 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 82503.8us
I20260709 12:22:36.937093 23927 raft_consensus.cc:606] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:36.933147 29630 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:36.937677 23927 raft_consensus.cc:614] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:36.878341 29640 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:36.946115 24557 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:36.946580 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:36.941318 29139 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:36.956955 23999 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:36.963236 29518 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:36.963536 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49831.4us
I20260709 12:22:36.970376 23818 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.964413 29607 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:36.949994 29655 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:36.977429 23818 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.980238 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:36.980888 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 55724us
I20260709 12:22:36.982610 23892 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:36.970778 29640 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:37.002667 28789 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:37.004307 23818 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:36.982370 23923 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 18.
I20260709 12:22:36.969126 29519 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:22:36.976806 29493 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:36.988027 23853 raft_consensus.cc:1240] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:36.981559 29421 consensus_queue.cc:1059] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:22:36.991161 29139 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:36.992712 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:37.009333 24554 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:37.015898 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:37.006862 28789 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 12:22:37.022928 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 254799us
I20260709 12:22:37.024407 29651 raft_consensus.cc:493] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:37.035080 23966 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.035370 29651 raft_consensus.cc:515] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:37.035959 29586 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:37.037256 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:37.037842 23921 raft_consensus.cc:606] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:37.024387 29330 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:37.024326 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:37.039930 23926 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:37.038237 23921 raft_consensus.cc:614] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:37.040408 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:37.028167 29261 consensus_queue.cc:1059] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:22:37.042620 24554 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:37.029290 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:37.024134 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.025130 29635 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:37.046193 29640 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:37.050011 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:37.049997 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:37.050958 23921 raft_consensus.cc:606] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
W20260709 12:22:37.051961 29647 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:22:37.058774 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:37.059458 23920 raft_consensus.cc:606] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:37.062249 28789 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:37.062841 28789 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.063280 28789 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:37.064071 23818 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.066519 29139 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:37.066512 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 83985.6us
I20260709 12:22:37.055145 29261 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:37.006325 29630 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:22:37.066251 29421 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:37.066349 29493 raft_consensus.cc:2749] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:37.077337 23818 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.077091 28789 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.111399 24554 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:22:37.082816 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:36.979756 29617 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:37.037603 29651 leader_election.cc:290] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:37.031874 29535 raft_consensus.cc:3055] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:37.107983 23926 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:37.111708 28789 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:37.080786 24003 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:22:37.112776 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:37.130605 23921 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:37.113780 23920 raft_consensus.cc:606] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:37.131531 23920 raft_consensus.cc:614] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:37.113122 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.119510 29416 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:37.121920 29434 raft_consensus.cc:993] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:37.122614 29519 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:37.135597 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.139397 29421 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:37.143450 29617 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:37.144060 29493 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:37.144436 24004 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:37.144515 29493 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:37.145008 29493 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:37.124943 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 89959.3us
I20260709 12:22:37.149915 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.118688 29139 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:37.155874 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:37.156564 23998 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 18.
I20260709 12:22:37.124995 29535 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:37.106587 29261 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:37.124737 29649 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:22:37.136305 29434 raft_consensus.cc:1081] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:37.137151 29416 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:37.164494 29416 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:37.133392 23892 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:37.159058 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:37.135267 29519 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.161324 24004 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:37.160218 29630 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:22:37.166761 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:37.177191 24554 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:37.166302 24002 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:22:37.178901 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:37.170164 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:37.182137 23921 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 19.
I20260709 12:22:37.183571 29631 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:37.180632 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 47451.5us
I20260709 12:22:37.187112 23892 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:37.190249 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:37.187397 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:37.190853 24004 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:37.192888 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:37.197432 29631 raft_consensus.cc:2764] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:22:37.197036 23739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73d2fbc1f30749eba64903d7e79de8a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 35a9a1f8b1d847fb8f2063ced2a3c26d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:37.199705 29139 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:37.204982 29261 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.206400 29261 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:37.180068 29519 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:37.215212 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 56745.4us
I20260709 12:22:37.163233 29360 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:37.219442 23926 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:37.226275 24004 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 19.
I20260709 12:22:37.231495 23817 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:37.237005 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 87279.9us
I20260709 12:22:37.238883 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:37.165526 29416 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.246627 23892 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:37.254691 24554 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 19.
I20260709 12:22:37.232290 29102 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:22:37.267436 24554 raft_consensus.cc:1240] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:37.269021 29303 consensus_queue.cc:1059] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:37.270108 29303 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:37.270475 29303 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:37.271351 29303 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:37.272812 29303 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:37.282845 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:37.285437 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.250092 29434 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:22:37.300727 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 84093.1us
I20260709 12:22:37.303395 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.287067 29503 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:37.246546 29493 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.294603 29404 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:37.235162 29535 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.303184 29330 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:37.315492 29360 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:37.316778 29404 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 19 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:37.343184 29404 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:37.346194 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 56805.5us
I20260709 12:22:37.347114 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.349120 23966 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.335599 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:37.354157 29668 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.354687 29668 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.357075 29493 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:37.357654 29493 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:37.358744 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:37.359596 23999 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:37.360368 29216 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.360901 29216 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:37.363234 29216 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:37.366369 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:37.371999 23999 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:37.372997 23997 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:37.374675 23818 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:37.377393 29493 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:37.377918 29493 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:37.378877 29493 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.335544 29221 consensus_queue.cc:1059] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 12:22:37.334404 29535 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:37.391956 29221 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:37.392496 29221 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:37.393652 29221 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:37.396937 29221 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:37.397995 29330 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 19 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:37.399022 29330 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:37.405417 29668 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:37.419653 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:37.421052 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:37.427589 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:37.415289 29649 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:37.416808 29364 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:37.437631 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:37.438530 23926 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
W20260709 12:22:37.443284 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 94209.9us
I20260709 12:22:37.457370 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:37.419226 29640 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:22:37.465744 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.482245 23849 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 21 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 12:22:37.482890 23849 pending_rounds.cc:85] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Aborting all ops after (but not including) 10
W20260709 12:22:37.333233 29670 consensus_queue.cc:1175] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" responder_term: 14 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: [13.8-13.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:37.506218 29649 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:37.504012 23850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:22:37.536522 23850 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:37.537012 23850 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:37.483155 23849 pending_rounds.cc:107] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 20.11
I20260709 12:22:37.544237 23849 raft_consensus.cc:2917] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 21 FOLLOWER]: Aborting config change with OpId 20.11: Aborted: Op aborted by new leader
I20260709 12:22:37.558200 23849 raft_consensus.cc:2889] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 21 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:37.563542 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 97918.6us
I20260709 12:22:37.565073 23846 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:37.559695 29434 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:37.596747 23850 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.619251 23849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44078 (request call id 0) took 3879 ms. Trace:
I20260709 12:22:37.620436 23849 rpcz_store.cc:276] 0709 12:22:33.713402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.713538 (+   136us) service_pool.cc:224] Handling call
0709 12:22:33.905390 (+191852us) log.cc:844] Serialized 499 byte log entry
0709 12:22:34.148405 (+243015us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54002d46d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa287452735 00007fa28c412d29 00007fa2859911d4 00007fa285991162 00007fa285991091 00007fa28599100c 00007fa2859902c2 00007fa28578748c 00007fa2857868c6 00007fa28578626f
0709 12:22:34.253310 (+104905us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b1800146ec0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:22:34.503359 (+250049us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b1800146ec0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f3f3 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:22:34.817920 (+314561us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b1800146ec0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa28b32058f 00007fa28435f571 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd
0709 12:22:37.584910 (+2766990us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":627647,"raft.queue_time_us":85560,"raft.run_cpu_time_us":3119,"raft.run_wall_time_us":310082,"spinlock_wait_cycles":390386432}
I20260709 12:22:37.638152 29434 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:37.642628 29679 log.cc:927] Time spent T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:37.650883 23850 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:37.674072 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 215600us
W20260709 12:22:37.632124 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 174453us
I20260709 12:22:37.685086 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:37.685712 23999 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:37.686950 23817 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:37.694861 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 95281.1us
I20260709 12:22:37.678694 29519 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.718433 23892 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:37.737352 23853 raft_consensus.cc:1240] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:37.740404 23999 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:37.717765 29683 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:22:37.747668 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60853.7us
I20260709 12:22:37.749117 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:37.751516 28789 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:37.751852 29607 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:37.752319 29607 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.726727 29687 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 12:22:37.757748 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet 5a4c451e990244d7a5701e875fa03f62: Aborted: Op aborted by new leader
I20260709 12:22:37.740450 29652 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:37.748641 29671 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.434s	user 0.000s	sys 0.011s
I20260709 12:22:37.753746 29683 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.766134 29652 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:37.766525 29144 raft_consensus.cc:993] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:37.766896 29519 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:37.767195 29144 raft_consensus.cc:1081] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:37.767532 29652 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.773537 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:37.774221 23920 raft_consensus.cc:3055] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:37.774544 23920 raft_consensus.cc:740] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:37.775460 23920 consensus_queue.cc:260] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.760673 29607 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:37.778632 23921 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:22:37.780604 23926 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:37.784332 29635 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:37.784770 29635 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:22:37.789057 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet 7b845c11f69f485889b01a0a648dc3bc: Illegal state: Replica e8bc734d763e4ddf87f7b930e35cbaa7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:37.792644 29635 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:37.795001 29685 log.cc:927] Time spent T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:37.796314 29649 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:22:37.798609 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 92741.3us
I20260709 12:22:37.799351 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:37.800645 23966 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.803203 29404 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.803869 29404 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:37.805683 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.806082 29360 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:37.807674 29360 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:37.808054 29360 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:37.808446 29360 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:37.808497 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:37.810182 23848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
W20260709 12:22:37.810681 29675 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:22:37.810750 29651 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:37.810761 23848 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:37.813669 23848 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:37.825280 29416 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:37.826493 29261 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.827075 29261 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.829424 29261 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:37.831446 29404 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:37.831552 24554 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:37.835816 24554 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:22:37.838735 29683 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:37.840132 29683 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:37.841985 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.843145 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:37.843986 29586 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:37.844678 29586 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:37.845028 29586 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.845386 29586 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:37.845903 29404 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:37.848325 23920 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:37.855650 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.853057 29635 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:37.856567 29651 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:37.856525 23848 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:37.867771 29607 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.869491 23848 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:37.878181 29566 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:22:37.879804 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet 05a83cc012d5420494cfd8c624a09767: Illegal state: Replica e8bc734d763e4ddf87f7b930e35cbaa7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:37.880540 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.881450 29566 raft_consensus.cc:2749] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:37.882894 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.883824 29566 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:37.884464 29566 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:37.879570 29360 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:37.885576 29566 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.888181 29360 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:37.889313 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:37.892269 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.900293 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:37.900440 23966 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.901015 24558 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:37.900872 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 46639.3us
I20260709 12:22:37.906641 29649 raft_consensus.cc:2804] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:37.916715 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.916998 23853 raft_consensus.cc:1240] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:37.918949 23966 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:37.919595 29364 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:37.902004 29651 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:37.926496 23848 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 15 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:37.934296 23923 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:37.922878 29586 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:37.940009 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:37.928689 29416 consensus_queue.cc:1059] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:22:37.941848 29586 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:37.942462 29416 raft_consensus.cc:3055] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:37.942893 29416 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:37.944096 29651 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:37.944640 29651 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:37.944680 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:37.948496 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:37.949151 24557 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:37.954625 23920 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:37.954758 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:37.944212 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:37.957998 23997 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:37.915138 29649 raft_consensus.cc:697] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:37.973951 24558 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:37.983443 29649 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.986164 29681 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:37.986304 29607 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:37.986680 29681 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:37.987159 29681 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:37.990059 29672 consensus_queue.cc:1059] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:22:37.991039 29672 raft_consensus.cc:3055] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:37.991423 29672 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:37.983858 29330 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:37.992242 29672 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:37.991916 29416 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:37.993469 29672 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:37.993695 23818 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:37.995435 23820 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:37.996938 29667 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:37.997375 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:37.998983 29677 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:37.999534 29677 raft_consensus.cc:697] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:37.999861 29535 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:38.000207 29261 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:38.000572 29677 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:38.006127 24003 raft_consensus.cc:1240] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:37.928224 29652 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:38.009760 29652 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:38.010852 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:38.011656 29493 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:38.012033 29493 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.012387 29493 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:38.012051 29652 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:38.020951 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:37.997494 29667 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:38.031721 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:38.039795 24557 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:37.970089 23999 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:38.028841 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:38.032671 23923 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:38.043845 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:38.048957 23923 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:22:38.052346 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 124723us
I20260709 12:22:38.054720 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:38.054790 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:38.055873 23925 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:38.055505 23927 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 17.
I20260709 12:22:38.044888 29416 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:38.074910 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:38.082881 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 162893us
I20260709 12:22:38.084260 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:38.063427 29566 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:38.090930 23893 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:38.094380 23927 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:22:38.095273 29630 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:38.098133 29360 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:38.108669 29360 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:38.109758 29360 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.110366 29667 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.094862 29674 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:22:38.118952 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:38.119609 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:38.120141 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:38.121985 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:38.119731 23926 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:22:38.122365 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:38.119697 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:38.125237 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:22:38.124706 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 78137.2us
I20260709 12:22:38.126758 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:38.127633 23920 raft_consensus.cc:2393] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 19: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:38.069482 29493 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.126309 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:38.127542 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3482cac0ee5745259004349e6078cf03" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:38.131500 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:38.132148 23924 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:38.134837 24559 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:22:38.135385 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:38.138327 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:38.135217 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:38.140111 23847 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:38.142038 23845 raft_consensus.cc:1275] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:22:38.093809 29566 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.144610 29566 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:38.150908 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:38.151881 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:38.152204 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:38.152454 23854 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:38.152878 23920 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:38.158071 23999 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:38.168218 29421 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:22:38.170260 23853 raft_consensus.cc:2368] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 17. Current term is 18.
I20260709 12:22:38.174235 23817 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:38.185268 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:38.197403 23849 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:22:38.201797 23966 leader_election.cc:304] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:38.203675 23924 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:38.122582 29617 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:22:38.204901 23928 raft_consensus.cc:1240] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:22:38.210846 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:38.214826 24002 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:38.218290 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:38.225013 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:38.226295 23966 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:38.217036 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:38.231137 23846 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:22:38.233013 23920 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:38.238281 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:38.281508 23854 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:38.291380 23999 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:38.230463 29566 raft_consensus.cc:2749] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:38.225322 29677 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:38.284054 23817 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:38.242479 24004 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:22:38.362380 29261 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:22:38.266878 29708 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:22:38.363262 29261 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:38.364729 29261 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:38.370363 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 86437.1us
I20260709 12:22:38.262766 29364 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:38.259673 29649 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:38.232900 29586 consensus_queue.cc:1048] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.141s
I20260709 12:22:38.250372 29696 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:38.360237 29677 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.229568 29682 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.143s
W20260709 12:22:38.409044 29695 log.cc:927] Time spent T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:22:38.409727 29649 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:38.360109 29303 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:22:38.425702 23921 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:38.250988 29681 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.261112 29668 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.140s
I20260709 12:22:38.423758 29677 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:38.445473 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 207262us
I20260709 12:22:38.506167 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:38.507869 23966 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:38.515095 24001 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:38.516456 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:38.420801 29696 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:38.517252 29566 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:22:38.508231 29706 log.cc:927] Time spent T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:22:38.526547 23966 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:38.509806 29364 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:38.520207 29493 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:38.447697 29651 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.526248 29649 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:38.523562 29696 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:38.534545 29670 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:38.587200 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:38.541499 29669 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:22:38.682570 24003 raft_consensus.cc:1240] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:38.587141 29649 raft_consensus.cc:697] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:38.673069 29364 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:38.674742 29687 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.576579 29654 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 12:22:38.674813 29503 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:38.725693 29709 log.cc:927] Time spent T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:22:38.730028 29630 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:38.730679 29630 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.732913 29630 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:38.733459 29630 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.733340 29696 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.736737 24004 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:38.738479 29676 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:38.739100 29676 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:38.741470 29676 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:38.745296 24004 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 18.
I20260709 12:22:38.747650 29696 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:38.747757 29630 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:38.752605 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:38.751472 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:38.756004 23928 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:38.761647 29713 log.cc:927] Time spent T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:38.755856 29503 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.764442 29503 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:38.773739 23928 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 18.
I20260709 12:22:38.778244 29649 consensus_queue.cc:237] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:38.821106 29630 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:38.822340 29698 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.606s	user 0.005s	sys 0.000s
I20260709 12:22:38.825969 29651 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:38.827293 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44103.3us
I20260709 12:22:38.828354 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:38.829185 29669 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:22:38.831861 29672 consensus_meta.cc:287] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Time spent flushing consensus metadata: real 0.789s	user 0.011s	sys 0.000s
I20260709 12:22:38.842569 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:38.847373 23966 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:38.846249 24560 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:22:38.757236 29687 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:38.829854 29669 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 18 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:38.855036 29669 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.866842 29724 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:22:38.868286 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:38.868813 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:38.869095 23995 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 14: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:38.869252 29681 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:38.872215 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:38.871919 24524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.017s	sys 0.007s
W20260709 12:22:38.872866 24524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.017s	sys 0.007s
I20260709 12:22:38.873502 23895 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:38.881807 23966 leader_election.cc:400] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 17. Current term is 18.
I20260709 12:22:38.886839 23893 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:38.889642 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:38.876981 29627 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.879879 29672 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:38.898610 23927 raft_consensus.cc:2368] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 17. Current term is 18.
I20260709 12:22:38.900573 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:38.906849 23926 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:38.923509 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:38.935220 23925 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:38.895108 29503 raft_consensus.cc:2749] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:38.886400 29726 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:38.946339 29719 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.947039 29719 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.948926 29654 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:38.949334 29719 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:38.940116 29535 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.950256 29728 consensus_queue.cc:1059] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:38.950938 29535 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.914184 29681 raft_consensus.cc:3055] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:38.885013 29676 consensus_queue.cc:1059] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:22:38.959618 23850 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:38.959704 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:38.953157 29535 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:38.971843 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:38.963601 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:38.964654 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:38.972980 23848 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:38.919688 29672 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.970058 23999 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:38.963752 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:38.973004 23846 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:38.955582 23853 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:38.984704 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:38.992002 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 79107.1us
I20260709 12:22:38.918249 29627 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:38.994400 23853 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:38.994462 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:38.965099 29681 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:38.996656 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:38.968277 29726 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:38.979555 29672 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.007033 29670 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:39.007376 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:39.008786 29725 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:39.009718 29716 consensus_queue.cc:1059] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:39.010881 29716 raft_consensus.cc:3055] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:39.011262 29716 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:39.012132 29716 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.013533 29716 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.000440 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:38.980569 29535 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.007592 29670 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:39.013609 24004 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:39.034057 23846 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:22:39.035573 23923 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:22:39.038303 23853 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:38.949715 29654 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.050284 23818 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:22:39.067215 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 125557us
I20260709 12:22:39.069972 24560 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:39.041869 29724 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:39.084857 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44853.6us
I20260709 12:22:39.047766 29535 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.063195 29364 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:22:39.066329 29725 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:22:39.117244 23921 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:39.081754 29431 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
W20260709 12:22:39.127241 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 45782.1us
I20260709 12:22:39.122830 23924 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:22:39.131675 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 45742.5us
I20260709 12:22:39.119907 29503 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.145198 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:39.148269 23927 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
W20260709 12:22:39.152221 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 61953.9us
I20260709 12:22:39.087456 29724 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.104001 29681 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.158318 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:39.161149 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:39.151575 29503 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.170401 29503 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.159670 29627 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.156829 29654 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.144673 29416 consensus_queue.cc:1059] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:22:39.174435 29681 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:39.175179 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:39.175832 23999 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:39.177019 23893 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:39.153342 23892 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:39.179768 29535 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.119513 29635 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:22:39.180074 29724 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:39.180692 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:39.119801 29726 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.183640 29672 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:39.187934 29677 consensus_meta.cc:287] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.001s
I20260709 12:22:39.156286 29729 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:39.190472 29729 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.190882 29729 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:39.185832 29672 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:39.192600 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 115347us
I20260709 12:22:39.153429 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:39.209964 23924 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:22:39.158223 29733 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:22:39.231043 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 54105.7us
W20260709 12:22:39.231906 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 78700us
I20260709 12:22:39.229533 29627 raft_consensus.cc:3055] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:39.232540 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:39.233213 23999 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.188392 29677 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.232882 29627 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:39.238759 29745 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:39.247131 29627 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.250582 29627 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:39.251686 29670 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.252190 29652 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:39.252647 29652 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:39.254252 29670 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.255075 23892 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:39.257099 29503 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:39.257517 29503 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:39.257937 29503 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:39.258232 29747 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:39.259486 29677 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.260176 23850 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:39.261000 29630 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.272785 23999 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 18.
I20260709 12:22:39.272389 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:39.274471 23893 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:39.275707 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:39.276178 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:39.270553 23922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35558 (request call id 2674) took 1138 ms. Trace:
I20260709 12:22:39.277562 23966 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:39.278162 23892 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:39.290149 23966 leader_election.cc:400] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 17. Current term is 18.
I20260709 12:22:39.290647 23966 leader_election.cc:403] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:22:39.261637 29416 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:39.278163 23922 rpcz_store.cc:276] 0709 12:22:38.132569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.132729 (+   160us) service_pool.cc:224] Handling call
0709 12:22:38.133048 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:38.133284 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.133310 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:38.163925 (+ 30615us) log.cc:844] Serialized 26 byte log entry
0709 12:22:38.435021 (+271096us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:39.269398 (+834377us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b18003565c0. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa286ff44bc 00007fa28434248b 00007fa28d19c9a9 00007fa28435e69b 00007fa28435c93f 00007fa28435c455 00007fa28ae443c7 00007fa2874569a7 00007fa2874660bf
0709 12:22:39.269629 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 12:22:39.269968 (+   339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.270090 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:39.270153 (+    63us) raft_consensus.cc:1685] finished
0709 12:22:39.270269 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:39.270447 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":292860,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":1020,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":3735424,"thread_start_us":262855,"threads_started":2,"wal-append.queue_time_us":371415}
I20260709 12:22:39.249162 29745 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.253451 29652 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.285528 29640 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:39.306838 29702 raft_consensus.cc:3055] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:39.307283 29702 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:39.308383 24000 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:39.308187 29702 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:39.311436 29753 log.cc:927] Time spent T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:22:39.301200 29416 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.313575 29716 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:39.314075 29744 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:39.314211 29416 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.299175 29728 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 17. Current term is 18.
I20260709 12:22:39.288844 29303 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:39.276201 29726 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.316242 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:39.297180 29696 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:39.320477 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:39.322141 23892 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:39.288286 29681 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:39.285763 29724 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:22:39.300056 29745 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.337839 24000 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:39.261705 29630 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.339432 29672 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:39.340478 29630 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.341161 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:39.341780 23846 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:22:39.302537 29364 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 12:22:39.399824 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.320022 29640 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:39.400261 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:39.402420 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:39.336987 29303 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:39.410492 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 88035.3us
I20260709 12:22:39.327582 29729 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.420293 29740 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:39.322073 29726 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.426872 29640 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.428684 29672 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:39.429121 29672 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.429525 29672 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.431591 23817 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:39.432351 29687 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:39.434841 29330 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:39.435128 29673 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:39.436791 29744 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:39.437258 29744 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.429193 29730 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:39.451769 23846 raft_consensus.cc:1240] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:39.453119 23852 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:39.454993 29696 consensus_queue.cc:1059] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:39.456041 29696 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:39.456210 29503 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.456614 29696 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.460456 24000 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:22:39.460963 24000 pending_rounds.cc:85] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 8
I20260709 12:22:39.461254 24000 pending_rounds.cc:107] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:22:39.461535 24000 raft_consensus.cc:2889] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:39.469322 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:39.469450 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:39.469971 24559 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.471114 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:39.473802 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:39.475314 23997 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:39.478812 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:39.480919 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:39.481093 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:39.483839 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:39.484612 23923 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.467008 29681 raft_consensus.cc:3055] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:39.493445 29681 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:39.495344 29696 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:39.495963 29681 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.497364 29681 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:39.499155 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:39.503970 23923 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
W20260709 12:22:39.508405 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.521943 24559 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 18.
W20260709 12:22:39.525544 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 133660us
I20260709 12:22:39.465655 29714 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:22:39.528618 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:39.529688 23926 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:22:39.486379 29668 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.534168 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:39.535015 23852 raft_consensus.cc:2368] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15.
I20260709 12:22:39.536139 23997 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 14: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:39.535789 24001 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:39.539813 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:39.542145 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:39.550954 29729 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.537912 29724 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:22:39.538580 29668 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.554057 29668 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:39.535928 29503 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.535761 29261 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:22:39.564319 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:39.595911 29745 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.607354 23927 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:39.578235 29503 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:39.611858 29503 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.636731 29747 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:39.650138 29747 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.651889 23927 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:22:39.652520 29747 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:39.655061 29360 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:39.655660 29360 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.570469 29716 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:39.657994 29716 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:39.658824 29716 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.637513 23969 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:39.664623 23969 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:39.678750 29716 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.678771 29654 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:39.679600 29654 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:39.683561 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 47833us
I20260709 12:22:39.690430 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:39.681608 29360 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:39.686290 29649 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:39.687726 29728 raft_consensus.cc:2749] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:39.706305 29745 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.687479 29714 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:22:39.710199 29672 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.686364 29630 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:39.719334 29630 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.722003 29630 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:39.703425 29649 consensus_queue.cc:1059] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:39.702670 29503 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:39.717965 29732 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.723533 29654 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.723870 29732 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.726140 29725 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:39.726540 29725 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:39.727319 29725 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.730176 23928 raft_consensus.cc:2368] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 17. Current term is 18.
I20260709 12:22:39.733922 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:39.734596 23928 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 15.
I20260709 12:22:39.743347 29732 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.745987 29676 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:39.746578 29676 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:39.745644 29672 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:39.760722 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.761277 24560 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:39.761559 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 68868.8us
I20260709 12:22:39.763808 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:39.764417 23999 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 10.
I20260709 12:22:39.764786 23966 leader_election.cc:400] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 17. Current term is 18.
I20260709 12:22:39.765261 23966 leader_election.cc:403] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:39.766362 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:39.766633 29676 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:39.755324 29735 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:39.767573 29735 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.770409 29735 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.766489 24563 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:39.775234 24525 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:39.775624 29716 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.776432 29654 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:39.776868 29654 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:39.777209 29654 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:39.778157 29360 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:39.732336 29744 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:39.791803 24560 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:22:39.798753 29772 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:22:38.295147 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:39.829034 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:39.829957 24000 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:39.831137 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:39.831713 24001 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:39.849371 23818 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:39.849753 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:39.850353 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:39.850960 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:39.851339 29738 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:39.852770 29738 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:39.851328 23818 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:39.849392 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:39.856782 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:39.844031 23895 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:39.866523 29747 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:39.868471 29759 log.cc:927] Time spent T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.290s	user 0.001s	sys 0.017s
I20260709 12:22:39.869632 23892 leader_election.cc:400] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15.
I20260709 12:22:39.869213 29686 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:39.869987 23892 leader_election.cc:403] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:22:39.870746 29771 log.cc:927] Time spent T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:39.857439 29684 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:39.871785 29735 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:39.855238 23995 raft_consensus.cc:2376] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 18. Re-sending same reply.
I20260709 12:22:39.875573 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52314 (request call id 2857) took 1005 ms. Trace:
I20260709 12:22:39.875991 23995 rpcz_store.cc:276] 0709 12:22:38.869441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.869747 (+   306us) service_pool.cc:224] Handling call
0709 12:22:39.849240 (+979493us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b58001a2898. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284327b71 00007fa284327a22 00007fa28d2408d9 00007fa28c39aee0 00007fa28c4640ab 00007fa28c464131 00007fa28c4120a0 00007fa28c411984 00007fa28598c6d4 00007fa28598c662
0709 12:22:39.874337 (+ 25097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4981120}
I20260709 12:22:39.877839 29535 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:39.878265 29726 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:39.880623 29725 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.885691 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:39.876329 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:39.908654 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:39.912480 24001 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:39.925767 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:39.926193 23817 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:39.926577 23851 raft_consensus.cc:3060] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.928944 29670 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:39.925709 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:39.931080 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:39.932191 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:39.933444 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:39.934059 23852 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 15.
W20260709 12:22:39.938119 24524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.946048 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:39.946950 24554 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 18.
I20260709 12:22:39.902766 29744 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:39.924224 29667 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:22:39.967092 23969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:39.981549 23895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.013842 23851 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 18.
I20260709 12:22:40.011790 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:40.068859 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:40.074110 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 106442us
I20260709 12:22:40.079147 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:39.959264 29667 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:40.010320 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 95105.9us
I20260709 12:22:40.080744 23851 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:22:40.005398 29670 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:40.025705 29649 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:40.098894 23968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.085490 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:40.101797 29716 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 17. Current term is 18.
I20260709 12:22:40.067137 29654 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:40.103485 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:40.104895 29654 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:40.106074 24559 raft_consensus.cc:1240] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:40.106606 23925 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:22:40.108484 29778 log.cc:927] Time spent T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.065s	user 0.003s	sys 0.000s
I20260709 12:22:40.109314 29702 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:40.110812 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:40.112190 24002 raft_consensus.cc:2410] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:22:40.115914 29670 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:40.120911 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:40.121114 29649 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:40.087383 29776 log.cc:927] Time spent T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
I20260709 12:22:40.128929 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:40.130007 29667 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:40.132548 29775 log.cc:927] Time spent T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:22:40.120744 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:40.100251 24001 raft_consensus.cc:2393] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:40.150519 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:40.174219 23893 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:40.178458 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:40.179924 23893 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:40.186081 29416 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:40.180953 29635 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:40.180888 29649 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:40.196980 29735 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 14. Current term is 15.
I20260709 12:22:40.216835 23995 raft_consensus.cc:2468] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 18.
I20260709 12:22:40.226593 23923 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:40.244674 23892 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:40.245729 29735 raft_consensus.cc:2804] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:40.246335 29735 raft_consensus.cc:697] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:40.247216 29735 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:40.248667 29649 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:22:40.254374 23892 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:40.255602 29635 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:40.259178 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 79333.1us
I20260709 12:22:40.274281 23893 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:40.276309 24526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.279915 29781 log.cc:927] Time spent T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.271s	user 0.003s	sys 0.000s
I20260709 12:22:40.284381 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:40.312387 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.313457 29724 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:40.317047 29724 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.317577 29724 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:40.318548 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44370.6us
I20260709 12:22:40.296093 29667 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:40.315886 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:40.324807 23853 raft_consensus.cc:2393] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 17: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:40.327035 29652 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:40.287549 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:40.292829 29518 consensus_queue.cc:1059] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:40.339102 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:40.403996 24561 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:40.394345 29649 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:40.347101 29635 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:40.436399 23751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59378 (request call id 145) took 10968 ms. Trace:
I20260709 12:22:40.347370 29681 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:40.436920 23895 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:40.445395 29640 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:40.446209 29640 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:22:40.329221 29667 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:40.446768 29640 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:40.437691 23751 rpcz_store.cc:276] 0709 12:22:29.535828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.543340 (+  7512us) service_pool.cc:224] Handling call
0709 12:22:30.300157 (+756817us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54003129d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b6090 00007fa287454f3a 00007fa28d20ae9c 00007fa28d30904e 00007fa28b7ca2a4 00007fa28b7ca232 00007fa28b7ca161 00007fa28b7ca0dc 00007fa28b7c9392 00007fa28578748c 00007fa2857868c6
0709 12:22:40.436320 (+10136163us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:36.567075 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:36.630713 (+ 63638us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:36.630796 (+    83us) write_op.cc:435] Acquired schema lock
0709 12:22:36.630826 (+    30us) tablet.cc:662] Decoding operations
0709 12:22:36.638673 (+  7847us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:36.638782 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:36.638815 (+    33us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:22:36.663811 (+ 24996us) tablet.cc:701] Row locks acquired
0709 12:22:36.663864 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:22:36.664088 (+   224us) write_op.cc:270] Start()
0709 12:22:36.664299 (+   211us) write_op.cc:276] Timestamp: P: 1783599756664005 usec, L: 0
0709 12:22:36.664340 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:22:36.665191 (+   851us) log.cc:844] Serialized 6738 byte log entry
0709 12:22:36.883671 (+218480us) op_driver.cc:464] REPLICATION: finished
0709 12:22:37.187871 (+304200us) write_op.cc:301] APPLY: starting
0709 12:22:37.187996 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:37.711804 (+523808us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:37.711915 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:37.891057 (+179142us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b1800160e40. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa28435f522 00007fa2843617c1 00007fa284361779 00007fa284361709 00007fa2843616d1 00007fa2843609cd 0000000000388634 0000000000388479 00007fa28434283a
0709 12:22:37.898204 (+  7147us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:37.898624 (+   420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 12:22:37.898692 (+    68us) write_op.cc:312] APPLY: finished
0709 12:22:37.899184 (+   492us) log.cc:844] Serialized 156 byte log entry
0709 12:22:38.069312 (+170128us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:38.082741 (+ 13429us) write_op.cc:454] Released schema lock
0709 12:22:38.092550 (+  9809us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:38.133662 (+ 41112us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:38.137118 (+  3456us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2721750,"reported_tablets":24,"spinlock_wait_cycles":67860224,"child_traces":[["op",{"apply.queue_time_us":298454,"apply.run_cpu_time_us":58143,"apply.run_wall_time_us":929635,"cfile_cache_hit":70,"cfile_cache_hit_bytes":74983,"num_ops":17,"prepare.queue_time_us":145904,"prepare.run_cpu_time_us":22361,"prepare.run_wall_time_us":298210,"raft.queue_time_us":78255,"raft.run_cpu_time_us":25419,"raft.run_wall_time_us":161918,"replication_time_us":217058,"spinlock_wait_cycles":19278976,"thread_start_us":577762,"threads_started":5,"wal-append.queue_time_us":320083,"wal-append.run_cpu_time_us":14141,"wal-append.run_wall_time_us":2100728}]]}
I20260709 12:22:40.422730 29684 raft_consensus.cc:3055] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:40.456143 29684 raft_consensus.cc:740] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:40.390657 29724 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:40.471521 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 330950us
I20260709 12:22:40.476331 23893 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:40.477975 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:40.329895 29732 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:40.485481 23923 raft_consensus.cc:1240] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:40.489657 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:40.436116 29649 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:40.455703 29686 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:40.510672 29684 consensus_queue.cc:260] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:40.512344 29684 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:40.456327 29640 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:40.486693 29303 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:40.495489 29734 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:40.516059 29734 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:40.438006 29681 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:40.487221 29732 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:40.524258 29649 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:40.524749 29732 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:40.495759 29535 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.518690 29686 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:40.534809 23926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:40.541805 23926 raft_consensus.cc:606] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:40.538697 24004 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:40.527617 23923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:40.509326 23818 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:40.549719 29535 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:40.555606 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 46401us
I20260709 12:22:40.576004 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:40.520933 29503 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.535980 29681 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:40.537918 29724 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:40.589221 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:40.553676 29535 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:40.608038 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:40.609025 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:40.609826 23892 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:40.587299 29627 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.609230 24004 raft_consensus.cc:2393] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:40.607635 23847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:40.615860 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 118500us
I20260709 12:22:40.619429 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:40.614025 29640 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:40.594892 29792 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:40.590981 29503 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:40.616907 29627 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:40.635757 29303 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.636302 24561 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:40.611789 29763 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:40.633534 29503 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:40.532442 23746 catalog_manager.cc:5697] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:40.662227 29793 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:22:40.657920 23929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:40.680027 23929 raft_consensus.cc:606] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:40.668325 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:40.681299 23920 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:40.617632 29518 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:40.642259 29216 consensus_queue.cc:1059] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:22:40.611758 29747 consensus_queue.cc:1059] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:22:40.684454 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:40.729092 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:40.729751 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 57286.3us
I20260709 12:22:40.693161 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:40.652343 24557 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:40.727823 23998 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 18.
I20260709 12:22:40.729899 24003 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:40.731832 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:40.727252 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 226934us
I20260709 12:22:40.733608 24525 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:40.736871 24524 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:40.735466 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 66992.4us
I20260709 12:22:40.683197 29630 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:40.727229 29767 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:22:40.700850 29792 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:40.726418 29734 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:40.791060 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59352.9us
I20260709 12:22:40.671757 29303 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:40.796960 23925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:40.752123 29686 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:40.799759 23925 raft_consensus.cc:606] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:40.803097 23925 raft_consensus.cc:614] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:40.726884 29518 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:40.801600 29734 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:40.789849 29654 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:40.799827 29631 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:40.801369 29747 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:40.789357 29743 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:22:40.804479 29519 raft_consensus.cc:3055] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:40.847888 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:40.850143 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:40.854355 24563 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:40.852156 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:40.816021 29734 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:40.836211 29631 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.796617 29630 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:40.865731 29734 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:40.871829 29631 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:40.883668 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:40.893708 29627 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:40.900758 29518 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:40.903487 24563 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 19.
I20260709 12:22:40.910401 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:40.912045 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:40.912891 23850 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 10.
I20260709 12:22:40.853753 29519 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:40.934674 23848 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:22:40.937776 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 204229us
I20260709 12:22:40.854668 29747 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:40.975209 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 128810us
W20260709 12:22:40.987504 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 53925.8us
I20260709 12:22:40.988535 23817 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:40.991551 24559 raft_consensus.cc:1240] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 12:22:40.973814 29798 log.cc:927] Time spent T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
I20260709 12:22:40.997635 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:41.014175 23997 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:22:40.999042 29803 log.cc:927] Time spent T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:22:41.019848 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:41.020478 24000 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 11.
I20260709 12:22:41.016364 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d00e1a3cc444623bdf4910b98044d66" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:40.971377 29617 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:41.028119 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:41.029228 23999 raft_consensus.cc:2393] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 11: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:41.037153 29744 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:41.037848 29796 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:41.037197 23893 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:41.041427 29719 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:41.023357 23969 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:40.844055 29792 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.047601 29627 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:22:41.071758 29763 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:41.072374 29763 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:41.056602 29743 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:41.075254 29743 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.074872 29763 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.075791 29743 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:41.058584 29796 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.078230 29796 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:41.047863 29635 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:41.079002 29635 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.079906 29630 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:41.081035 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:41.081509 29635 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.082244 29769 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:41.082424 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:41.088630 29684 consensus_meta.cc:287] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
I20260709 12:22:41.095278 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.096433 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.098021 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.026070 29821 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:41.103832 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:41.105734 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:22:41.106096 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 82835.4us
I20260709 12:22:41.110030 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.052479 29719 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:22:41.108911 23969 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:41.103825 29732 consensus_meta.cc:287] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent flushing consensus metadata: real 0.578s	user 0.005s	sys 0.008s
I20260709 12:22:41.044761 29617 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.110200 29649 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:41.117113 23849 raft_consensus.cc:2468] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:41.057503 29744 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.101030 29804 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:41.132123 29725 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.134521 23818 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:41.114329 29719 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:41.177752 29503 raft_consensus.cc:993] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:41.178329 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:41.111150 29821 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.136708 29734 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.127655 29732 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.172053 29725 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.174638 29617 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.175108 23846 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:41.167922 29649 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:41.178325 29735 raft_consensus.cc:1081] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:41.018563 29519 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.125654 29303 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.126164 29769 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:41.185241 23818 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:41.189409 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.189697 29734 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.183789 29330 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:41.191395 24002 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:22:41.211889 24002 pending_rounds.cc:85] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting all ops after (but not including) 8
I20260709 12:22:41.212195 24002 pending_rounds.cc:107] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:22:41.212528 24002 raft_consensus.cc:2889] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:41.212877 24562 raft_consensus.cc:1240] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:41.195096 29649 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.198480 29747 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.205636 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:41.208226 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.191265 29672 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:22:41.179986 29749 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:41.220005 23850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:22:41.220669 23850 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:22:41.214663 29421 consensus_queue.cc:1175] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" responder_term: 15 status { last_received { term: 15 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 15 index: 11 } }
I20260709 12:22:41.221021 23850 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.221895 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.222255 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:41.224634 23852 raft_consensus.cc:2393] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
I20260709 12:22:41.189440 29821 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:41.226126 29652 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:41.232115 29652 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.227651 29744 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.193766 23746 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.234005 23850 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:41.234299 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 49159us
I20260709 12:22:41.224921 23845 raft_consensus.cc:2368] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13.
I20260709 12:22:41.218066 29769 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:41.234341 29799 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:41.223176 29519 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:41.241034 29649 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:41.243227 29732 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.244377 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:41.236637 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:41.245956 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:41.246732 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:41.237773 29769 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.244751 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.255532 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.258530 23850 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.260577 24001 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:22:41.237259 29640 raft_consensus.cc:993] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:41.266803 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:41.267604 23999 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 13: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:22:41.266814 29640 raft_consensus.cc:1081] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:41.275110 29696 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.275672 29696 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:41.276010 23739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8630b76482c543a2a08e289b32b13ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 35a9a1f8b1d847fb8f2063ced2a3c26d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:41.206154 29631 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.277979 23925 raft_consensus.cc:1240] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:22:41.278687 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:41.279492 23927 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:41.234340 23746 catalog_manager.cc:5697] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 9 to 12, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:41.265676 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:41.262055 23892 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:41.288516 23998 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:41.293998 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.298854 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:41.300269 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:41.305646 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:41.308360 29743 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.302951 29734 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:41.308921 29631 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.311079 29805 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:41.312963 23926 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:22:41.261976 29726 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.277827 29696 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:41.319325 23850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:22:41.319957 23850 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:41.320289 23850 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.321594 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:41.322227 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:41.304948 29640 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:41.323757 29640 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.324018 29763 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:41.324189 29640 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.324331 23998 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:41.341316 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:41.341917 23921 raft_consensus.cc:3055] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:41.342206 23921 raft_consensus.cc:740] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:41.343636 23850 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.342779 23921 consensus_queue.cc:260] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.346056 23850 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.347913 29743 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.295194 29792 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:22:41.333737 29726 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.375401 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:41.382402 23997 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.378461 29640 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.387380 29726 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:41.392509 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:41.398134 24000 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:41.398787 29640 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.400437 23927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:41.400960 24562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36558 (request call id 1002) took 1041 ms. Trace:
I20260709 12:22:41.400998 23927 raft_consensus.cc:606] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:41.406260 23927 raft_consensus.cc:614] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:41.406435 23892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.406566 29652 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:41.411430 23818 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:41.412328 29749 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:41.412881 29749 raft_consensus.cc:697] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:41.413797 29749 consensus_queue.cc:237] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.415529 23846 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:41.415638 23921 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.417248 29743 consensus_queue.cc:1059] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:41.417697 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.415529 29719 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.419678 29743 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:41.420101 29743 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:41.422017 23848 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:41.427369 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet e24af680f7e54ded89a0d5eff1320c6c: Illegal state: Replica e8bc734d763e4ddf87f7b930e35cbaa7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:41.401343 24562 rpcz_store.cc:276] 0709 12:22:40.359655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.359794 (+   139us) service_pool.cc:224] Handling call
0709 12:22:40.391302 (+ 31508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.213448 (+822146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.400731 (+187283us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54005f0d54. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b5571 00007fa28744ce01 00007fa28744b83e 00007fa28c410419 00007fa285987bd4 00007fa285987b62 00007fa285987a91 00007fa285987a0c 00007fa285986cc2 00007fa28578748c 00007fa2857868c6
0709 12:22:41.400903 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888816512}
I20260709 12:22:41.396795 23893 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:41.395690 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:41.396078 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:41.435158 23893 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:41.396800 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:41.435906 24004 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:41.436693 29631 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:41.439129 23893 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:41.393800 23998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:41.439930 23998 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:41.442929 24525 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:22:41.443571 24004 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:41.420943 29719 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.444725 29732 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:41.445292 29732 raft_consensus.cc:697] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:41.420931 29743 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.435027 29652 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:41.436636 29674 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:41.452602 29674 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.456422 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:41.457216 23926 raft_consensus.cc:2393] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 14: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:41.457356 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:41.457978 23929 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:41.455374 29674 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.453222 23921 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 10.
I20260709 12:22:41.459882 29725 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:41.455693 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:41.463328 23995 raft_consensus.cc:2368] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12.
I20260709 12:22:41.463147 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:41.465193 29716 consensus_queue.cc:1059] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:41.468743 29726 raft_consensus.cc:3055] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:41.469550 29726 raft_consensus.cc:740] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:41.470296 29732 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.467190 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:41.472259 24562 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:41.472892 29743 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.463982 24001 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:41.476723 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:41.478055 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:41.478817 23928 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:41.480567 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.481251 23849 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:41.481184 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.485404 23845 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:41.492581 23848 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:41.493980 23818 leader_election.cc:400] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12.
I20260709 12:22:41.493906 23969 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:41.494616 23818 leader_election.cc:403] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:22:41.495651 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 56610.2us
I20260709 12:22:41.501950 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:41.502784 23850 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.502698 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:41.532955 23892 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:41.535471 23895 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:41.541429 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44940.1us
I20260709 12:22:41.544611 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:41.547987 23850 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:41.542212 23893 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:41.552811 23817 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:41.554158 29607 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:41.554661 29607 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:41.555100 29607 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:41.555207 29416 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:41.521332 29725 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:41.514276 29631 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:41.474897 29726 consensus_queue.cc:260] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.566342 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:41.567070 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:41.527287 29716 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:41.526597 29535 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12.
I20260709 12:22:41.537333 29649 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:41.553778 29799 raft_consensus.cc:2764] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:22:41.562753 29735 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:41.570247 29824 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:41.595685 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:41.570451 29631 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:41.570765 29416 raft_consensus.cc:697] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:41.575835 29716 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.578311 29750 consensus_queue.cc:1059] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:22:41.578958 29649 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.596765 29763 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.586277 29696 raft_consensus.cc:493] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:41.572139 29493 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:22:41.619517 23895 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:41.617365 29763 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:41.628233 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 86104.9us
I20260709 12:22:41.628885 23895 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:41.629101 23893 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:41.596879 29725 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.602404 29631 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:41.601540 29735 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:41.610270 29716 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.618352 29726 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:41.618549 29649 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.631963 29672 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:41.633447 29652 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:41.650231 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:41.655892 23996 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.636500 29635 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:41.629940 29696 raft_consensus.cc:515] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.635728 29725 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.656002 29416 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.680459 29607 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.682888 29607 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.683317 29696 leader_election.cc:290] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:41.684490 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:41.695246 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:41.713086 29763 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.713079 24563 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:41.696086 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:41.697340 24524 leader_election.cc:400] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13.
I20260709 12:22:41.715488 24524 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:41.716682 29805 raft_consensus.cc:2804] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:41.716872 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:41.717213 29805 raft_consensus.cc:697] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:41.698060 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:41.719136 23921 raft_consensus.cc:2393] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:41.719168 23892 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:41.720146 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.721621 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:41.722625 23921 raft_consensus.cc:606] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:41.723148 23921 raft_consensus.cc:614] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:41.723479 23997 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:41.724203 24001 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:41.725348 23996 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:41.725682 23818 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:41.701220 29749 raft_consensus.cc:3055] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:22:41.702791 29829 log.cc:927] Time spent T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:22:41.702651 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:41.710068 29735 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.728363 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:41.737334 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:41.742409 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:41.745718 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:41.746884 23925 raft_consensus.cc:2393] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 12: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:41.754727 24004 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 12.
I20260709 12:22:41.727248 29824 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:41.761543 23818 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:41.729357 29749 raft_consensus.cc:740] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:41.759778 29330 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:41.790333 29725 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:41.796945 29716 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.799455 29730 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:41.802009 29749 consensus_queue.cc:260] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.735144 29805 consensus_queue.cc:237] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:41.827901 29730 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:41.844197 23928 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 14.
I20260709 12:22:41.828692 29749 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:41.862728 29696 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:41.881407 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.895112 29631 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.897511 29631 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.893708 29730 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.884215 29696 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.910291 29631 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.911039 29631 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.911943 29649 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:41.913079 29631 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:41.910360 29696 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:41.922313 29649 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:41.929419 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet 5a4c451e990244d7a5701e875fa03f62: Illegal state: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:41.907480 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 171418us
I20260709 12:22:41.918009 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:41.930576 24004 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:41.918949 29716 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:41.915650 24003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:41.932319 24003 raft_consensus.cc:2368] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14.
I20260709 12:22:41.933971 23892 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:41.875801 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:41.942102 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:41.942795 24563 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:41.935225 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 173766us
I20260709 12:22:41.946637 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:41.947383 23848 raft_consensus.cc:2393] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:41.948347 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 76771.9us
I20260709 12:22:41.952539 23997 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:41.963312 23921 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:41.967085 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
W20260709 12:22:41.979730 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44700.8us
I20260709 12:22:41.980254 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a79eabff38b4edebe70e32ff0d72afc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.981050 23848 raft_consensus.cc:2393] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 11: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:41.981171 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.981948 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:41.986207 23966 leader_election.cc:304] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:41.987462 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:41.988106 23852 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.980512 23893 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:41.978746 29330 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:41.995434 24563 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:41.944504 29716 raft_consensus.cc:2764] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:22:41.944963 29416 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:42.004237 29493 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:41.996099 29725 raft_consensus.cc:3060] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:42.020551 23893 leader_election.cc:400] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14.
I20260709 12:22:42.020964 23893 leader_election.cc:403] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:22:42.023085 29763 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:42.023231 29845 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:42.023523 29763 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.024012 29763 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:42.029259 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:42.039583 23927 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 12:22:42.040042 23927 pending_rounds.cc:85] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 12
I20260709 12:22:42.040328 23927 pending_rounds.cc:107] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:22:42.040612 23927 raft_consensus.cc:2889] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:42.041865 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:42.044325 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:42.043113 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:42.050144 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:42.053344 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:42.074230 29810 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.073849 29330 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.074802 29810 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.077143 29810 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:42.080787 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:42.081758 23850 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:42.037415 29607 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:22:42.083374 23892 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:42.058734 29726 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:42.060125 29649 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:42.057664 29824 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:42.115285 29824 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.099345 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:42.100812 23969 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:42.102218 24563 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:22:42.125233 29836 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:42.125934 29836 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:42.127058 29836 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:42.100430 29735 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:42.139205 29735 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.139578 29735 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:42.070716 29838 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:22:42.161823 23852 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:42.167014 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:42.176324 23848 raft_consensus.cc:1240] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Rejecting Update request from peer 35a9a1f8b1d847fb8f2063ced2a3c26d for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:42.180915 29849 consensus_queue.cc:1059] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:42.182199 29849 raft_consensus.cc:3055] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:42.182621 29849 raft_consensus.cc:740] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:42.183723 29849 consensus_queue.cc:260] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:42.188308 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 88007.1us
I20260709 12:22:42.236284 29763 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.170756 29769 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:42.237952 23923 raft_consensus.cc:1240] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:42.238451 29769 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.241302 29769 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:42.327312 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 76089.9us
I20260709 12:22:42.174576 29716 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.144s
I20260709 12:22:42.354614 29725 raft_consensus.cc:2749] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:42.356057 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 105130us
I20260709 12:22:42.357057 29789 consensus_queue.cc:1059] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:42.359643 29789 raft_consensus.cc:3055] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:42.361632 29763 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:42.365181 29845 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14.
W20260709 12:22:42.375828 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 202254us
I20260709 12:22:42.360025 29789 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:42.374531 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:42.351401 29416 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.383149 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:42.384773 23848 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:22:42.383559 23995 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:42.318818 29769 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:42.401350 23848 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:42.404563 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:42.380062 29735 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.391528 29416 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.429283 29416 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:42.433964 29735 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:42.434967 23924 raft_consensus.cc:2368] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 16. Current term is 17.
I20260709 12:22:42.408607 29789 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.439924 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:42.439862 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:42.441155 23848 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:42.444238 23966 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:42.446707 29696 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:42.447114 29696 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:42.447484 29696 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:42.449363 23848 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:22:42.450122 29848 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:42.451393 23996 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:42.456507 23996 raft_consensus.cc:1275] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:42.461201 29732 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:42.468650 29849 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:42.481566 29856 log.cc:927] Time spent T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.287s	user 0.003s	sys 0.000s
I20260709 12:22:42.502640 23850 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:42.503114 29789 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:42.499473 29696 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.510247 23892 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:42.511037 29735 raft_consensus.cc:2804] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:42.511543 29735 raft_consensus.cc:697] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:42.512247 29696 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:42.512365 29735 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.521329 29769 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:42.522682 29769 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.530452 23920 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:22:42.532707 23997 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:42.536525 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:42.521713 23966 leader_election.cc:400] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 16. Current term is 17.
W20260709 12:22:42.548350 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 216600us
I20260709 12:22:42.549660 23995 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:42.550247 24559 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:42.570065 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:42.571290 23997 raft_consensus.cc:2410] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:22:42.578174 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:42.579213 23851 raft_consensus.cc:2368] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 16. Current term is 17.
I20260709 12:22:42.580134 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:42.587631 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9308162d63f49c4aa8dfccb14c1cf8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:42.589314 23997 raft_consensus.cc:3060] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:42.592005 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 56829.2us
I20260709 12:22:42.565392 29850 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:22:42.630944 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.631750 23966 leader_election.cc:400] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 16. Current term is 17.
I20260709 12:22:42.632082 23966 leader_election.cc:403] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:22:42.634909 23893 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:42.589574 29792 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:22:42.643567 23997 raft_consensus.cc:2468] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:22:42.627415 29793 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:42.616974 29631 consensus_queue.cc:1059] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 12:22:42.663844 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 262090us
I20260709 12:22:42.626619 29843 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:22:42.665249 24002 raft_consensus.cc:1240] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:42.649794 29696 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 22996f888daf435398b693481171c18c (127.22.43.65:34895) with higher term. Message: Invalid argument: T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 16. Current term is 17.
I20260709 12:22:42.681706 23995 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:42.675310 29871 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:42.683892 29631 raft_consensus.cc:3055] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:42.684280 29631 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:42.685227 29631 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:42.694288 29631 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:42.677965 29732 consensus_queue.cc:1048] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 12:22:42.697412 29867 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:22:42.625449 29850 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:42.678817 29870 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.709309 29870 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:42.663991 29793 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:42.715848 29793 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:42.725144 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:42.726002 24557 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c in current term 16: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:42.712582 29870 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:42.762806 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:42.758365 24002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:42.764036 24002 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:42.759910 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:42.763484 23854 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:42.808938 29838 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:42.809077 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:42.810061 23922 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:42.810688 23925 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:22:42.811029 23925 pending_rounds.cc:85] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting all ops after (but not including) 10
I20260709 12:22:42.811256 23925 pending_rounds.cc:107] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:22:42.811474 23925 raft_consensus.cc:2889] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:42.809813 29838 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:42.814177 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:42.719355 29850 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:42.818514 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:42.819139 24562 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
W20260709 12:22:42.820766 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet d78d41f27ddd4a3fa2fe292b189ba372: Illegal state: Replica 604755d84b7e4ff8a2b75453dccb6f1b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:42.815874 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 144916us
W20260709 12:22:42.823614 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 96266.5us
I20260709 12:22:42.827203 23925 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:22:42.821087 29853 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:22:42.845685 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:42.847739 23922 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
W20260709 12:22:42.846294 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 78213.5us
I20260709 12:22:42.818087 29836 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:42.850426 23925 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:42.848589 23893 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:42.857518 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:42.858232 24562 raft_consensus.cc:2393] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 16: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:22:42.851226 29836 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.864415 29836 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:42.846786 29843 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:22:42.818251 29726 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:22:42.855561 29866 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.868512 29866 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:42.871016 29866 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:42.873988 29881 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:22:42.877008 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:42.877492 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:42.878069 23845 raft_consensus.cc:2393] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 13: Already voted for candidate 22996f888daf435398b693481171c18c in this term.
W20260709 12:22:42.878705 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet d78ef4be778a4d7fa19baf9815bd1d96: Illegal state: Replica 604755d84b7e4ff8a2b75453dccb6f1b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:42.879482 24559 raft_consensus.cc:2410] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:22:42.885875 23966 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:42.896566 29838 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:42.904747 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:42.905627 23922 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 19: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:42.908643 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:42.910585 23895 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:42.911653 29838 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:42.912277 29850 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:42.887290 29810 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:42.925288 29882 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:22:42.892906 29749 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:22:42.936163 29850 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:42.916781 23845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:42.956377 23845 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 19.
I20260709 12:22:42.969750 24562 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:42.986616 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:43.003861 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 102151us
W20260709 12:22:43.005100 29888 log.cc:927] Time spent T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:22:43.005647 23849 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:22:43.011932 29686 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:43.016253 29836 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:43.017794 24001 raft_consensus.cc:2368] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17.
I20260709 12:22:43.023902 23817 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:43.026823 29749 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:43.027410 29749 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:43.027906 29749 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:43.003211 29864 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:43.070974 23893 leader_election.cc:400] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 16. Current term is 17.
I20260709 12:22:42.996469 29870 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:22:43.027426 29847 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:22:43.042325 29631 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:22:43.071712 29864 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:22:43.118396 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 71671.1us
I20260709 12:22:43.101487 29864 raft_consensus.cc:3060] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:43.135394 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:43.194428 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:43.195127 24562 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:43.210018 24562 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:22:43.211393 29838 raft_consensus.cc:2749] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:43.212494 29836 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:22:43.242427 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 105669us
I20260709 12:22:43.245554 23852 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:43.247324 29836 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:22:43.263681 29749 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:43.264941 23849 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:43.273777 29749 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:43.281203 23849 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:22:43.287082 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
W20260709 12:22:43.287278 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 152611us
I20260709 12:22:43.287834 23997 raft_consensus.cc:2368] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 16. Current term is 17.
I20260709 12:22:43.289486 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:43.290089 23925 raft_consensus.cc:3060] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:43.329121 23995 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:22:43.331110 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 82403us
W20260709 12:22:43.333746 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 44235.5us
I20260709 12:22:43.334528 23818 leader_election.cc:400] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 16. Current term is 17.
I20260709 12:22:43.334820 23818 leader_election.cc:403] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:22:43.336483 29518 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331) with higher term. Message: Invalid argument: T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 16. Current term is 17.
I20260709 12:22:43.336045 29864 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:43.337653 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:43.340291 29864 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:43.340909 24557 raft_consensus.cc:2368] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 16. Current term is 17.
I20260709 12:22:43.343818 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:43.360605 23851 raft_consensus.cc:2468] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 19.
I20260709 12:22:43.367455 23925 raft_consensus.cc:2468] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:22:43.363240 29747 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:22:43.365196 23966 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:43.388674 23820 leader_election.cc:400] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Vote denied by peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439) with higher term. Message: Invalid argument: T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 16. Current term is 17.
I20260709 12:22:43.404348 23921 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:43.409293 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8630b76482c543a2a08e289b32b13ab6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:43.410398 23929 raft_consensus.cc:2368] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 16. Current term is 17.
I20260709 12:22:43.401895 23966 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:43.411180 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:43.411942 23928 raft_consensus.cc:2393] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 19: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:43.412873 29838 raft_consensus.cc:2804] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:43.334998 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:43.444492 23751 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.446153 23751 catalog_manager.cc:5697] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 14 to 15, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 15 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.447712 23751 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 14 to 15, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 15 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.448989 23751 catalog_manager.cc:5697] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 10 to 11, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 11 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.432744 29863 raft_consensus.cc:2804] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:43.450569 29838 raft_consensus.cc:697] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:43.433033 29649 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:22:43.475684 29838 consensus_queue.cc:237] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:43.458702 29863 raft_consensus.cc:697] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:43.480376 29863 consensus_queue.cc:237] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:43.551383 23995 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:22:43.557189 23751 catalog_manager.cc:5697] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 9 to 16, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.558809 23751 catalog_manager.cc:5697] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.560047 23751 catalog_manager.cc:5697] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.562318 29640 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:43.561249 23751 catalog_manager.cc:5697] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.575450 23817 leader_election.cc:400] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Vote denied by peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453) with higher term. Message: Invalid argument: T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 22996f888daf435398b693481171c18c for earlier term 16. Current term is 17.
I20260709 12:22:43.581230 23927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:43.582195 23927 raft_consensus.cc:606] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:43.582619 23927 raft_consensus.cc:614] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:43.585866 23927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:43.586652 23927 raft_consensus.cc:606] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:43.592182 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:43.592823 23920 raft_consensus.cc:606] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:43.593175 23920 raft_consensus.cc:614] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:43.596105 23927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:43.596910 23927 raft_consensus.cc:606] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:43.601212 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:43.601841 23920 raft_consensus.cc:606] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:43.602320 23920 raft_consensus.cc:614] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:43.604183 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:43.609786 29849 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.610467 29849 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:43.618121 29849 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:43.619238 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:43.623924 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:43.624797 23851 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:43.625948 24524 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:43.633165 29849 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:43.633582 29849 raft_consensus.cc:493] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.633963 29849 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:43.633773 23751 catalog_manager.cc:5697] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 12 to 18, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 18 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.635344 23751 catalog_manager.cc:5697] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.636547 23751 catalog_manager.cc:5697] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 11 to 13, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 13 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.637976 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:43.638798 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:43.642688 23751 catalog_manager.cc:5697] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 18 to 19, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 19 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.622848 23995 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:43.666765 29676 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.667326 29676 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:43.670742 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:43.671065 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:43.672057 23850 raft_consensus.cc:2410] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:22:43.673357 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:43.674422 29885 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:43.669711 29676 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:43.680199 29849 raft_consensus.cc:515] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:43.694465 23751 catalog_manager.cc:5697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.696105 23751 catalog_manager.cc:5697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 9 to 10, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 10 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.697572 23751 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 10 to 13, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 13 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.712581 23751 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.713785 23751 catalog_manager.cc:5697] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 9 to 10, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 10 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.715298 23751 catalog_manager.cc:5697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 12 to 15, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:43.727180 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:43.727389 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d811dc320452d8daaca5fda5cd52a" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:43.727905 23850 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:43.728157 23995 raft_consensus.cc:3060] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:43.735893 23850 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:43.736135 23995 raft_consensus.cc:2468] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:43.736896 24524 leader_election.cc:304] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:43.727783 29849 leader_election.cc:290] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:22:43.734717 23746 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43184 (request call id 226) took 46457 ms (client timeout 15000 ms). Trace:
I20260709 12:22:43.737865 29858 raft_consensus.cc:2804] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:43.746196 29858 raft_consensus.cc:697] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:43.747273 29858 consensus_queue.cc:237] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:43.743292 23746 rpcz_store.cc:269] 0709 12:21:57.276789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.277071 (+   282us) service_pool.cc:224] Handling call
0709 12:22:43.733674 (+46456603us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:41.727560 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:41.797041 (+ 69481us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:41.797083 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:22:41.797102 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:41.797649 (+   547us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:41.797702 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:41.797743 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:22:41.798077 (+   334us) tablet.cc:701] Row locks acquired
0709 12:22:41.798096 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:22:41.798228 (+   132us) write_op.cc:270] Start()
0709 12:22:41.798328 (+   100us) write_op.cc:276] Timestamp: P: 1783599761798184 usec, L: 0
0709 12:22:41.798348 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:22:41.798966 (+   618us) log.cc:844] Serialized 1308 byte log entry
0709 12:22:42.411758 (+612792us) op_driver.cc:464] REPLICATION: finished
0709 12:22:42.740786 (+329028us) write_op.cc:301] APPLY: starting
0709 12:22:42.740919 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:42.750577 (+  9658us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:42.750720 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:42.752927 (+  2207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:42.753201 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:22:42.753242 (+    41us) write_op.cc:312] APPLY: finished
0709 12:22:42.753474 (+   232us) log.cc:844] Serialized 41 byte log entry
0709 12:22:42.814149 (+ 60675us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:42.817694 (+  3545us) write_op.cc:454] Released schema lock
0709 12:22:42.820200 (+  2506us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:42.873449 (+ 53249us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:42.873505 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3740627,"reported_tablets":51,"spinlock_wait_cycles":9472,"child_traces":[["op",{"apply.queue_time_us":328741,"apply.run_cpu_time_us":7296,"apply.run_wall_time_us":113604,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16631,"num_ops":3,"prepare.queue_time_us":260328,"prepare.run_cpu_time_us":30180,"prepare.run_wall_time_us":392093,"raft.queue_time_us":305184,"raft.run_cpu_time_us":17976,"raft.run_wall_time_us":240383,"replication_time_us":613233,"thread_start_us":946152,"threads_started":4,"wal-append.queue_time_us":257254}]]}
I20260709 12:22:43.790216 29676 raft_consensus.cc:993] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:43.795828 29676 raft_consensus.cc:1081] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:43.798487 24561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36552
I20260709 12:22:43.799388 24561 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.799786 24561 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:43.815995 24561 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:43.822645 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:43.823366 23922 raft_consensus.cc:3055] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:43.823750 23922 raft_consensus.cc:740] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:43.824692 23922 consensus_queue.cc:260] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:43.826603 23922 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:43.838903 24561 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:43.842367 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:43.843230 23995 raft_consensus.cc:3060] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:43.856348 23922 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 17.
I20260709 12:22:43.857753 24524 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:43.859843 23995 raft_consensus.cc:2468] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 17.
I20260709 12:22:43.860033 29858 raft_consensus.cc:2804] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:43.860564 29858 raft_consensus.cc:697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:43.866452 29858 consensus_queue.cc:237] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:43.870357 29863 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:43.873871 29863 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:43.875994 29863 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:43.877507 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:22:43.878226 23850 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:22:43.880686 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:43.882788 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:43.883620 23927 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 16: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:22:43.887360 29863 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:43.892155 29863 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:22:43.898612 29863 raft_consensus.cc:3060] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:43.917243 29863 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:43.926187 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:43.937846 23850 raft_consensus.cc:2468] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:22:43.939298 23966 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:43.939881 29863 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:43.944164 29863 raft_consensus.cc:2804] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:43.944787 29863 raft_consensus.cc:697] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:43.945770 29863 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:43.947093 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:43.947945 23927 raft_consensus.cc:2393] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 16: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
W20260709 12:22:44.013180 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 70031.2us
I20260709 12:22:44.014726 23927 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:22:44.020036 29838 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:22:44.054412 29871 raft_consensus.cc:993] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:44.054986 29871 raft_consensus.cc:1081] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:44.061848 23850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:22:44.062776 23850 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:44.063627 23850 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.099639 23924 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:22:44.108111 24561 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:22:44.103402 23850 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:44.111200 23851 raft_consensus.cc:1275] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:22:44.117446 23852 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:22:44.121608 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:44.122689 23924 raft_consensus.cc:3055] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:44.123078 23924 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:44.127822 23924 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:44.118999 29838 consensus_queue.cc:1048] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:22:44.135634 23850 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:44.137059 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:44.137554 24561 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.105116 29864 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:22:44.143373 23924 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.144616 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:44.145179 23999 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.158548 24561 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:44.163781 23850 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:44.171566 23999 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:44.172338 24002 raft_consensus.cc:1240] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:44.174726 23818 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:44.160955 29863 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:22:44.176524 29789 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:44.177134 29789 raft_consensus.cc:697] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:44.178031 29836 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:44.178241 29789 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:44.183954 23999 raft_consensus.cc:1275] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:44.186980 23924 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 11.
I20260709 12:22:44.211575 29927 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:44.256268 29927 consensus_queue.cc:1048] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:44.340889 23751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59378 (request call id 146) took 2919 ms. Trace:
I20260709 12:22:44.341506 23751 rpcz_store.cc:276] 0709 12:22:41.416108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.416274 (+   166us) service_pool.cc:224] Handling call
0709 12:22:44.335017 (+2918743us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:43.786902 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:43.787522 (+   620us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:43.787564 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:22:43.787584 (+    20us) tablet.cc:662] Decoding operations
0709 12:22:43.799460 (+ 11876us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:43.799821 (+   361us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:43.800885 (+  1064us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:22:43.818871 (+ 17986us) tablet.cc:701] Row locks acquired
0709 12:22:43.818887 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:22:43.819050 (+   163us) write_op.cc:270] Start()
0709 12:22:43.819166 (+   116us) write_op.cc:276] Timestamp: P: 1783599763819005 usec, L: 0
0709 12:22:43.819185 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:22:43.819801 (+   616us) log.cc:844] Serialized 6994 byte log entry
0709 12:22:43.887616 (+ 67815us) op_driver.cc:464] REPLICATION: finished
0709 12:22:43.914053 (+ 26437us) write_op.cc:301] APPLY: starting
0709 12:22:43.914138 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:43.960934 (+ 46796us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:43.961074 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:44.201240 (+240166us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:44.201549 (+   309us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0709 12:22:44.201594 (+    45us) write_op.cc:312] APPLY: finished
0709 12:22:44.202026 (+   432us) log.cc:844] Serialized 164 byte log entry
0709 12:22:44.202226 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:44.202415 (+   189us) write_op.cc:454] Released schema lock
0709 12:22:44.202474 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:44.202921 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:44.202973 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":237637,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":26144,"apply.run_cpu_time_us":27084,"apply.run_wall_time_us":288836,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79151,"num_ops":18,"prepare.queue_time_us":32781,"prepare.run_cpu_time_us":5704,"prepare.run_wall_time_us":33254,"replication_time_us":68271,"spinlock_wait_cycles":47488,"thread_start_us":52519,"threads_started":2}]]}
W20260709 12:22:44.390847 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet 05a83cc012d5420494cfd8c624a09767: Illegal state: Replica e8bc734d763e4ddf87f7b930e35cbaa7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:44.414322 23851 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:22:44.419399 29935 log.cc:927] Time spent T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:22:44.425205 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49671.8us
W20260709 12:22:44.427467 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 50376.3us
I20260709 12:22:44.474339 23747 catalog_manager.cc:5697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:44.476511 23747 catalog_manager.cc:5697] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:44.490825 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 56182.9us
I20260709 12:22:44.508960 23747 catalog_manager.cc:5697] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 11 to 13, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 13 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:44.515461 23926 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:22:44.519436 23747 catalog_manager.cc:5697] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:44.532279 23747 catalog_manager.cc:5697] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 5 to 14, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:44.508785 29864 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:22:44.525873 29858 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:22:44.552004 23747 catalog_manager.cc:5697] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:44.570724 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 62836.1us
I20260709 12:22:44.575259 23747 catalog_manager.cc:5697] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:44.579388 24002 raft_consensus.cc:1275] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:22:44.579828 23927 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:44.590786 23747 catalog_manager.cc:5697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:44.607164 23747 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:44.616670 23747 catalog_manager.cc:5697] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 7 to 12, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:44.629274 24561 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:44.629539 23747 catalog_manager.cc:5697] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:44.634588 29909 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:44.634176 23747 catalog_manager.cc:5697] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 9 to 18, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 18 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:44.644233 23747 catalog_manager.cc:5697] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:44.651793 29946 consensus_queue.cc:1048] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:22:44.667209 29838 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 12:22:44.690747 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 160114us
W20260709 12:22:44.697175 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet 5a4c451e990244d7a5701e875fa03f62: Illegal state: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:44.726233 23747 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:44.729189 23747 catalog_manager.cc:5697] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 8 to 9, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 9 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:44.744247 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:44.762086 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet 7b845c11f69f485889b01a0a648dc3bc: Illegal state: Replica e8bc734d763e4ddf87f7b930e35cbaa7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:44.798959 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 48041.2us
I20260709 12:22:44.821870 23999 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:44.835328 23924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:44.835945 23924 raft_consensus.cc:606] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:44.836280 23924 raft_consensus.cc:614] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:44.839111 23924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:44.839681 23924 raft_consensus.cc:606] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:44.839999 23924 raft_consensus.cc:614] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:44.862044 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 53638.5us
I20260709 12:22:44.868162 29963 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:44.869407 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:44.870186 23852 raft_consensus.cc:606] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 21 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:44.870554 23852 raft_consensus.cc:614] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:44.873457 23924 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:22:44.920571 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet a9308162d63f49c4aa8dfccb14c1cf8a: Illegal state: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:44.952425 29719 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:44.959010 23851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:44.959646 23851 raft_consensus.cc:606] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 19 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:44.978652 23851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:44.979279 23851 raft_consensus.cc:606] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:44.980827 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:44.982625 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:44.983479 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:45.144982 23751 catalog_manager.cc:5697] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 16 to 17, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 17 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.147528 23751 catalog_manager.cc:5697] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.149446 23751 catalog_manager.cc:5697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 11 to 19. New cstate: current_term: 19 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:45.151000 23751 catalog_manager.cc:5697] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 6 to 14, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 14 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:45.152695 23751 catalog_manager.cc:5697] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 12 to 17, leader changed from 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 17 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:45.162195 23751 catalog_manager.cc:5697] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 10 to 11, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 11 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:45.195581 23747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43184 (request call id 227) took 23789 ms (client timeout 15000 ms). Trace:
W20260709 12:22:45.195989 23747 rpcz_store.cc:269] 0709 12:22:21.406321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.410029 (+  3708us) service_pool.cc:224] Handling call
0709 12:22:45.195513 (+23785484us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:44.851134 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:44.851743 (+   609us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:44.852060 (+   317us) write_op.cc:435] Acquired schema lock
0709 12:22:44.852084 (+    24us) tablet.cc:662] Decoding operations
0709 12:22:44.853455 (+  1371us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:44.853537 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:44.853579 (+    42us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:22:44.854824 (+  1245us) tablet.cc:701] Row locks acquired
0709 12:22:44.854845 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:22:44.854993 (+   148us) write_op.cc:270] Start()
0709 12:22:44.855107 (+   114us) write_op.cc:276] Timestamp: P: 1783599764854944 usec, L: 0
0709 12:22:44.855127 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:22:44.855821 (+   694us) log.cc:844] Serialized 5925 byte log entry
0709 12:22:44.894986 (+ 39165us) op_driver.cc:464] REPLICATION: finished
0709 12:22:44.971239 (+ 76253us) write_op.cc:301] APPLY: starting
0709 12:22:44.971335 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:45.028067 (+ 56732us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:45.028186 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:45.066630 (+ 38444us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:45.066947 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:22:45.067003 (+    56us) write_op.cc:312] APPLY: finished
0709 12:22:45.067384 (+   381us) log.cc:844] Serialized 139 byte log entry
0709 12:22:45.088052 (+ 20668us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:45.088435 (+   383us) write_op.cc:454] Released schema lock
0709 12:22:45.088495 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:45.088934 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:45.088967 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18398,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":75976,"apply.run_cpu_time_us":20635,"apply.run_wall_time_us":117672,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66647,"num_ops":15,"prepare.queue_time_us":64730,"prepare.run_cpu_time_us":4680,"prepare.run_wall_time_us":7306,"replication_time_us":39686,"thread_start_us":138175,"threads_started":2}]]}
I20260709 12:22:45.298616 29962 raft_consensus.cc:993] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:45.299957 29962 raft_consensus.cc:1081] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:45.301853 24561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36570
I20260709 12:22:45.302660 24561 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:45.303143 24561 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:45.338315 24561 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:45.344110 24561 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:45.344867 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:45.345492 23851 raft_consensus.cc:3055] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:45.345798 23851 raft_consensus.cc:740] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:45.347548 23748 catalog_manager.cc:5697] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.351899 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:45.352506 23928 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:45.346572 23851 consensus_queue.cc:260] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:45.355983 23851 raft_consensus.cc:3060] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:45.353205 23748 catalog_manager.cc:5697] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 9 to 14, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 14 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.363602 23928 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:45.371050 24524 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:45.371865 29849 raft_consensus.cc:2804] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:45.372409 29849 raft_consensus.cc:697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:45.373330 29849 consensus_queue.cc:237] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:45.387683 23747 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 10 to 11, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 11 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:45.396335 29749 raft_consensus.cc:993] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:45.397972 29749 raft_consensus.cc:1081] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 19 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:45.396423 23851 raft_consensus.cc:2468] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 11.
I20260709 12:22:45.404573 24561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36570
I20260709 12:22:45.405138 24561 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:45.405493 24561 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:45.414778 23736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73d2fbc1f30749eba64903d7e79de8a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 22996f888daf435398b693481171c18c (127.22.43.65:34895) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 22996f888daf435398b693481171c18c from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:45.420126 24561 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:45.423063 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:45.423717 23849 raft_consensus.cc:3055] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:45.424057 23849 raft_consensus.cc:740] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:45.424775 23849 consensus_queue.cc:260] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:45.426131 23849 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:45.430243 24561 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:45.435206 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:45.435842 23928 raft_consensus.cc:3060] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:45.445237 23928 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 20.
I20260709 12:22:45.449350 23849 raft_consensus.cc:2468] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 20.
I20260709 12:22:45.450163 24524 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:45.450891 29947 raft_consensus.cc:2804] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:22:45.451009 23748 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43178 (request call id 256) took 29685 ms (client timeout 15000 ms). Trace:
I20260709 12:22:45.451452 29947 raft_consensus.cc:697] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:45.452499 29947 consensus_queue.cc:237] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:45.451501 23748 rpcz_store.cc:269] 0709 12:22:15.768266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.772816 (+  4550us) service_pool.cc:224] Handling call
0709 12:22:45.372400 (+29599584us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:45.372431 (+    31us) write_op.cc:454] Released schema lock
0709 12:22:45.450927 (+ 78496us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:45.362955 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:45.363496 (+   541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:45.363538 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:22:45.363558 (+    20us) tablet.cc:662] Decoding operations
0709 12:22:45.363973 (+   415us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:45.364037 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:45.364065 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:22:45.364387 (+   322us) tablet.cc:701] Row locks acquired
0709 12:22:45.364410 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:22:45.364545 (+   135us) write_op.cc:270] Start()
0709 12:22:45.364655 (+   110us) write_op.cc:276] Timestamp: P: 1783599765364508 usec, L: 0
0709 12:22:45.364679 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:22:45.365301 (+   622us) log.cc:844] Serialized 923 byte log entry
0709 12:22:45.367337 (+  2036us) op_driver.cc:464] REPLICATION: finished
0709 12:22:45.367802 (+   465us) write_op.cc:301] APPLY: starting
0709 12:22:45.367897 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:45.369297 (+  1400us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:45.369397 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:45.370703 (+  1306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:45.370863 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:22:45.370912 (+    49us) write_op.cc:312] APPLY: finished
0709 12:22:45.371115 (+   203us) log.cc:844] Serialized 33 byte log entry
0709 12:22:45.371267 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:45.371350 (+    83us) write_op.cc:454] Released schema lock
0709 12:22:45.371385 (+    35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":258,"apply.run_cpu_time_us":3818,"apply.run_wall_time_us":3869,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8336,"num_ops":2,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":2597,"prepare.run_wall_time_us":2598,"replication_time_us":2537}]]}
I20260709 12:22:45.496120 23747 catalog_manager.cc:5697] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 10 to 11, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 11 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:45.551218 23749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43178 (request call id 255) took 58797 ms (client timeout 15000 ms). Trace:
W20260709 12:22:45.551793 23749 rpcz_store.cc:269] 0709 12:21:46.758988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.761296 (+  2308us) service_pool.cc:224] Handling call
0709 12:22:45.551014 (+58789718us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":342849,"reported_tablets":51}
I20260709 12:22:45.552259 23851 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:45.560707 24561 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:45.562618 29749 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:45.565999 23749 catalog_manager.cc:5697] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 19 to 20, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 20 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.570999 24002 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:45.577124 29854 raft_consensus.cc:2955] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 3 to 10, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:45.589462 29908 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:45.582129 24561 raft_consensus.cc:2955] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 3 to 10, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:45.586338 23745 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.598984 23745 catalog_manager.cc:5697] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 14 to 16, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.601697 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 729f7490c64342bebf0188dd2f975e39 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:45.600704 23745 catalog_manager.cc:5697] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 11 to 14, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 14 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.608283 24002 raft_consensus.cc:2955] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 3 to 10, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:45.615221 23745 catalog_manager.cc:5697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 13 to 14, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 14 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.617426 23745 catalog_manager.cc:5697] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 12 to 14, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 14 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.619081 23745 catalog_manager.cc:5697] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.635605 23745 catalog_manager.cc:5697] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.642521 23745 catalog_manager.cc:5697] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 13 to 16, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.648829 23745 catalog_manager.cc:5697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.651721 23745 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 16 to 17, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 17 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.658917 23745 catalog_manager.cc:5697] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 14 to 16, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 16 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.664086 23745 catalog_manager.cc:5697] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 12 to 14, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 14 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.678161 23745 catalog_manager.cc:5697] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 12 to 13, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 13 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.774894 23745 catalog_manager.cc:5697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.777827 23745 catalog_manager.cc:5697] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 11 to 12, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 12 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.785635 23745 catalog_manager.cc:5697] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.788177 23745 catalog_manager.cc:5697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 10 to 12, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 12 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.795176 23745 catalog_manager.cc:5697] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 10 to 11, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 11 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.877689 23925 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:22:45.883168 23924 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:22:45.891559 29946 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:22:45.851578 23745 catalog_manager.cc:5697] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:45.907250 29946 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:45.908881 23851 raft_consensus.cc:1275] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:22:45.937366 29947 consensus_queue.cc:1048] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:22:45.972308 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 89421.5us
I20260709 12:22:45.980868 23849 raft_consensus.cc:1275] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:22:46.016963 29946 consensus_queue.cc:1048] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:22:46.108296 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:46.165484 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 60983.7us
I20260709 12:22:46.278527 23925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23e8987a07704ea192b04366772512e7"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:46.279429 23925 raft_consensus.cc:606] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:46.279803 23925 raft_consensus.cc:614] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:46.284466 23749 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 3 to 10, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 11 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:46.295097 23925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:46.295773 23925 raft_consensus.cc:606] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:46.297086 23925 raft_consensus.cc:614] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:46.303062 23925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:46.303817 23925 raft_consensus.cc:606] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:46.311141 23928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:46.311780 23928 raft_consensus.cc:606] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:46.312146 23928 raft_consensus.cc:614] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:46.330109 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet 729f7490c64342bebf0188dd2f975e39 with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48096
I20260709 12:22:46.344192 23744 catalog_manager.cc:5697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 15 to 16, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.347275 23744 catalog_manager.cc:5697] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 14 to 18, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 18 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.351944 23744 catalog_manager.cc:5697] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 13 to 14, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:46.353989 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet f82c4b60fcc242eda3a32f8f32d6d163: Illegal state: Replica e8bc734d763e4ddf87f7b930e35cbaa7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:46.350737 23745 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43186 (request call id 247) took 14327 ms (client timeout 15000 ms). Trace:
W20260709 12:22:46.358925 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet 05a83cc012d5420494cfd8c624a09767: Illegal state: Replica e8bc734d763e4ddf87f7b930e35cbaa7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:46.372565 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet f478cef7044d4597b6db8ead4067f592: Illegal state: Replica e8bc734d763e4ddf87f7b930e35cbaa7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.361622 23744 catalog_manager.cc:5697] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 13 to 15, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 15 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:46.356482 23745 rpcz_store.cc:269] 0709 12:22:32.023407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.023779 (+   372us) service_pool.cc:224] Handling call
0709 12:22:46.350650 (+14326871us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:46.038894 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:46.039579 (+   685us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:46.039632 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:22:46.039666 (+    34us) tablet.cc:662] Decoding operations
0709 12:22:46.041426 (+  1760us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:46.041565 (+   139us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:46.041598 (+    33us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:22:46.043648 (+  2050us) tablet.cc:701] Row locks acquired
0709 12:22:46.043704 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:22:46.043906 (+   202us) write_op.cc:270] Start()
0709 12:22:46.044111 (+   205us) write_op.cc:276] Timestamp: P: 1783599766043839 usec, L: 0
0709 12:22:46.044151 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:22:46.044970 (+   819us) log.cc:844] Serialized 7465 byte log entry
0709 12:22:46.050173 (+  5203us) op_driver.cc:464] REPLICATION: finished
0709 12:22:46.053319 (+  3146us) write_op.cc:301] APPLY: starting
0709 12:22:46.053422 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:46.147969 (+ 94547us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:46.148115 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:46.239928 (+ 91813us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:46.240290 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 12:22:46.240352 (+    62us) write_op.cc:312] APPLY: finished
0709 12:22:46.240809 (+   457us) log.cc:844] Serialized 172 byte log entry
0709 12:22:46.241000 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:46.266111 (+ 25111us) write_op.cc:454] Released schema lock
0709 12:22:46.266197 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:46.294322 (+ 28125us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:46.294358 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2614475,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":2864,"apply.run_cpu_time_us":26521,"apply.run_wall_time_us":240961,"cfile_cache_hit":76,"cfile_cache_hit_bytes":79192,"num_ops":19,"prepare.queue_time_us":289,"prepare.run_cpu_time_us":6534,"prepare.run_wall_time_us":27769,"replication_time_us":5835}]]}
I20260709 12:22:46.384817 23744 catalog_manager.cc:5697] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 14 to 17, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 17 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.397500 23744 catalog_manager.cc:5697] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 12 to 13, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 13 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.400595 23744 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 11 to 12, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 12 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.401481 23927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdd49025134246c8a0245389cc43db77"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:46.402158 23927 raft_consensus.cc:606] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:46.402539 23927 raft_consensus.cc:614] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:46.403214 23744 catalog_manager.cc:5697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 13 to 17, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 17 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.405126 23744 catalog_manager.cc:5697] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 13 to 14, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 14 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.406306 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:46.407313 23744 catalog_manager.cc:5697] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 14 to 15, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.409557 23744 catalog_manager.cc:5697] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.411268 23744 catalog_manager.cc:5697] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 12 to 15, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.414738 23744 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 17 to 18, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 18 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:46.417171 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet 573b7fecf80d4359b0e9f045d989ed09: Illegal state: Replica 22996f888daf435398b693481171c18c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.416334 23744 catalog_manager.cc:5697] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 16 to 19, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 19 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.440373 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:46.441437 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:46.443783 29952 raft_consensus.cc:993] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:46.444322 29952 raft_consensus.cc:1081] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:46.446110 23996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:22:46.446684 23996 raft_consensus.cc:493] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.447036 23996 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:46.466969 23996 raft_consensus.cc:515] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:46.475872 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:46.476398 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5d779cbe414b879d3a8be40d0428fa" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:46.476725 23851 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:46.477058 23925 raft_consensus.cc:3055] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:46.477520 23925 raft_consensus.cc:740] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:46.478418 23925 consensus_queue.cc:260] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:46.479575 23925 raft_consensus.cc:3060] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:46.481963 23996 leader_election.cc:290] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:46.493419 29988 tablet_replica.cc:333] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:22:46.506984 29988 raft_consensus.cc:2243] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.507817 29988 raft_consensus.cc:2272] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.513247 23851 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:46.504839 23925 raft_consensus.cc:2468] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:46.514724 23966 leader_election.cc:304] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:46.516367 29838 raft_consensus.cc:2804] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:46.516953 29838 raft_consensus.cc:697] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:46.524466 29988 ts_tablet_manager.cc:1916] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:46.524020 29838 consensus_queue.cc:237] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:46.595526 29988 ts_tablet_manager.cc:1929] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:22:46.596194 29988 log.cc:1199] T 729f7490c64342bebf0188dd2f975e39 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/729f7490c64342bebf0188dd2f975e39
I20260709 12:22:46.606592 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 729f7490c64342bebf0188dd2f975e39 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:22:46.617345 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet 729f7490c64342bebf0188dd2f975e39 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:48096
I20260709 12:22:46.619417 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 729f7490c64342bebf0188dd2f975e39 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:22:46.624903 23744 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43184 (request call id 228) took 4999 ms. Trace:
I20260709 12:22:46.625475 23744 rpcz_store.cc:276] 0709 12:22:41.625718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.645304 (+ 19586us) service_pool.cc:224] Handling call
0709 12:22:46.624814 (+4979510us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:46.434872 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:46.435383 (+   511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:46.435420 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:22:46.435438 (+    18us) tablet.cc:662] Decoding operations
0709 12:22:46.436674 (+  1236us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:46.436728 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:46.436753 (+    25us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:22:46.437818 (+  1065us) tablet.cc:701] Row locks acquired
0709 12:22:46.437833 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:22:46.443971 (+  6138us) write_op.cc:270] Start()
0709 12:22:46.444102 (+   131us) write_op.cc:276] Timestamp: P: 1783599766443921 usec, L: 0
0709 12:22:46.444135 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:22:46.444783 (+   648us) log.cc:844] Serialized 5540 byte log entry
0709 12:22:46.447592 (+  2809us) op_driver.cc:464] REPLICATION: finished
0709 12:22:46.448058 (+   466us) write_op.cc:301] APPLY: starting
0709 12:22:46.448174 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:46.455433 (+  7259us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:46.455529 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:46.568968 (+113439us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:46.569242 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 12:22:46.569298 (+    56us) write_op.cc:312] APPLY: finished
0709 12:22:46.569681 (+   383us) log.cc:844] Serialized 129 byte log entry
0709 12:22:46.572432 (+  2751us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:46.572590 (+   158us) write_op.cc:454] Released schema lock
0709 12:22:46.572657 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:46.573037 (+   380us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:46.606465 (+ 33428us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5974,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":240,"apply.run_cpu_time_us":18145,"apply.run_wall_time_us":124936,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58352,"num_ops":14,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":4253,"prepare.run_wall_time_us":19159,"replication_time_us":3311}]]}
I20260709 12:22:46.639803 23750 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.642520 23750 catalog_manager.cc:5697] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 9 to 10, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 10 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.735078 23750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43178 (request call id 257) took 10678 ms. Trace:
I20260709 12:22:46.735471 23750 rpcz_store.cc:276] 0709 12:22:36.056635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.070024 (+ 13389us) service_pool.cc:224] Handling call
0709 12:22:46.735017 (+10664993us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:46.649969 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:46.650535 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:46.650603 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:22:46.650619 (+    16us) tablet.cc:662] Decoding operations
0709 12:22:46.651030 (+   411us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:46.651083 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:46.651118 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:22:46.651432 (+   314us) tablet.cc:701] Row locks acquired
0709 12:22:46.651447 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:22:46.651603 (+   156us) write_op.cc:270] Start()
0709 12:22:46.651710 (+   107us) write_op.cc:276] Timestamp: P: 1783599766651557 usec, L: 0
0709 12:22:46.651727 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:22:46.652325 (+   598us) log.cc:844] Serialized 923 byte log entry
0709 12:22:46.655586 (+  3261us) op_driver.cc:464] REPLICATION: finished
0709 12:22:46.656022 (+   436us) write_op.cc:301] APPLY: starting
0709 12:22:46.656097 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:46.657362 (+  1265us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:46.657461 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:46.658764 (+  1303us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:46.658946 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:22:46.659002 (+    56us) write_op.cc:312] APPLY: finished
0709 12:22:46.659236 (+   234us) log.cc:844] Serialized 33 byte log entry
0709 12:22:46.659420 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:46.659518 (+    98us) write_op.cc:454] Released schema lock
0709 12:22:46.659566 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:46.659931 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:46.659962 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1558,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":247,"apply.run_cpu_time_us":3843,"apply.run_wall_time_us":3842,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8336,"num_ops":2,"prepare.queue_time_us":120,"prepare.run_cpu_time_us":2643,"prepare.run_wall_time_us":2643,"replication_time_us":3716}]]}
I20260709 12:22:46.817826 23749 catalog_manager.cc:5697] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 16 to 19, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 19 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.820633 23749 catalog_manager.cc:5697] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 9 to 10, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 10 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.851538 23749 catalog_manager.cc:5697] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 12 to 16, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 16 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.853292 23749 catalog_manager.cc:5697] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.854982 23749 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.858330 23749 catalog_manager.cc:5697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 13 to 14, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 14 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.868029 23749 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.878540 23749 catalog_manager.cc:5697] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:46.916206 23749 catalog_manager.cc:5697] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 10 to 12, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 12 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
W20260709 12:22:46.864140 23752 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43186 (request call id 245) took 58881 ms (client timeout 15000 ms). Trace:
I20260709 12:22:47.021158 23851 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:47.028481 29951 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:47.035210 23925 raft_consensus.cc:1275] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:47.036859 29975 consensus_queue.cc:1048] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:22:47.018293 23752 rpcz_store.cc:269] 0709 12:21:47.982679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.982953 (+   274us) service_pool.cc:224] Handling call
0709 12:22:46.863898 (+58880945us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2759239,"reported_tablets":50}
I20260709 12:22:47.072211 23749 catalog_manager.cc:5697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 13 to 16, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:47.339030 23752 catalog_manager.cc:5697] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c reported cstate change: term changed from 12 to 13, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 13 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:47.574288 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:47.677958 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:47.678684 23852 raft_consensus.cc:606] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:47.681644 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0499f663114741880a025070e7b81f"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:47.682288 23852 raft_consensus.cc:606] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 12 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:47.703842 29908 raft_consensus.cc:993] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:47.704463 29994 raft_consensus.cc:1081] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 12 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:47.704491 23927 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:47.712775 23996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e0499f663114741880a025070e7b81f"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:49640
I20260709 12:22:47.713434 23996 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:47.713814 23996 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:47.704756 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:47.716850 23852 raft_consensus.cc:606] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 14 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:47.722090 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:47.722750 23852 raft_consensus.cc:606] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:47.726012 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d728437e541d463594bcfe1155df3a32"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:47.726634 23852 raft_consensus.cc:606] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 18 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:47.730072 29994 raft_consensus.cc:993] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:47.730621 29994 raft_consensus.cc:1081] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:47.732016 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:47.734331 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:47.735450 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:47.736403 23928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:22:47.737025 23928 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:47.737397 23928 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:47.769750 23928 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:47.770046 23996 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:47.793392 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:47.794462 23852 raft_consensus.cc:3055] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:47.794994 23852 raft_consensus.cc:740] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:47.796304 23996 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:47.797766 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:47.804577 23851 raft_consensus.cc:3055] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:47.804898 23851 raft_consensus.cc:740] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:47.805735 23851 consensus_queue.cc:260] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:47.807052 23851 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:47.798512 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:47.817703 23924 raft_consensus.cc:3060] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:47.825533 23996 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:47.825533 23849 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:47.829989 30000 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:22:47.831060 23895 consensus_peers.cc:597] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d78ef4be778a4d7fa19baf9815bd1d96. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:47.832019 30000 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:47.795809 23852 consensus_queue.cc:260] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:47.803025 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55123f416ba4e9a930f3a24bb6c88f3" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:47.846557 24561 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:47.848129 23928 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:47.850795 23851 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:47.852701 23966 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:47.852993 23924 raft_consensus.cc:2468] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:22:47.853344 23852 raft_consensus.cc:3060] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:47.860895 29997 raft_consensus.cc:2804] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:47.861527 29997 raft_consensus.cc:697] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:47.863401 29997 consensus_queue.cc:237] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:47.880862 24561 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:47.882213 23895 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:47.883339 29999 raft_consensus.cc:2804] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:47.884749 23852 raft_consensus.cc:2468] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 12.
I20260709 12:22:47.884892 29999 raft_consensus.cc:697] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:47.887153 29885 raft_consensus.cc:2955] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:47.888264 29999 consensus_queue.cc:237] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:47.894120 23996 raft_consensus.cc:2955] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:47.903532 23999 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:47.990304 23744 catalog_manager.cc:5697] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 12 to 13, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 13 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.082966 30013 raft_consensus.cc:993] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:48.083585 30013 raft_consensus.cc:1081] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 18 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
W20260709 12:22:48.086282 23969 consensus_peers.cc:597] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f82c4b60fcc242eda3a32f8f32d6d163. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:48.086905 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 83661.9us
W20260709 12:22:48.160678 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 78437.3us
I20260709 12:22:48.164191 23852 raft_consensus.cc:2955] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:48.194726 23924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d728437e541d463594bcfe1155df3a32"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:22:48.195487 23924 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:48.195955 23924 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:48.211529 23750 catalog_manager.cc:5697] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 11 to 12, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.229064 23925 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:48.222242 23924 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:48.239105 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:48.239697 23851 raft_consensus.cc:3055] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:48.239986 23851 raft_consensus.cc:740] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:48.236948 23924 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:48.294270 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d728437e541d463594bcfe1155df3a32" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:48.295043 24557 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:48.238991 29838 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:22:48.294057 23851 consensus_queue.cc:260] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:48.296741 23851 raft_consensus.cc:3060] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:48.304430 24557 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 19.
I20260709 12:22:48.305023 23851 raft_consensus.cc:2468] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 19.
I20260709 12:22:48.306103 23895 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:48.296763 30017 raft_consensus.cc:993] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:48.315598 23851 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:48.323254 30028 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:22:48.351368 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 45465.2us
I20260709 12:22:48.352648 30019 raft_consensus.cc:2804] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:48.353296 30019 raft_consensus.cc:697] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:48.354418 30019 consensus_queue.cc:237] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:48.384347 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 100642us
I20260709 12:22:48.364192 30013 raft_consensus.cc:1081] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 14 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
W20260709 12:22:48.405450 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.407151 23849 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:48.409407 30012 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:22:48.456861 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 98236.4us
I20260709 12:22:48.485970 24563 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:48.488655 30020 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:48.493763 30037 raft_consensus.cc:993] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:48.494304 30037 raft_consensus.cc:1081] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:48.495157 23927 raft_consensus.cc:1275] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:48.488775 30012 raft_consensus.cc:2955] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:48.485901 23925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:22:48.498667 23925 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:48.499131 23925 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:48.497116 23922 raft_consensus.cc:2955] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:48.504895 30028 consensus_queue.cc:1048] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:48.514699 23852 raft_consensus.cc:1275] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:48.543792 23925 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:48.553486 30020 consensus_queue.cc:1048] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
W20260709 12:22:48.555101 30043 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:22:48.558784 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:48.561800 23852 raft_consensus.cc:3055] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:48.562212 23852 raft_consensus.cc:740] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:48.563118 23852 consensus_queue.cc:260] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:48.568791 23852 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:48.590000 23925 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:48.600768 23852 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:48.612758 23924 raft_consensus.cc:1240] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:48.618498 23928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:22:48.619335 23928 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:48.619783 23928 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:48.621357 23851 raft_consensus.cc:2955] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:48.623199 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:48.623852 23997 raft_consensus.cc:3060] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:48.645452 23997 raft_consensus.cc:2468] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:48.647470 23892 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:48.807431 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 204831us
I20260709 12:22:48.809326 30021 raft_consensus.cc:2804] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:22:48.809974 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 164979us
I20260709 12:22:48.805629 23928 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:48.820681 23928 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:48.824002 30045 ts_tablet_manager.cc:933] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:48.815702 30021 raft_consensus.cc:697] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:48.825188 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:48.825958 24561 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:48.826368 30021 consensus_queue.cc:237] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:48.849658 24561 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:48.858994 30042 ts_tablet_manager.cc:933] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:48.814308 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:48.892705 23895 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:22:48.954425 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 142443us
I20260709 12:22:48.986845 30045 tablet_copy_client.cc:323] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:22:48.987743 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:48.988432 23850 raft_consensus.cc:3055] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:48.988793 23850 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:48.989588 23850 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:48.998123 23854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:48.998991 23854 raft_consensus.cc:606] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 19 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:49.002954 30041 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.397s	user 0.011s	sys 0.013s
W20260709 12:22:49.014215 30047 log.cc:927] Time spent T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:22:49.017706 30040 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:49.018416 30040 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:49.019451 30040 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:49.022858 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 51483.8us
I20260709 12:22:49.038527 23850 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:49.039198 23849 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:22:49.043118 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 74857.3us
W20260709 12:22:49.061712 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 89246.2us
I20260709 12:22:49.078027 30020 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
W20260709 12:22:49.094046 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 201430us
I20260709 12:22:49.120561 23925 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:49.127168 23845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:49.127851 23845 raft_consensus.cc:606] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 14 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:22:49.130271 30049 log.cc:927] Time spent T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.003s
I20260709 12:22:49.144783 23850 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:22:49.147930 29994 raft_consensus.cc:993] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:49.162182 29994 raft_consensus.cc:1081] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 19 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:49.175414 23845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:49.176441 23845 raft_consensus.cc:606] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:49.177069 23845 raft_consensus.cc:614] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:49.181409 29973 raft_consensus.cc:993] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:49.182005 29973 raft_consensus.cc:1081] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 14 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:49.182368 24563 raft_consensus.cc:1275] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:22:49.184891 29999 consensus_queue.cc:1048] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:22:49.206598 23845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d728437e541d463594bcfe1155df3a32"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:49.191425 23750 catalog_manager.cc:5697] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 9, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:49.217264 23920 raft_consensus.cc:1240] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:49.206111 30042 tablet_copy_client.cc:323] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:22:49.249184 23845 raft_consensus.cc:606] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:49.249816 23845 raft_consensus.cc:614] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:49.250005 23999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:49640
I20260709 12:22:49.250638 23999 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.250988 23999 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:49.253588 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet f82c4b60fcc242eda3a32f8f32d6d163 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:22:49.254310 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet f82c4b60fcc242eda3a32f8f32d6d163 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-f82c4b60fcc242eda3a32f8f32d6d163
W20260709 12:22:49.267740 23819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.280333 23845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:49.281076 23845 raft_consensus.cc:606] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:49.290695 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:49.292603 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:49.294512 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:49.295953 23922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:22:49.296551 23922 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.296923 23922 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:49.299955 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet d78ef4be778a4d7fa19baf9815bd1d96 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:22:49.300613 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet d78ef4be778a4d7fa19baf9815bd1d96 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-d78ef4be778a4d7fa19baf9815bd1d96
I20260709 12:22:49.314292 24014 tablet_copy_source_session.cc:215] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:49.323848 23922 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:49.334517 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:49.329758 23895 consensus_peers.cc:597] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83e1955dc5e84b5080e7ea8d739baff4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:49.335194 23851 raft_consensus.cc:3055] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:49.337842 23851 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:49.338845 23851 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:49.340070 23851 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:49.342737 23922 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:49.348133 24002 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:49.349758 30019 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:49.360567 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:49.363755 23997 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:49.420625 23854 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:49.427512 23939 tablet_copy_source_session.cc:215] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:49.443755 30045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82c4b60fcc242eda3a32f8f32d6d163. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:49.447865 30070 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.086s	user 0.003s	sys 0.000s
I20260709 12:22:49.450919 29885 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:49.455308 30056 raft_consensus.cc:993] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:49.455935 29973 raft_consensus.cc:1081] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
W20260709 12:22:49.458035 30068 log.cc:927] Time spent T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.008s
I20260709 12:22:49.467816 23999 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:49.469774 23925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:22:49.478513 23925 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.478909 23925 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:49.479460 23850 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:49.476611 30019 raft_consensus.cc:2955] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:49.487926 23851 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:49.490613 23925 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:49.493870 23999 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 20 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:49.472545 30042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78ef4be778a4d7fa19baf9815bd1d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.495425 23925 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:49.496848 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:49.512605 23995 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:49.514469 23997 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:49.516148 23893 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:49.517149 30000 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:49.517722 30000 raft_consensus.cc:697] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:49.518801 30000 consensus_queue.cc:237] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:49.520886 23995 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:22:49.522770 23893 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:49.524233 29885 raft_consensus.cc:2804] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:49.524941 29885 raft_consensus.cc:697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:49.498342 24001 raft_consensus.cc:2955] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:49.501704 23752 catalog_manager.cc:5697] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 18 to 19, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 19 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.526201 29885 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:49.527463 23752 catalog_manager.cc:5697] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 16 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:49.530284 23922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:49.530843 23922 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:49.471482 23996 raft_consensus.cc:1275] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:49.536387 30060 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:49.529313 23752 catalog_manager.cc:5697] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 14 to 15, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 15 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.537659 23922 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 20.
I20260709 12:22:49.555318 23854 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:49.554996 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:49.558617 23966 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:49.558580 23851 raft_consensus.cc:3055] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:49.559520 23851 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:49.564011 30018 raft_consensus.cc:2804] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:49.562434 30021 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:22:49.564581 30018 raft_consensus.cc:697] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:49.560861 30040 consensus_queue.cc:1048] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:22:49.565500 30018 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:49.571096 23999 raft_consensus.cc:1240] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:49.579094 23851 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:49.593050 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a76a5d75e47acaff6a5ca2f03dcc5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:49.596091 29730 consensus_queue.cc:1059] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:22:49.600980 23848 raft_consensus.cc:3055] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:49.601460 23848 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:49.610541 23851 raft_consensus.cc:3060] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:49.627743 24562 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:49.634255 30058 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:49.602954 23848 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:49.647751 23849 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:49.660007 23848 raft_consensus.cc:3060] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:49.673965 30042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36552 (request call id 1332) took 1229 ms. Trace:
I20260709 12:22:49.674539 30042 rpcz_store.cc:276] 0709 12:22:48.428242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.432931 (+  4689us) service_pool.cc:224] Handling call
0709 12:22:48.859447 (+426516us) ts_tablet_manager.cc:934] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
0709 12:22:49.008817 (+149370us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7fa284428768. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284382d91 00007fa28435dc08 00007fa28435bbb4 00007fa28c3c0131 00007fa28c3c6ac8 00007fa28c45f1df 00007fa28c490f4e 00007fa28c475fdd 00007fa28c475f89 00007fa28c475f19
0709 12:22:49.471184 (+462367us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:49.523796 (+ 52612us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:49.523933 (+   137us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:49.657078 (+133145us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:49.657376 (+   298us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:49.657690 (+   314us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:49.657843 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":49538,"spinlock_wait_cycles":22362880,"tablet-copy.queue_time_us":204806,"thread_start_us":237775,"threads_started":2}
I20260709 12:22:49.682967 30042 tablet_copy_client.cc:806] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:49.683689 30042 tablet_copy_client.cc:670] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:49.689163 30042 tablet_copy_client.cc:538] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:49.694820 23851 raft_consensus.cc:2468] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 20.
I20260709 12:22:49.697263 23848 raft_consensus.cc:2468] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
W20260709 12:22:49.705228 29730 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:22:49.832855 23752 catalog_manager.cc:5697] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 19 to 20, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 20 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.841866 23752 catalog_manager.cc:5697] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 9, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:22:49.873303 30081 log.cc:927] Time spent T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:22:49.876798 30076 log.cc:927] Time spent T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:22:49.921017 23995 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:49.926625 30020 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:49.931473 23850 raft_consensus.cc:2955] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:49.951819 30045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36558 (request call id 1107) took 1454 ms. Trace:
I20260709 12:22:49.929863 30042 tablet_bootstrap.cc:492] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:22:49.952710 30045 rpcz_store.cc:276] 0709 12:22:48.497594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.497718 (+   124us) service_pool.cc:224] Handling call
0709 12:22:48.824444 (+326726us) ts_tablet_manager.cc:934] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
0709 12:22:49.345974 (+521530us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:49.694573 (+348599us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:49.694709 (+   136us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:49.945352 (+250643us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:49.945675 (+   323us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:49.951651 (+  5976us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:49.951730 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":52452,"tablet-copy.queue_time_us":315614,"thread_start_us":150833,"threads_started":2}
I20260709 12:22:49.976070 23750 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 13 to 14, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.987846 23750 catalog_manager.cc:5697] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 14 to 15, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 15 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.972563 30045 tablet_copy_client.cc:806] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:49.999552 30045 tablet_copy_client.cc:670] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:50.005899 23750 catalog_manager.cc:5697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 14 to 15, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 15 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:50.039398 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 44380us
I20260709 12:22:50.052446 30089 ts_tablet_manager.cc:933] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:50.335908 23995 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:22:50.338532 30085 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:22:50.349428 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 297755us
I20260709 12:22:50.362318 30040 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:22:50.404695 30089 tablet_copy_client.cc:323] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
W20260709 12:22:50.424873 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 74558.6us
W20260709 12:22:50.428817 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 213706us
I20260709 12:22:50.458453 23922 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:50.463971 23852 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:22:50.485738 30115 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:50.514729 23995 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:50.521157 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet 83e1955dc5e84b5080e7ea8d739baff4 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:22:50.521839 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet 83e1955dc5e84b5080e7ea8d739baff4 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-83e1955dc5e84b5080e7ea8d739baff4
I20260709 12:22:50.532945 23854 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:50.533711 23850 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:50.534992 23922 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:22:50.528977 30096 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:22:50.543113 23939 tablet_copy_source_session.cc:215] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:50.559317 30017 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 12:22:50.578922 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 105709us
I20260709 12:22:50.596503 30045 tablet_copy_client.cc:538] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:22:50.622057 23820 consensus_peers.cc:597] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d78d41f27ddd4a3fa2fe292b189ba372. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:50.642668 29951 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:50.659493 30089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e1955dc5e84b5080e7ea8d739baff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:50.675527 30020 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:50.692857 30125 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:50.718741 23922 raft_consensus.cc:2955] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:50.726202 30122 raft_consensus.cc:2955] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:50.737255 24004 raft_consensus.cc:2955] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:50.739874 30045 tablet_bootstrap.cc:492] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:22:50.750451 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:50.767560 30122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44078 (request call id 5) took 1119 ms. Trace:
I20260709 12:22:50.782501 30122 rpcz_store.cc:276] 0709 12:22:49.645443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.645706 (+   263us) service_pool.cc:224] Handling call
0709 12:22:49.716909 (+ 71203us) log.cc:844] Serialized 499 byte log entry
0709 12:22:50.347522 (+630613us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18003f5b00. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa28d227ab1 00007fa28d234281 00007fa2842d9c0a 00007fa28da19219 00007fa284361a40 00007fa28435c4e4 00007fa28435c455 00007fa2873a5b0b 00007fa28742ab63 00007fa287452752 00007fa28c412d29
0709 12:22:50.765098 (+417576us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164095,"raft.queue_time_us":303659,"raft.run_cpu_time_us":2087,"raft.run_wall_time_us":175075,"spinlock_wait_cycles":6044544,"thread_start_us":327894,"threads_started":1,"wal-append.queue_time_us":501471}
I20260709 12:22:50.814785 30132 ts_tablet_manager.cc:933] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:22:50.912783 30042 tablet_bootstrap.cc:492] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:50.924563 30042 tablet_bootstrap.cc:492] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:22:50.925401 30042 ts_tablet_manager.cc:1403] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.996s	user 0.065s	sys 0.058s
I20260709 12:22:50.926008 23749 catalog_manager.cc:5697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:50.957691 23850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:50.958377 23850 raft_consensus.cc:606] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:50.990940 23850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23e8987a07704ea192b04366772512e7"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:50.991688 23850 raft_consensus.cc:606] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:51.003517 30042 raft_consensus.cc:359] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:51.008874 23850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:51.013175 29730 raft_consensus.cc:993] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:51.035175 23850 raft_consensus.cc:606] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
W20260709 12:22:51.045393 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 102522us
I20260709 12:22:51.033141 30042 raft_consensus.cc:740] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:22:51.084146 23850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:51.084715 23850 raft_consensus.cc:606] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:51.082551 30132 tablet_copy_client.cc:323] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
I20260709 12:22:51.114543 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdd49025134246c8a0245389cc43db77"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:51.115311 23852 raft_consensus.cc:606] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:51.119956 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:51.122189 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:51.123268 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:51.130458 30089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36552 (request call id 1353) took 1182 ms. Trace:
I20260709 12:22:51.130996 30089 rpcz_store.cc:276] 0709 12:22:49.948537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.948691 (+   154us) service_pool.cc:224] Handling call
0709 12:22:50.194266 (+245575us) ts_tablet_manager.cc:934] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
0709 12:22:50.341651 (+147385us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b4400022b4c. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284285c85 00007fa2842866a2 00007fa286ff81db 00007fa286ff3aaf 00007fa2843420ac 00007fa28d19c9a9 00007fa28435e69b 00007fa28435bcaa 00007fa28435bbd2 00007fa28c3c0131
0709 12:22:50.658475 (+316824us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:50.797706 (+139231us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:50.797825 (+   119us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:51.129620 (+331795us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:51.129944 (+   324us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:51.130247 (+   303us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:51.130393 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":283,"spinlock_wait_cycles":5463424,"tablet-copy.queue_time_us":63219,"thread_start_us":137617,"threads_started":2}
I20260709 12:22:51.120471 30121 raft_consensus.cc:1081] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:51.092617 30042 consensus_queue.cc:260] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:51.147568 24563 raft_consensus.cc:1217] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 12:22:51.142769 30089 tablet_copy_client.cc:806] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:51.150194 30089 tablet_copy_client.cc:670] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:51.182265 24004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23e8987a07704ea192b04366772512e7"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:49640
I20260709 12:22:51.182873 24004 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.183247 24004 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:51.212116 24004 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.223690 30042 ts_tablet_manager.cc:1434] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.298s	user 0.009s	sys 0.000s
W20260709 12:22:51.236743 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 129286us
I20260709 12:22:51.240926 24004 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:51.243196 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:51.243866 23852 raft_consensus.cc:3055] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:51.244168 23852 raft_consensus.cc:740] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:51.244870 23852 consensus_queue.cc:260] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.245119 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:51.250674 23927 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:51.251555 23852 raft_consensus.cc:3060] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:51.259512 23863 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet d78d41f27ddd4a3fa2fe292b189ba372 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:22:51.260180 23863 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet d78d41f27ddd4a3fa2fe292b189ba372 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-d78d41f27ddd4a3fa2fe292b189ba372
I20260709 12:22:51.287411 23852 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:51.290424 23966 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:51.286355 30089 tablet_copy_client.cc:538] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:51.292199 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d78ef4be778a4d7fa19baf9815bd1d96 received from {username='slave'} at 127.0.0.1:35824
I20260709 12:22:51.292733 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d78ef4be778a4d7fa19baf9815bd1d96 on tablet d78ef4be778a4d7fa19baf9815bd1d96 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:51.302539 30099 raft_consensus.cc:2804] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:51.305135 30099 raft_consensus.cc:697] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:51.306092 30099 consensus_queue.cc:237] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.311546 23863 tablet_copy_source_session.cc:215] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:51.320027 30132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78d41f27ddd4a3fa2fe292b189ba372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:51.329636 23927 raft_consensus.cc:2468] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:51.382756 30089 tablet_bootstrap.cc:492] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:22:51.461812 23749 catalog_manager.cc:5697] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 14 to 15, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 15 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:51.489439 30119 raft_consensus.cc:993] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:51.490187 30119 raft_consensus.cc:1081] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:51.496909 24004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:49640
I20260709 12:22:51.479341 30121 raft_consensus.cc:993] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:51.498307 24004 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.499717 24004 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:51.525635 24004 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.511363 30121 raft_consensus.cc:1081] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:51.532452 24004 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:51.534214 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:51.540444 23854 raft_consensus.cc:3055] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:51.540777 23854 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:51.541481 23854 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.542393 23854 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:51.546265 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:51.546904 23920 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:51.536687 30017 raft_consensus.cc:993] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:51.550447 30017 raft_consensus.cc:1081] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:51.553669 23924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:22:51.554314 23924 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.554788 23924 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:51.558321 23920 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:51.562829 23922 raft_consensus.cc:1240] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:51.563966 23854 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:22:51.575340 24004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:49640
I20260709 12:22:51.576200 24004 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.576673 24004 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:51.572227 23966 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:51.588953 23924 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.604084 30097 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:51.604758 30097 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:51.605727 30097 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.614408 24004 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.627745 24004 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:51.635452 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:51.635679 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:51.636123 23854 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:51.636222 23920 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:51.636498 23854 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:51.642607 23854 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.647707 23924 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:51.651810 30125 raft_consensus.cc:1064] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:22:51.653213 23854 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:51.666898 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:51.667742 23852 raft_consensus.cc:3055] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:51.668175 23852 raft_consensus.cc:740] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:51.669536 23920 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:51.672520 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:51.678757 23852 consensus_queue.cc:260] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.681036 23854 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:51.684324 30018 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:51.684875 30018 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:51.698951 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9458291d6d4d499f9c4b21cbe9170c33" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:51.699702 23852 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:51.701048 30121 raft_consensus.cc:993] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:51.703408 30121 raft_consensus.cc:1081] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:51.706125 23924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdd49025134246c8a0245389cc43db77"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:22:51.706894 23924 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.707343 23924 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:51.707626 24000 raft_consensus.cc:3060] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:51.737118 23852 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:51.738598 23892 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:51.738113 23924 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.743223 30132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36570 (request call id 1325) took 1082 ms. Trace:
I20260709 12:22:51.743980 30132 rpcz_store.cc:276] 0709 12:22:50.661174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.661335 (+   161us) service_pool.cc:224] Handling call
0709 12:22:50.815219 (+153884us) ts_tablet_manager.cc:934] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
0709 12:22:51.318783 (+503564us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:51.429130 (+110347us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:51.429253 (+   123us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:51.742263 (+313010us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:51.742656 (+   393us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:51.743054 (+   398us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:51.743136 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":39836,"tablet-copy.queue_time_us":113505,"thread_start_us":153236,"threads_started":2}
I20260709 12:22:51.746038 30132 tablet_copy_client.cc:806] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:51.746860 30132 tablet_copy_client.cc:670] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:51.685729 30018 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.704851 30125 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:22:51.759400 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 117599us
I20260709 12:22:51.782577 23920 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:51.760974 30103 raft_consensus.cc:2804] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:51.797338 30103 raft_consensus.cc:697] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:51.798318 30103 consensus_queue.cc:237] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.808665 30099 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:22:51.823707 30132 tablet_copy_client.cc:538] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:51.827881 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:51.828176 23924 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:51.829438 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:51.844564 23850 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:51.843950 23996 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:51.846217 23850 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:51.855309 23850 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.856660 23850 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:51.861721 24000 raft_consensus.cc:2468] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:51.876255 24562 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:51.885321 24000 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:51.911101 23996 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:22:51.915253 23850 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
W20260709 12:22:51.922683 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 53164.5us
I20260709 12:22:51.924585 23892 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:51.934983 30125 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:51.937964 30125 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:51.892441 30101 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:22:51.950062 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 104062us
I20260709 12:22:51.966421 23852 raft_consensus.cc:1275] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:51.942265 30125 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:51.976164 30018 consensus_queue.cc:1048] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:51.977082 30132 tablet_bootstrap.cc:492] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:22:51.996306 23749 catalog_manager.cc:5697] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 15 to 16, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.006897 30154 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 12:22:52.016902 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 44317.2us
W20260709 12:22:52.017076 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 43667.5us
I20260709 12:22:52.048724 23850 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:52.072717 30029 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:22:52.180176 30045 tablet_bootstrap.cc:492] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:52.181442 30045 tablet_bootstrap.cc:492] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
W20260709 12:22:52.189340 30163 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:22:52.191107 23854 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:52.200129 30157 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:52.211484 23924 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:52.205137 23752 catalog_manager.cc:5697] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 11 to 12, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 12 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.215852 23752 catalog_manager.cc:5697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 14 to 15, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 15 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.223124 30045 ts_tablet_manager.cc:1403] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 1.483s	user 0.058s	sys 0.039s
I20260709 12:22:52.263924 30156 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:52.288586 30045 raft_consensus.cc:359] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:52.289621 30045 raft_consensus.cc:740] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:22:52.290397 30045 consensus_queue.cc:260] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:52.308596 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:52.330848 30045 ts_tablet_manager.cc:1434] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
W20260709 12:22:52.333463 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 118498us
I20260709 12:22:52.337540 23996 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:22:52.345908 23969 consensus_peers.cc:597] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:52.360191 23924 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:52.366446 30165 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:52.374835 30168 raft_consensus.cc:2955] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:52.382274 23849 raft_consensus.cc:1275] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:52.392877 30171 consensus_queue.cc:1048] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:52.402845 23744 catalog_manager.cc:5697] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 12 to 13, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 13 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.398603 23854 raft_consensus.cc:2955] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:52.444906 23850 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:52.422508 24562 raft_consensus.cc:2955] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:52.454272 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-f82c4b60fcc242eda3a32f8f32d6d163 received from {username='slave'} at 127.0.0.1:34868
I20260709 12:22:52.454816 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-f82c4b60fcc242eda3a32f8f32d6d163 on tablet f82c4b60fcc242eda3a32f8f32d6d163 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:22:52.528282 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 59756.7us
I20260709 12:22:52.548943 29951 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:22:52.556695 30176 log.cc:927] Time spent T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:22:52.588963 24001 raft_consensus.cc:2955] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:52.668387 30089 tablet_bootstrap.cc:492] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:52.669641 30089 tablet_bootstrap.cc:492] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
W20260709 12:22:52.687398 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 76939.1us
I20260709 12:22:52.708087 30089 ts_tablet_manager.cc:1403] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 1.324s	user 0.042s	sys 0.011s
I20260709 12:22:52.702069 30187 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
W20260709 12:22:52.740152 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 218244us
W20260709 12:22:52.782559 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 74532.6us
I20260709 12:22:52.856420 23852 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:52.867422 24563 raft_consensus.cc:1217] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
W20260709 12:22:52.902096 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 48832.3us
I20260709 12:22:52.935864 23995 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:52.938251 30089 raft_consensus.cc:359] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:52.939246 30089 raft_consensus.cc:740] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:22:52.939936 30089 consensus_queue.cc:260] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:52.941973 30168 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:52.951573 23750 catalog_manager.cc:5697] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 9 to 10, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:52.995625 30089 ts_tablet_manager.cc:1434] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.209s	user 0.009s	sys 0.000s
W20260709 12:22:53.072783 30132 log.cc:927] Time spent T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:22:53.085116 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 187353us
W20260709 12:22:53.094395 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 188847us
I20260709 12:22:53.065514 30171 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:22:53.123111 30196 log.cc:927] Time spent T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.136s	user 0.002s	sys 0.001s
W20260709 12:22:53.123522 30197 log.cc:927] Time spent T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:22:53.139655 24557 raft_consensus.cc:1217] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
W20260709 12:22:53.146971 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 78095.4us
I20260709 12:22:53.181057 24001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45032
I20260709 12:22:53.188570 30132 tablet_bootstrap.cc:492] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:53.189566 30132 tablet_bootstrap.cc:492] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:22:53.195139 30132 ts_tablet_manager.cc:1403] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 1.218s	user 0.067s	sys 0.063s
I20260709 12:22:53.181680 24001 raft_consensus.cc:606] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:53.211881 23927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:53.212517 23927 raft_consensus.cc:606] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:53.221519 23927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:53.222153 23927 raft_consensus.cc:606] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 21 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:53.227670 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:53.227558 30132 raft_consensus.cc:359] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:53.228478 23852 raft_consensus.cc:606] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:53.228688 30132 raft_consensus.cc:740] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:22:53.235834 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-83e1955dc5e84b5080e7ea8d739baff4 received from {username='slave'} at 127.0.0.1:35824
I20260709 12:22:53.236375 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-83e1955dc5e84b5080e7ea8d739baff4 on tablet 83e1955dc5e84b5080e7ea8d739baff4 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:53.238974 23849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:53.239636 23849 raft_consensus.cc:606] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 17 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:53.249120 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:53.250990 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:53.229486 30132 consensus_queue.cc:260] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:53.255129 30132 ts_tablet_manager.cc:1434] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 12:22:53.258517 23863 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d78d41f27ddd4a3fa2fe292b189ba372 received from {username='slave'} at 127.0.0.1:42458
I20260709 12:22:53.259006 23863 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d78d41f27ddd4a3fa2fe292b189ba372 on tablet d78d41f27ddd4a3fa2fe292b189ba372 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:53.262506 30204 raft_consensus.cc:993] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:53.263098 30193 raft_consensus.cc:1081] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 21 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:53.286890 23852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:22:53.287495 23852 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.287882 23852 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:53.283674 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:53.300873 30178 raft_consensus.cc:1064] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:22:53.302186 23852 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:53.309201 23852 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 22 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:53.310205 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:53.310858 23995 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:53.318125 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:53.323421 23927 raft_consensus.cc:3055] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:53.324349 23927 raft_consensus.cc:740] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:53.327795 23995 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 22.
I20260709 12:22:53.329087 23818 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:53.334870 30192 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:53.335574 30192 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 22 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:53.334856 23927 consensus_queue.cc:260] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:53.336506 30192 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:53.321453 30178 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:53.367871 23927 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:53.396492 23924 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:53.399156 24562 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:53.401007 30181 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:53.405063 23852 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:53.407933 23922 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:53.414443 30177 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:53.421180 23927 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 22.
I20260709 12:22:53.418181 30147 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:22:53.429451 24563 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:53.433998 24001 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:53.434610 30157 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:53.435245 30171 raft_consensus.cc:993] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:53.435765 30171 raft_consensus.cc:1081] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:53.438328 24001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:22:53.439462 24001 raft_consensus.cc:493] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.440304 24001 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:53.441897 30157 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:22:53.472291 24554 raft_consensus.cc:2955] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:53.469519 30154 raft_consensus.cc:2955] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:53.482769 24001 raft_consensus.cc:515] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:53.494416 23995 raft_consensus.cc:2955] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:53.505273 23752 catalog_manager.cc:5697] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 21 to 22, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 22 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.513440 23749 catalog_manager.cc:5697] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 10 to 11, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 12 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:53.524173 30181 raft_consensus.cc:2955] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:53.540422 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:53.541059 23849 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:53.543994 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72394010d8464f87107625dbd58b7d" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:53.544580 23924 raft_consensus.cc:3055] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:53.544889 23924 raft_consensus.cc:740] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:53.545614 23924 consensus_queue.cc:260] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:53.546703 23924 raft_consensus.cc:3060] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:53.553129 30147 raft_consensus.cc:993] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:53.553562 30201 raft_consensus.cc:993] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:53.553792 30147 raft_consensus.cc:1081] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:53.554126 30201 raft_consensus.cc:1081] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:53.559260 23849 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:22:53.561765 23854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:22:53.562438 23854 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.562844 23854 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:53.563534 30101 raft_consensus.cc:1064] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:22:53.542196 23922 raft_consensus.cc:2955] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:53.571497 23924 raft_consensus.cc:2468] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:22:53.572022 24001 leader_election.cc:290] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:53.571216 23966 leader_election.cc:304] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:53.573342 24554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36570
I20260709 12:22:53.580144 24554 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.580431 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d78ef4be778a4d7fa19baf9815bd1d96 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:53.581141 24554 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:53.582748 30029 raft_consensus.cc:2804] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:53.592603 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet d78ef4be778a4d7fa19baf9815bd1d96 with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:60686
I20260709 12:22:53.595500 24554 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:53.602125 30101 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:53.603350 24563 raft_consensus.cc:2955] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:53.606144 30029 raft_consensus.cc:697] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:53.608328 30029 consensus_queue.cc:237] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:53.613765 23854 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:53.618796 24554 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:53.623601 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:53.624266 23849 raft_consensus.cc:3055] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:53.624366 24001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:53.624603 23849 raft_consensus.cc:740] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:53.624945 24001 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:53.626945 23854 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:53.627439 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:53.627979 23924 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:53.628782 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:53.629352 23996 raft_consensus.cc:3055] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:53.629606 23996 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:53.629962 23849 consensus_queue.cc:260] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:53.642269 23849 raft_consensus.cc:3060] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:53.630215 30215 log.cc:927] Time spent T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:22:53.650178 23996 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:53.653340 24001 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:53.654068 23924 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:53.655294 23817 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:53.661393 24525 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:53.665511 23996 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:53.657276 23749 catalog_manager.cc:5697] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 11 to 12, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.662322 30192 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:53.677485 23849 raft_consensus.cc:2468] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
I20260709 12:22:53.670331 30199 raft_consensus.cc:2804] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:53.706573 30199 raft_consensus.cc:697] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:53.707525 30199 consensus_queue.cc:237] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:53.734920 24554 raft_consensus.cc:1217] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 12:22:53.680353 30192 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:53.778667 30192 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:53.765429 23996 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:22:53.761119 30216 tablet_replica.cc:333] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: stopping tablet replica
W20260709 12:22:53.943195 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 196012us
I20260709 12:22:54.002010 23852 raft_consensus.cc:2955] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:54.040570 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 288048us
I20260709 12:22:54.083406 23749 catalog_manager.cc:5697] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 12 to 13, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 13 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:54.095018 30216 raft_consensus.cc:2243] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:54.107715 24563 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:22:54.108767 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 67002.3us
I20260709 12:22:54.113343 23927 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 22 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 12:22:54.114763 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49009.8us
I20260709 12:22:54.114683 30216 raft_consensus.cc:2272] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:54.127399 30154 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:22:54.161741 30216 ts_tablet_manager.cc:1916] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:54.177265 30203 raft_consensus.cc:993] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:54.177914 30203 raft_consensus.cc:1081] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 17 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:54.178190 23750 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 14 to 15, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:54.183494 23995 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:54.187568 23752 catalog_manager.cc:5697] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 15 to 16, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 16 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:54.195946 30108 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:54.198210 23852 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:54.204921 30157 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:22:54.217801 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 147155us
I20260709 12:22:54.227681 24004 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 22 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 12:22:54.263157 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 232075us
I20260709 12:22:54.258656 30167 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:22:54.280776 23851 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:54.295842 30201 raft_consensus.cc:1064] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:22:54.299340 30220 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:54.304533 30201 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:54.311703 30192 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:54.315577 23924 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:54.317546 30240 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:54.317692 23995 raft_consensus.cc:1275] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:54.320075 30199 consensus_queue.cc:1048] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:54.310891 24004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:49640
I20260709 12:22:54.335673 24004 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:54.336067 24004 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:54.358868 23854 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:54.373260 23925 raft_consensus.cc:1275] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:54.380316 24004 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:54.387723 23997 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:54.397737 24004 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:54.411983 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:54.399441 30216 ts_tablet_manager.cc:1929] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:22:54.462473 30216 log.cc:1199] T d78ef4be778a4d7fa19baf9815bd1d96 P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/d78ef4be778a4d7fa19baf9815bd1d96
W20260709 12:22:54.499887 30250 log.cc:927] Time spent T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 12:22:54.514394 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet d78ef4be778a4d7fa19baf9815bd1d96 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:22:54.483636 30058 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 12:22:54.536229 30249 log.cc:927] Time spent T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:22:54.574994 24000 consensus_queue.cc:237] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:54.604163 24557 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:54.606829 30237 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:54.610579 23925 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:54.618532 30237 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:54.629832 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:54.632757 23852 raft_consensus.cc:3055] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:54.657853 23852 raft_consensus.cc:740] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:54.659092 23852 consensus_queue.cc:260] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:54.660725 23852 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:54.698599 30125 raft_consensus.cc:2955] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:54.710758 23817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.718704 24563 raft_consensus.cc:2955] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:54.726706 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:54.727550 23920 raft_consensus.cc:3060] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:54.731881 24554 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:54.740877 30223 raft_consensus.cc:2955] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:54.751667 23929 raft_consensus.cc:2955] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:54.762951 23920 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 18.
I20260709 12:22:54.790141 24004 raft_consensus.cc:1240] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:54.794756 23996 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:54.764904 24557 raft_consensus.cc:2955] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:54.797672 23995 raft_consensus.cc:2955] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:54.817006 23852 raft_consensus.cc:2468] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 18.
I20260709 12:22:54.825049 30181 consensus_queue.cc:1048] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:54.840325 23966 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:54.791174 30236 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 12:22:54.857928 30253 raft_consensus.cc:2804] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:54.858493 30253 raft_consensus.cc:697] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:54.868559 23852 raft_consensus.cc:2955] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:54.859392 30253 consensus_queue.cc:237] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:54.874125 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 75272us
I20260709 12:22:54.901825 23920 raft_consensus.cc:1275] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:54.875188 30097 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 12:22:54.917824 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 104157us
I20260709 12:22:54.896234 30201 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:22:54.992676 30253 consensus_queue.cc:1048] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:22:55.053683 24562 raft_consensus.cc:2955] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:55.045758 30253 raft_consensus.cc:2955] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:22:55.064630 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 131232us
W20260709 12:22:55.072337 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 110181us
I20260709 12:22:55.099423 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f15f801cf34333ad12954d0b614109"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:55.100010 23920 raft_consensus.cc:606] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:55.107859 24000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45032
I20260709 12:22:55.108670 24000 raft_consensus.cc:606] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:55.154944 23929 raft_consensus.cc:2955] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:55.170276 30282 raft_consensus.cc:993] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:55.170889 30282 raft_consensus.cc:1081] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:55.176385 23750 catalog_manager.cc:5697] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 9 to 10, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:55.178267 23750 catalog_manager.cc:5697] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:55.179873 23996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01f15f801cf34333ad12954d0b614109"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:22:55.180509 23996 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:55.180876 23996 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:55.183189 23999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45032
I20260709 12:22:55.183861 23999 raft_consensus.cc:606] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:55.187559 23853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:55.188135 23853 raft_consensus.cc:606] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 13 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:55.193624 23848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:55.194226 23848 raft_consensus.cc:606] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:55.194556 23848 raft_consensus.cc:614] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:55.195785 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:55.197616 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:55.200423 30029 raft_consensus.cc:993] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:55.200933 30178 raft_consensus.cc:1081] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:55.203099 23853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:22:55.203790 23853 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:55.204133 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f82c4b60fcc242eda3a32f8f32d6d163 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:55.204188 23853 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:55.206220 23995 raft_consensus.cc:2955] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:55.214232 23996 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:55.216841 23853 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:55.226457 23853 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:55.236290 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:55.249811 23853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:55.250669 23853 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:55.251027 23996 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:55.252892 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:55.253476 23929 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:55.253788 23929 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:55.254599 23929 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:55.255930 23929 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:55.267336 23929 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:55.269172 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:55.289443 23920 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:55.270756 23853 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:22:55.286690 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:55.291548 23996 raft_consensus.cc:3055] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:55.291915 23996 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:55.292881 23996 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:55.330266 23996 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:55.331598 23920 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:55.333683 23817 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:55.334479 30237 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:55.335049 30237 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:55.335989 30237 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:55.338624 23996 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:22:55.325707 23966 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:55.351368 30253 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:55.353442 30253 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:55.354612 30253 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:55.454879 30099 raft_consensus.cc:993] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:55.455407 30099 raft_consensus.cc:1081] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:55.461429 23853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:22:55.462102 23853 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:55.462495 23853 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:55.468571 30243 raft_consensus.cc:993] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:55.469121 30243 raft_consensus.cc:1081] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 13 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:55.470870 24554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36570
I20260709 12:22:55.471421 24554 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:55.471761 24554 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.472560 23853 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:55.475420 23853 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:55.475616 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:55.476176 23920 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:55.476481 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:55.477025 23995 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:55.477315 23995 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:55.478139 23995 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:55.479031 23995 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:55.483717 24554 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:55.484031 23920 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:55.486708 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:55.487327 23848 raft_consensus.cc:3055] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:55.487653 23848 raft_consensus.cc:740] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:55.488435 23848 consensus_queue.cc:260] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:55.489550 23848 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.493413 24554 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:55.494760 23817 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:55.498386 23929 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:22:55.500159 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:55.500348 23995 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 16.
I20260709 12:22:55.500767 23996 raft_consensus.cc:3060] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.508771 23996 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:55.511857 30279 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:55.512526 30279 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:55.513407 30279 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:55.517297 30203 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:22:55.519595 23848 raft_consensus.cc:2468] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 14.
I20260709 12:22:55.520823 24524 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:55.517904 30203 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:55.524266 30234 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:22:55.527899 30203 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:55.525055 30284 raft_consensus.cc:2804] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:55.529134 30284 raft_consensus.cc:697] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:55.529596 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:22:55.532656 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:22:55.533581 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82c4b60fcc242eda3a32f8f32d6d163" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:22:55.536819 23820 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:55.541618 23848 raft_consensus.cc:1275] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:22:55.546782 30099 consensus_queue.cc:1048] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:55.538529 30284 consensus_queue.cc:237] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:55.540191 30203 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:55.674319 23752 catalog_manager.cc:5697] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 17 to 18, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 18 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.701010 23750 catalog_manager.cc:5697] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 12 to 13, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 16 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:55.723043 23750 catalog_manager.cc:5697] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 13 to 14, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 14 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:55.752767 30294 log.cc:927] Time spent T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:22:55.790412 30297 log.cc:927] Time spent T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:22:55.810817 23920 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:22:55.854609 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 77624.2us
I20260709 12:22:55.842124 30118 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 12:22:55.894660 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 43934.4us
I20260709 12:22:55.954828 23848 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:56.093197 24000 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:56.136125 30304 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:56.095415 30301 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:22:56.205946 23925 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:56.213955 23744 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43178 (request call id 275) took 1013 ms. Trace:
I20260709 12:22:56.214579 23744 rpcz_store.cc:276] 0709 12:22:55.143138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.143289 (+   151us) service_pool.cc:224] Handling call
0709 12:22:56.153454 (+1010165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54143,"reported_tablets":3}
I20260709 12:22:56.224860 23922 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:56.245668 30311 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:56.247687 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet f82c4b60fcc242eda3a32f8f32d6d163 with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:60686
I20260709 12:22:56.251129 23749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43184 (request call id 247) took 1038 ms. Trace:
I20260709 12:22:56.277685 23853 raft_consensus.cc:1275] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:56.271947 23749 rpcz_store.cc:276] 0709 12:22:55.212386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.212526 (+   140us) service_pool.cc:224] Handling call
0709 12:22:55.246337 (+ 33811us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b54003129d4. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2873b6090 00007fa287454f3a 00007fa28d20ae9c 00007fa28d30904e 00007fa28b7ca2a4 00007fa28b7ca232 00007fa28b7ca161 00007fa28b7ca0dc 00007fa28b7c9392 00007fa28578748c 00007fa2857868c6
0709 12:22:55.342837 (+ 96500us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b5400002490. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284328640 00007fa28d1ff846 00007fa28d30990e 00007fa28b7ca2a4 00007fa28b7ca232 00007fa28b7ca161 00007fa28b7ca0dc 00007fa28b7c9392 00007fa28578748c 00007fa2857868c6
0709 12:22:56.250909 (+908072us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":128462976}
I20260709 12:22:56.257298 23929 consensus_queue.cc:237] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:56.318372 30240 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:22:56.348727 23893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.364730 30324 tablet_replica.cc:333] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:22:56.367115 30324 raft_consensus.cc:2243] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.369697 30324 raft_consensus.cc:2272] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.384369 30220 consensus_queue.cc:1048] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:56.399632 23995 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:56.427882 30324 ts_tablet_manager.cc:1916] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:56.474076 23996 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:56.527590 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:56.534055 24563 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:22:56.542403 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 103991us
I20260709 12:22:56.554903 23849 raft_consensus.cc:1275] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:56.572793 30243 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:56.579169 30236 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:56.580747 23749 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 14 to 15, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 15 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:56.583526 30302 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:56.659408 30286 consensus_queue.cc:1048] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:56.838773 30270 raft_consensus.cc:2955] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:56.841902 24557 raft_consensus.cc:2955] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:56.884626 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83e1955dc5e84b5080e7ea8d739baff4 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:22:56.913507 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 147761us
I20260709 12:22:56.925904 23852 raft_consensus.cc:2955] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:56.969671 30324 ts_tablet_manager.cc:1929] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 12:22:56.970495 30324 log.cc:1199] T f82c4b60fcc242eda3a32f8f32d6d163 P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/f82c4b60fcc242eda3a32f8f32d6d163
I20260709 12:22:56.972842 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet f82c4b60fcc242eda3a32f8f32d6d163 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:22:57.020025 23752 catalog_manager.cc:5697] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 12 to 13, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 13 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:57.013700 23744 catalog_manager.cc:5697] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 10 to 11, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:57.022207 23752 catalog_manager.cc:5697] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 15 to 16, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:22:57.064682 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet 83e1955dc5e84b5080e7ea8d739baff4 with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:45044
I20260709 12:22:57.081769 30346 tablet_replica.cc:333] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:22:57.093071 30346 raft_consensus.cc:2243] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:57.096606 30346 raft_consensus.cc:2272] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.122761 30346 ts_tablet_manager.cc:1916] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:57.158128 23849 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:57.289794 24557 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:57.292585 24004 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:57.306319 30279 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:22:57.322402 30243 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:57.342020 30346 ts_tablet_manager.cc:1929] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 12:22:57.342885 30346 log.cc:1199] T 83e1955dc5e84b5080e7ea8d739baff4 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/83e1955dc5e84b5080e7ea8d739baff4
I20260709 12:22:57.348562 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet 83e1955dc5e84b5080e7ea8d739baff4 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:22:57.416247 30317 raft_consensus.cc:2955] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:57.418000 23999 raft_consensus.cc:2955] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:57.422003 24557 raft_consensus.cc:2955] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:57.463881 23997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f15f801cf34333ad12954d0b614109"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:45032
I20260709 12:22:57.464715 23997 raft_consensus.cc:606] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:57.482431 24004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:45032
I20260709 12:22:57.483623 24004 raft_consensus.cc:606] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:57.504750 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d78d41f27ddd4a3fa2fe292b189ba372 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:57.510596 30018 raft_consensus.cc:993] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:57.511309 30343 raft_consensus.cc:993] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:57.511328 30227 raft_consensus.cc:1081] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:57.511901 30343 raft_consensus.cc:1081] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:57.524801 23926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01f15f801cf34333ad12954d0b614109"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:35558
I20260709 12:22:57.525482 23926 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:57.514356 24557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36558
I20260709 12:22:57.530889 24557 raft_consensus.cc:493] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:57.531246 24557 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:57.529691 23926 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:57.546749 23752 catalog_manager.cc:5697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 11 to 12, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:22:57.565529 24557 raft_consensus.cc:515] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:57.566365 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet d78d41f27ddd4a3fa2fe292b189ba372 with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:48096
I20260709 12:22:57.567962 24557 leader_election.cc:290] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:57.570178 23999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d880a30519445959394501b6616f15f"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45032
I20260709 12:22:57.570922 23999 raft_consensus.cc:606] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:22:57.571630 23926 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:57.572434 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:57.573144 23997 raft_consensus.cc:3055] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:57.573459 23997 raft_consensus.cc:740] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:57.573851 23926 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:57.574489 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536d25b8a1934dfd8c9ecb2fa2068928" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:57.574317 23997 consensus_queue.cc:260] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:57.575115 23925 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:57.577651 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
W20260709 12:22:57.578368 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 58912.8us
I20260709 12:22:57.578747 23850 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:57.584503 24004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:57.585194 24004 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:57.585501 24004 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:57.575821 23997 raft_consensus.cc:3060] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:57.606511 30352 tablet_replica.cc:333] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:22:57.614817 30352 raft_consensus.cc:2243] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:57.615912 30352 raft_consensus.cc:2272] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.623353 23850 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:57.624188 30352 ts_tablet_manager.cc:1916] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:57.624286 23852 raft_consensus.cc:1240] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:57.626284 24004 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:57.636704 30018 consensus_queue.cc:1059] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:57.638653 24004 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:57.631670 23999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:45032
I20260709 12:22:57.641984 23999 raft_consensus.cc:606] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:22:57.630154 23892 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:57.655537 23997 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 16.
I20260709 12:22:57.668898 24525 leader_election.cc:304] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:57.671036 30284 raft_consensus.cc:2804] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:57.671561 30284 raft_consensus.cc:697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:57.659318 24004 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:22:57.672515 30284 consensus_queue.cc:237] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:57.686657 30335 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:57.695111 30335 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:57.696303 30335 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:57.702144 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:57.704190 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:57.705281 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:57.726454 23925 raft_consensus.cc:2468] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 16.
I20260709 12:22:57.736756 23750 catalog_manager.cc:5697] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 15 to 16, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 16 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.737020 23752 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 15 to 16, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.792057 30352 ts_tablet_manager.cc:1929] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:22:57.796015 30352 log.cc:1199] T d78d41f27ddd4a3fa2fe292b189ba372 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/d78d41f27ddd4a3fa2fe292b189ba372
I20260709 12:22:57.798940 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet d78d41f27ddd4a3fa2fe292b189ba372 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:22:57.975893 30018 raft_consensus.cc:993] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:57.976593 30312 raft_consensus.cc:1081] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:57.980211 23850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d880a30519445959394501b6616f15f"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:22:57.980769 23850 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:57.981141 23850 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:57.989676 23850 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:58.007087 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:58.007758 23999 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:58.008059 23999 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:58.009558 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:58.010191 24561 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:58.012362 23850 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:58.008900 23999 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:58.017278 23999 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:58.027102 24561 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 18.
I20260709 12:22:58.028587 23820 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:22:58.029564 30236 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:58.030061 30236 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 18 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:58.031020 30236 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:58.033753 23999 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 18.
I20260709 12:22:58.066599 30320 raft_consensus.cc:993] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:58.067206 30320 raft_consensus.cc:1081] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:22:58.053365 23752 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c reported cstate change: term changed from 17 to 18, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 18 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.073585 23925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:35558
I20260709 12:22:58.074254 23925 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:58.074652 23925 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:58.116923 23925 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:58.119693 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:58.120328 23999 raft_consensus.cc:3055] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:58.120623 23999 raft_consensus.cc:740] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:58.121460 23999 consensus_queue.cc:260] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:58.124526 23999 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:58.133492 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:58.134191 24561 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:58.134755 23920 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:58.136337 30354 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:58.151981 23925 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:58.154729 24561 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 20.
I20260709 12:22:58.156061 23895 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:58.156966 30335 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:58.157545 30335 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:58.158468 30335 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:58.164522 23999 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 20.
I20260709 12:22:58.171821 23999 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:58.173396 30286 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:58.178803 23997 raft_consensus.cc:1275] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:58.181070 30309 consensus_queue.cc:1048] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:58.221108 23850 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:58.225292 30270 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:58.219254 23752 catalog_manager.cc:5697] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 19 to 20, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 20 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.463450 24561 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:22:58.464922 30236 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:22:58.504716 23999 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:22:58.521670 30350 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:22:58.559437 24561 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:22:58.567624 30286 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:58.610572 24004 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:22:58.612154 30335 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:58.819944 23920 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:58.887365 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:58.929183 23895 consensus_peers.cc:597] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01f15f801cf34333ad12954d0b614109. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:59.001273 23850 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:59.005308 23997 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:59.006942 30270 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:59.037375 30286 raft_consensus.cc:2955] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:59.039213 24004 raft_consensus.cc:2955] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:59.069850 23926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f15f801cf34333ad12954d0b614109"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:59.129946 23926 raft_consensus.cc:606] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
W20260709 12:22:59.139739 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 68036.3us
I20260709 12:22:59.144889 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:59.145772 23852 raft_consensus.cc:606] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 19 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:22:59.156368 30286 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:22:59.201290 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 56699.7us
I20260709 12:22:59.208859 23752 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:59.210572 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:59.211844 23852 raft_consensus.cc:606] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 18 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:59.277699 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d880a30519445959394501b6616f15f"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:22:59.278494 23852 raft_consensus.cc:606] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 18 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:59.285202 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdd49025134246c8a0245389cc43db77"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:22:59.289848 23926 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:59.289930 23920 raft_consensus.cc:606] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:22:59.294034 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:59.295908 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:59.296757 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:59.308269 30350 raft_consensus.cc:993] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:59.308867 30350 raft_consensus.cc:1081] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 19 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:22:59.314850 23850 raft_consensus.cc:2955] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:59.358388 30236 raft_consensus.cc:993] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:59.360316 30236 raft_consensus.cc:1081] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 18 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:59.369921 24004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d880a30519445959394501b6616f15f"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:49640
I20260709 12:22:59.370674 24004 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.371099 24004 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:59.395709 24561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36570
I20260709 12:22:59.396337 24561 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.396710 24561 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:59.406055 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 56367.2us
W20260709 12:22:59.414129 23895 consensus_peers.cc:597] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d80eac81f44441f49acb9eba858e3637. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:59.433991 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 58899.2us
I20260709 12:22:59.441717 24004 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:59.443645 23997 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:59.445705 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:59.451984 24561 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:59.473071 23852 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:59.473666 23852 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:59.468056 24004 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:22:59.500540 24561 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:22:59.500623 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 135030us
I20260709 12:22:59.498051 30335 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 12:22:59.511957 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 48241.7us
I20260709 12:22:59.515918 23849 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:22:59.518354 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 98000.1us
W20260709 12:22:59.532279 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 117239us
I20260709 12:22:59.539991 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:59.540591 23929 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:59.543908 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:59.544543 23850 raft_consensus.cc:3055] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:59.544813 23850 raft_consensus.cc:740] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
W20260709 12:22:59.547887 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 146114us
I20260709 12:22:59.559945 23850 consensus_queue.cc:260] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:59.559913 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:22:59.565011 24554 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:59.583014 23850 raft_consensus.cc:3060] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:59.638274 23850 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 20.
I20260709 12:22:59.663055 24554 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 19.
I20260709 12:22:59.666173 23929 raft_consensus.cc:2468] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 20.
I20260709 12:22:59.679272 24004 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:59.682195 30398 raft_consensus.cc:993] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:59.682798 30398 raft_consensus.cc:1081] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 18 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:59.683526 30399 ts_tablet_manager.cc:933] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:59.710212 30381 raft_consensus.cc:993] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:59.709587 23852 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:59.717607 23852 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:59.710765 30381 raft_consensus.cc:1081] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:22:59.730103 23969 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:59.739719 30392 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:59.740463 30392 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:59.745018 24524 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:59.745450 23852 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 19.
I20260709 12:22:59.742558 30392 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:59.757218 30354 raft_consensus.cc:2804] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:59.757776 30354 raft_consensus.cc:697] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:22:59.758826 30354 consensus_queue.cc:237] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:22:59.768620 23849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01f15f801cf34333ad12954d0b614109"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:22:59.769280 23849 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.769671 23849 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:59.789242 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 49408.8us
W20260709 12:22:59.795570 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 91792.5us
I20260709 12:22:59.799902 23849 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:59.803546 23849 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:22:59.781806 30380 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:22:59.802407 24004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:49640
I20260709 12:22:59.810954 24004 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.812155 24004 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:59.819538 23997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:22:59.820273 23997 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:59.798768 30399 tablet_copy_client.cc:323] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:22:59.840303 24004 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:59.844774 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 61503.8us
I20260709 12:22:59.859344 23997 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 17.
I20260709 12:22:59.863022 23750 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 18 to 19, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 19 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.871222 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:59.871851 23926 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:59.872205 23926 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:22:59.872929 23926 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:59.876981 23926 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:59.874854 23818 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:22:59.879904 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:22:59.880461 23849 raft_consensus.cc:3055] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:59.880650 23849 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:59.879439 24004 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:59.888777 30380 raft_consensus.cc:993] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:59.889264 30380 raft_consensus.cc:1081] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:22:59.888087 23849 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:59.890972 23849 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:59.890894 30387 raft_consensus.cc:2955] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:59.887475 30385 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:59.899029 30385 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 17 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:22:59.899978 30385 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:59.908960 23996 raft_consensus.cc:2955] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:22:59.915511 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet 01f15f801cf34333ad12954d0b614109 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:22:59.916144 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet 01f15f801cf34333ad12954d0b614109 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-01f15f801cf34333ad12954d0b614109
I20260709 12:22:59.924233 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:22:59.924889 23925 raft_consensus.cc:3060] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:59.941363 23997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdd49025134246c8a0245389cc43db77"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:22:59.942029 23997 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.942412 23997 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:59.931865 23925 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 19.
I20260709 12:22:59.953730 23744 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 16 to 17, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 17 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.950358 23926 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 17.
I20260709 12:22:59.961241 23966 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:22:59.962211 30402 raft_consensus.cc:2804] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:59.969431 23849 raft_consensus.cc:2468] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 19.
I20260709 12:22:59.973834 23997 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:22:59.962761 30402 raft_consensus.cc:697] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:22:59.979939 30402 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:22:59.988242 23894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.987900 23852 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:22:59.977420 23939 tablet_copy_source_session.cc:215] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:59.999208 30414 ts_tablet_manager.cc:933] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:22:59.984932 23752 catalog_manager.cc:5697] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 19 to 20, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 20 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.015554 30399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f15f801cf34333ad12954d0b614109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.003368 23848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:23:00.020227 23848 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:00.024003 23749 catalog_manager.cc:5697] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:00.032591 23997 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:00.033455 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:00.034250 23926 raft_consensus.cc:3055] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:00.031767 23849 raft_consensus.cc:2955] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:00.034314 23848 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:23:00.034662 23926 raft_consensus.cc:740] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:00.035203 23850 raft_consensus.cc:1240] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:00.042671 23966 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:00.043660 30320 raft_consensus.cc:2804] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:00.044360 30320 raft_consensus.cc:697] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:00.051304 23926 consensus_queue.cc:260] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:00.055999 30414 tablet_copy_client.cc:323] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:23:00.053027 30381 consensus_queue.cc:1059] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 12:23:00.058979 23820 consensus_peers.cc:597] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41807c0564934d23b20ac6f983e233d6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:00.065784 23925 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:00.067591 30391 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:00.068341 23926 raft_consensus.cc:3060] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:00.059412 30320 consensus_queue.cc:237] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:00.063213 23997 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:00.073099 30385 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:00.083427 23926 raft_consensus.cc:2468] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:23:00.100481 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet d80eac81f44441f49acb9eba858e3637 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:23:00.101342 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet d80eac81f44441f49acb9eba858e3637 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-d80eac81f44441f49acb9eba858e3637
I20260709 12:23:00.167898 30404 raft_consensus.cc:2955] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:00.168219 23996 raft_consensus.cc:2955] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:00.193770 23939 tablet_copy_source_session.cc:215] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:00.197453 30414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80eac81f44441f49acb9eba858e3637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.244899 23744 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 18 to 19, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 19 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.249634 30399 tablet_copy_client.cc:806] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:00.250391 30399 tablet_copy_client.cc:670] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:00.246505 23744 catalog_manager.cc:5697] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 13 to 14, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 14 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.250674 23925 raft_consensus.cc:2955] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:00.279170 23926 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:00.290432 30388 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:00.301147 30399 tablet_copy_client.cc:538] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:00.322724 23744 catalog_manager.cc:5697] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 13 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:00.332974 30399 tablet_bootstrap.cc:492] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:23:00.333853 23995 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:00.345932 23920 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:00.355683 30404 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:00.364806 23848 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
W20260709 12:23:00.372555 23969 consensus_peers.cc:597] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ade9323ef4a49b3b60c68243facc406. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:00.376681 30402 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:23:00.385022 23926 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:00.388247 23849 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:00.388175 30320 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:00.390515 23852 raft_consensus.cc:1275] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:00.401194 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:00.406802 23820 consensus_peers.cc:597] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:00.418773 30354 consensus_queue.cc:1048] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:23:00.434744 30384 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 12:23:00.543783 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 80644.1us
I20260709 12:23:00.570744 30414 tablet_copy_client.cc:806] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:00.611415 24554 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
I20260709 12:23:00.721560 23926 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:23:00.632092 30414 tablet_copy_client.cc:670] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:00.734364 23848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:23:00.735158 23848 raft_consensus.cc:606] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:23:00.735345 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 101924us
W20260709 12:23:00.782021 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 154358us
W20260709 12:23:00.830353 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 46920.5us
W20260709 12:23:00.902339 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 60519.2us
W20260709 12:23:00.919363 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 299420us
I20260709 12:23:00.954295 23925 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:00.978402 23852 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 12:23:01.043382 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 113342us
W20260709 12:23:01.064553 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 82481.6us
I20260709 12:23:01.055202 30439 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
W20260709 12:23:01.117781 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 89568.4us
I20260709 12:23:01.135567 30450 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 12:23:01.188144 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 52720.3us
I20260709 12:23:01.198647 30385 raft_consensus.cc:993] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:23:01.199306 30385 raft_consensus.cc:1081] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:23:01.200573 30438 raft_consensus.cc:2955] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:01.204519 30414 tablet_copy_client.cc:538] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:01.209837 23925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:23:01.210721 23925 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.211082 23925 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:01.214358 30440 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:23:01.230955 23995 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:01.259963 23925 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:01.262701 23925 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:01.263433 23849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:23:01.264158 23849 raft_consensus.cc:3055] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:01.264456 23849 raft_consensus.cc:740] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:23:01.265312 23849 consensus_queue.cc:260] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:01.266311 23849 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:01.267086 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092a962747db4e3b9c0bb6d7fdb831d5" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:01.267714 24000 raft_consensus.cc:3060] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:01.239563 30402 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 12:23:01.279718 23852 raft_consensus.cc:1275] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:01.287178 23850 raft_consensus.cc:2955] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:01.296875 24000 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:23:01.297696 23999 raft_consensus.cc:1240] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:01.302991 23849 raft_consensus.cc:2468] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:23:01.305189 23893 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:01.335583 30461 consensus_queue.cc:1048] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:01.336036 30387 raft_consensus.cc:2804] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:01.336650 30387 raft_consensus.cc:697] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:01.339807 30399 tablet_bootstrap.cc:492] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:01.340818 30399 tablet_bootstrap.cc:492] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:01.341588 30399 ts_tablet_manager.cc:1403] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 1.009s	user 0.059s	sys 0.009s
I20260709 12:23:01.352775 24000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d880a30519445959394501b6616f15f"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45032
I20260709 12:23:01.353533 24000 raft_consensus.cc:606] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:23:01.368438 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:01.370420 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:01.371215 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:01.399724 30463 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
W20260709 12:23:01.401394 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 46840.5us
W20260709 12:23:01.425330 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 58142.6us
I20260709 12:23:01.337533 30387 consensus_queue.cc:237] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:01.444124 23926 raft_consensus.cc:2955] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:23:01.482908 30453 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:23:01.483435 30478 ts_tablet_manager.cc:933] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:23:01.517431 30479 ts_tablet_manager.cc:933] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:01.539547 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 58072.3us
W20260709 12:23:01.561100 30481 log.cc:927] Time spent T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:23:01.572212 30399 raft_consensus.cc:359] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:01.573582 30399 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:01.574604 30399 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:01.589854 30430 raft_consensus.cc:993] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:23:01.590644 30430 raft_consensus.cc:1081] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
W20260709 12:23:01.585578 30474 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:23:01.596889 30475 log.cc:927] Time spent T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.229s	user 0.003s	sys 0.000s
I20260709 12:23:01.602733 23854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d880a30519445959394501b6616f15f"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:23:01.603485 23854 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.603932 23854 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:01.611802 23854 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:01.628685 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 148918us
I20260709 12:23:01.647745 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:01.654081 23854 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 20 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:01.671626 30399 ts_tablet_manager.cc:1434] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.328s	user 0.007s	sys 0.004s
I20260709 12:23:01.686715 30414 tablet_bootstrap.cc:492] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:23:01.705621 23744 catalog_manager.cc:5697] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 8, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 15 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.732179 23852 raft_consensus.cc:1240] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Rejecting Update request from peer 604755d84b7e4ff8a2b75453dccb6f1b for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:01.735414 23999 raft_consensus.cc:3055] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:01.735893 23999 raft_consensus.cc:740] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:01.736701 23999 consensus_queue.cc:260] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 19.18, Last appended by leader: 18, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:01.738118 23999 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:01.742770 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 359677us
I20260709 12:23:01.788645 23999 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 20.
I20260709 12:23:01.833097 23818 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:01.838585 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:01.839568 24554 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:01.838801 30467 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:01.869163 24554 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 20.
I20260709 12:23:01.836426 30478 tablet_copy_client.cc:323] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
W20260709 12:23:01.891695 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 49745.7us
I20260709 12:23:01.870277 30467 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 20 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:23:01.877863 30479 tablet_copy_client.cc:323] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:23:01.900583 30467 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 19.18, Last appended by leader: 18, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:01.985747 23863 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet 41807c0564934d23b20ac6f983e233d6 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:23:01.986510 23863 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet 41807c0564934d23b20ac6f983e233d6 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-41807c0564934d23b20ac6f983e233d6
I20260709 12:23:01.990700 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 0ade9323ef4a49b3b60c68243facc406 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:23:01.991519 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 0ade9323ef4a49b3b60c68243facc406 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-0ade9323ef4a49b3b60c68243facc406
W20260709 12:23:02.011242 23736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73d2fbc1f30749eba64903d7e79de8a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 22996f888daf435398b693481171c18c (127.22.43.65:34895) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 22996f888daf435398b693481171c18c from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 16 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:02.024745 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-01f15f801cf34333ad12954d0b614109 received from {username='slave'} at 127.0.0.1:35824
I20260709 12:23:02.026602 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-01f15f801cf34333ad12954d0b614109 on tablet 01f15f801cf34333ad12954d0b614109 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:02.040858 24004 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:02.059190 30387 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:02.135596 23851 raft_consensus.cc:1275] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:02.149333 24014 tablet_copy_source_session.cc:215] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:02.182426 30435 consensus_queue.cc:1048] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:02.197865 23863 tablet_copy_source_session.cc:215] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:02.238318 30479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ade9323ef4a49b3b60c68243facc406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.249223 30478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41807c0564934d23b20ac6f983e233d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:02.251976 23752 catalog_manager.cc:5697] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 16 to 17, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 17 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:02.386303 30511 log.cc:927] Time spent T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:23:02.406245 30391 raft_consensus.cc:1064] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:23:02.425089 24000 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 19 index: 18. Preceding OpId from leader: term: 20 index: 19. (index mismatch)
I20260709 12:23:02.427971 30445 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.004s
I20260709 12:23:02.460775 30391 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:02.512367 23752 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 19 to 20, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 20 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:02.517261 24562 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 19 index: 18. Preceding OpId from leader: term: 20 index: 19. (index mismatch)
I20260709 12:23:02.518566 24554 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:02.521057 30467 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:23:02.522083 30463 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:23:02.545380 30414 log.cc:927] Time spent T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:23:02.552795 30516 log.cc:927] Time spent T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:23:02.564329 24004 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:02.575042 23920 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:02.574409 30466 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:23:02.608117 30463 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:23:02.621413 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36570 (request call id 1486) took 1380 ms. Trace:
I20260709 12:23:02.626108 30478 rpcz_store.cc:276] 0709 12:23:01.241410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.246970 (+  5560us) service_pool.cc:224] Handling call
0709 12:23:01.483982 (+237012us) ts_tablet_manager.cc:934] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
0709 12:23:01.792368 (+308386us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7fa284428768. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284382d91 00007fa28435dc44 00007fa28435bbb4 00007fa28c3c0131 00007fa28c3c6ac8 00007fa28c45f1df 00007fa28c490f4e 00007fa28c475fdd 00007fa28c475f89 00007fa28c475f19
0709 12:23:02.242735 (+450367us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:23:02.429669 (+186934us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:02.429810 (+   141us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:23:02.598144 (+168334us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:23:02.613701 (+ 15557us) tablet_replica.cc:206] Creating consensus instance
0709 12:23:02.621045 (+  7344us) ts_tablet_manager.cc:989] Replica registered.
0709 12:23:02.621280 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":16729,"spinlock_wait_cycles":12566912,"tablet-copy.queue_time_us":231931,"thread_start_us":162527,"threads_started":2}
I20260709 12:23:02.633641 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36558 (request call id 1277) took 1321 ms. Trace:
I20260709 12:23:02.651564 30479 rpcz_store.cc:276] 0709 12:23:01.312538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.313736 (+  1198us) service_pool.cc:224] Handling call
0709 12:23:01.517918 (+204182us) ts_tablet_manager.cc:934] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
0709 12:23:01.784355 (+266437us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7fa284428768. stack: 00007fa28432d343 00007fa28432d240 00007fa283cbc1d4 00007fa28d9fa304 00007fa28d9fa299 00007fa2841e7db1 00007fa284382d91 00007fa28435dc08 00007fa28435bbb4 00007fa28c3c0131 00007fa28c3c6ac8 00007fa28c45f1df 00007fa28c490f4e 00007fa28c475fdd 00007fa28c475f89 00007fa28c475f19
0709 12:23:02.237030 (+452675us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:23:02.484056 (+247026us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:02.484224 (+   168us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:23:02.632801 (+148577us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:23:02.633102 (+   301us) tablet_replica.cc:206] Creating consensus instance
0709 12:23:02.633428 (+   326us) ts_tablet_manager.cc:989] Replica registered.
0709 12:23:02.633572 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":27479,"spinlock_wait_cycles":25428224,"tablet-copy.queue_time_us":165354,"thread_start_us":169542,"threads_started":2}
I20260709 12:23:02.683629 30479 tablet_copy_client.cc:806] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:02.684283 30479 tablet_copy_client.cc:670] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:02.688320 30479 tablet_copy_client.cc:538] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:02.711800 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:02.709143 30479 tablet_bootstrap.cc:492] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:23:02.717978 30467 raft_consensus.cc:2955] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:02.706701 30478 tablet_copy_client.cc:806] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:02.721395 30478 tablet_copy_client.cc:670] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:02.733114 23927 raft_consensus.cc:2955] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:02.734864 24000 raft_consensus.cc:2955] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:02.758671 30478 tablet_copy_client.cc:538] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:02.800424 30414 tablet_bootstrap.cc:492] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:02.801527 30414 tablet_bootstrap.cc:492] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:02.802362 30414 ts_tablet_manager.cc:1403] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 1.133s	user 0.072s	sys 0.037s
I20260709 12:23:02.816574 23744 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 11 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:02.851285 30414 raft_consensus.cc:359] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:02.852283 30414 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:02.852965 30414 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
W20260709 12:23:02.957556 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 82571.1us
W20260709 12:23:02.969919 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 104961us
I20260709 12:23:02.966861 30414 ts_tablet_manager.cc:1434] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.156s	user 0.013s	sys 0.000s
I20260709 12:23:02.992192 24562 raft_consensus.cc:2955] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:03.047549 30478 tablet_bootstrap.cc:492] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
W20260709 12:23:03.088335 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 113337us
W20260709 12:23:03.124284 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 143238us
I20260709 12:23:03.138762 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d80eac81f44441f49acb9eba858e3637 received from {username='slave'} at 127.0.0.1:35824
I20260709 12:23:03.139250 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-d80eac81f44441f49acb9eba858e3637 on tablet d80eac81f44441f49acb9eba858e3637 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:03.148901 23924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:23:03.149547 23924 raft_consensus.cc:606] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
W20260709 12:23:03.211670 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 114632us
W20260709 12:23:03.238119 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 104023us
W20260709 12:23:03.238119 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 90708.3us
I20260709 12:23:03.325673 23852 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:03.319618 24562 raft_consensus.cc:1217] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 12:23:03.362798 23852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:23:03.368237 23852 raft_consensus.cc:606] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:03.387478 30371 raft_consensus.cc:993] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:23:03.388201 30473 raft_consensus.cc:1081] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:23:03.392396 23846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:23:03.393061 23846 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:03.393441 23846 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:03.458899 24554 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:03.465682 30531 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:03.468734 23846 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:03.457525 23927 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:03.481015 30466 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:03.486996 23846 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:03.510262 30458 raft_consensus.cc:2955] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:03.514518 24554 raft_consensus.cc:2955] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:03.518592 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:03.519279 23927 raft_consensus.cc:3055] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:03.519834 23927 raft_consensus.cc:740] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:23:03.525638 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 173574us
I20260709 12:23:03.527127 23927 consensus_queue.cc:260] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:03.551222 23927 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:03.527096 23924 raft_consensus.cc:2955] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:03.565686 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:03.567750 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:03.568580 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:03.579594 23752 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 13 to 14, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 17 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:03.600677 23927 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:23:03.602089 23817 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:03.603052 30529 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:03.603590 30529 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:23:03.604519 30529 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:03.624374 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:03.625253 23996 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:03.646920 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 50138.9us
I20260709 12:23:03.662959 23996 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
W20260709 12:23:03.686627 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 90159.2us
I20260709 12:23:03.696656 23744 catalog_manager.cc:5697] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 14 to 15, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:03.692354 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01f15f801cf34333ad12954d0b614109 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:03.716435 30479 tablet_bootstrap.cc:492] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:03.717509 30479 tablet_bootstrap.cc:492] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:03.750523 30479 ts_tablet_manager.cc:1403] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 1.045s	user 0.062s	sys 0.028s
I20260709 12:23:03.760802 30505 raft_consensus.cc:1064] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:23:03.765031 30505 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:03.792944 30478 tablet_bootstrap.cc:492] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:03.796738 30478 tablet_bootstrap.cc:492] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:03.797484 30478 ts_tablet_manager.cc:1403] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.750s	user 0.049s	sys 0.019s
I20260709 12:23:03.793637 24561 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:03.793664 24000 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:03.802850 30371 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:03.812122 30473 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:03.829259 23846 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:03.833528 30524 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:03.846590 30529 raft_consensus.cc:993] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:23:03.823421 30479 raft_consensus.cc:359] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:03.851042 30529 raft_consensus.cc:1081] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:23:03.851199 30479 raft_consensus.cc:740] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:03.854887 23999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:49640
I20260709 12:23:03.855429 23999 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:03.855825 23999 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.867166 23999 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:03.871704 23999 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:03.872960 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:03.873570 24561 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.873436 23852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:23:03.874195 23852 raft_consensus.cc:3055] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:03.874485 23852 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:23:03.857129 30479 consensus_queue.cc:260] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:03.875232 23852 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:03.878883 23852 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.879612 30478 raft_consensus.cc:359] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:03.880539 30478 raft_consensus.cc:740] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:03.881278 30478 consensus_queue.cc:260] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:03.884148 30478 ts_tablet_manager.cc:1434] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.004s
I20260709 12:23:03.886636 23863 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-41807c0564934d23b20ac6f983e233d6 received from {username='slave'} at 127.0.0.1:42458
I20260709 12:23:03.887101 23863 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-41807c0564934d23b20ac6f983e233d6 on tablet 41807c0564934d23b20ac6f983e233d6 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:03.896315 23852 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:23:03.897830 23966 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:03.900354 30320 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:03.900823 30320 raft_consensus.cc:697] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:03.902127 24561 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 12.
I20260709 12:23:03.903772 30320 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:03.910290 30473 raft_consensus.cc:2955] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:03.912091 23846 raft_consensus.cc:2955] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:03.921451 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet 01f15f801cf34333ad12954d0b614109 with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:45044
I20260709 12:23:03.938861 23744 catalog_manager.cc:5697] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:03.942093 30552 tablet_replica.cc:333] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:03.944036 30552 raft_consensus.cc:2243] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:03.945007 30552 raft_consensus.cc:2272] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:03.950331 23750 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 11 to 12, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 12 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:03.939754 30479 ts_tablet_manager.cc:1434] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.189s	user 0.005s	sys 0.004s
I20260709 12:23:03.956192 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-0ade9323ef4a49b3b60c68243facc406 received from {username='slave'} at 127.0.0.1:34868
I20260709 12:23:03.956664 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-0ade9323ef4a49b3b60c68243facc406 on tablet 0ade9323ef4a49b3b60c68243facc406 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:03.956857 24561 raft_consensus.cc:2955] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:03.974601 24554 raft_consensus.cc:1217] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 12:23:03.986200 24000 raft_consensus.cc:2955] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:04.004040 24554 raft_consensus.cc:1217] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Deduplicated request from leader. Original: 15.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 12:23:03.988044 30552 ts_tablet_manager.cc:1916] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:04.038389 23929 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:04.056905 24554 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:04.057384 23999 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:04.058403 30473 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:04.059625 30435 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:04.071688 23929 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:04.073184 30529 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:04.079607 30435 raft_consensus.cc:2955] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:04.090531 23999 raft_consensus.cc:2955] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:04.088471 24554 raft_consensus.cc:2955] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:04.112514 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d80eac81f44441f49acb9eba858e3637 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:04.139312 23752 catalog_manager.cc:5697] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 11 to 12, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:04.154556 24000 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:04.158442 30531 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:04.172683 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet d80eac81f44441f49acb9eba858e3637 with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:60686
I20260709 12:23:04.174074 30552 ts_tablet_manager.cc:1929] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 12:23:04.190478 30552 log.cc:1199] T 01f15f801cf34333ad12954d0b614109 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/01f15f801cf34333ad12954d0b614109
I20260709 12:23:04.224119 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet 01f15f801cf34333ad12954d0b614109 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:23:04.236510 30556 tablet_replica.cc:333] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:04.237699 30556 raft_consensus.cc:2243] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.238626 30556 raft_consensus.cc:2272] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.277683 30556 ts_tablet_manager.cc:1916] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:04.443187 30312 raft_consensus.cc:1064] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:23:04.450021 30556 ts_tablet_manager.cc:1929] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 12:23:04.450536 30556 log.cc:1199] T d80eac81f44441f49acb9eba858e3637 P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/d80eac81f44441f49acb9eba858e3637
I20260709 12:23:04.452157 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet d80eac81f44441f49acb9eba858e3637 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:23:04.465583 30312 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 6, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:04.494585 23852 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:04.496256 30536 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:04.518896 23849 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:04.524430 24554 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:04.526207 30320 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:04.530366 24561 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:04.520448 30312 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:23:04.549600 30536 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:04.609401 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 59514.4us
I20260709 12:23:04.614208 23920 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:04.626305 30312 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:04.700301 30529 raft_consensus.cc:1064] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:23:04.763801 30535 raft_consensus.cc:2955] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:04.769109 23920 raft_consensus.cc:2955] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:23:04.789899 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 135575us
I20260709 12:23:04.836010 23752 catalog_manager.cc:5697] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 8 to 9, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:04.857714 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:04.894011 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 47710.8us
I20260709 12:23:04.924007 24561 raft_consensus.cc:2955] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:23:04.940167 23818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:04.979689 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 84579us
I20260709 12:23:04.988343 23996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:45032
I20260709 12:23:04.989061 23996 raft_consensus.cc:606] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:23:04.997789 30567 log.cc:927] Time spent T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 12:23:05.010255 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 108117us
I20260709 12:23:05.036749 23850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:23:05.042621 23850 raft_consensus.cc:606] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:05.056198 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:05.058293 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:05.059147 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.122406 30529 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:05.143095 30562 raft_consensus.cc:993] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
W20260709 12:23:05.144006 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 109410us
I20260709 12:23:05.164873 23996 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:05.154906 30580 raft_consensus.cc:1081] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:23:05.203020 23924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:23:05.203718 23924 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.204149 23924 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:05.211474 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 182504us
I20260709 12:23:05.217494 24554 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:23:05.227942 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 46199.8us
I20260709 12:23:05.235643 23920 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:05.240185 23924 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:05.242491 23924 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:05.244933 23852 raft_consensus.cc:2955] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.246320 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:05.247028 23996 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:05.252202 30580 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:05.254783 30531 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:05.273667 30529 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:05.285461 23996 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:23:05.287532 23893 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:05.290844 30593 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:05.291406 30593 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:05.292294 30593 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:05.341253 24000 consensus_queue.cc:237] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:05.346812 24554 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:05.353648 30535 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:23:05.365484 30566 raft_consensus.cc:2955] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.376199 24554 raft_consensus.cc:2955] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.400207 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ade9323ef4a49b3b60c68243facc406 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:05.384871 30458 raft_consensus.cc:2955] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.383800 23924 raft_consensus.cc:2955] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.407092 23920 raft_consensus.cc:1275] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:05.386494 23996 raft_consensus.cc:2955] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.420559 24000 raft_consensus.cc:1240] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Rejecting Update request from peer 22996f888daf435398b693481171c18c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:05.422192 30596 consensus_queue.cc:1059] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:05.423194 30596 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:05.423501 30596 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:23:05.429803 30596 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:05.450563 30596 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:05.454937 23750 catalog_manager.cc:5697] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.463477 23752 catalog_manager.cc:5697] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 9 to 10, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 15 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.470255 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:23:05.481494 24561 raft_consensus.cc:2955] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.497825 30535 raft_consensus.cc:993] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:23:05.498360 30594 raft_consensus.cc:1081] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:23:05.500229 30566 consensus_queue.cc:1048] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:05.525110 23924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:35558
I20260709 12:23:05.525743 23924 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:05.526144 23924 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:05.530681 23929 raft_consensus.cc:2955] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.535902 23924 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:05.537851 23924 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:05.538594 23850 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:23:05.540704 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:05.541285 24554 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:05.543841 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:05.544449 23996 raft_consensus.cc:3055] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:05.544752 23996 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:05.545557 23996 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:05.560002 23996 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:05.610284 24554 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:23:05.611649 23895 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:05.630148 30473 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:05.630858 30473 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:05.631848 30473 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:05.660535 23749 catalog_manager.cc:5697] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 16 to 17, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 17 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.672657 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ade9323ef4a49b3b60c68243facc406 with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:60686
I20260709 12:23:05.681455 23996 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:23:05.680754 23852 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:05.719430 24554 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:05.724874 30585 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:05.726562 30609 tablet_replica.cc:333] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:05.726737 23995 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:05.727736 30609 raft_consensus.cc:2243] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:05.728602 30609 raft_consensus.cc:2272] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:05.728645 30585 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:05.740587 30458 raft_consensus.cc:2955] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.745491 30609 ts_tablet_manager.cc:1916] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:05.747272 24561 raft_consensus.cc:2955] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.770895 24000 raft_consensus.cc:2955] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.790990 23750 catalog_manager.cc:5697] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 11 to 12, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 13 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:05.810796 23752 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 13 to 14, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.860141 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet 41807c0564934d23b20ac6f983e233d6 with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:48096
I20260709 12:23:05.873124 23852 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:23:05.907414 30598 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:05.897795 24000 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:23:05.899449 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 41807c0564934d23b20ac6f983e233d6 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:05.910758 30598 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:05.950521 30611 tablet_replica.cc:333] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:05.951835 30611 raft_consensus.cc:2243] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:05.952768 30611 raft_consensus.cc:2272] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:05.990895 30611 ts_tablet_manager.cc:1916] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:06.023038 30609 ts_tablet_manager.cc:1929] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 12:23:06.024020 30609 log.cc:1199] T 0ade9323ef4a49b3b60c68243facc406 P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/0ade9323ef4a49b3b60c68243facc406
I20260709 12:23:06.038097 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet 0ade9323ef4a49b3b60c68243facc406 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:23:06.064678 30611 ts_tablet_manager.cc:1929] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 12:23:06.065361 30611 log.cc:1199] T 41807c0564934d23b20ac6f983e233d6 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/41807c0564934d23b20ac6f983e233d6
I20260709 12:23:06.068171 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 41807c0564934d23b20ac6f983e233d6 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:23:06.283176 24000 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:06.286038 24561 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:06.317873 30618 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:23:06.323251 30593 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:06.524708 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.644189 23926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:23:06.645124 23926 raft_consensus.cc:606] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:06.654745 23926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:23:06.655400 23926 raft_consensus.cc:606] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:06.656837 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:06.658802 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:06.660111 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.684430 30581 raft_consensus.cc:993] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:23:06.685039 30581 raft_consensus.cc:1081] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:23:06.693940 24554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36552
I20260709 12:23:06.694957 24554 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:06.695564 24554 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:06.730964 24554 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:06.734269 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:06.735140 23926 raft_consensus.cc:3055] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:06.735272 24554 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:06.735522 23926 raft_consensus.cc:740] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:06.736634 23926 consensus_queue.cc:260] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:06.734310 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:06.739338 24000 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:06.746670 23926 raft_consensus.cc:3060] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:06.770605 24000 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 17.
I20260709 12:23:06.772403 24525 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:06.773727 30540 raft_consensus.cc:2804] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:06.774341 30540 raft_consensus.cc:697] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:23:06.775527 30540 consensus_queue.cc:237] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:06.789366 23752 catalog_manager.cc:5697] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 16 to 17, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 17 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.804355 23926 raft_consensus.cc:2468] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 17.
I20260709 12:23:07.069283 23846 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:07.071648 30593 raft_consensus.cc:993] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:23:07.072275 30620 raft_consensus.cc:1081] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:23:07.074189 23996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:23:07.074813 23996 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:07.075189 23996 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:07.082998 23995 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:07.084841 30530 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:07.098995 23926 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:07.102460 30569 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:07.107600 23996 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:07.114522 23846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:23:07.115291 23846 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:07.117986 23820 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29a434c2919b4912a056d435a8992ff0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:07.119313 23996 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:07.125169 23927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:07.133430 23927 raft_consensus.cc:3055] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:07.133713 23927 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:07.138499 23846 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 18.
I20260709 12:23:07.139096 23927 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:07.131392 30569 raft_consensus.cc:2955] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:07.139990 23966 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:07.140558 23927 raft_consensus.cc:3060] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:07.141022 30566 raft_consensus.cc:2804] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:07.141571 30566 raft_consensus.cc:697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:07.142587 30566 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:07.143563 23996 raft_consensus.cc:2955] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:07.184759 23749 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.188335 23927 raft_consensus.cc:2468] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 18.
I20260709 12:23:07.171275 23752 catalog_manager.cc:5697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 17 to 18, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 18 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:07.205838 23800 auto_rebalancer.cc:629] Failed to schedule move for tablet f478cef7044d4597b6db8ead4067f592: Illegal state: Replica e8bc734d763e4ddf87f7b930e35cbaa7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } }
I20260709 12:23:07.243876 23926 raft_consensus.cc:2955] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:07.254758 23996 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:07.262779 30540 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:07.280799 23846 consensus_queue.cc:237] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:07.308354 23926 raft_consensus.cc:1275] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:07.310847 30575 consensus_queue.cc:1048] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:07.362785 23926 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:07.364656 30530 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:07.421980 23995 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:07.424753 30458 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:07.553012 23846 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:07.565510 30458 raft_consensus.cc:2955] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:07.574241 23929 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:07.573648 23995 raft_consensus.cc:2955] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:23:07.582168 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 106330us
I20260709 12:23:07.624341 23926 raft_consensus.cc:2955] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:07.625856 30644 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:23:07.639622 30535 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:23:07.674728 23820 consensus_peers.cc:597] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 375316edc4f14c939e96f8ce70294c81. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:07.658532 23999 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:07.717767 23749 catalog_manager.cc:5697] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 8, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 10 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:07.731036 23852 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:07.734220 30610 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:07.772722 23924 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:07.779629 30656 ts_tablet_manager.cc:933] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:23:07.780646 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:07.793025 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 54914.7us
W20260709 12:23:07.863914 30661 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:23:07.870599 23969 consensus_peers.cc:597] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b845c11f69f485889b01a0a648dc3bc. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:07.871214 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 69851.5us
W20260709 12:23:07.891923 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 92466.5us
I20260709 12:23:07.912726 30535 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:23:07.931941 30656 tablet_copy_client.cc:323] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
I20260709 12:23:07.934203 23863 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet 29a434c2919b4912a056d435a8992ff0 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:23:07.934928 23863 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet 29a434c2919b4912a056d435a8992ff0 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-29a434c2919b4912a056d435a8992ff0
I20260709 12:23:07.936205 30535 raft_consensus.cc:2955] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:07.943562 24000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45032
I20260709 12:23:07.944258 24000 raft_consensus.cc:606] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:23:07.952466 23846 raft_consensus.cc:2955] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:07.962836 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:07.964754 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:07.965579 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:07.989372 23863 tablet_copy_source_session.cc:215] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:07.998418 30667 ts_tablet_manager.cc:933] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 22996f888daf435398b693481171c18c (127.22.43.65:34895)
I20260709 12:23:08.022758 30656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a434c2919b4912a056d435a8992ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.095184 23928 raft_consensus.cc:2955] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:08.127300 23752 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 11, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 19 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.137835 30656 tablet_copy_client.cc:806] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:08.144428 30656 tablet_copy_client.cc:670] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:08.140854 30667 tablet_copy_client.cc:323] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.65:34895
I20260709 12:23:08.155665 23863 tablet_copy_service.cc:140] P 22996f888daf435398b693481171c18c: Received BeginTabletCopySession request for tablet 375316edc4f14c939e96f8ce70294c81 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:42458)
I20260709 12:23:08.156230 23863 tablet_copy_service.cc:161] P 22996f888daf435398b693481171c18c: Beginning new tablet copy session on tablet 375316edc4f14c939e96f8ce70294c81 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:42458: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-375316edc4f14c939e96f8ce70294c81
I20260709 12:23:08.159298 30644 raft_consensus.cc:993] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:23:08.159916 30644 raft_consensus.cc:1081] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:23:08.163410 23852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:60702
I20260709 12:23:08.164048 23852 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:08.164459 23852 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:08.184211 23863 tablet_copy_source_session.cc:215] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:08.193173 23852 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:08.194468 30656 tablet_copy_client.cc:538] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:08.196730 23852 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:08.197103 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:08.197769 24563 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:08.205297 24563 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:23:08.207422 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:08.208062 23995 raft_consensus.cc:3055] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:08.208392 23995 raft_consensus.cc:740] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:08.209250 23995 consensus_queue.cc:260] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:08.210688 23995 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:08.218905 30667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375316edc4f14c939e96f8ce70294c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.230346 23995 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 13.
I20260709 12:23:08.231838 23818 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:08.233075 30641 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:08.233793 30641 raft_consensus.cc:697] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:23:08.235096 30641 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:08.310223 30656 tablet_bootstrap.cc:492] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:23:08.354991 30670 ts_tablet_manager.cc:933] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:08.375080 30670 tablet_copy_client.cc:323] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:23:08.380484 30667 tablet_copy_client.cc:806] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:08.390764 30667 tablet_copy_client.cc:670] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:08.377851 23752 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 12 to 13, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 13 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.397043 30667 tablet_copy_client.cc:538] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:08.397997 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 7b845c11f69f485889b01a0a648dc3bc from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:23:08.398641 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 7b845c11f69f485889b01a0a648dc3bc from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-7b845c11f69f485889b01a0a648dc3bc
I20260709 12:23:08.409276 24014 tablet_copy_source_session.cc:215] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:08.410980 30667 tablet_bootstrap.cc:492] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:23:08.430437 30670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b845c11f69f485889b01a0a648dc3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.540136 30670 tablet_copy_client.cc:806] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:08.540817 30670 tablet_copy_client.cc:670] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:08.556861 30670 tablet_copy_client.cc:538] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:08.579406 30656 tablet_bootstrap.cc:492] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:08.591548 30656 tablet_bootstrap.cc:492] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:08.598980 30656 ts_tablet_manager.cc:1403] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.317s	user 0.043s	sys 0.011s
I20260709 12:23:08.602883 30656 raft_consensus.cc:359] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:08.603830 30656 raft_consensus.cc:740] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:08.604509 30656 consensus_queue.cc:260] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:08.635164 30656 ts_tablet_manager.cc:1434] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.004s
I20260709 12:23:08.638417 24000 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:08.640969 30641 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:23:08.645925 23863 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-29a434c2919b4912a056d435a8992ff0 received from {username='slave'} at 127.0.0.1:42458
I20260709 12:23:08.646457 23863 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-29a434c2919b4912a056d435a8992ff0 on tablet 29a434c2919b4912a056d435a8992ff0 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:08.660475 30670 tablet_bootstrap.cc:492] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:23:08.687501 30667 tablet_bootstrap.cc:492] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:08.693603 30667 tablet_bootstrap.cc:492] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:08.697316 30667 ts_tablet_manager.cc:1403] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.287s	user 0.027s	sys 0.013s
I20260709 12:23:08.710305 30667 raft_consensus.cc:359] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:08.715557 30667 raft_consensus.cc:740] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:08.716560 30667 consensus_queue.cc:260] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:08.732334 24554 raft_consensus.cc:1217] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Deduplicated request from leader. Original: 15.11->[15.12-15.12]   Dedup: 15.12->[]
I20260709 12:23:08.743791 24554 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:08.749285 30655 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:08.771353 30667 ts_tablet_manager.cc:1434] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 12:23:08.801329 23863 tablet_copy_service.cc:342] P 22996f888daf435398b693481171c18c: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-375316edc4f14c939e96f8ce70294c81 received from {username='slave'} at 127.0.0.1:42458
I20260709 12:23:08.801949 23863 tablet_copy_service.cc:434] P 22996f888daf435398b693481171c18c: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-375316edc4f14c939e96f8ce70294c81 on tablet 375316edc4f14c939e96f8ce70294c81 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:08.879253 30670 tablet_bootstrap.cc:492] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:08.880471 30670 tablet_bootstrap.cc:492] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:08.881541 30670 ts_tablet_manager.cc:1403] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.221s	user 0.046s	sys 0.023s
I20260709 12:23:08.885080 30670 raft_consensus.cc:359] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:08.886226 30670 raft_consensus.cc:740] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:08.887115 30670 consensus_queue.cc:260] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:08.891058 30670 ts_tablet_manager.cc:1434] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:08.894457 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-7b845c11f69f485889b01a0a648dc3bc received from {username='slave'} at 127.0.0.1:34868
I20260709 12:23:08.894961 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-7b845c11f69f485889b01a0a648dc3bc on tablet 7b845c11f69f485889b01a0a648dc3bc with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:08.906860 24563 raft_consensus.cc:1217] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 12:23:09.123800 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:09.285161 23846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f15f801cf34333ad12954d0b614109"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:23:09.285833 23846 raft_consensus.cc:606] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 17 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:09.287396 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:09.289319 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:09.290143 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:09.320590 30458 raft_consensus.cc:1064] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:23:09.323990 30458 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:09.355248 30569 raft_consensus.cc:1064] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:23:09.364151 30569 consensus_queue.cc:237] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:09.443991 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 82083.4us
I20260709 12:23:09.446488 30655 raft_consensus.cc:993] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:23:09.447983 30655 raft_consensus.cc:1081] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 17 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:23:09.451102 24563 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:09.452582 24554 raft_consensus.cc:1217] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 LEARNER]: Deduplicated request from leader. Original: 19.10->[19.11-19.11]   Dedup: 19.11->[]
I20260709 12:23:09.462332 30655 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:09.474105 23929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01f15f801cf34333ad12954d0b614109"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:23:09.474856 23929 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:09.475322 23929 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:09.538661 23996 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:09.545745 30683 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:23:09.545962 23929 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:09.578366 23850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:23:09.579005 23850 raft_consensus.cc:3055] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:09.579301 23850 raft_consensus.cc:740] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:23:09.580050 23850 consensus_queue.cc:260] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:09.588985 24000 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:23:09.590256 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 72018.1us
I20260709 12:23:09.593206 24554 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEARNER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:09.595068 23929 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:09.597399 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:09.598191 24554 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:09.601631 23928 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:09.606900 23850 raft_consensus.cc:3060] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:09.595991 30687 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:23:09.615191 30680 raft_consensus.cc:2955] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:09.673168 30689 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:09.680177 23929 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:09.673326 30690 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:23:09.682055 23850 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 18.
I20260709 12:23:09.690128 30458 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:09.690835 23892 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:09.692945 30694 raft_consensus.cc:2804] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:09.693656 30694 raft_consensus.cc:697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:23:09.704129 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 96049.2us
I20260709 12:23:09.694639 30694 consensus_queue.cc:237] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:09.774406 23996 raft_consensus.cc:2955] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:23:09.781219 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 150715us
I20260709 12:23:09.785372 24554 raft_consensus.cc:2468] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 18.
W20260709 12:23:09.790938 30696 log.cc:927] Time spent T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:23:09.805279 24554 raft_consensus.cc:2955] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:23:09.845364 30695 log.cc:927] Time spent T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.093s	user 0.001s	sys 0.001s
I20260709 12:23:09.837373 23928 raft_consensus.cc:2955] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:09.838984 30688 raft_consensus.cc:2955] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:09.878113 23752 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:09.907109 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 72297.7us
I20260709 12:23:09.916574 24000 raft_consensus.cc:2955] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:23:09.942579 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 109721us
I20260709 12:23:09.939327 24557 raft_consensus.cc:2955] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:09.982681 23744 catalog_manager.cc:5697] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 17 to 18, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 18 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.994114 23928 raft_consensus.cc:2955] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:23:10.021639 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 77911.3us
W20260709 12:23:10.027693 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 84268.4us
W20260709 12:23:10.029551 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 61300.1us
I20260709 12:23:10.124622 30662 raft_consensus.cc:1064] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:23:10.127965 30662 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:10.130146 23850 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:10.137619 24557 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:23:10.139381 30655 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:10.140071 23995 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:23:10.145439 30683 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:10.148296 23752 catalog_manager.cc:5697] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 8 to 9, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.155481 30688 raft_consensus.cc:2955] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.164793 23995 raft_consensus.cc:2955] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.169169 24554 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:10.169802 24557 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:10.181639 30650 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:10.187062 23926 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:10.189435 24554 raft_consensus.cc:2955] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.190569 30624 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:10.203676 30566 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:10.205683 23852 raft_consensus.cc:1275] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:10.213320 30650 consensus_queue.cc:1048] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:10.214489 23851 consensus_queue.cc:237] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:10.189435 23850 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:10.239172 30566 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:10.254968 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 29a434c2919b4912a056d435a8992ff0 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:10.258644 24563 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:10.262951 23995 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:10.276782 30680 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:10.280143 30690 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:10.304992 30705 raft_consensus.cc:2955] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.329492 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 375316edc4f14c939e96f8ce70294c81 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:10.336099 30662 raft_consensus.cc:2955] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.341675 24554 raft_consensus.cc:2955] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.343717 23928 raft_consensus.cc:2955] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.372076 23850 raft_consensus.cc:2955] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.374531 23995 raft_consensus.cc:2955] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.402375 24561 raft_consensus.cc:2955] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.422501 23752 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 13 to 14, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.424849 23752 catalog_manager.cc:5697] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 9 to 10, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 10 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.435706 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:10.496091 23912 tablet_service.cc:1558] Processing DeleteTablet for tablet 29a434c2919b4912a056d435a8992ff0 with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:48096
I20260709 12:23:10.497577 23917 tablet_service.cc:1558] Processing DeleteTablet for tablet 375316edc4f14c939e96f8ce70294c81 with delete_type TABLET_DATA_TOMBSTONED (TS e8bc734d763e4ddf87f7b930e35cbaa7 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48096
I20260709 12:23:10.507725 23749 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 11 to 12, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.551726 23996 consensus_queue.cc:237] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:10.559440 24557 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:10.561226 30662 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:10.562935 30723 tablet_replica.cc:333] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:10.570554 23929 raft_consensus.cc:1275] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:10.571776 30723 raft_consensus.cc:2243] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:10.573935 30723 raft_consensus.cc:2272] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:10.573952 30566 consensus_queue.cc:1048] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:10.584023 30624 raft_consensus.cc:2955] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.590715 24561 raft_consensus.cc:2955] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.596704 23928 raft_consensus.cc:2955] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:10.604841 30723 ts_tablet_manager.cc:1916] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:10.615056 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b845c11f69f485889b01a0a648dc3bc with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:10.636054 23744 catalog_manager.cc:5697] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 12 to 13, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 19 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.651533 30723 ts_tablet_manager.cc:1929] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.13
I20260709 12:23:10.652143 30723 log.cc:1199] T 29a434c2919b4912a056d435a8992ff0 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/29a434c2919b4912a056d435a8992ff0
I20260709 12:23:10.654261 30723 tablet_replica.cc:333] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:10.654629 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 29a434c2919b4912a056d435a8992ff0 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:23:10.655344 30723 raft_consensus.cc:2243] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:10.656298 30723 raft_consensus.cc:2272] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:10.660458 30723 ts_tablet_manager.cc:1916] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:10.665990 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b845c11f69f485889b01a0a648dc3bc with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:60686
I20260709 12:23:10.690654 30723 ts_tablet_manager.cc:1929] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 12:23:10.691216 30723 log.cc:1199] T 375316edc4f14c939e96f8ce70294c81 P e8bc734d763e4ddf87f7b930e35cbaa7: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/wals/375316edc4f14c939e96f8ce70294c81
I20260709 12:23:10.692812 23736 catalog_manager.cc:5028] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): tablet 375316edc4f14c939e96f8ce70294c81 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:23:10.695236 23929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:23:10.695890 23929 raft_consensus.cc:606] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Received request to transfer leadership to TS 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:10.698422 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:10.700349 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:10.701257 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:10.708343 30724 tablet_replica.cc:333] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:10.740753 30724 raft_consensus.cc:2243] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:10.742190 30724 raft_consensus.cc:2272] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:10.755658 30724 ts_tablet_manager.cc:1916] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:10.807817 30724 ts_tablet_manager.cc:1929] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.12
I20260709 12:23:10.808305 30724 log.cc:1199] T 7b845c11f69f485889b01a0a648dc3bc P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/7b845c11f69f485889b01a0a648dc3bc
I20260709 12:23:10.818437 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet 7b845c11f69f485889b01a0a648dc3bc (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:23:11.098737 30685 raft_consensus.cc:993] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:23:11.099321 30694 raft_consensus.cc:1081] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Signalling peer 604755d84b7e4ff8a2b75453dccb6f1b to start an election
I20260709 12:23:11.101372 23995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
 from {username='slave'} at 127.0.0.1:52314
I20260709 12:23:11.102092 23995 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.102475 23995 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:11.111835 23995 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:11.237641 23995 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:11.309971 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:11.312438 23928 raft_consensus.cc:3055] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:11.312973 23928 raft_consensus.cc:740] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:11.313683 23928 consensus_queue.cc:260] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:11.315271 23928 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:11.310470 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 97814.2us
W20260709 12:23:11.353657 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 55092.6us
I20260709 12:23:11.362890 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:11.363493 24557 raft_consensus.cc:3060] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:11.363907 23928 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:23:11.402221 24557 raft_consensus.cc:2468] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:23:11.406888 23966 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:11.407873 30662 raft_consensus.cc:2804] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:11.408483 30662 raft_consensus.cc:697] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:11.409507 30662 consensus_queue.cc:237] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:11.434949 23744 catalog_manager.cc:5697] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 14 to 15, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 15 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.787946 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:11.843456 24557 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:11.918412 30709 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:12.031828 23926 raft_consensus.cc:1275] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:12.034451 30709 consensus_queue.cc:1048] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:12.056288 23995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "769e238f62804be6900a5660ed34e431"
dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:45032
I20260709 12:23:12.057135 23995 raft_consensus.cc:606] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:12.072804 23928 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:12.095672 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:12.119813 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:12.120810 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:12.128180 23895 consensus_peers.cc:597] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9308162d63f49c4aa8dfccb14c1cf8a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:12.129354 23995 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:12.156280 30737 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
W20260709 12:23:12.167256 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 92727us
I20260709 12:23:12.173712 23850 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:12.215917 30685 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:23:12.299443 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 127456us
W20260709 12:23:12.314994 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 72530.3us
I20260709 12:23:12.341051 30749 raft_consensus.cc:2955] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:23:12.388173 30745 log.cc:927] Time spent T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 12:23:12.394104 30566 raft_consensus.cc:993] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:23:12.404456 30566 raft_consensus.cc:1081] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:23:12.394959 23995 raft_consensus.cc:2955] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:12.430222 23924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "769e238f62804be6900a5660ed34e431"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:35558
I20260709 12:23:12.430827 23924 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:12.431182 23924 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:12.452136 23850 raft_consensus.cc:2955] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:12.456722 23924 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:12.458860 23924 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:12.462764 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:12.463413 24562 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:12.470395 23744 catalog_manager.cc:5697] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 13, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 17 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:12.477243 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:12.477916 23995 raft_consensus.cc:3055] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:12.483254 23995 raft_consensus.cc:740] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:12.484289 23995 consensus_queue.cc:260] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:12.485639 23995 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:12.478344 24562 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:23:12.482375 23924 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
W20260709 12:23:12.479728 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 105171us
I20260709 12:23:12.486977 23895 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:12.496240 30739 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:12.496788 30739 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:12.498139 30739 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:12.523648 23995 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:23:12.587061 30760 ts_tablet_manager.cc:933] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:12.667608 23995 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:12.671237 30739 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:23:12.675235 23895 consensus_peers.cc:597] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fadf34409dda41739b8f46dcf0a526b2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:12.671742 23850 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:12.684250 30749 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:23:12.685818 30760 tablet_copy_client.cc:323] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:23:12.703696 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet a9308162d63f49c4aa8dfccb14c1cf8a from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:23:12.704356 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet a9308162d63f49c4aa8dfccb14c1cf8a from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-a9308162d63f49c4aa8dfccb14c1cf8a
I20260709 12:23:12.716197 23995 raft_consensus.cc:2955] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:12.731565 23939 tablet_copy_source_session.cc:215] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:12.753008 30760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9308162d63f49c4aa8dfccb14c1cf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.713759 30739 raft_consensus.cc:2955] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:12.798353 23850 raft_consensus.cc:2955] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:12.824646 23928 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:12.829546 23744 catalog_manager.cc:5697] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 18 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:12.915987 23996 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:12.916105 30760 tablet_copy_client.cc:806] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:12.928229 23850 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:23:12.930363 23895 consensus_peers.cc:597] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f07a76a5d75e47acaff6a5ca2f03dcc5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:12.933332 30737 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:23:12.940303 30650 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:12.928179 30760 tablet_copy_client.cc:670] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:12.970206 24557 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:12.972270 30760 tablet_copy_client.cc:538] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:12.972375 30739 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:12.980798 23745 catalog_manager.cc:5697] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 14 to 15, leader changed from 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 15 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:13.003584 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 69078.7us
I20260709 12:23:13.022523 23996 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:13.024591 30694 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:13.028380 30739 raft_consensus.cc:2955] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:13.033177 23850 raft_consensus.cc:2955] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:13.040319 23996 raft_consensus.cc:2955] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:13.066138 23745 catalog_manager.cc:5697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index -1 to 10, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 15 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:13.075847 30760 tablet_bootstrap.cc:492] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:23:13.105031 23997 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
W20260709 12:23:13.158706 23969 consensus_peers.cc:597] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f478cef7044d4597b6db8ead4067f592. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:13.161648 23928 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:13.164255 23850 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:13.164728 30746 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:13.167500 30566 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:13.194396 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:13.213222 30783 ts_tablet_manager.cc:933] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:13.240415 30566 raft_consensus.cc:2955] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:13.243150 23854 raft_consensus.cc:2955] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:13.273125 23745 catalog_manager.cc:5697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 18 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.293810 23928 raft_consensus.cc:2955] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
I20260709 12:23:13.302029 30783 tablet_copy_client.cc:323] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:23:13.314723 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet fadf34409dda41739b8f46dcf0a526b2 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:23:13.315299 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet fadf34409dda41739b8f46dcf0a526b2 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-fadf34409dda41739b8f46dcf0a526b2
I20260709 12:23:13.327589 23939 tablet_copy_source_session.cc:215] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:13.333096 30783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadf34409dda41739b8f46dcf0a526b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:13.379938 30783 tablet_copy_client.cc:806] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:13.390286 30783 tablet_copy_client.cc:670] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:13.395589 23928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:23:13.396175 23928 raft_consensus.cc:606] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Received request to transfer leadership to TS 22996f888daf435398b693481171c18c
I20260709 12:23:13.400444 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:13.402346 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:13.413623 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:13.413528 30783 tablet_copy_client.cc:538] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:13.435911 30785 ts_tablet_manager.cc:933] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:13.463717 30785 tablet_copy_client.cc:323] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.66:33453
I20260709 12:23:13.470871 23939 tablet_copy_service.cc:140] P e8bc734d763e4ddf87f7b930e35cbaa7: Received BeginTabletCopySession request for tablet f07a76a5d75e47acaff6a5ca2f03dcc5 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:35824)
I20260709 12:23:13.471491 23939 tablet_copy_service.cc:161] P e8bc734d763e4ddf87f7b930e35cbaa7: Beginning new tablet copy session on tablet f07a76a5d75e47acaff6a5ca2f03dcc5 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:35824: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-f07a76a5d75e47acaff6a5ca2f03dcc5
I20260709 12:23:13.510694 30783 tablet_bootstrap.cc:492] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:23:13.557156 23939 tablet_copy_source_session.cc:215] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:13.569623 30785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07a76a5d75e47acaff6a5ca2f03dcc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:13.577065 30788 ts_tablet_manager.cc:933] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:13.611276 30760 tablet_bootstrap.cc:492] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:13.615605 30760 tablet_bootstrap.cc:492] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:13.622618 30760 ts_tablet_manager.cc:1403] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.547s	user 0.043s	sys 0.012s
I20260709 12:23:13.627039 30760 raft_consensus.cc:359] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:13.635098 30760 raft_consensus.cc:740] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:13.636050 30760 consensus_queue.cc:260] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:13.638805 30760 ts_tablet_manager.cc:1434] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.005s
I20260709 12:23:13.658006 30785 tablet_copy_client.cc:806] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:13.658663 30785 tablet_copy_client.cc:670] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:13.678558 30788 tablet_copy_client.cc:323] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:23:13.679852 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-a9308162d63f49c4aa8dfccb14c1cf8a received from {username='slave'} at 127.0.0.1:35824
I20260709 12:23:13.680337 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-a9308162d63f49c4aa8dfccb14c1cf8a on tablet a9308162d63f49c4aa8dfccb14c1cf8a with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:13.686832 30785 tablet_copy_client.cc:538] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:13.687700 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet f478cef7044d4597b6db8ead4067f592 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:23:13.688270 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet f478cef7044d4597b6db8ead4067f592 from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-f478cef7044d4597b6db8ead4067f592
I20260709 12:23:13.696643 24014 tablet_copy_source_session.cc:215] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:13.707454 30788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f478cef7044d4597b6db8ead4067f592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:13.719525 30785 tablet_bootstrap.cc:492] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:23:13.829414 30788 tablet_copy_client.cc:806] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:13.830053 30788 tablet_copy_client.cc:670] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:13.835774 30788 tablet_copy_client.cc:538] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:13.867645 30783 tablet_bootstrap.cc:492] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:13.868774 30783 tablet_bootstrap.cc:492] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:13.869598 30783 ts_tablet_manager.cc:1403] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.359s	user 0.040s	sys 0.010s
W20260709 12:23:13.891916 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 66899.2us
I20260709 12:23:13.910006 30783 raft_consensus.cc:359] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:13.921380 30788 tablet_bootstrap.cc:492] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:23:13.921566 30783 raft_consensus.cc:740] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:13.926128 30783 consensus_queue.cc:260] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:13.930644 30783 ts_tablet_manager.cc:1434] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.002s
I20260709 12:23:13.951594 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-fadf34409dda41739b8f46dcf0a526b2 received from {username='slave'} at 127.0.0.1:35824
I20260709 12:23:13.952096 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-fadf34409dda41739b8f46dcf0a526b2 on tablet fadf34409dda41739b8f46dcf0a526b2 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:13.980008 30739 raft_consensus.cc:993] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 22996f888daf435398b693481171c18c to start an election
I20260709 12:23:13.980562 30739 raft_consensus.cc:1081] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Signalling peer 22996f888daf435398b693481171c18c to start an election
I20260709 12:23:13.984485 23854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23"
dest_uuid: "22996f888daf435398b693481171c18c"
 from {username='slave'} at 127.0.0.1:47066
I20260709 12:23:13.985198 23854 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.985642 23854 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:13.995630 30785 tablet_bootstrap.cc:492] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:13.996743 30785 tablet_bootstrap.cc:492] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:13.997740 30785 ts_tablet_manager.cc:1403] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.278s	user 0.039s	sys 0.008s
I20260709 12:23:14.010043 30785 raft_consensus.cc:359] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:14.010811 30785 raft_consensus.cc:740] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:14.011616 30785 consensus_queue.cc:260] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:14.013958 23854 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:14.029069 23854 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:14.029346 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:14.017827 30785 ts_tablet_manager.cc:1434] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:23:14.030113 23926 raft_consensus.cc:3055] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:14.030472 23926 raft_consensus.cc:740] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:14.031250 23926 consensus_queue.cc:260] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:14.032516 23926 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:14.034942 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:14.035498 24561 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:14.040971 23939 tablet_copy_service.cc:342] P e8bc734d763e4ddf87f7b930e35cbaa7: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-f07a76a5d75e47acaff6a5ca2f03dcc5 received from {username='slave'} at 127.0.0.1:35824
I20260709 12:23:14.041438 23939 tablet_copy_service.cc:434] P e8bc734d763e4ddf87f7b930e35cbaa7: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-f07a76a5d75e47acaff6a5ca2f03dcc5 on tablet f07a76a5d75e47acaff6a5ca2f03dcc5 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:14.042814 24561 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:23:14.044445 23820 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:23:14.047681 30752 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:14.048501 30752 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Becoming Leader. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:23:14.049417 30752 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:14.053629 23926 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22996f888daf435398b693481171c18c in term 15.
I20260709 12:23:14.116189 24562 raft_consensus.cc:1217] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 LEARNER]: Deduplicated request from leader. Original: 17.12->[17.13-17.13]   Dedup: 17.13->[]
I20260709 12:23:14.116976 23745 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c reported cstate change: term changed from 14 to 15, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 22996f888daf435398b693481171c18c (127.22.43.65). New cstate: current_term: 15 leader_uuid: "22996f888daf435398b693481171c18c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.198527 30788 tablet_bootstrap.cc:492] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=4 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:14.212600 30788 tablet_bootstrap.cc:492] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:14.219563 30788 ts_tablet_manager.cc:1403] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.298s	user 0.036s	sys 0.018s
I20260709 12:23:14.227735 30788 raft_consensus.cc:359] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:14.228727 30788 raft_consensus.cc:740] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:14.229445 30788 consensus_queue.cc:260] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:14.256163 30788 ts_tablet_manager.cc:1434] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:23:14.262208 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-f478cef7044d4597b6db8ead4067f592 received from {username='slave'} at 127.0.0.1:34868
I20260709 12:23:14.262686 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-f478cef7044d4597b6db8ead4067f592 on tablet f478cef7044d4597b6db8ead4067f592 with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:14.276265 24562 raft_consensus.cc:1217] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 12:23:14.434543 24562 raft_consensus.cc:1217] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 12:23:14.457010 23928 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:23:14.459584 30756 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:14.537621 24561 raft_consensus.cc:1217] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 12:23:14.549432 24562 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer 22996f888daf435398b693481171c18c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:23:14.554719 30752 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:14.555558 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:14.716969 23850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace"
dest_uuid: "22996f888daf435398b693481171c18c"
mode: GRACEFUL
new_leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:56180
I20260709 12:23:14.717612 23850 raft_consensus.cc:606] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 16 LEADER]: Received request to transfer leadership to TS e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:14.723079 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:14.727421 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:14.729830 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:14.756006 30752 raft_consensus.cc:993] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: : Instructing follower e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:23:14.756738 30752 raft_consensus.cc:1081] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 16 LEADER]: Signalling peer e8bc734d763e4ddf87f7b930e35cbaa7 to start an election
I20260709 12:23:14.772362 23928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
 from {username='slave'} at 127.0.0.1:33822
I20260709 12:23:14.773131 23928 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:14.773604 23928 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:14.788808 23928 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:14.791957 23928 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:23:14.815133 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 92292.6us
W20260709 12:23:14.858233 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 78296.9us
W20260709 12:23:14.861184 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 52883.4us
I20260709 12:23:14.871814 30737 raft_consensus.cc:1064] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
W20260709 12:23:14.890300 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 77346.5us
I20260709 12:23:14.891916 23854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:23:14.892652 23854 raft_consensus.cc:3055] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:14.892964 23854 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 22996f888daf435398b693481171c18c, State: Running, Role: LEADER
I20260709 12:23:14.894593 23854 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:14.896451 23854 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:14.909828 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:14.910516 24561 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:14.912204 23854 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:23:14.926844 24561 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:23:14.897163 30737 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:14.940806 30808 raft_consensus.cc:1064] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:23:14.944120 30808 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:14.961001 30739 raft_consensus.cc:1064] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:23:14.963882 23895 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:14.966672 30739 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:14.978420 24000 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:14.979969 30809 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:14.981041 23997 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:14.982601 30808 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:14.987311 24561 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:14.999826 30746 raft_consensus.cc:1064] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:23:15.001945 30808 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:15.003116 30746 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:15.009577 23996 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:15.014206 30809 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:15.017572 24561 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:15.019217 30808 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:15.021498 30808 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:15.024650 23852 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:15.025352 23850 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:15.056519 23851 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:15.057734 24562 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEARNER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:15.068838 30792 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:15.080624 30810 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:15.082544 30807 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
W20260709 12:23:15.106575 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 44157us
I20260709 12:23:15.108014 30739 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:15.110091 30771 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:23:15.115404 30818 log.cc:927] Time spent T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:23:15.132282 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 63867.3us
I20260709 12:23:15.143664 30822 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:15.205330 23744 catalog_manager.cc:5697] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 16 to 17, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 17 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.266955 30808 raft_consensus.cc:2955] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:23:15.294802 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 61834us
I20260709 12:23:15.293285 24562 raft_consensus.cc:2955] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:15.310532 24561 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:23:15.312496 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 121355us
I20260709 12:23:15.315279 23928 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:15.319204 30815 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:23:15.372850 30566 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:23:15.383463 23818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 71461.3us
W20260709 12:23:15.397958 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 64865.5us
I20260709 12:23:15.447014 23852 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:23:15.447906 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 112109us
I20260709 12:23:15.474989 24000 raft_consensus.cc:2955] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:15.490228 30810 raft_consensus.cc:2955] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:15.525995 23997 raft_consensus.cc:2955] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:15.526888 30821 raft_consensus.cc:2955] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:15.542603 23745 catalog_manager.cc:5697] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 13 to 14, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:15.561903 30566 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:15.561281 23846 raft_consensus.cc:2955] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:15.578245 23849 raft_consensus.cc:2955] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:15.560859 23851 raft_consensus.cc:2955] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:23:15.613927 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 52334.2us
I20260709 12:23:15.670469 23996 raft_consensus.cc:2955] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:23:15.676795 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 90541.1us
I20260709 12:23:15.688599 23846 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:23:15.707683 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 95848.1us
W20260709 12:23:15.751122 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 129772us
W20260709 12:23:15.754822 23820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 177210us
W20260709 12:23:15.756894 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 76044.9us
I20260709 12:23:15.805523 24554 raft_consensus.cc:2955] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:15.814443 24557 raft_consensus.cc:2955] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:23:15.877604 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 52368.2us
W20260709 12:23:15.880167 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 72968.5us
I20260709 12:23:15.883183 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:15.899708 30858 log.cc:927] Time spent T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:23:15.896438 30792 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
W20260709 12:23:16.014526 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 89476.2us
I20260709 12:23:16.054622 23750 catalog_manager.cc:5697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 10 to 11, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:16.073459 24562 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:16.094365 30869 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:16.095297 30791 raft_consensus.cc:2955] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:16.134440 24557 raft_consensus.cc:2955] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:16.142674 23926 raft_consensus.cc:2955] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:16.164371 23850 raft_consensus.cc:2955] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:16.291669 23744 catalog_manager.cc:5697] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:16.300340 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 419436us
I20260709 12:23:16.354581 23926 consensus_queue.cc:237] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:16.356034 23750 catalog_manager.cc:5697] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 12 to 13, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:16.370393 23924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace"
dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
mode: GRACEFUL
new_leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:45224
I20260709 12:23:16.371220 23924 raft_consensus.cc:606] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Received request to transfer leadership to TS 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:16.404738 23929 consensus_queue.cc:237] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:16.435351 23846 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:16.438164 23924 consensus_queue.cc:237] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:16.438894 24554 raft_consensus.cc:1275] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:16.441301 30869 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:16.500654 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:16.521166 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:16.535329 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:16.535429 23850 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:16.563355 30771 consensus_queue.cc:1048] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:16.584232 30807 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:16.591254 30855 raft_consensus.cc:2955] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:16.657915 24554 raft_consensus.cc:1275] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:16.661458 24554 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:23:16.686386 30807 consensus_queue.cc:1048] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:16.684195 24557 raft_consensus.cc:2955] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:16.690979 30809 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:16.725324 23846 raft_consensus.cc:1275] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:23:16.785158 23996 consensus_queue.cc:237] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:16.804004 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f07a76a5d75e47acaff6a5ca2f03dcc5 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:16.812336 30807 consensus_queue.cc:1048] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:16.815441 30807 raft_consensus.cc:993] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: : Instructing follower 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:23:16.816148 30771 raft_consensus.cc:1081] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Signalling peer 35a9a1f8b1d847fb8f2063ced2a3c26d to start an election
I20260709 12:23:16.820341 30821 raft_consensus.cc:2955] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:16.827543 23745 catalog_manager.cc:5697] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 11 to 12, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 15 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.836689 23926 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:16.850999 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet f07a76a5d75e47acaff6a5ca2f03dcc5 with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:45044
W20260709 12:23:16.865527 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 78821.2us
I20260709 12:23:16.868919 24562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace"
dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
 from {username='slave'} at 127.0.0.1:36552
I20260709 12:23:16.869669 24562 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:16.870090 24562 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:16.870100 24563 raft_consensus.cc:1275] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:16.858054 30839 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:23:16.904237 30566 consensus_queue.cc:1048] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:16.903534 24560 raft_consensus.cc:2955] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:16.922640 24562 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:17.017575 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 89330.1us
W20260709 12:23:17.020049 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 81372.3us
I20260709 12:23:17.028122 30870 raft_consensus.cc:2955] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:17.038087 30881 tablet_replica.cc:333] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:17.038728 23852 raft_consensus.cc:2955] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:17.040215 24561 raft_consensus.cc:2955] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:17.056646 30839 raft_consensus.cc:2955] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:17.102941 24562 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:17.110698 23920 raft_consensus.cc:2955] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:17.129786 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fadf34409dda41739b8f46dcf0a526b2 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:17.128062 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "22996f888daf435398b693481171c18c"
I20260709 12:23:17.132558 23851 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:17.130971 30881 raft_consensus.cc:2243] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.144300 30881 raft_consensus.cc:2272] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.148185 30881 ts_tablet_manager.cc:1916] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.163944 24562 raft_consensus.cc:2955] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:17.166656 23750 catalog_manager.cc:5697] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c reported cstate change: config changed from index 13 to 14, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 18 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:17.184657 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f478cef7044d4597b6db8ead4067f592 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:17.184985 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet fadf34409dda41739b8f46dcf0a526b2 with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:45044
I20260709 12:23:17.201869 23851 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 18.
I20260709 12:23:17.209306 24563 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:17.211490 24524 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 
I20260709 12:23:17.213197 30821 consensus_queue.cc:1059] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:17.214360 30821 raft_consensus.cc:3055] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:17.220999 30566 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:17.221611 30566 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } attrs { replace: true } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:17.222461 30793 raft_consensus.cc:2804] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:17.223209 30793 raft_consensus.cc:697] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:23:17.224269 30793 consensus_queue.cc:237] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:17.225219 30566 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:17.231820 23851 raft_consensus.cc:1240] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Rejecting Update request from peer e8bc734d763e4ddf87f7b930e35cbaa7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:17.238631 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:17.240808 23736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a9308162d63f49c4aa8dfccb14c1cf8a with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:17.218626 30821 raft_consensus.cc:740] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:17.243207 30821 consensus_queue.cc:260] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:17.246727 30821 raft_consensus.cc:3060] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:17.260425 23854 raft_consensus.cc:2955] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:17.266332 23851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "22996f888daf435398b693481171c18c" is_pre_election: true
I20260709 12:23:17.274387 23850 raft_consensus.cc:2955] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:17.282317 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:17.287240 30881 ts_tablet_manager.cc:1929] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:23:17.287910 30881 log.cc:1199] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/f07a76a5d75e47acaff6a5ca2f03dcc5
I20260709 12:23:17.289947 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet f07a76a5d75e47acaff6a5ca2f03dcc5 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:23:17.302486 23745 catalog_manager.cc:5697] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 13 to 14, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 18 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.296710 23750 catalog_manager.cc:5697] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 14 to 15, VOTER 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67) evicted. New cstate: current_term: 17 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:17.310633 30881 tablet_replica.cc:333] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:17.312111 30881 raft_consensus.cc:2243] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.313336 30881 raft_consensus.cc:2272] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.314808 23920 raft_consensus.cc:2468] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 18.
I20260709 12:23:17.317021 30881 ts_tablet_manager.cc:1916] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.323495 23966 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:23:17.324359 23966 raft_consensus.cc:2686] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:23:17.340198 23989 tablet_service.cc:1558] Processing DeleteTablet for tablet a9308162d63f49c4aa8dfccb14c1cf8a with delete_type TABLET_DATA_TOMBSTONED (TS 604755d84b7e4ff8a2b75453dccb6f1b not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:45044
I20260709 12:23:17.346268 23843 tablet_service.cc:1558] Processing DeleteTablet for tablet f478cef7044d4597b6db8ead4067f592 with delete_type TABLET_DATA_TOMBSTONED (TS 22996f888daf435398b693481171c18c not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:60686
I20260709 12:23:17.365271 30892 tablet_replica.cc:333] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:17.366979 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:17.370379 30892 raft_consensus.cc:2243] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.371431 30892 raft_consensus.cc:2272] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.376487 30881 ts_tablet_manager.cc:1929] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 12:23:17.377067 30881 log.cc:1199] T fadf34409dda41739b8f46dcf0a526b2 P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/fadf34409dda41739b8f46dcf0a526b2
I20260709 12:23:17.379617 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet fadf34409dda41739b8f46dcf0a526b2 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:23:17.390903 23750 catalog_manager.cc:5697] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 17 to 18, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 18 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.381043 30881 tablet_replica.cc:333] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:17.412287 30892 ts_tablet_manager.cc:1916] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.438889 30881 raft_consensus.cc:2243] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.440424 30881 raft_consensus.cc:2272] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.444410 30881 ts_tablet_manager.cc:1916] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.464600 30881 ts_tablet_manager.cc:1929] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.14
I20260709 12:23:17.465071 30881 log.cc:1199] T a9308162d63f49c4aa8dfccb14c1cf8a P 604755d84b7e4ff8a2b75453dccb6f1b: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/wals/a9308162d63f49c4aa8dfccb14c1cf8a
I20260709 12:23:17.466903 23737 catalog_manager.cc:5028] TS 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): tablet a9308162d63f49c4aa8dfccb14c1cf8a (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:23:17.525695 30892 ts_tablet_manager.cc:1929] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 12:23:17.536592 30892 log.cc:1199] T f478cef7044d4597b6db8ead4067f592 P 22996f888daf435398b693481171c18c: Deleting WAL directory at /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/wals/f478cef7044d4597b6db8ead4067f592
I20260709 12:23:17.542286 23736 catalog_manager.cc:5028] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): tablet f478cef7044d4597b6db8ead4067f592 (table test-workload [id=c0d74a83531a4662b07debf30a362e9a]) successfully deleted
I20260709 12:23:17.650840 23850 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:17.652848 30889 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:17.701766 23920 raft_consensus.cc:1275] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:17.704664 30889 consensus_queue.cc:1048] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:23:18.021946 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 69607.5us
I20260709 12:23:18.396180 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.556496 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:18.571827 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:18.572623 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.646281 23995 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:18.670670 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:18.694053 23969 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439): Couldn't send request to peer 35a9a1f8b1d847fb8f2063ced2a3c26d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38d6b859dc2949aeaefe73fefd5829bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.695845 23926 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:18.709733 30839 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:18.711217 23850 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:18.720808 30839 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:18.731132 22701 tablet_server.cc:179] TabletServer@127.22.43.65:0 shutting down...
I20260709 12:23:18.745909 30791 raft_consensus.cc:2955] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:23:18.749300 23892 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:23:18.818503 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 45095us
W20260709 12:23:18.856109 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 72822.8us
W20260709 12:23:18.864398 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 115146us
I20260709 12:23:18.872205 23926 raft_consensus.cc:2955] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } }
W20260709 12:23:18.919718 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.942893 23745 catalog_manager.cc:5697] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index -1 to 14, NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) added. New cstate: current_term: 20 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:18.970485 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 46672.5us
W20260709 12:23:18.969718 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:18.974499 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 45400.4us
W20260709 12:23:18.971357 23892 consensus_peers.cc:597] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:18.978170 24524 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:18.978704 23892 consensus_peers.cc:597] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:18.983598 24524 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:18.979861 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:18.987730 23892 consensus_peers.cc:597] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.008478 23892 consensus_peers.cc:597] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.010085 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.030568 23892 consensus_peers.cc:597] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.032917 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.040042 23892 consensus_peers.cc:597] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.056071 23892 consensus_peers.cc:597] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.079324 23892 consensus_peers.cc:597] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.082319 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.083148 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.129307 23966 consensus_peers.cc:597] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.139787 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.132407 24524 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.145506 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.146204 24524 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.146816 24524 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.166524 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.167155 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.167522 24524 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.169864 23892 consensus_peers.cc:597] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.174991 23892 consensus_peers.cc:597] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.244817 30918 ts_tablet_manager.cc:933] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Initiating tablet copy from peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:19.273335 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:19.281141 22701 tablet_replica.cc:333] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.287712 30918 tablet_copy_client.cc:323] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.43.67:40331
I20260709 12:23:19.289851 24014 tablet_copy_service.cc:140] P 604755d84b7e4ff8a2b75453dccb6f1b: Received BeginTabletCopySession request for tablet 38d6b859dc2949aeaefe73fefd5829bb from peer 35a9a1f8b1d847fb8f2063ced2a3c26d ({username='slave'} at 127.0.0.1:34868)
I20260709 12:23:19.290371 24014 tablet_copy_service.cc:161] P 604755d84b7e4ff8a2b75453dccb6f1b: Beginning new tablet copy session on tablet 38d6b859dc2949aeaefe73fefd5829bb from peer 35a9a1f8b1d847fb8f2063ced2a3c26d at {username='slave'} at 127.0.0.1:34868: session id = 35a9a1f8b1d847fb8f2063ced2a3c26d-38d6b859dc2949aeaefe73fefd5829bb
I20260709 12:23:19.295809 22701 raft_consensus.cc:2243] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.296579 22701 raft_consensus.cc:2272] T d728437e541d463594bcfe1155df3a32 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.299467 24014 tablet_copy_source_session.cc:215] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:19.314733 30918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d6b859dc2949aeaefe73fefd5829bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:19.321368 22701 tablet_replica.cc:333] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.322530 22701 raft_consensus.cc:2243] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:19.324640 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.331467 22701 raft_consensus.cc:2272] T 4a79eabff38b4edebe70e32ff0d72afc P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:19.354686 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.362416 30918 tablet_copy_client.cc:806] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:19.368080 30918 tablet_copy_client.cc:670] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:19.368718 22701 tablet_replica.cc:333] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.369702 22701 raft_consensus.cc:2243] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.370898 22701 raft_consensus.cc:2272] T d78d41f27ddd4a3fa2fe292b189ba372 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.373692 22701 tablet_replica.cc:333] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.406652 22701 raft_consensus.cc:2243] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.407312 22701 raft_consensus.cc:2272] T 3482cac0ee5745259004349e6078cf03 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.408825 30918 tablet_copy_client.cc:538] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:19.410358 22701 tablet_replica.cc:333] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.411345 22701 raft_consensus.cc:2243] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.412410 22701 raft_consensus.cc:2272] T a9308162d63f49c4aa8dfccb14c1cf8a P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.418869 30918 tablet_bootstrap.cc:492] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap starting.
I20260709 12:23:19.453061 22701 tablet_replica.cc:333] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.454128 22701 raft_consensus.cc:2243] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.455482 22701 raft_consensus.cc:2272] T 73d2fbc1f30749eba64903d7e79de8a7 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.484314 22701 tablet_replica.cc:333] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.493620 22701 raft_consensus.cc:2243] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.494463 22701 raft_consensus.cc:2272] T 5d00e1a3cc444623bdf4910b98044d66 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.497375 22701 tablet_replica.cc:333] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.498328 22701 raft_consensus.cc:2243] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.499420 22701 raft_consensus.cc:2272] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.538962 22701 tablet_replica.cc:333] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.539870 22701 raft_consensus.cc:2243] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.540518 22701 raft_consensus.cc:2272] T 4a72394010d8464f87107625dbd58b7d P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.578747 22701 tablet_replica.cc:333] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.590201 22701 raft_consensus.cc:2243] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.591092 22701 raft_consensus.cc:2272] T 362d811dc320452d8daaca5fda5cd52a P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.594234 22701 tablet_replica.cc:333] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.610631 22701 raft_consensus.cc:2243] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.618934 22701 raft_consensus.cc:2272] T 29a434c2919b4912a056d435a8992ff0 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.621867 22701 tablet_replica.cc:333] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.655527 30752 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:23:19.656131 30752 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:19.659039 30752 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:19.660687 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:19.662823 22701 raft_consensus.cc:2243] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.663764 22701 raft_consensus.cc:2272] T 8630b76482c543a2a08e289b32b13ab6 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.664947 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:19.670061 23820 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:19.671931 30900 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:19.675153 22701 tablet_replica.cc:333] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.676219 22701 raft_consensus.cc:2243] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.680295 22701 raft_consensus.cc:2272] T d12092e2a1294da4acc0a5f0261bfe94 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.683967 22701 tablet_replica.cc:333] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.685180 22701 raft_consensus.cc:2243] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.686733 22701 raft_consensus.cc:2272] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.689715 22701 tablet_replica.cc:333] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.690675 22701 raft_consensus.cc:2243] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.691342 22701 raft_consensus.cc:2272] T 5b6aae08bca4478b92abb367635b948e P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.709430 22701 tablet_replica.cc:333] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.721477 22701 raft_consensus.cc:2243] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.722348 22701 raft_consensus.cc:2272] T 3e5d779cbe414b879d3a8be40d0428fa P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.726022 22701 tablet_replica.cc:333] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.727675 22701 raft_consensus.cc:2243] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.728920 22701 raft_consensus.cc:2272] T 729f7490c64342bebf0188dd2f975e39 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.732684 22701 tablet_replica.cc:333] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.733827 22701 raft_consensus.cc:2243] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.729064 30918 tablet_bootstrap.cc:492] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=3 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.735358 30918 tablet_bootstrap.cc:492] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Bootstrap complete.
I20260709 12:23:19.736366 30918 ts_tablet_manager.cc:1403] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent bootstrapping tablet: real 0.318s	user 0.047s	sys 0.012s
I20260709 12:23:19.739972 22701 raft_consensus.cc:2272] T 23e8987a07704ea192b04366772512e7 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.743606 22701 tablet_replica.cc:333] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.750538 22701 raft_consensus.cc:2243] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.751875 22701 raft_consensus.cc:2272] T 573b7fecf80d4359b0e9f045d989ed09 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.755905 22701 tablet_replica.cc:333] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.756699 22701 raft_consensus.cc:2243] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.758049 22701 raft_consensus.cc:2272] T 375316edc4f14c939e96f8ce70294c81 P 22996f888daf435398b693481171c18c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.762861 30900 raft_consensus.cc:493] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:23:19.763458 30900 raft_consensus.cc:515] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:19.764204 22701 tablet_replica.cc:333] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.765161 22701 raft_consensus.cc:2243] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.767544 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:19.768299 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2bef15f0a6452999bc8b6f4e360c3e" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:19.765784 22701 raft_consensus.cc:2272] T 092a962747db4e3b9c0bb6d7fdb831d5 P 22996f888daf435398b693481171c18c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.769850 23820 leader_election.cc:304] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:19.770758 30752 raft_consensus.cc:2749] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:19.765697 30900 leader_election.cc:290] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:19.772891 22701 tablet_replica.cc:333] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.773772 22701 raft_consensus.cc:2243] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.774842 22701 raft_consensus.cc:2272] T 41807c0564934d23b20ac6f983e233d6 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.778111 22701 tablet_replica.cc:333] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.778818 22701 raft_consensus.cc:2243] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.779695 22701 raft_consensus.cc:2272] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.782342 22701 tablet_replica.cc:333] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.782910 30900 raft_consensus.cc:493] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:23:19.783638 30900 raft_consensus.cc:515] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:19.787113 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:19.789584 22701 raft_consensus.cc:2243] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.795797 30900 leader_election.cc:290] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:19.796175 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9527aa74b6e94801a45ae653023f6793" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:19.799115 23820 leader_election.cc:304] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:19.800555 30900 raft_consensus.cc:2706] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Received pre-election callback for term 14 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:23:19.803121 22701 raft_consensus.cc:2272] T 9527aa74b6e94801a45ae653023f6793 P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.807554 22701 tablet_replica.cc:333] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.808477 22701 raft_consensus.cc:2243] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.809203 22701 raft_consensus.cc:2272] T fdd49025134246c8a0245389cc43db77 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.809295 30918 raft_consensus.cc:359] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:19.810446 30918 raft_consensus.cc:740] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Initialized, Role: LEARNER
I20260709 12:23:19.811252 30918 consensus_queue.cc:260] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } }
I20260709 12:23:19.814692 22701 tablet_replica.cc:333] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.815747 22701 raft_consensus.cc:2243] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.816363 22701 raft_consensus.cc:2272] T bed4315a53504a7a84ffb2b5e251ea08 P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.820511 22701 tablet_replica.cc:333] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.822095 22701 raft_consensus.cc:2243] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.822780 22701 raft_consensus.cc:2272] T e24af680f7e54ded89a0d5eff1320c6c P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.826182 22701 tablet_replica.cc:333] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.827062 22701 raft_consensus.cc:2243] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.827651 22701 pending_rounds.cc:70] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Trying to abort 1 pending ops.
I20260709 12:23:19.827957 22701 pending_rounds.cc:77] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c: Aborting op as it isn't in flight: id { term: 20 index: 14 } timestamp: 7305624775248547840 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } } new_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: NON_VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: true } } } }
I20260709 12:23:19.829155 22701 raft_consensus.cc:2917] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Aborting config change with OpId 20.14: Aborted: Op aborted
I20260709 12:23:19.829597 22701 raft_consensus.cc:2889] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:23:19.830000 22701 raft_consensus.cc:2272] T 38d6b859dc2949aeaefe73fefd5829bb P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.830173 30900 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:19.830761 30900 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:19.833033 30900 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:19.834806 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:19.835268 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:19.836881 30900 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:23:19.837473 30900 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:19.839767 30900 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:19.837891 30918 ts_tablet_manager.cc:1434] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.001s
I20260709 12:23:19.842660 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:19.845032 23818 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:19.846541 30900 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:19.848094 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:19.851773 23820 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:19.855273 30900 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:19.858788 22701 tablet_replica.cc:333] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.860471 22701 raft_consensus.cc:2243] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.867081 22701 raft_consensus.cc:2272] T d55123f416ba4e9a930f3a24bb6c88f3 P 22996f888daf435398b693481171c18c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.877486 22701 tablet_replica.cc:333] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.878414 22701 raft_consensus.cc:2243] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.877521 30752 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:19.909840 30752 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:19.896207 30900 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:19.910550 22701 raft_consensus.cc:2272] T 9d9e6b2e7add490280e05d9b2bfdda17 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.913426 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:19.911965 30752 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:19.917625 22701 tablet_replica.cc:333] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.912233 30900 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:19.920430 30900 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:19.921957 23924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:19.922580 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadf34409dda41739b8f46dcf0a526b2" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:19.918639 22701 raft_consensus.cc:2243] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.925168 22701 raft_consensus.cc:2272] T 9458291d6d4d499f9c4b21cbe9170c33 P 22996f888daf435398b693481171c18c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.928213 30900 raft_consensus.cc:493] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:23:19.928781 30900 raft_consensus.cc:515] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:19.930936 30900 leader_election.cc:290] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:19.931811 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e1955dc5e84b5080e7ea8d739baff4" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:19.932456 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:19.925462 23817 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:19.933503 24014 tablet_copy_service.cc:342] P 604755d84b7e4ff8a2b75453dccb6f1b: Request end of tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-38d6b859dc2949aeaefe73fefd5829bb received from {username='slave'} at 127.0.0.1:34868
I20260709 12:23:19.933964 24014 tablet_copy_service.cc:434] P 604755d84b7e4ff8a2b75453dccb6f1b: ending tablet copy session 35a9a1f8b1d847fb8f2063ced2a3c26d-38d6b859dc2949aeaefe73fefd5829bb on tablet 38d6b859dc2949aeaefe73fefd5829bb with peer 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:19.934573 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68dea7a8ca44705b1d5fe7b0748519d" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:19.936178 23820 leader_election.cc:304] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:19.936679 23817 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:19.935410 30900 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:19.937670 30900 raft_consensus.cc:2749] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:19.938455 30752 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:19.940650 22701 tablet_replica.cc:333] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.941507 22701 raft_consensus.cc:2243] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.942734 30900 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:19.943264 30900 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:19.952870 30752 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:19.953469 30752 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:19.956593 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:19.960296 30752 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:19.964023 30900 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:19.968830 22701 raft_consensus.cc:2272] T 5a4c451e990244d7a5701e875fa03f62 P 22996f888daf435398b693481171c18c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.970553 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:19.974844 22701 tablet_replica.cc:333] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.975827 22701 raft_consensus.cc:2243] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.979872 22701 raft_consensus.cc:2272] T 9e0499f663114741880a025070e7b81f P 22996f888daf435398b693481171c18c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.984879 22701 tablet_replica.cc:333] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.990749 22701 raft_consensus.cc:2243] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.991405 22701 raft_consensus.cc:2272] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 22996f888daf435398b693481171c18c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.998497 22701 tablet_replica.cc:333] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:19.999361 22701 raft_consensus.cc:2243] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.002091 22701 raft_consensus.cc:2272] T 83e1955dc5e84b5080e7ea8d739baff4 P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.009824 22701 tablet_replica.cc:333] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:20.010840 22701 raft_consensus.cc:2243] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:20.011312 23817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 74714.6us
I20260709 12:23:20.011596 22701 raft_consensus.cc:2272] T 5d2bef15f0a6452999bc8b6f4e360c3e P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.012952 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f15f801cf34333ad12954d0b614109" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:20.015164 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0df961accdf4f35a6f59fd126751e8a" candidate_uuid: "22996f888daf435398b693481171c18c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:20.019179 23817 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:20.020386 23817 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22996f888daf435398b693481171c18c; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:20.021118 30752 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:20.021598 30900 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:20.027096 22701 tablet_replica.cc:333] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:20.028012 22701 raft_consensus.cc:2243] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.042908 22701 raft_consensus.cc:2272] T fadf34409dda41739b8f46dcf0a526b2 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.045677 22701 tablet_replica.cc:333] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:20.046409 22701 raft_consensus.cc:2243] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.046954 22701 raft_consensus.cc:2272] T 01f15f801cf34333ad12954d0b614109 P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.049574 22701 tablet_replica.cc:333] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:20.066375 22701 raft_consensus.cc:2243] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.067556 22701 raft_consensus.cc:2272] T 66100c48e39a42c7be31fa60db7a0d23 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.070382 22701 tablet_replica.cc:333] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:20.071065 22701 raft_consensus.cc:2243] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.071607 22701 raft_consensus.cc:2272] T 9f65f9b948cd4a8d88db397a8232dace P 22996f888daf435398b693481171c18c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.074186 22701 tablet_replica.cc:333] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:20.074867 22701 raft_consensus.cc:2243] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.075371 22701 raft_consensus.cc:2272] T d0df961accdf4f35a6f59fd126751e8a P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.090339 22701 tablet_replica.cc:333] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:20.091055 22701 raft_consensus.cc:2243] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.092186 22701 raft_consensus.cc:2272] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 22996f888daf435398b693481171c18c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.094934 22701 tablet_replica.cc:333] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:20.095780 22701 raft_consensus.cc:2243] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.098446 22701 raft_consensus.cc:2272] T 8d880a30519445959394501b6616f15f P 22996f888daf435398b693481171c18c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.101361 22701 tablet_replica.cc:333] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:20.102093 22701 raft_consensus.cc:2243] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.102633 22701 raft_consensus.cc:2272] T c68dea7a8ca44705b1d5fe7b0748519d P 22996f888daf435398b693481171c18c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.105540 22701 tablet_replica.cc:333] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c: stopping tablet replica
I20260709 12:23:20.106215 22701 raft_consensus.cc:2243] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.118299 22701 raft_consensus.cc:2272] T 05a83cc012d5420494cfd8c624a09767 P 22996f888daf435398b693481171c18c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.255268 24562 raft_consensus.cc:1217] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 LEARNER]: Deduplicated request from leader. Original: 20.13->[20.14-20.14]   Dedup: 20.14->[]
I20260709 12:23:20.487355 30914 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.487944 30914 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:20.497346 24524 leader_election.cc:336] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.498518 30914 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:20.499218 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:20.501870 24525 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:20.503691 30914 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:20.611521 30821 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.612149 30821 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:20.624006 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:20.625476 30821 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:20.627064 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:23:20.627195 23892 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.628034 23892 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:20.629181 30821 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:20.636372 30909 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.637149 30909 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:20.640377 30909 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:20.641032 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:20.642028 24562 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:23:20.643227 23969 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:20.651440 30909 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:20.651945 30909 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.652441 30909 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:20.692203 23966 leader_election.cc:336] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.706689 30909 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:20.710114 30887 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.710707 30887 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:20.712800 30887 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:20.716862 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
W20260709 12:23:20.720693 24524 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.721607 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:20.722395 30887 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:20.742264 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78d41f27ddd4a3fa2fe292b189ba372" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:20.742962 24562 raft_consensus.cc:3060] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:20.745514 30909 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:23:20.755080 23966 leader_election.cc:336] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.763711 24562 raft_consensus.cc:2468] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:23:20.766178 23969 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:20.767383 30909 raft_consensus.cc:2804] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:20.770205 30909 raft_consensus.cc:697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:20.773175 30909 consensus_queue.cc:237] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:20.802807 30791 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.803483 30791 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:20.806206 30791 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:20.814286 30932 raft_consensus.cc:1064] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: attempting to promote NON_VOTER 35a9a1f8b1d847fb8f2063ced2a3c26d to VOTER
I20260709 12:23:20.817031 30932 consensus_queue.cc:237] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:20.839558 30821 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.840134 30821 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:20.842139 30821 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:20.843277 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:20.852567 30887 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.853214 30887 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:20.854804 23892 leader_election.cc:336] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.855289 23892 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:20.855623 30887 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:20.860072 30919 raft_consensus.cc:2749] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:20.873930 24524 leader_election.cc:336] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.874576 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:20.867576 30887 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.875473 30887 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:20.880432 30914 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.881021 30914 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:20.883924 30914 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:20.885578 24524 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.887259 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:20.887872 23928 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 16.
I20260709 12:23:20.887275 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:20.892297 23745 catalog_manager.cc:5697] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 15 to 16, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 16 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:20.896337 24524 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.890931 30887 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:20.902005 30919 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.900358 30931 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.903226 30919 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:20.903764 30931 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:20.906708 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:20.906931 30931 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:20.907331 24562 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 13.
I20260709 12:23:20.908389 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:20.909034 24563 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:23:20.910239 23895 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:20.911032 30821 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:20.911356 30821 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.911661 30821 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:20.914101 23892 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.917268 30919 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:20.922712 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:23:20.925441 23966 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.925954 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:20.927114 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:20.927724 24000 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 16.
I20260709 12:23:20.940184 30933 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:20.948478 30821 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:20.956143 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b7bbae4eed4b9b88eeba1ae28c6ecb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:20.956807 24563 raft_consensus.cc:3060] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:20.961891 24525 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:20.985070 30909 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:20.985677 30909 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:20.962718 30821 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:20.991091 24525 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:20.992460 30909 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:20.994032 23928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:20.997697 30791 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.015403 30791 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:21.010251 23892 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:20.988876 30937 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:21.017553 24563 raft_consensus.cc:2468] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:23:21.018414 24562 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 LEARNER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:21.021229 24525 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:21.022858 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:21.023530 30887 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:21.023571 23926 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:23:21.024147 30887 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.025534 23928 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:23:21.026866 30791 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:21.027299 23895 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:21.031450 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:21.033015 30940 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:21.033506 30939 raft_consensus.cc:2804] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:21.034111 30939 raft_consensus.cc:697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:21.035235 30939 consensus_queue.cc:237] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.036036 30940 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.035894 30909 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:21.024565 30887 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:21.036598 30940 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.038909 30940 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:21.040424 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:21.042817 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:21.046038 30930 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:21.046535 30930 raft_consensus.cc:493] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.046940 30930 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:21.050125 30887 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.053212 30887 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:21.053339 30940 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.054011 30940 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.056156 30940 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:21.063895 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:21.064626 23929 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:21.071686 30932 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:21.074697 30941 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.075054 30932 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.075657 30932 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:21.075315 30941 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.079905 23929 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 17.
W20260709 12:23:21.081454 24524 leader_election.cc:336] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.082525 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:21.081241 30941 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:21.084589 30887 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.091296 30887 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.093370 30887 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:21.093562 23966 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.085568 30931 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.087066 30933 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:23:21.097433 23892 leader_election.cc:336] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.101913 23892 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:21.107422 30930 raft_consensus.cc:515] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.107980 30931 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.109932 30930 leader_election.cc:290] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:21.110324 30931 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:23:21.114146 23966 leader_election.cc:336] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.115442 24524 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.115972 24524 leader_election.cc:336] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.117842 23966 leader_election.cc:336] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.119988 30933 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.118301 23966 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
W20260709 12:23:21.124094 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:21.124979 30930 raft_consensus.cc:2749] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:21.125768 30930 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.123447 30933 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:21.126327 30930 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.127353 30941 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:21.129941 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0c3eeb21514ee1a8f1324ff166cb7f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:21.130257 23928 raft_consensus.cc:1275] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:21.130496 23926 raft_consensus.cc:3060] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:21.131536 30930 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:21.132180 30930 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.132779 30930 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.137642 23926 raft_consensus.cc:2468] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 18.
I20260709 12:23:21.140352 30821 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.140828 30821 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.143981 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:21.144655 24562 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:23:21.146368 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:21.146939 24562 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:23:21.144109 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:21.167825 23969 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:23:21.170764 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 149634us
I20260709 12:23:21.174973 30930 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:21.183702 30821 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:21.186164 30943 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:21.186661 30943 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.187077 30943 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:21.187732 23750 catalog_manager.cc:5697] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 13 to 14, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 14 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.181262 30932 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.192492 30932 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:21.187160 30909 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.194108 30909 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.196316 30909 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:21.173296 23969 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:23:21.197677 23892 consensus_peers.cc:597] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.198194 23892 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.198400 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:21.199086 23929 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 22.
I20260709 12:23:21.201598 30943 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.202114 30929 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:21.202636 30929 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.203050 30929 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:21.203536 30887 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.204149 30887 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.204432 30931 consensus_queue.cc:1048] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:21.206405 30887 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:21.210796 30943 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:23:21.215418 23892 consensus_peers.cc:597] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.219194 30929 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.221494 30929 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:21.222254 23966 leader_election.cc:304] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:21.231822 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:21.234094 30929 raft_consensus.cc:2804] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:21.234650 30929 raft_consensus.cc:697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:21.234792 30943 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:21.235257 30943 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.235678 30943 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:23:21.236784 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.237238 23966 leader_election.cc:336] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.237864 23966 leader_election.cc:336] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.243494 30943 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.243893 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:21.244745 30919 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.245298 30919 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.235590 30929 consensus_queue.cc:237] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.247570 30919 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:21.245771 30943 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 23 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:21.249773 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:21.250591 24562 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:23:21.251801 23895 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:23:21.252701 23892 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.253167 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:21.253715 30949 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:21.253829 24000 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:23:21.254354 30949 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.254829 30949 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:21.255477 30919 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.256036 30919 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.258018 30919 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:21.262270 23893 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:21.263181 30919 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:21.263571 30919 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.263960 30919 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:21.271179 24524 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.271423 30919 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.273411 30919 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:21.273480 23892 leader_election.cc:336] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.274147 23892 consensus_peers.cc:597] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.277218 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:21.278122 23929 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 17: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:23:21.271811 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:23:21.283537 23892 consensus_peers.cc:597] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.293912 30944 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:21.295637 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:21.296307 23926 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
I20260709 12:23:21.297690 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12092e2a1294da4acc0a5f0261bfe94" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:21.298336 23996 raft_consensus.cc:3060] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:21.283931 30949 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.284969 30933 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.285934 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:21.315557 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:21.315872 24000 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:23:21.316249 23999 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 15.
I20260709 12:23:21.311630 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:21.317585 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:21.318475 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:21.318598 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:21.319187 24562 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 17: Already voted for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in this term.
I20260709 12:23:21.319178 24560 raft_consensus.cc:3060] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:21.314436 23996 raft_consensus.cc:2468] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 17.
I20260709 12:23:21.322077 23893 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:21.323418 23999 raft_consensus.cc:2393] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 17: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
W20260709 12:23:21.322983 23892 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.324270 23893 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
W20260709 12:23:21.324611 22701 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23875)
I20260709 12:23:21.326620 30948 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:21.327157 30948 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.327519 30948 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:21.328593 23966 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.329577 23966 leader_election.cc:336] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.329698 30821 raft_consensus.cc:2804] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:21.326690 30887 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
W20260709 12:23:21.334530 23966 leader_election.cc:336] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.330953 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41807c0564934d23b20ac6f983e233d6" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:23:21.335405 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.337330 23999 raft_consensus.cc:2393] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 14: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:23:21.340555 30821 raft_consensus.cc:697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:21.342604 23926 raft_consensus.cc:2393] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in current term 16: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:23:21.344589 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:21.345031 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729f7490c64342bebf0188dd2f975e39" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:21.345594 24561 raft_consensus.cc:3060] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:21.352743 23892 consensus_peers.cc:597] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.355408 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:21.356151 23929 raft_consensus.cc:3060] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:21.362217 30821 consensus_queue.cc:237] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.368685 24560 raft_consensus.cc:2468] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:23:21.375300 30929 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:21.315573 30933 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.379739 30933 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:21.383106 30949 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:21.335695 30887 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.392860 30887 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:21.396144 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 51635.1us
I20260709 12:23:21.396948 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:21.397709 30932 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:21.393708 24561 raft_consensus.cc:2468] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:23:21.398139 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:21.403569 23929 raft_consensus.cc:2468] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 23.
I20260709 12:23:21.404901 30919 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.405689 30930 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:21.405838 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 64365.4us
I20260709 12:23:21.406236 30930 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.405655 30919 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.407629 24525 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:21.406729 30930 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:21.412184 30919 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:21.413319 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:21.419165 23999 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 14.
I20260709 12:23:21.415518 30948 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.420394 23893 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:21.407935 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945f6253667d4ed18d5bf1c3fd3cc9e9" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:21.422084 24560 raft_consensus.cc:3060] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:21.422554 23892 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.424495 23892 consensus_peers.cc:597] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.423636 24525 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:21.421252 30919 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:21.415961 30930 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.429400 30955 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:21.437963 23969 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:21.429695 30940 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:21.440408 24560 raft_consensus.cc:2468] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:23:21.440496 23969 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:21.441586 23895 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:21.442730 30821 raft_consensus.cc:2804] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:21.442921 30933 raft_consensus.cc:2804] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:21.439222 30955 raft_consensus.cc:493] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.443405 30821 raft_consensus.cc:697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:21.431087 30919 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.443471 30929 raft_consensus.cc:2804] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:21.446329 30929 raft_consensus.cc:697] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:21.447100 30948 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:21.447256 30929 consensus_queue.cc:237] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.448696 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:21.451210 30930 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:21.443815 30955 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:21.453850 30919 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:21.455471 23999 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bc734d763e4ddf87f7b930e35cbaa7 in current term 16: Already voted for candidate 604755d84b7e4ff8a2b75453dccb6f1b in this term.
I20260709 12:23:21.445205 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:21.458873 24563 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 10.
I20260709 12:23:21.444245 24561 raft_consensus.cc:1275] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:21.443421 30933 raft_consensus.cc:697] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:21.444608 23966 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:23:21.464629 24524 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.465561 24524 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.467353 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:21.464303 23750 catalog_manager.cc:5697] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 16 to 17, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 17 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.473774 30930 raft_consensus.cc:2955] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:21.479668 30954 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:21.482237 30909 raft_consensus.cc:2804] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:21.482813 30909 raft_consensus.cc:697] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 23 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:21.483698 30909 consensus_queue.cc:237] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.470626 30821 consensus_queue.cc:237] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.461778 30933 consensus_queue.cc:237] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.489925 23969 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
W20260709 12:23:21.498544 23892 leader_election.cc:336] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.503041 23926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:21.503811 23926 raft_consensus.cc:2393] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 604755d84b7e4ff8a2b75453dccb6f1b in current term 16: Already voted for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in this term.
I20260709 12:23:21.505278 30958 consensus_queue.cc:1048] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:21.503690 30932 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:21.506165 30932 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.506523 30932 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:21.503837 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 21 candidate_status { last_received { term: 20 index: 19 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:21.512439 30955 raft_consensus.cc:515] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.514621 30955 leader_election.cc:290] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:21.522326 24525 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:21.524729 30948 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.526211 30954 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:21.526134 30948 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.528348 30948 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:21.524232 30919 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:21.528887 23929 raft_consensus.cc:2955] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:21.530948 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:21.531561 24563 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:23:21.531643 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d9e6b2e7add490280e05d9b2bfdda17" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:21.532230 24000 raft_consensus.cc:3060] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:21.532809 23895 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:21.537312 30949 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:21.537753 30949 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.538152 30949 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:21.538435 30943 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.539151 30943 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:21.543263 23966 consensus_peers.cc:597] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.547379 24000 raft_consensus.cc:2468] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 15.
I20260709 12:23:21.548388 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 21 candidate_status { last_received { term: 20 index: 19 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:21.548926 23893 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:21.549868 24560 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 20.
W20260709 12:23:21.551613 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.553856 24524 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.556263 24524 leader_election.cc:336] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.554452 30948 raft_consensus.cc:2804] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:21.557928 30948 raft_consensus.cc:697] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
I20260709 12:23:21.533439 30932 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.558856 30948 consensus_queue.cc:237] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:23:21.565467 23966 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.566357 23966 leader_election.cc:336] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.567044 23966 leader_election.cc:336] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.567701 23966 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.568338 23966 leader_election.cc:336] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.566188 24563 raft_consensus.cc:2955] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:21.545818 30943 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:21.573524 23969 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:21.571444 30949 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.574391 30943 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:21.574817 30943 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 22996f888daf435398b693481171c18c)
I20260709 12:23:21.575218 30943 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:21.576110 30949 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:21.546000 30919 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:21.577622 23892 leader_election.cc:336] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.578112 23892 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:21.578644 24560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66100c48e39a42c7be31fa60db7a0d23" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:21.579070 24560 raft_consensus.cc:3060] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:21.578866 23966 leader_election.cc:336] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.580869 23966 consensus_peers.cc:597] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:21.581267 23966 leader_election.cc:336] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.581658 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.589771 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.589169 24525 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:21.594435 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:23:21.598582 23892 consensus_peers.cc:597] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.600924 24560 raft_consensus.cc:2468] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bc734d763e4ddf87f7b930e35cbaa7 in term 16.
I20260709 12:23:21.604002 24000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a434c2919b4912a056d435a8992ff0" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:21.604626 24000 raft_consensus.cc:3060] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:21.602216 23895 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
I20260709 12:23:21.608336 30821 raft_consensus.cc:2804] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:21.608798 30821 raft_consensus.cc:697] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Becoming Leader. State: Replica: e8bc734d763e4ddf87f7b930e35cbaa7, State: Running, Role: LEADER
W20260709 12:23:21.614274 23892 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.616427 23892 leader_election.cc:336] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.601977 30954 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:21.607048 30935 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:21.607182 30919 raft_consensus.cc:2749] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:23:21.623425 23892 consensus_peers.cc:597] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.623980 23892 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.626617 30821 consensus_queue.cc:237] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.631121 30932 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:21.631760 24559 raft_consensus.cc:1275] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:21.632849 30943 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.642113 30949 consensus_queue.cc:1048] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:21.644025 30943 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 21 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:23:21.645780 23892 consensus_peers.cc:597] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:21.654413 24524 leader_election.cc:336] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.658970 24524 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.661417 24524 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.662029 24524 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.671800 24000 raft_consensus.cc:2468] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 16.
I20260709 12:23:21.680599 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d880a30519445959394501b6616f15f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 21 candidate_status { last_received { term: 20 index: 19 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:21.680337 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375316edc4f14c939e96f8ce70294c81" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:21.681674 24559 raft_consensus.cc:3060] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:21.682351 23966 leader_election.cc:336] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:21.681233 24561 raft_consensus.cc:3060] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:21.694687 24559 raft_consensus.cc:2468] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 11.
I20260709 12:23:21.702814 24561 raft_consensus.cc:2468] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 21.
I20260709 12:23:21.710703 24525 leader_election.cc:304] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:21.722328 30914 raft_consensus.cc:2804] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:21.724375 30914 raft_consensus.cc:697] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:23:21.725461 30914 consensus_queue.cc:237] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.739215 23750 catalog_manager.cc:5697] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 15 to 16, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.754367 23750 catalog_manager.cc:5697] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: config changed from index 14 to 15, 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
W20260709 12:23:21.756312 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.757056 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.757573 23966 leader_election.cc:336] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.759560 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.763878 23750 catalog_manager.cc:5697] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 14 to 15, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 15 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.763083 23969 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:21.766434 23969 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:21.768946 30933 raft_consensus.cc:2804] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:21.777535 30958 raft_consensus.cc:2804] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:23:21.787781 23892 consensus_peers.cc:597] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.788491 30958 raft_consensus.cc:697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:23:21.790132 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.778277 30933 raft_consensus.cc:697] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:21.795115 30933 consensus_queue.cc:237] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:21.789345 30958 consensus_queue.cc:237] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 20.19, Last appended by leader: 19, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:21.812932 23892 consensus_peers.cc:597] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.849440 24524 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.842602 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 65998.8us
I20260709 12:23:21.868566 23745 catalog_manager.cc:5697] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 reported cstate change: term changed from 15 to 16, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66). New cstate: current_term: 16 leader_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.875389 23752 catalog_manager.cc:5697] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 17 to 18, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 18 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.877674 24563 raft_consensus.cc:1275] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:21.877169 23752 catalog_manager.cc:5697] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 13 to 14, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 14 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.880380 23752 catalog_manager.cc:5697] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 13 to 14, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 14 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.879519 30958 consensus_queue.cc:1048] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:23:21.882010 23752 catalog_manager.cc:5697] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 22 to 23, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 23 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:21.891561 23892 consensus_peers.cc:597] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:21.893302 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.894459 23966 leader_election.cc:336] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:21.895833 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.895339 23750 catalog_manager.cc:5697] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 15 to 16, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 16 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.901381 23926 raft_consensus.cc:1275] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 12:23:21.909516 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:21.910194 23966 consensus_peers.cc:597] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:21.974045 23893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 59261us
I20260709 12:23:21.974709 30933 consensus_queue.cc:1048] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:23:21.976893 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 65465us
I20260709 12:23:22.011991 23929 raft_consensus.cc:1275] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 23 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:23:22.018692 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:22.024900 23995 raft_consensus.cc:1275] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:23:22.029218 23966 consensus_peers.cc:597] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:22.029841 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:22.036343 24561 raft_consensus.cc:1275] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:23:22.040040 30949 consensus_queue.cc:1048] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:22.067466 30821 consensus_queue.cc:1048] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:22.061893 30933 consensus_queue.cc:1048] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:23:22.118649 23752 catalog_manager.cc:5697] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 10 to 11, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 11 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.120471 23752 catalog_manager.cc:5697] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 20 to 21, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 21 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:22.141425 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 55090.2us
I20260709 12:23:22.160815 23999 raft_consensus.cc:1275] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:22.162851 30821 consensus_queue.cc:1048] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:22.163467 24559 raft_consensus.cc:1275] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:22.176537 30791 consensus_queue.cc:1048] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:23:22.183645 23892 consensus_peers.cc:597] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:22.184617 23892 consensus_peers.cc:597] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:22.192924 23892 consensus_peers.cc:597] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:22.239319 24559 raft_consensus.cc:1275] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:22.271677 30932 consensus_queue.cc:1048] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:22.275843 24563 raft_consensus.cc:1275] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer e8bc734d763e4ddf87f7b930e35cbaa7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:22.304112 24560 raft_consensus.cc:1275] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 20 index: 19. Preceding OpId from leader: term: 21 index: 20. (index mismatch)
I20260709 12:23:22.307034 30939 consensus_queue.cc:1048] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:22.317445 30791 consensus_queue.cc:1048] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:23:22.318562 23995 raft_consensus.cc:1275] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 12:23:22.325142 22701 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23875)
I20260709 12:23:22.329185 30914 consensus_queue.cc:1048] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:23:22.332639 23966 consensus_peers.cc:597] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:22.336045 24524 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:22.353844 23966 consensus_peers.cc:597] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:23.175868 30958 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.176473 30958 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:23.179399 30958 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:23.180982 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:23.181663 24563 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:23:23.183665 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:23.184270 23929 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:23:23.187734 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 
W20260709 12:23:23.188611 23966 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:23.189568 30932 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:23.190052 30932 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.190424 30932 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:23.200603 30932 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:23.212945 30932 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:23.213485 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:23.214166 24559 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:23.214449 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:23.215018 23929 raft_consensus.cc:3060] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:23.224500 23966 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:23.228992 24559 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 18.
I20260709 12:23:23.245443 23929 raft_consensus.cc:2468] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 18.
I20260709 12:23:23.251140 23966 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:23.253597 30958 raft_consensus.cc:2804] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:23.254184 30958 raft_consensus.cc:697] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:23.255162 30958 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:23.305974 23750 catalog_manager.cc:5697] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 16 to 18, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 18 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:23.325620 22701 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 23875)
I20260709 12:23:23.442500 30958 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.443194 30958 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:23:23.450742 23966 leader_election.cc:336] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:23.454437 30958 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:23.457017 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" is_pre_election: true
I20260709 12:23:23.457759 23929 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:23:23.458762 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:23.459547 30932 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:23.459950 30932 raft_consensus.cc:493] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.460305 30932 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:23.468557 30932 raft_consensus.cc:515] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:23:23.480894 23966 leader_election.cc:336] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:23.485535 30932 leader_election.cc:290] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Requested vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:23.488291 23929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573b7fecf80d4359b0e9f045d989ed09" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7"
I20260709 12:23:23.490458 23929 raft_consensus.cc:3060] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:23.498404 23929 raft_consensus.cc:2468] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
W20260709 12:23:23.500728 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:23.518436 23966 leader_election.cc:304] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c
I20260709 12:23:23.520287 30932 raft_consensus.cc:2804] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:23.520852 30932 raft_consensus.cc:697] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:23.521806 30932 consensus_queue.cc:237] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:23:23.525357 23892 consensus_peers.cc:597] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:23.570696 23750 catalog_manager.cc:5697] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 15 to 17, leader changed from 22996f888daf435398b693481171c18c (127.22.43.65) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 17 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:23.599416 23892 consensus_peers.cc:597] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:23.658485 23929 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:23:23.663271 23892 consensus_peers.cc:597] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:23.665107 30932 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:23:23.693568 23892 consensus_peers.cc:597] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:23.700248 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:23.717211 23966 consensus_peers.cc:597] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:23.726879 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:23.732942 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:23.742586 24524 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:23.761193 23966 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111) [suppressed 407 similar messages]
I20260709 12:23:23.764880 24559 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:23.766788 30930 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:23:23.783390 23966 consensus_peers.cc:597] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:23.834291 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:23.879720 23892 consensus_peers.cc:597] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:23.896556 23892 consensus_peers.cc:597] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:23.940335 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:23.946542 23892 consensus_peers.cc:597] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:23.973222 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:23.995402 23892 consensus_peers.cc:597] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.016850 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.046038 24524 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:24.046444 23929 raft_consensus.cc:1275] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:24.051781 30932 consensus_queue.cc:1048] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:23:24.057799 24524 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.077458 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:24.098567 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.099260 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.099651 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.130645 23892 consensus_peers.cc:597] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.137496 23966 consensus_peers.cc:597] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:24.222785 24524 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.252127 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:24.258865 24524 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.326169 22701 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 23875)
W20260709 12:23:24.330346 23892 consensus_peers.cc:597] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:24.374051 23966 consensus_peers.cc:597] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:24.375036 23892 consensus_peers.cc:597] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.393030 24524 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.402071 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.424517 23892 consensus_peers.cc:597] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:24.471746 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:24.604486 23966 consensus_peers.cc:597] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:24.699213 23892 consensus_peers.cc:597] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:24.699874 23892 consensus_peers.cc:597] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:24.702497 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:24.715055 23966 consensus_peers.cc:597] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:24.777155 23892 consensus_peers.cc:597] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:24.906258 24524 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:25.043917 23966 consensus_peers.cc:597] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:25.326725 22701 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 23875)
W20260709 12:23:25.549171 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 81941.9us
W20260709 12:23:25.895983 23892 consensus_peers.cc:597] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:25.976964 23966 consensus_peers.cc:597] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:25.997867 23892 consensus_peers.cc:597] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.085033 23892 consensus_peers.cc:597] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.111958 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.119581 24524 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.130456 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.188000 23892 consensus_peers.cc:597] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.270493 23892 consensus_peers.cc:597] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.300191 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:26.312361 23966 consensus_peers.cc:597] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.313159 24524 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.322445 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.325733 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.327250 22701 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 23875)
W20260709 12:23:26.368794 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.429704 23892 consensus_peers.cc:597] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.433449 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.483840 23892 consensus_peers.cc:597] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.501482 23895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 79169.3us
W20260709 12:23:26.538913 24524 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.559614 23966 consensus_peers.cc:597] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:26.571821 23892 consensus_peers.cc:597] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.576874 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:26.610703 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.622411 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.628069 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.846359 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:26.853530 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:26.859844 23892 consensus_peers.cc:597] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:26.932192 23966 consensus_peers.cc:597] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:26.938194 24524 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.939157 24524 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:26.953365 23892 consensus_peers.cc:597] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:26.985580 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:27.010162 24524 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:27.026750 23892 consensus_peers.cc:597] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:27.040153 23892 consensus_peers.cc:597] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:27.042315 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:27.051152 23892 consensus_peers.cc:597] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:27.163506 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:27.295804 23892 consensus_peers.cc:597] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:27.298286 23966 consensus_peers.cc:597] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:27.310163 23892 consensus_peers.cc:597] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:27.327348 23966 consensus_peers.cc:597] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:27.327955 22701 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 23875)
W20260709 12:23:27.385614 24524 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:27.491396 23966 consensus_peers.cc:597] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:28.238039 24524 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.251245 23892 consensus_peers.cc:597] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.330183 22701 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 23875)
W20260709 12:23:28.425592 23892 consensus_peers.cc:597] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.602818 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.654088 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.671725 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:28.725564 23966 consensus_peers.cc:597] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:28.771690 23892 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111) [suppressed 443 similar messages]
W20260709 12:23:28.807760 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.827078 23966 consensus_peers.cc:597] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.827574 23892 consensus_peers.cc:597] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.841303 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.862102 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.886507 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.895525 23892 consensus_peers.cc:597] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.897738 23892 consensus_peers.cc:597] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.946478 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:28.948905 24524 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.956707 23892 consensus_peers.cc:597] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:28.986703 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.016175 23892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 59505.6us
W20260709 12:23:29.043463 23966 consensus_peers.cc:597] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:29.056046 23892 consensus_peers.cc:597] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.078888 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.119323 23966 consensus_peers.cc:597] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:29.206362 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.221590 24524 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.330669 22701 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 23875)
W20260709 12:23:29.331617 23892 consensus_peers.cc:597] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.359860 24524 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.383985 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.443193 23892 consensus_peers.cc:597] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:29.444103 23892 consensus_peers.cc:597] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:29.448544 23892 consensus_peers.cc:597] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.471757 23892 consensus_peers.cc:597] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.492164 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:29.522650 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.528476 24524 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.588451 24524 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.650290 23892 consensus_peers.cc:597] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:29.729564 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33453, user_credentials={real_user=slave}} blocked reactor thread for 51322.7us
W20260709 12:23:29.744831 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:29.845845 23966 consensus_peers.cc:597] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:29.855907 23892 consensus_peers.cc:597] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:29.943097 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:29.966040 23892 consensus_peers.cc:597] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:29.980400 23966 consensus_peers.cc:597] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:30.028409 23966 consensus_peers.cc:597] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:30.289577 24524 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:30.331130 22701 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 23875)
W20260709 12:23:30.759464 23966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 48815.6us
W20260709 12:23:30.910844 23892 consensus_peers.cc:597] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:30.918993 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:30.920465 24524 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:30.960666 23892 consensus_peers.cc:597] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.131884 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.192689 23966 consensus_peers.cc:597] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:31.212548 23892 consensus_peers.cc:597] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.269532 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:31.347564 23892 consensus_peers.cc:597] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.367838 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.369537 23892 consensus_peers.cc:597] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.371719 24524 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.373240 23892 consensus_peers.cc:597] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.412159 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.425770 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.442816 23892 consensus_peers.cc:597] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.445191 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.480132 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.514560 23966 consensus_peers.cc:597] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.552647 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:31.586881 23966 consensus_peers.cc:597] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:31.605137 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.667687 23966 consensus_peers.cc:597] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:31.783466 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.816524 23892 consensus_peers.cc:597] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:31.838191 23892 consensus_peers.cc:597] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.852918 24524 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.861560 23892 consensus_peers.cc:597] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.888463 24524 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:31.968537 23892 consensus_peers.cc:597] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:32.039011 24524 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:32.051802 23966 consensus_peers.cc:597] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:32.088797 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:32.118630 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:32.120232 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:32.126718 24524 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:32.151484 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:32.158167 23892 consensus_peers.cc:597] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:32.235505 23892 consensus_peers.cc:597] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:32.360071 23892 consensus_peers.cc:597] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:32.408352 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:32.414222 23892 consensus_peers.cc:597] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:32.526733 24524 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:32.545531 23966 consensus_peers.cc:597] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:32.639621 23966 consensus_peers.cc:597] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:33.253043 22701 tablet_server.cc:196] TabletServer@127.22.43.65:0 shutdown complete.
W20260709 12:23:33.300698 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:33.343256 23892 consensus_peers.cc:597] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:33.424548 24524 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:33.552455 23892 consensus_peers.cc:597] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:33.703918 23892 consensus_peers.cc:597] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:33.991640 23892 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111) [suppressed 428 similar messages]
W20260709 12:23:34.018119 23969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.030s	sys 0.054s
W20260709 12:23:34.037212 23969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.031s	sys 0.054s
W20260709 12:23:34.037685 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 615745us
W20260709 12:23:34.095063 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.128768 24524 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.130505 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.129540 24525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.083s	sys 0.152s
W20260709 12:23:34.132606 24525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.084s	sys 0.153s
W20260709 12:23:34.132922 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 552985us
W20260709 12:23:34.138053 23892 consensus_peers.cc:597] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.155817 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.156457 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.157250 23966 consensus_peers.cc:597] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:34.158771 22701 tablet_server.cc:179] TabletServer@127.22.43.66:0 shutting down...
W20260709 12:23:34.158757 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:34.160202 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:34.169126 23966 consensus_peers.cc:597] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:34.240537 23892 consensus_peers.cc:597] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.241127 23892 consensus_peers.cc:597] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.264408 23892 consensus_peers.cc:597] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.266536 24524 consensus_peers.cc:597] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.267632 24524 consensus_peers.cc:597] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.268414 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.269217 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.269960 24524 consensus_peers.cc:597] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.270712 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.278512 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 62495.8us
W20260709 12:23:34.278159 23966 consensus_peers.cc:597] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.281427 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.283087 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.283568 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.284157 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.286820 23966 consensus_peers.cc:597] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.287472 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.288122 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.288726 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.289322 23966 consensus_peers.cc:597] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.289983 23966 consensus_peers.cc:597] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.291168 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.291812 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.292618 23966 consensus_peers.cc:597] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.295689 23966 consensus_peers.cc:597] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.296334 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.296973 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:34.333084 31047 raft_consensus.cc:493] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.333841 31047 raft_consensus.cc:515] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:34.338038 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24af680f7e54ded89a0d5eff1320c6c" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.341821 31047 leader_election.cc:290] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:34.347579 23892 leader_election.cc:336] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:34.347714 31043 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.348212 23892 leader_election.cc:304] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:34.348443 31043 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.349128 31047 raft_consensus.cc:2749] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:34.351806 31043 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:34.352296 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.353852 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d2fbc1f30749eba64903d7e79de8a7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:34.356032 23895 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:34.356820 31043 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:34.365482 23892 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:34.388669 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.421622 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:34.493654 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:34.500551 22701 tablet_replica.cc:333] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
W20260709 12:23:34.503320 24524 consensus_peers.cc:597] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:34.511132 22701 raft_consensus.cc:2243] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:23:34.513520 31047 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.514052 31047 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.514599 22701 raft_consensus.cc:2272] T d728437e541d463594bcfe1155df3a32 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.516176 31047 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:34.517413 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:34.519322 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cef7044d4597b6db8ead4067f592" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
W20260709 12:23:34.520516 23892 consensus_peers.cc:597] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:34.521142 23893 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:34.523205 31039 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:34.525054 22701 tablet_replica.cc:333] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.527573 22701 raft_consensus.cc:2243] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:34.535106 22701 raft_consensus.cc:2272] T 880fc0774867427e9e9a605bad2bd375 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.538587 22701 tablet_replica.cc:333] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.539626 22701 raft_consensus.cc:2243] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.546260 22701 raft_consensus.cc:2272] T 536d25b8a1934dfd8c9ecb2fa2068928 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:34.546609 24524 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.601650 23892 consensus_peers.cc:597] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.605443 23966 consensus_peers.cc:597] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.606104 23892 consensus_peers.cc:597] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:34.573212 22701 tablet_replica.cc:333] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.611408 22701 raft_consensus.cc:2243] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:34.612535 22701 raft_consensus.cc:2272] T c4a453d774d845e59416b4429315c41f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.615587 22701 tablet_replica.cc:333] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.616416 22701 raft_consensus.cc:2243] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:34.617619 22701 raft_consensus.cc:2272] T 9d9e6b2e7add490280e05d9b2bfdda17 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.625463 22701 tablet_replica.cc:333] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.639925 31039 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.650120 22701 raft_consensus.cc:2243] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:34.646647 31047 raft_consensus.cc:493] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.650810 31047 raft_consensus.cc:515] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:34.651650 22701 raft_consensus.cc:2272] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.653297 31047 leader_election.cc:290] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:34.649686 31039 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.654390 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e8987a07704ea192b04366772512e7" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.656378 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.656859 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ade9323ef4a49b3b60c68243facc406" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:34.658599 23895 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:34.666062 31043 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:34.672880 23892 consensus_peers.cc:597] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:34.674397 31039 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:34.675904 31043 raft_consensus.cc:493] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:23:34.686107 31043 raft_consensus.cc:515] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.688485 31043 leader_election.cc:290] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:34.689155 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.690213 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80eac81f44441f49acb9eba858e3637" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:34.691731 23895 leader_election.cc:304] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:34.693073 31043 raft_consensus.cc:2749] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:34.696143 23892 leader_election.cc:336] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:34.696699 23892 leader_election.cc:304] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:34.697517 31039 raft_consensus.cc:2749] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:34.682242 24524 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:34.684237 22701 tablet_replica.cc:333] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.706738 22701 raft_consensus.cc:2243] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.707419 22701 raft_consensus.cc:2272] T 4a72394010d8464f87107625dbd58b7d P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:34.685335 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.710366 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.714205 23950 debug-util.cc:398] Leaking SignalData structure 0x7b08002198e0 after lost signal to thread 22704
W20260709 12:23:34.718794 23950 debug-util.cc:398] Leaking SignalData structure 0x7b080039b320 after lost signal to thread 23786
W20260709 12:23:34.719895 23950 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce700 after lost signal to thread 23953
W20260709 12:23:34.720853 23950 debug-util.cc:398] Leaking SignalData structure 0x7b0800392f60 after lost signal to thread 24028
W20260709 12:23:34.721781 23950 debug-util.cc:398] Leaking SignalData structure 0x7b080016c000 after lost signal to thread 24587
I20260709 12:23:34.730299 31039 raft_consensus.cc:493] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:23:34.740422 31039 raft_consensus.cc:515] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.742590 31039 leader_election.cc:290] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:34.743634 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6aae08bca4478b92abb367635b948e" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
W20260709 12:23:34.742276 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.749168 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:34.750131 23966 consensus_peers.cc:597] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:34.756780 22701 tablet_replica.cc:333] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.757829 22701 raft_consensus.cc:2243] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.769282 31047 raft_consensus.cc:493] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:23:34.769920 31047 raft_consensus.cc:515] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.771973 31047 leader_election.cc:290] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:34.776953 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4315a53504a7a84ffb2b5e251ea08" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:34.780663 22701 raft_consensus.cc:2272] T 573b7fecf80d4359b0e9f045d989ed09 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.786681 22701 tablet_replica.cc:333] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.789407 22701 raft_consensus.cc:2243] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.790277 22701 raft_consensus.cc:2272] T 0ade9323ef4a49b3b60c68243facc406 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.794554 22701 tablet_replica.cc:333] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.801489 22701 raft_consensus.cc:2243] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.802393 22701 raft_consensus.cc:2272] T 5d0c3eeb21514ee1a8f1324ff166cb7f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.820379 22701 tablet_replica.cc:333] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.821163 22701 raft_consensus.cc:2243] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.821791 22701 raft_consensus.cc:2272] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.834977 31039 raft_consensus.cc:493] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.835594 31039 raft_consensus.cc:515] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:34.837847 31039 leader_election.cc:290] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:34.840499 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0499f663114741880a025070e7b81f" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.847189 22701 tablet_replica.cc:333] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.848160 22701 raft_consensus.cc:2243] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.847836 23999 consensus_queue.cc:237] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.848937 22701 raft_consensus.cc:2272] T 3e5d779cbe414b879d3a8be40d0428fa P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.851913 22701 tablet_replica.cc:333] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
W20260709 12:23:34.855276 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:34.860412 24524 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:34.861302 31039 raft_consensus.cc:493] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.861909 31039 raft_consensus.cc:515] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:34.862900 22701 raft_consensus.cc:2243] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.863395 31051 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.864074 22701 raft_consensus.cc:2272] T f82c4b60fcc242eda3a32f8f32d6d163 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.864019 31051 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.864384 31039 leader_election.cc:290] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:34.867607 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:34.868961 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a83cc012d5420494cfd8c624a09767" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.869177 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7130e46e524c588b99e0dfff2518c4" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.870071 31043 raft_consensus.cc:493] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.870654 31043 raft_consensus.cc:515] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:23:34.872150 23966 consensus_peers.cc:597] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:34.872752 31043 leader_election.cc:290] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:34.873697 22701 tablet_replica.cc:333] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.874637 22701 raft_consensus.cc:2243] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:34.875756 23893 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:34.876730 31047 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:34.875782 22701 raft_consensus.cc:2272] T d12092e2a1294da4acc0a5f0261bfe94 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.879410 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4c451e990244d7a5701e875fa03f62" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.879240 31051 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:34.882561 24557 raft_consensus.cc:1275] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:23:34.883492 23892 leader_election.cc:336] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:34.884160 23892 leader_election.cc:304] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:34.884310 31055 consensus_queue.cc:1048] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:23:34.884859 23892 raft_consensus.cc:2686] T 5b6aae08bca4478b92abb367635b948e P e8bc734d763e4ddf87f7b930e35cbaa7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:23:34.892249 22701 tablet_replica.cc:333] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.893096 22701 raft_consensus.cc:2243] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.908697 31039 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.909345 31039 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.912412 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.913578 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b845c11f69f485889b01a0a648dc3bc" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:34.893713 22701 raft_consensus.cc:2272] T 8630b76482c543a2a08e289b32b13ab6 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.915653 23895 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:34.916613 31051 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:34.917747 31051 raft_consensus.cc:493] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:23:34.918327 31051 raft_consensus.cc:515] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.916527 31050 raft_consensus.cc:2955] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 3 to 12, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:34.919615 24559 raft_consensus.cc:2955] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 3 to 12, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:34.921736 31051 leader_election.cc:290] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:34.925043 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.924358 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53a1203874c465cbc2d50279fc76c4b" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:34.928356 31047 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.928889 31047 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.931658 31047 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:34.934310 31043 raft_consensus.cc:493] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:23:34.934831 31043 raft_consensus.cc:515] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:34.937220 31043 leader_election.cc:290] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:34.939425 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:34.940047 23895 leader_election.cc:304] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:34.941505 31047 raft_consensus.cc:2749] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:34.942467 22701 tablet_replica.cc:333] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.941640 23752 catalog_manager.cc:5697] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: config changed from index 3 to 12, VOTER 22996f888daf435398b693481171c18c (127.22.43.65) evicted. New cstate: current_term: 18 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:34.942387 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f65f9b948cd4a8d88db397a8232dace" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:34.917405 31039 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:34.948925 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73d2fbc1f30749eba64903d7e79de8a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 12:23:34.949554 22701 raft_consensus.cc:2243] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:34.953142 22701 raft_consensus.cc:2272] T f07a76a5d75e47acaff6a5ca2f03dcc5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:34.948446 23892 leader_election.cc:336] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:34.962081 23892 leader_election.cc:304] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:34.963692 31039 raft_consensus.cc:2749] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:34.954427 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d6b859dc2949aeaefe73fefd5829bb" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:34.965636 23895 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:34.966578 31039 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:34.974566 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:34.978085 31051 raft_consensus.cc:493] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:34.978689 31051 raft_consensus.cc:515] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:34.980969 31051 leader_election.cc:290] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:34.985924 23892 leader_election.cc:336] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:34.986424 23892 leader_election.cc:304] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:34.988438 22701 tablet_replica.cc:333] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:34.989427 22701 raft_consensus.cc:2243] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:34.995131 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd49025134246c8a0245389cc43db77" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:35.009806 31039 raft_consensus.cc:2749] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:35.027638 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:35.040803 22701 raft_consensus.cc:2272] T 092a962747db4e3b9c0bb6d7fdb831d5 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:35.019276 23892 leader_election.cc:336] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:35.042160 23892 leader_election.cc:304] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:35.042980 31043 raft_consensus.cc:2749] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:35.043219 23892 leader_election.cc:336] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:35.043821 23892 leader_election.cc:304] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:35.053155 31043 raft_consensus.cc:2749] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:35.060011 22701 tablet_replica.cc:333] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
W20260709 12:23:35.060941 23892 leader_election.cc:336] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:35.077215 22701 raft_consensus.cc:2243] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:35.094043 23892 leader_election.cc:336] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:35.094107 22701 raft_consensus.cc:2272] T 23e8987a07704ea192b04366772512e7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.094681 23892 leader_election.cc:304] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:35.096167 31051 raft_consensus.cc:2749] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:35.124349 22701 tablet_replica.cc:333] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.126248 22701 raft_consensus.cc:2243] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.133698 22701 raft_consensus.cc:2272] T aa7130e46e524c588b99e0dfff2518c4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:35.124976 23966 consensus_peers.cc:597] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:35.141541 22701 tablet_replica.cc:333] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.146255 22701 raft_consensus.cc:2243] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.148509 22701 raft_consensus.cc:2272] T a9308162d63f49c4aa8dfccb14c1cf8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:35.145239 23966 consensus_peers.cc:597] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.149626 31043 raft_consensus.cc:493] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35a9a1f8b1d847fb8f2063ced2a3c26d)
I20260709 12:23:35.158380 31043 raft_consensus.cc:515] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:35.158735 23892 leader_election.cc:336] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:35.159272 23892 leader_election.cc:304] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:35.160748 31043 leader_election.cc:290] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:35.162230 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7ddeeeb6384431bc2cc3bcf50c2a16" candidate_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:35.163553 31051 raft_consensus.cc:2749] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:35.164460 23736 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 65128.8us
W20260709 12:23:35.170397 23736 catalog_manager.cc:4755] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 73d2fbc1f30749eba64903d7e79de8a7: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:35.175797 22701 tablet_replica.cc:333] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.179103 22701 raft_consensus.cc:2243] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.179818 22701 raft_consensus.cc:2272] T 73d2fbc1f30749eba64903d7e79de8a7 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.182662 22701 tablet_replica.cc:333] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.183535 22701 raft_consensus.cc:2243] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.184917 22701 raft_consensus.cc:2272] T d55123f416ba4e9a930f3a24bb6c88f3 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.187739 22701 tablet_replica.cc:333] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.188689 22701 raft_consensus.cc:2243] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.189337 22701 raft_consensus.cc:2272] T d80eac81f44441f49acb9eba858e3637 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.192330 22701 tablet_replica.cc:333] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.193296 22701 raft_consensus.cc:2243] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.194594 22701 raft_consensus.cc:2272] T fe9ef9f9e0c249d5bdb5743853fa3308 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.197504 22701 tablet_replica.cc:333] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.198347 22701 raft_consensus.cc:2243] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.200896 22701 raft_consensus.cc:2272] T d0df961accdf4f35a6f59fd126751e8a P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.206224 22701 tablet_replica.cc:333] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.215668 22701 raft_consensus.cc:2243] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.216440 22701 raft_consensus.cc:2272] T fdd49025134246c8a0245389cc43db77 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.219172 22701 tablet_replica.cc:333] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.222810 22701 raft_consensus.cc:2243] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.223883 22701 raft_consensus.cc:2272] T bed4315a53504a7a84ffb2b5e251ea08 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.227895 22701 tablet_replica.cc:333] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
W20260709 12:23:35.229218 24524 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:35.230149 22701 raft_consensus.cc:2243] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.231284 22701 raft_consensus.cc:2272] T e24af680f7e54ded89a0d5eff1320c6c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.234899 22701 tablet_replica.cc:333] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
W20260709 12:23:35.235965 23892 consensus_peers.cc:597] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:35.236428 23892 leader_election.cc:336] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:35.236903 23892 leader_election.cc:304] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bc734d763e4ddf87f7b930e35cbaa7; no voters: 22996f888daf435398b693481171c18c, 35a9a1f8b1d847fb8f2063ced2a3c26d
I20260709 12:23:35.238243 31043 raft_consensus.cc:2749] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.240957 22701 raft_consensus.cc:2243] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:35.253260 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:35.254050 22701 raft_consensus.cc:2272] T 9e0499f663114741880a025070e7b81f P e8bc734d763e4ddf87f7b930e35cbaa7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.264837 22701 tablet_replica.cc:333] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.265702 22701 raft_consensus.cc:2243] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:35.265868 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:35.266542 22701 raft_consensus.cc:2272] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.269291 22701 tablet_replica.cc:333] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.270280 22701 raft_consensus.cc:2243] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.273162 22701 raft_consensus.cc:2272] T 9458291d6d4d499f9c4b21cbe9170c33 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.280997 22701 tablet_replica.cc:333] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.284427 22701 raft_consensus.cc:2243] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.294375 22701 raft_consensus.cc:2272] T 5a4c451e990244d7a5701e875fa03f62 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.298280 22701 tablet_replica.cc:333] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.306561 22701 raft_consensus.cc:2243] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.311429 22701 raft_consensus.cc:2272] T 83e1955dc5e84b5080e7ea8d739baff4 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.323189 22701 tablet_replica.cc:333] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.324095 22701 raft_consensus.cc:2243] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.325234 22701 raft_consensus.cc:2272] T f478cef7044d4597b6db8ead4067f592 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.357277 22701 tablet_replica.cc:333] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.358240 22701 raft_consensus.cc:2243] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.359300 22701 raft_consensus.cc:2272] T 7b845c11f69f485889b01a0a648dc3bc P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.365895 22701 tablet_replica.cc:333] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.370502 22701 raft_consensus.cc:2243] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.371640 22701 raft_consensus.cc:2272] T 38d6b859dc2949aeaefe73fefd5829bb P e8bc734d763e4ddf87f7b930e35cbaa7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.382468 22701 tablet_replica.cc:333] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.385851 22701 raft_consensus.cc:2243] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.391850 22701 raft_consensus.cc:2272] T 769e238f62804be6900a5660ed34e431 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.397943 22701 tablet_replica.cc:333] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.406095 22701 raft_consensus.cc:2243] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.407480 22701 raft_consensus.cc:2272] T 66100c48e39a42c7be31fa60db7a0d23 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.410458 22701 tablet_replica.cc:333] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.414340 22701 raft_consensus.cc:2243] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.414973 22701 raft_consensus.cc:2272] T 9f65f9b948cd4a8d88db397a8232dace P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.427543 22701 tablet_replica.cc:333] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.444770 22701 raft_consensus.cc:2243] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.466992 22701 raft_consensus.cc:2272] T d53a1203874c465cbc2d50279fc76c4b P e8bc734d763e4ddf87f7b930e35cbaa7 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:35.467787 23966 consensus_peers.cc:597] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:35.515894 22701 tablet_replica.cc:333] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.518271 22701 raft_consensus.cc:2243] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.542893 22701 raft_consensus.cc:2272] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.545763 22701 tablet_replica.cc:333] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.546604 22701 raft_consensus.cc:2243] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.547268 22701 raft_consensus.cc:2272] T 05a83cc012d5420494cfd8c624a09767 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.562335 22701 tablet_replica.cc:333] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.563100 22701 raft_consensus.cc:2243] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.564232 22701 raft_consensus.cc:2272] T d78ef4be778a4d7fa19baf9815bd1d96 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.595629 22701 tablet_replica.cc:333] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.596309 22701 raft_consensus.cc:2243] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.596925 22701 raft_consensus.cc:2272] T 45f9750732564b8ebf9a7d205547b35c P e8bc734d763e4ddf87f7b930e35cbaa7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.622390 22701 tablet_replica.cc:333] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.624251 22701 raft_consensus.cc:2243] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.626349 22701 raft_consensus.cc:2272] T 01f15f801cf34333ad12954d0b614109 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.629484 22701 tablet_replica.cc:333] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7: stopping tablet replica
I20260709 12:23:35.639618 22701 raft_consensus.cc:2243] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:35.646874 22701 raft_consensus.cc:2272] T fadf34409dda41739b8f46dcf0a526b2 P e8bc734d763e4ddf87f7b930e35cbaa7 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:35.655157 24524 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:35.745213 31060 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:35.746222 31056 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:35.745808 31060 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:35.746788 31056 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:35.748378 31060 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:35.748921 31060 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:35.749123 31056 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:35.758313 24524 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:35.760268 24524 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.760725 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:35.761512 31056 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:35.761871 24524 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.749413 31060 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:35.766412 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:35.767689 31060 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:35.768549 24525 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:35.769049 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:35.769732 31060 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:35.778760 24524 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.779230 24524 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:35.779915 31060 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:35.859575 31060 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:35.868393 31060 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:35.882898 24524 leader_election.cc:336] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:35.886198 31060 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:35.893782 24524 leader_election.cc:336] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:35.902114 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:35.906071 31056 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:35.939576 31055 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:35.940165 31055 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:35.943233 31055 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:35.954881 31055 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:35.955484 31055 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:35.957829 31055 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:35.962146 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:35.962845 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:35.963481 24561 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
I20260709 12:23:35.962862 24562 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 13.
I20260709 12:23:35.970693 31055 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:35.971311 31055 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:35.974851 31055 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:35.979277 23969 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:35.980222 31055 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:35.980620 31055 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:35.980994 31055 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:35.984512 23969 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:35.987036 31070 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:35.987437 31070 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:35.987804 31070 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:35.995247 31070 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.006521 31070 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:23:36.020532 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:36.020725 24561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880fc0774867427e9e9a605bad2bd375" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:36.021386 24561 raft_consensus.cc:3060] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:36.030074 24561 raft_consensus.cc:2468] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 14.
I20260709 12:23:36.047544 31055 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:36.048123 23966 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:36.048926 23966 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.052917 31060 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.053608 23969 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:36.053460 31060 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.054404 31041 raft_consensus.cc:2804] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:36.054895 31041 raft_consensus.cc:697] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:36.055593 31060 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:36.055794 31041 consensus_queue.cc:237] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.062559 31055 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:36.082369 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a453d774d845e59416b4429315c41f" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:36.083002 24562 raft_consensus.cc:3060] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:36.083856 23966 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:36.085278 23966 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.090334 24562 raft_consensus.cc:2468] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 17.
I20260709 12:23:36.096349 31050 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.096903 31050 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:23:36.097687 23966 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:36.098194 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.100135 31055 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:36.101436 31050 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:36.103201 24524 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:36.111238 23750 catalog_manager.cc:5697] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 13 to 14, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 14 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.119258 23969 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:36.120229 31041 raft_consensus.cc:2804] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:36.120712 31041 raft_consensus.cc:697] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
I20260709 12:23:36.121678 31041 consensus_queue.cc:237] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:36.124512 24524 leader_election.cc:336] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:36.125658 24524 leader_election.cc:336] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:36.132799 24524 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.137318 31060 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:36.155889 23966 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.170589 31041 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.171216 31041 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:36.173450 31041 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:36.190755 23966 leader_election.cc:336] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:36.214738 23966 leader_election.cc:336] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.215368 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.216985 31041 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:36.235368 23750 catalog_manager.cc:5697] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 16 to 17, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 17 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:36.236869 23966 leader_election.cc:336] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:36.238471 23966 leader_election.cc:336] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:36.254048 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.259109 31041 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:36.277070 31041 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.277616 31041 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:36.279893 31041 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:36.280508 31041 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.281031 31041 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.284801 24562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:36.284890 31041 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:36.288064 31060 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.288698 31060 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.290908 31060 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:36.308300 24524 leader_election.cc:336] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:36.309576 24524 leader_election.cc:336] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.314982 24524 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.317003 31060 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:36.328245 23966 leader_election.cc:336] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:36.330114 23966 leader_election.cc:336] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.330590 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.331400 31041 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:36.331596 23966 leader_election.cc:336] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.334403 23966 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.335219 31041 raft_consensus.cc:2749] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:36.362251 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.388175 23736 catalog_manager.cc:4755] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 73d2fbc1f30749eba64903d7e79de8a7: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:36.393594 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:36.410203 31041 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.410889 31041 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:36.413169 31041 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:36.427354 31060 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.427990 31060 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.430131 31060 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:36.437278 24524 leader_election.cc:336] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:36.439141 24524 leader_election.cc:336] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.439661 24524 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.440632 31060 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:36.448309 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:36.452955 23966 leader_election.cc:336] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:36.456470 23966 leader_election.cc:336] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.457007 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.458074 31041 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:36.461463 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:36.473695 31060 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.474512 31060 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.476830 31060 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:36.478839 24524 consensus_peers.cc:597] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:36.493345 24562 raft_consensus.cc:1275] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:36.499387 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:36.506552 31041 consensus_queue.cc:1048] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:36.519430 31060 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.520092 31060 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.522616 31060 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:36.527926 24524 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.528592 24524 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.533080 31056 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:36.541739 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:36.549268 31060 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.554241 31056 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.554855 31056 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.558377 31056 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:36.560633 31060 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.564472 31060 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:36.588327 31050 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.588886 31050 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.592213 31050 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:36.594074 31060 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.595245 31060 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.598592 31060 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:36.603957 24524 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:36.615145 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:36.615901 23995 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 20.
I20260709 12:23:36.617945 31050 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.620929 31050 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.623829 31050 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
W20260709 12:23:36.635280 24524 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.640785 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.642063 31060 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:36.637071 23966 consensus_peers.cc:597] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.641798 24524 consensus_peers.cc:597] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:36.647871 24525 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:36.649991 31060 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:36.650511 31060 raft_consensus.cc:493] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.650990 31060 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:36.668291 24524 leader_election.cc:336] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:36.674225 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:36.684998 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:36.693828 24559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:36.700167 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" is_pre_election: true
I20260709 12:23:36.700819 24557 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 15.
W20260709 12:23:36.701452 24524 leader_election.cc:336] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.708652 31060 raft_consensus.cc:515] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.701993 24524 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.716216 31056 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:36.717536 24524 leader_election.cc:336] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:36.720561 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.722348 24524 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:36.727969 24524 leader_election.cc:336] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:36.727305 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9ef9f9e0c249d5bdb5743853fa3308" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:36.725942 31060 leader_election.cc:290] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:36.733091 23999 raft_consensus.cc:3060] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:36.731549 23966 leader_election.cc:336] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:36.739272 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.739799 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.740291 23966 consensus_peers.cc:597] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.740736 23966 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:36.741335 23966 consensus_peers.cc:597] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:36.740913 23999 raft_consensus.cc:2468] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 21.
W20260709 12:23:36.741914 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.744240 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:36.746451 23969 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.749014 31041 raft_consensus.cc:2749] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:36.752734 23969 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.753866 31041 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:36.754323 31041 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.754746 31041 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:36.754912 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:36.755475 23966 consensus_peers.cc:597] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:36.758430 24525 leader_election.cc:304] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 
I20260709 12:23:36.759244 31060 raft_consensus.cc:2804] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:36.759747 31060 raft_consensus.cc:697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:23:36.760608 31060 consensus_queue.cc:237] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:36.761305 23966 consensus_peers.cc:597] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.761783 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.770503 23966 consensus_peers.cc:597] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.771093 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.776695 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.779692 23966 consensus_peers.cc:597] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.787776 24524 leader_election.cc:336] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.791863 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.793198 31060 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:36.790019 31041 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.799181 31060 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.799705 31060 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.801734 31060 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:36.801807 23966 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:36.804761 31041 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68:43439)
I20260709 12:23:36.805809 24559 raft_consensus.cc:1275] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:36.808880 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e238f62804be6900a5660ed34e431" candidate_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d"
I20260709 12:23:36.809458 24557 raft_consensus.cc:3060] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:36.816325 24557 raft_consensus.cc:2468] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604755d84b7e4ff8a2b75453dccb6f1b in term 16.
W20260709 12:23:36.823589 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.824162 24524 leader_election.cc:336] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:36.824740 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.828562 24524 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:36.852838 22701 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23950)
W20260709 12:23:36.895653 23966 consensus_peers.cc:597] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:36.900776 31041 consensus_queue.cc:1048] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
W20260709 12:23:36.829632 24524 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:36.903236 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.908733 23969 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:36.913013 31041 raft_consensus.cc:2804] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:36.913985 31041 raft_consensus.cc:697] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Becoming Leader. State: Replica: 604755d84b7e4ff8a2b75453dccb6f1b, State: Running, Role: LEADER
W20260709 12:23:36.913564 24524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:34895, user_credentials={real_user=slave}} blocked reactor thread for 83940.7us
I20260709 12:23:36.916869 31041 consensus_queue.cc:237] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.913851 31060 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:36.913545 23750 catalog_manager.cc:5697] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 20 to 21, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 21 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:36.937736 23966 consensus_peers.cc:597] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:36.943049 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:36.965010 31060 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:36.966862 31060 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:36.971975 31060 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:36.974695 24524 consensus_peers.cc:597] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:36.991504 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:36.992240 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:36.999048 24524 leader_election.cc:336] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:37.004437 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:37.004874 31060 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:37.006093 31060 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:37.008303 31060 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:37.013244 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:37.014245 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" is_pre_election: true
I20260709 12:23:37.015633 23999 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 12.
I20260709 12:23:37.019843 24525 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:37.021703 31071 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:37.022174 31071 raft_consensus.cc:493] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:37.022570 31071 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:37.023747 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:37.036252 23752 catalog_manager.cc:5697] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: term changed from 15 to 16, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67). New cstate: current_term: 16 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:37.039130 24524 leader_election.cc:336] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:37.051517 24524 leader_election.cc:336] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:37.051926 24524 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:37.052924 31060 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:37.084318 23966 consensus_peers.cc:597] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:37.097082 31071 raft_consensus.cc:515] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:37.102257 31071 leader_election.cc:290] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Requested vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:37.108903 24524 leader_election.cc:336] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:37.109143 23999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78ef4be778a4d7fa19baf9815bd1d96" candidate_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "604755d84b7e4ff8a2b75453dccb6f1b"
I20260709 12:23:37.111300 23999 raft_consensus.cc:3060] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.127797 23999 raft_consensus.cc:2468] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a9a1f8b1d847fb8f2063ced2a3c26d in term 13.
W20260709 12:23:37.138484 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:37.142004 24525 leader_election.cc:304] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d, 604755d84b7e4ff8a2b75453dccb6f1b; no voters: e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:23:37.142621 24524 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:37.142802 31071 raft_consensus.cc:2804] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:37.143362 31071 raft_consensus.cc:697] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Becoming Leader. State: Replica: 35a9a1f8b1d847fb8f2063ced2a3c26d, State: Running, Role: LEADER
I20260709 12:23:37.144644 31071 consensus_queue.cc:237] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:37.168664 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:37.179440 24524 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:37.182301 23752 catalog_manager.cc:5697] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d reported cstate change: term changed from 12 to 13, leader changed from e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) to 35a9a1f8b1d847fb8f2063ced2a3c26d (127.22.43.68). New cstate: current_term: 13 leader_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:37.186067 24524 consensus_peers.cc:597] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:37.189502 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:37.204945 23999 raft_consensus.cc:1275] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:37.206416 31071 consensus_queue.cc:1048] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:23:37.273415 24524 consensus_peers.cc:597] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.283304 24524 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:37.317239 24560 raft_consensus.cc:1275] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:23:37.318658 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:37.319087 31041 consensus_queue.cc:1048] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:23:37.334981 23966 consensus_peers.cc:597] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:37.389058 23966 consensus_peers.cc:597] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.416718 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:37.448541 23966 consensus_peers.cc:597] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:37.483023 23736 catalog_manager.cc:4755] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 73d2fbc1f30749eba64903d7e79de8a7: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:37.558175 23999 raft_consensus.cc:1275] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Refusing update from remote peer 35a9a1f8b1d847fb8f2063ced2a3c26d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:37.561818 31071 consensus_queue.cc:1048] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:37.565092 31056 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:37.565730 31056 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:37.568245 31056 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:37.574604 24524 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:37.575649 24524 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:37.576123 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:37.576910 31071 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:37.606995 24524 consensus_peers.cc:597] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.606918 23966 consensus_peers.cc:597] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:37.658638 31060 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:37.659461 31060 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:37.667680 24524 leader_election.cc:336] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:37.668756 31060 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:37.678215 24524 leader_election.cc:336] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:37.679093 24524 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:37.688512 31071 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:37.718139 24524 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:37.742357 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:37.839226 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:37.840426 31050 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:37.841056 31050 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:37.843266 31050 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:37.853732 22701 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23950)
W20260709 12:23:37.859731 23966 leader_election.cc:336] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:37.860734 23966 leader_election.cc:336] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:37.862537 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:37.863418 31050 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:37.878810 31050 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:37.879446 31050 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:37.881623 31050 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:37.883785 23966 consensus_peers.cc:597] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:37.890065 23966 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:37.897462 23966 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:37.897909 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:37.902237 31041 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:37.970520 31071 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:37.971242 31071 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:37.973500 31071 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:37.984043 24524 leader_election.cc:336] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:37.985296 24524 leader_election.cc:336] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:37.985643 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:37.987555 31060 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:38.009539 31060 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:38.010306 31060 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:38.012518 31060 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:38.017669 24524 leader_election.cc:336] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:38.018450 24524 leader_election.cc:336] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:38.018899 24524 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:38.019681 31060 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:38.263043 31041 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:38.263780 31041 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:38.266912 31041 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:38.274255 23966 leader_election.cc:336] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:38.276181 23966 leader_election.cc:336] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:38.276726 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:38.277572 31041 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:38.294062 31041 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:38.294706 31041 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:38.297125 31041 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:38.306063 31071 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:38.306808 31071 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:38.309118 31071 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:38.322085 23966 leader_election.cc:336] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:38.322836 23966 leader_election.cc:336] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:38.323218 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:23:38.323966 24524 leader_election.cc:336] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:38.324630 24524 leader_election.cc:336] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:38.325002 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:38.328078 31071 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:38.329033 31087 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:38.330523 31087 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:38.331126 31087 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:38.333412 31087 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:38.347623 31060 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:38.348333 31060 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:38.350433 31060 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:38.367121 23966 leader_election.cc:336] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:38.375685 24524 leader_election.cc:336] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:38.379228 24524 leader_election.cc:336] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:38.379726 24524 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:23:38.378154 23966 leader_election.cc:336] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:38.380559 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:38.381393 31050 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:38.383638 31071 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:38.406041 24524 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:38.507009 24524 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:23:38.576524 31071 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:38.577219 31071 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:38.579627 31071 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:38.586743 24524 leader_election.cc:336] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:38.591385 24524 leader_election.cc:336] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:38.591948 24524 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:38.593999 31071 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:38.642961 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:23:38.673338 31071 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:38.674060 31071 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:38.676415 31071 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:38.692857 24524 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:38.696365 24524 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:38.700913 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:38.701956 31071 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:38.715494 31071 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:38.716387 31071 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:38.720916 31071 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:38.744189 24524 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:38.757469 24524 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:38.758018 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:38.758831 31071 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:38.793684 31060 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:38.794363 31060 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:38.796319 31060 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:38.805186 24524 leader_election.cc:336] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:38.808058 24524 leader_election.cc:336] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:38.808555 24524 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:38.809476 31071 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:38.842837 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:38.855053 22701 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 23950)
W20260709 12:23:38.860814 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:38.890656 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:38.933089 24524 consensus_peers.cc:597] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:38.958508 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:38.987795 24524 consensus_peers.cc:597] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.001690 24524 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111) [suppressed 714 similar messages]
W20260709 12:23:39.009069 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.100934 23966 consensus_peers.cc:597] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.109531 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.111711 23966 consensus_peers.cc:597] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:39.127177 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.136793 23966 consensus_peers.cc:597] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:39.137539 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:39.142160 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.169699 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.181901 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.190140 23966 consensus_peers.cc:597] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.197865 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.200588 24524 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.209159 23966 consensus_peers.cc:597] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:39.214773 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.237172 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.252018 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.266040 23966 consensus_peers.cc:597] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.282310 23966 consensus_peers.cc:597] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.307161 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.349160 23966 consensus_peers.cc:597] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.356297 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:39.410458 31087 raft_consensus.cc:493] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
W20260709 12:23:39.411324 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:39.411017 31087 raft_consensus.cc:515] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:39.413466 31087 leader_election.cc:290] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:39.420570 23966 leader_election.cc:336] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:39.422465 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.422493 23966 leader_election.cc:336] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:39.423601 23966 leader_election.cc:304] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:39.424350 31087 raft_consensus.cc:2749] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:39.440923 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.442550 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.447404 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.537483 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.541074 23966 consensus_peers.cc:597] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.547164 24524 consensus_peers.cc:597] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.548471 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.561070 23966 consensus_peers.cc:597] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:39.578825 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.602808 23736 catalog_manager.cc:4755] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 73d2fbc1f30749eba64903d7e79de8a7: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:39.606856 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.746905 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 73091.1us
W20260709 12:23:39.792887 23969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:43439, user_credentials={real_user=slave}} blocked reactor thread for 44369.1us
I20260709 12:23:39.833745 31112 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:39.834394 31112 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:39.837296 31112 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:39.855826 22701 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 23950)
W20260709 12:23:39.858501 24525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:40331, user_credentials={real_user=slave}} blocked reactor thread for 173978us
W20260709 12:23:39.868374 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:39.869215 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.871153 23966 consensus_peers.cc:597] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:39.886489 31102 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:39.887033 31102 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:39.889024 31102 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:39.903592 23966 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:39.904374 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.904702 24524 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.905104 23966 consensus_peers.cc:597] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:39.905476 24524 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:39.905946 23966 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:39.906067 24524 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.907291 24524 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:39.907670 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:39.909490 31113 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:39.907742 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:39.910488 31114 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:39.917487 24524 consensus_peers.cc:597] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:39.920322 24524 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.925113 23966 consensus_peers.cc:597] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:39.935348 24524 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:39.992337 24524 consensus_peers.cc:597] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.053246 31111 raft_consensus.cc:493] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:40.053835 31111 raft_consensus.cc:515] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:40.056479 31111 leader_election.cc:290] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:40.065860 23966 leader_election.cc:336] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:40.068300 23966 leader_election.cc:336] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:40.068838 23966 leader_election.cc:304] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:40.069658 31111 raft_consensus.cc:2749] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:40.143082 24524 consensus_peers.cc:597] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.155377 31102 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:40.156016 31102 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:40.158352 31102 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:40.166441 24524 leader_election.cc:336] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:40.167593 24524 leader_election.cc:336] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:40.168026 24524 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:40.171597 31114 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:40.213542 23966 consensus_peers.cc:597] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:40.394547 23966 consensus_peers.cc:597] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:40.421083 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:40.528564 31110 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:40.529141 31110 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:40.531298 31110 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:40.534050 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:40.541033 23966 leader_election.cc:336] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:40.544116 23966 leader_election.cc:336] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:40.544611 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:40.545708 31110 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:40.560832 31102 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:40.561497 31102 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:40.566820 31102 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:40.571084 24524 leader_election.cc:336] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:40.574028 24524 leader_election.cc:336] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:40.574571 24524 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:40.575415 31102 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:40.645467 24524 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:40.743970 23783 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2ec0 after lost signal to thread 22704
W20260709 12:23:40.745141 23783 debug-util.cc:398] Leaking SignalData structure 0x7b080010c860 after lost signal to thread 23786
W20260709 12:23:40.746572 23783 debug-util.cc:398] Leaking SignalData structure 0x7b080037ff60 after lost signal to thread 24028
W20260709 12:23:40.747872 23783 debug-util.cc:398] Leaking SignalData structure 0x7b080016b3e0 after lost signal to thread 24587
I20260709 12:23:40.771441 31102 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:40.772070 31102 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:40.778903 24524 leader_election.cc:336] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:40.774333 31102 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:40.779757 24524 leader_election.cc:336] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:40.780254 24524 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:40.781014 31102 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:41.014087 31117 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:41.015244 31117 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:41.017640 31117 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:41.037674 24524 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:41.045940 24524 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:41.046540 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:41.047333 31102 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:41.061815 23966 consensus_peers.cc:597] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.069195 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:41.156584 31102 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:41.157131 31102 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:41.159255 31102 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:41.168255 24524 leader_election.cc:336] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:41.169201 24524 leader_election.cc:336] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:41.169627 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:41.170372 31102 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:41.213567 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:41.319686 23995 consensus_queue.cc:237] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:41.330628 24524 consensus_peers.cc:597] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:41.342855 24560 raft_consensus.cc:1275] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Refusing update from remote peer 604755d84b7e4ff8a2b75453dccb6f1b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:23:41.354918 24524 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:41.361817 31119 consensus_queue.cc:1048] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:23:41.366652 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.369165 23966 consensus_peers.cc:597] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.375280 23966 consensus_peers.cc:597] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.410054 31119 raft_consensus.cc:2955] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 3 to 11, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:41.426270 31117 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:41.425973 24560 raft_consensus.cc:2955] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 3 to 11, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } } }
I20260709 12:23:41.426826 31117 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:41.428893 31117 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:41.436836 24524 leader_election.cc:336] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:41.437624 24524 leader_election.cc:336] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:41.438081 24524 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:41.438827 31102 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:41.443486 23737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8630b76482c543a2a08e289b32b13ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 12:23:41.457566 23750 catalog_manager.cc:5697] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b reported cstate change: config changed from index 3 to 11, VOTER e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66) evicted. New cstate: current_term: 17 leader_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.484472 31120 raft_consensus.cc:493] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:41.485071 31120 raft_consensus.cc:515] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
W20260709 12:23:41.491392 23966 leader_election.cc:336] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:41.487243 31120 leader_election.cc:290] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:41.494589 23966 leader_election.cc:336] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:41.495113 23966 leader_election.cc:304] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:41.495991 31120 raft_consensus.cc:2749] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:41.560624 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.588322 23966 consensus_peers.cc:597] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.592017 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.592599 23966 consensus_peers.cc:597] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.614380 23736 catalog_manager.cc:4755] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8630b76482c543a2a08e289b32b13ab6: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:41.650805 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:41.653290 23966 consensus_peers.cc:597] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.653620 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:41.661269 31102 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:41.661940 31102 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:41.664395 31102 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:41.669809 24524 leader_election.cc:336] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:41.670733 24524 leader_election.cc:336] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:41.671242 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:41.672719 31115 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:41.687289 23966 consensus_peers.cc:597] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:23:41.695977 31102 raft_consensus.cc:493] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:41.696587 31102 raft_consensus.cc:515] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:41.698770 31102 leader_election.cc:290] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:41.704545 24524 consensus_peers.cc:597] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.734102 24524 leader_election.cc:336] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:41.735301 24524 leader_election.cc:336] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:41.735961 24524 leader_election.cc:304] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:41.736821 31102 raft_consensus.cc:2749] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:41.767050 24524 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:41.771332 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.773744 23966 consensus_peers.cc:597] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:41.786069 23966 consensus_peers.cc:597] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:41.787565 22701 tablet_server.cc:196] TabletServer@127.22.43.66:0 shutdown complete.
W20260709 12:23:41.802361 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:41.812302 23966 consensus_peers.cc:597] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:41.831935 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:41.855718 24524 consensus_peers.cc:597] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.880504 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08003ba3c0 after lost signal to thread 22704
W20260709 12:23:41.881659 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2cc0 after lost signal to thread 23786
W20260709 12:23:41.883204 24584 debug-util.cc:398] Leaking SignalData structure 0x7b080004e100 after lost signal to thread 24028
W20260709 12:23:41.884600 24584 debug-util.cc:398] Leaking SignalData structure 0x7b08003abaa0 after lost signal to thread 24587
W20260709 12:23:41.911512 23966 consensus_peers.cc:597] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.930150 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.942934 23966 consensus_peers.cc:597] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.945341 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:41.958467 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.962463 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:41.976774 23966 consensus_peers.cc:597] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:41.977802 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:41.988864 23966 consensus_peers.cc:597] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:42.002874 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:42.009357 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:42.009848 23966 consensus_peers.cc:597] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:42.015254 23966 consensus_peers.cc:597] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:42.023144 22701 tablet_server.cc:179] TabletServer@127.22.43.67:0 shutting down...
I20260709 12:23:42.028206 31115 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:42.028820 31115 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:42.032282 31115 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:42.040356 24524 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:42.041663 23966 consensus_peers.cc:597] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:42.042727 24524 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:42.043208 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:42.044301 31102 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:42.050783 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:42.104578 24525 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.113960 31115 raft_consensus.cc:493] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:42.114554 31115 raft_consensus.cc:515] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:42.116807 31115 leader_election.cc:290] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:42.126885 24524 leader_election.cc:336] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:42.127549 24524 leader_election.cc:336] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:42.128289 24524 leader_election.cc:304] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:42.128974 31102 raft_consensus.cc:2749] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:42.139537 23966 consensus_peers.cc:597] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:42.144358 24525 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:42.154338 24524 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:42.157302 24525 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:42.165177 23966 consensus_peers.cc:597] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:42.182436 24525 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:42.192296 24525 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:42.208160 23966 consensus_peers.cc:597] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:42.218865 23966 consensus_peers.cc:597] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:42.229472 24525 consensus_peers.cc:597] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:42.229524 24524 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:42.245596 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:42.247044 22701 tablet_replica.cc:333] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
W20260709 12:23:42.251127 24524 consensus_peers.cc:597] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:42.263315 22701 raft_consensus.cc:2243] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.265159 22701 raft_consensus.cc:2272] T 880fc0774867427e9e9a605bad2bd375 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:42.272396 24525 consensus_peers.cc:597] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.273382 22701 tablet_replica.cc:333] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.274425 22701 raft_consensus.cc:2243] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.275645 22701 raft_consensus.cc:2272] T 8630b76482c543a2a08e289b32b13ab6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:42.282979 24525 consensus_peers.cc:597] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.292140 22701 tablet_replica.cc:333] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.293170 22701 raft_consensus.cc:2243] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.294562 22701 raft_consensus.cc:2272] T 29a434c2919b4912a056d435a8992ff0 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.297786 22701 tablet_replica.cc:333] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.298712 22701 raft_consensus.cc:2243] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.299887 22701 raft_consensus.cc:2272] T c4a453d774d845e59416b4429315c41f P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.313277 22701 tablet_replica.cc:333] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
W20260709 12:23:42.316730 24524 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:42.318017 22701 raft_consensus.cc:2243] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.319622 22701 raft_consensus.cc:2272] T d78d41f27ddd4a3fa2fe292b189ba372 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:42.326247 24525 consensus_peers.cc:597] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.326706 22701 tablet_replica.cc:333] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.328410 22701 raft_consensus.cc:2243] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.329146 22701 raft_consensus.cc:2272] T 3482cac0ee5745259004349e6078cf03 P 604755d84b7e4ff8a2b75453dccb6f1b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.331809 31119 raft_consensus.cc:493] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:42.332181 22701 tablet_replica.cc:333] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.332361 31119 raft_consensus.cc:515] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:42.333108 22701 raft_consensus.cc:2243] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.334496 22701 raft_consensus.cc:2272] T 5d00e1a3cc444623bdf4910b98044d66 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.334710 31119 leader_election.cc:290] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:42.337080 22701 tablet_replica.cc:333] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
W20260709 12:23:42.342338 23966 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:42.350942 22701 raft_consensus.cc:2243] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:23:42.355866 23966 leader_election.cc:336] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:42.356441 23966 leader_election.cc:304] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:42.357323 31119 raft_consensus.cc:2749] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:42.356551 22701 raft_consensus.cc:2272] T 4a72394010d8464f87107625dbd58b7d P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.360863 22701 tablet_replica.cc:333] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.361835 22701 raft_consensus.cc:2243] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.362751 22701 raft_consensus.cc:2272] T 362d811dc320452d8daaca5fda5cd52a P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.377499 22701 tablet_replica.cc:333] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.378539 22701 raft_consensus.cc:2243] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.379509 22701 raft_consensus.cc:2272] T 092a962747db4e3b9c0bb6d7fdb831d5 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.383042 22701 tablet_replica.cc:333] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
W20260709 12:23:42.388581 23966 consensus_peers.cc:597] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:23:42.389576 22701 raft_consensus.cc:2243] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.392024 22701 raft_consensus.cc:2272] T 41807c0564934d23b20ac6f983e233d6 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.395382 22701 tablet_replica.cc:333] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.396322 22701 raft_consensus.cc:2243] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.397639 22701 raft_consensus.cc:2272] T 573b7fecf80d4359b0e9f045d989ed09 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.400514 22701 tablet_replica.cc:333] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.401451 22701 raft_consensus.cc:2243] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:23:42.417186 24525 consensus_peers.cc:597] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.419518 22701 raft_consensus.cc:2272] T 0ade9323ef4a49b3b60c68243facc406 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:42.417215 23966 consensus_peers.cc:597] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:23:42.422564 22701 tablet_replica.cc:333] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.423564 22701 raft_consensus.cc:2243] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.425336 22701 raft_consensus.cc:2272] T 375316edc4f14c939e96f8ce70294c81 P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:42.426126 23966 consensus_peers.cc:597] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:42.428216 22701 tablet_replica.cc:333] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.436070 22701 raft_consensus.cc:2243] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.437013 22701 raft_consensus.cc:2272] T d12092e2a1294da4acc0a5f0261bfe94 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.440371 22701 tablet_replica.cc:333] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.444906 22701 raft_consensus.cc:2243] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.449033 22701 raft_consensus.cc:2272] T f82c4b60fcc242eda3a32f8f32d6d163 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.451956 22701 tablet_replica.cc:333] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.455267 22701 raft_consensus.cc:2243] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.463927 22701 raft_consensus.cc:2272] T 729f7490c64342bebf0188dd2f975e39 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:42.475787 24525 consensus_peers.cc:597] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.477074 22701 tablet_replica.cc:333] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.479966 22701 raft_consensus.cc:2243] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.481490 22701 raft_consensus.cc:2272] T 23e8987a07704ea192b04366772512e7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.492040 22701 tablet_replica.cc:333] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
W20260709 12:23:42.499047 24525 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.500241 22701 raft_consensus.cc:2243] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.501761 22701 raft_consensus.cc:2272] T aa7130e46e524c588b99e0dfff2518c4 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.504909 22701 tablet_replica.cc:333] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.505923 22701 raft_consensus.cc:2243] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.507616 22701 raft_consensus.cc:2272] T 4a79eabff38b4edebe70e32ff0d72afc P 604755d84b7e4ff8a2b75453dccb6f1b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.512811 22701 tablet_replica.cc:333] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.520977 22701 raft_consensus.cc:2243] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:23:42.518172 24524 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:42.522854 22701 raft_consensus.cc:2272] T 5d0c3eeb21514ee1a8f1324ff166cb7f P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.526446 22701 tablet_replica.cc:333] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.533581 22701 raft_consensus.cc:2243] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.535007 22701 raft_consensus.cc:2272] T 3e5d779cbe414b879d3a8be40d0428fa P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.538311 22701 tablet_replica.cc:333] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.539265 22701 raft_consensus.cc:2243] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:42.539692 23966 consensus_peers.cc:597] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.541596 22701 raft_consensus.cc:2272] T 9527aa74b6e94801a45ae653023f6793 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:42.544308 24525 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.544721 22701 tablet_replica.cc:333] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.558887 22701 raft_consensus.cc:2243] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.560848 22701 raft_consensus.cc:2272] T 38d6b859dc2949aeaefe73fefd5829bb P 604755d84b7e4ff8a2b75453dccb6f1b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.564384 22701 tablet_replica.cc:333] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.565680 22701 raft_consensus.cc:2243] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.567028 22701 raft_consensus.cc:2272] T 7b845c11f69f485889b01a0a648dc3bc P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.569998 22701 tablet_replica.cc:333] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.578466 22701 raft_consensus.cc:2243] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.580314 22701 raft_consensus.cc:2272] T 73d2fbc1f30749eba64903d7e79de8a7 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.581995 31119 raft_consensus.cc:493] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:42.582654 31119 raft_consensus.cc:515] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } }
I20260709 12:23:42.583541 22701 tablet_replica.cc:333] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.584597 22701 raft_consensus.cc:2243] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.585366 22701 raft_consensus.cc:2272] T 536d25b8a1934dfd8c9ecb2fa2068928 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.587777 31119 leader_election.cc:290] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:42.588282 22701 tablet_replica.cc:333] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.603048 22701 raft_consensus.cc:2243] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:42.591786 23966 leader_election.cc:336] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:42.604171 22701 raft_consensus.cc:2272] T 9d9e6b2e7add490280e05d9b2bfdda17 P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:42.604651 23966 leader_election.cc:336] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:42.605085 23966 leader_election.cc:304] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604755d84b7e4ff8a2b75453dccb6f1b; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:42.607105 22701 tablet_replica.cc:333] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.607903 31119 raft_consensus.cc:2749] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:42.608096 22701 raft_consensus.cc:2243] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.610759 22701 raft_consensus.cc:2272] T d80eac81f44441f49acb9eba858e3637 P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.615593 22701 tablet_replica.cc:333] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.621085 22701 raft_consensus.cc:2243] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.621852 22701 raft_consensus.cc:2272] T 5d2bef15f0a6452999bc8b6f4e360c3e P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.626195 22701 tablet_replica.cc:333] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.634065 22701 raft_consensus.cc:2243] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.634785 22701 raft_consensus.cc:2272] T fe9ef9f9e0c249d5bdb5743853fa3308 P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.637741 22701 tablet_replica.cc:333] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.642591 22701 raft_consensus.cc:2243] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.643854 22701 raft_consensus.cc:2272] T d78ef4be778a4d7fa19baf9815bd1d96 P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.646595 22701 tablet_replica.cc:333] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.647360 22701 raft_consensus.cc:2243] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.648701 22701 raft_consensus.cc:2272] T 8d880a30519445959394501b6616f15f P 604755d84b7e4ff8a2b75453dccb6f1b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.651715 22701 tablet_replica.cc:333] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.652562 22701 raft_consensus.cc:2243] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:23:42.655130 24524 consensus_peers.cc:597] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.653700 22701 raft_consensus.cc:2272] T 9e0499f663114741880a025070e7b81f P 604755d84b7e4ff8a2b75453dccb6f1b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.668766 22701 tablet_replica.cc:333] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.669612 22701 raft_consensus.cc:2243] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.670538 22701 raft_consensus.cc:2272] T 9458291d6d4d499f9c4b21cbe9170c33 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.673663 22701 tablet_replica.cc:333] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.674594 22701 raft_consensus.cc:2243] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.681418 22701 raft_consensus.cc:2272] T 5a4c451e990244d7a5701e875fa03f62 P 604755d84b7e4ff8a2b75453dccb6f1b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.684635 22701 tablet_replica.cc:333] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.685696 22701 raft_consensus.cc:2243] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.687083 22701 raft_consensus.cc:2272] T fdd49025134246c8a0245389cc43db77 P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.690114 22701 tablet_replica.cc:333] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.690937 22701 raft_consensus.cc:2243] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.692157 22701 raft_consensus.cc:2272] T e24af680f7e54ded89a0d5eff1320c6c P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.695015 22701 tablet_replica.cc:333] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.695808 22701 raft_consensus.cc:2243] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.697041 22701 raft_consensus.cc:2272] T 769e238f62804be6900a5660ed34e431 P 604755d84b7e4ff8a2b75453dccb6f1b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.699853 22701 tablet_replica.cc:333] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.700657 22701 raft_consensus.cc:2243] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.701835 22701 raft_consensus.cc:2272] T f478cef7044d4597b6db8ead4067f592 P 604755d84b7e4ff8a2b75453dccb6f1b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.704681 22701 tablet_replica.cc:333] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.705435 22701 raft_consensus.cc:2243] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.706218 22701 raft_consensus.cc:2272] T d0df961accdf4f35a6f59fd126751e8a P 604755d84b7e4ff8a2b75453dccb6f1b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.709139 22701 tablet_replica.cc:333] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.710026 22701 raft_consensus.cc:2243] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:23:42.711387 22701 raft_consensus.cc:2272] T 05a83cc012d5420494cfd8c624a09767 P 604755d84b7e4ff8a2b75453dccb6f1b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.714614 22701 tablet_replica.cc:333] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.715471 22701 raft_consensus.cc:2243] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.716224 22701 raft_consensus.cc:2272] T c68dea7a8ca44705b1d5fe7b0748519d P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.719363 22701 tablet_replica.cc:333] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.720314 22701 raft_consensus.cc:2243] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.720955 22701 raft_consensus.cc:2272] T 45f9750732564b8ebf9a7d205547b35c P 604755d84b7e4ff8a2b75453dccb6f1b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.723680 22701 tablet_replica.cc:333] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b: stopping tablet replica
I20260709 12:23:42.724432 22701 raft_consensus.cc:2243] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.725566 22701 raft_consensus.cc:2272] T d53a1203874c465cbc2d50279fc76c4b P 604755d84b7e4ff8a2b75453dccb6f1b [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:42.794402 24524 consensus_peers.cc:597] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:42.876485 23736 catalog_manager.cc:4755] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8630b76482c543a2a08e289b32b13ab6: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:43.020753 24524 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:43.072484 23966 connection.cc:466] server connection from 127.0.0.1:34868 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 1885) could send its response
W20260709 12:23:43.073509 23966 connection.cc:466] server connection from 127.0.0.1:34868 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 1886) could send its response
W20260709 12:23:43.074348 23966 connection.cc:466] server connection from 127.0.0.1:34868 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 1887) could send its response
W20260709 12:23:43.075166 23966 connection.cc:466] server connection from 127.0.0.1:34868 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34868 (request call id 1888) could send its response
I20260709 12:23:43.454741 31132 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.457931 31132 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.461658 31132 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.474258 24524 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:43.482988 24525 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:43.485594 24525 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:43.486500 31132 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:43.485030 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:23:43.508256 31132 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.508921 31132 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.514003 31132 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.515946 24525 leader_election.cc:336] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
W20260709 12:23:43.523947 24524 leader_election.cc:336] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:43.524595 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:43.525398 31132 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:43.652253 31132 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.652813 31132 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.655081 31132 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.659530 24525 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
W20260709 12:23:43.661345 24524 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:43.661291 31132 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.662050 24524 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:43.662175 31132 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.662794 31102 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:43.664506 31132 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:43.666950 31132 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.668090 31132 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:43.670435 24525 leader_election.cc:336] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
W20260709 12:23:43.672895 24524 leader_election.cc:336] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:43.673373 24524 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:43.674160 31102 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:43.674911 31132 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.679718 24524 leader_election.cc:336] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:43.680922 24525 leader_election.cc:336] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:43.681289 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:43.681934 31132 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:43.683532 31132 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.683983 31132 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.685920 31132 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.689620 24524 leader_election.cc:336] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:43.691880 24525 leader_election.cc:336] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:43.692265 24525 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:43.693572 31132 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:43.702592 31132 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.703071 31132 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.704900 31132 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.709623 24524 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:43.710933 24525 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:43.712395 24525 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:43.713024 31132 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:43.713517 31102 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.714174 31102 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.715821 31102 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
I20260709 12:23:43.719851 31102 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.720299 31102 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:43.721095 24524 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:43.722411 31102 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.730544 24525 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:43.731804 24525 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:43.732631 31132 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:43.733976 24524 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:43.734601 24525 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:43.735049 24525 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:43.736709 31132 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:43.753510 31132 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.754112 31132 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.757227 31132 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.760818 24524 leader_election.cc:336] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:43.761709 31132 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
W20260709 12:23:43.762023 24525 leader_election.cc:336] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:43.762313 31132 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.762585 24525 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:43.763495 31102 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:43.765370 31132 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.768544 24524 leader_election.cc:336] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:43.770268 24525 leader_election.cc:336] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:43.770697 24525 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:43.771551 31132 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:43.852046 31132 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.852584 31132 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.854665 31132 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.859685 24525 leader_election.cc:336] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
W20260709 12:23:43.860205 24524 leader_election.cc:336] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:43.860689 24524 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:43.861503 31132 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:43.872617 31132 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.873206 31132 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.876127 31132 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.881433 24524 leader_election.cc:336] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:43.881968 24525 leader_election.cc:336] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:43.882483 24525 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:43.883337 31132 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:43.919512 23736 catalog_manager.cc:4755] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8630b76482c543a2a08e289b32b13ab6: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:43.938225 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:23:43.939949 31132 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.940560 31132 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.943811 31132 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:43.950219 24525 leader_election.cc:336] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
W20260709 12:23:43.950834 24524 leader_election.cc:336] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:43.951264 24524 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:43.952039 31132 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:43.983543 24524 consensus_peers.cc:597] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:43.988903 31102 raft_consensus.cc:493] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:43.989431 31102 raft_consensus.cc:515] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.991475 31102 leader_election.cc:290] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
I20260709 12:23:43.993263 31102 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:43.993808 31102 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:43.995842 31102 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:44.004057 24524 leader_election.cc:336] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:44.004609 24524 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111) [suppressed 610 similar messages]
W20260709 12:23:44.005327 24524 leader_election.cc:336] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:44.005697 24524 leader_election.cc:304] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
W20260709 12:23:44.007948 24525 leader_election.cc:336] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:44.009733 31102 raft_consensus.cc:2749] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:44.010636 24524 leader_election.cc:336] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:44.011058 24524 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:44.011787 31132 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:23:44.014904 24524 consensus_peers.cc:597] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:44.036146 31132 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:44.036743 31132 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:44.039834 31132 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:44.045276 24525 leader_election.cc:336] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
W20260709 12:23:44.046960 24524 leader_election.cc:336] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:44.048570 24524 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:44.049273 31132 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:44.049480 24524 leader_election.cc:336] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:44.052083 31132 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:44.052642 31132 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:44.054807 24524 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:23:44.057948 31132 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:44.060318 24524 leader_election.cc:336] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:44.062309 24525 leader_election.cc:336] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:44.062714 24525 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:44.063373 31132 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:44.091300 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08001714c0 after lost signal to thread 22704
W20260709 12:23:44.092473 24025 debug-util.cc:398] Leaking SignalData structure 0x7b080039cf80 after lost signal to thread 23786
W20260709 12:23:44.093990 24025 debug-util.cc:398] Leaking SignalData structure 0x7b08001ac080 after lost signal to thread 24587
W20260709 12:23:44.094381 24025 debug-util.cc:398] Leaking SignalData structure 0x7b0800282240 after lost signal to thread 31119
I20260709 12:23:44.222762 31132 raft_consensus.cc:493] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:44.223372 31132 raft_consensus.cc:515] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:44.225419 31132 leader_election.cc:290] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:44.233914 24524 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:44.234618 24524 leader_election.cc:336] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:44.235050 24524 leader_election.cc:304] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:44.236315 31132 raft_consensus.cc:2749] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:44.248342 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:44.372756 24525 consensus_peers.cc:597] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.426013 24524 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:44.437052 22701 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24025)
I20260709 12:23:44.446669 31132 raft_consensus.cc:493] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:44.447408 31132 raft_consensus.cc:515] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:44.449822 31132 leader_election.cc:290] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:44.457070 24524 consensus_peers.cc:597] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:44.460813 24524 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:44.462488 24524 leader_election.cc:336] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:44.462924 24524 leader_election.cc:304] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:44.463665 31132 raft_consensus.cc:2749] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:44.476493 31132 raft_consensus.cc:493] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:44.477113 31132 raft_consensus.cc:515] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:44.479423 31132 leader_election.cc:290] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:44.501166 24524 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:44.507925 24524 leader_election.cc:336] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:44.508453 24524 leader_election.cc:304] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:44.509215 31132 raft_consensus.cc:2749] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:44.526005 24524 consensus_peers.cc:597] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:44.578368 24525 consensus_peers.cc:597] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.579334 24524 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:44.615631 24524 consensus_peers.cc:597] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:44.663973 24524 consensus_peers.cc:597] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:44.726984 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:44.748971 24525 consensus_peers.cc:597] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.756829 24525 consensus_peers.cc:597] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.818414 24525 consensus_peers.cc:597] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:44.842622 31132 raft_consensus.cc:493] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:44.843291 31132 raft_consensus.cc:515] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:44.845732 31132 leader_election.cc:290] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:44.860625 24525 consensus_peers.cc:597] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.867892 24524 leader_election.cc:336] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:44.879231 24525 consensus_peers.cc:597] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.891870 24524 leader_election.cc:336] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:44.892697 24524 leader_election.cc:304] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:44.893556 31132 raft_consensus.cc:2749] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:44.905472 24525 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.907177 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:44.907833 24524 consensus_peers.cc:597] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:44.933261 24524 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:44.936025 24524 consensus_peers.cc:597] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:44.965157 24525 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.974355 24525 consensus_peers.cc:597] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.995642 24525 consensus_peers.cc:597] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:45.013629 24525 consensus_peers.cc:597] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:45.071841 31102 raft_consensus.cc:493] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:45.072391 31102 raft_consensus.cc:515] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.074548 31102 leader_election.cc:290] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:45.079926 24524 consensus_peers.cc:597] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:45.092455 24525 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Couldn't send request to peer 604755d84b7e4ff8a2b75453dccb6f1b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:45.116276 24524 leader_election.cc:336] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:45.118921 24524 leader_election.cc:336] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:45.119537 24524 leader_election.cc:304] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:45.120368 31102 raft_consensus.cc:2749] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:45.314574 31102 raft_consensus.cc:493] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.315408 31102 raft_consensus.cc:515] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.317799 31102 leader_election.cc:290] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.323397 24524 leader_election.cc:336] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:45.323990 24525 leader_election.cc:336] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.324471 24525 leader_election.cc:304] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:45.325357 31102 raft_consensus.cc:2749] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:45.351699 31102 raft_consensus.cc:493] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.352258 31102 raft_consensus.cc:515] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.354465 31102 leader_election.cc:290] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.360157 24524 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:45.360436 31102 raft_consensus.cc:493] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:45.362701 31102 raft_consensus.cc:515] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.364796 31102 leader_election.cc:290] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:45.365231 24525 leader_election.cc:336] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.369858 24525 leader_election.cc:304] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:45.371279 31102 raft_consensus.cc:2749] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:45.380560 24524 leader_election.cc:336] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:45.381757 24524 leader_election.cc:336] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:45.382352 24524 leader_election.cc:304] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:45.384358 31102 raft_consensus.cc:2749] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:45.385722 24524 consensus_peers.cc:597] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:45.428956 31102 raft_consensus.cc:493] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.429526 31102 raft_consensus.cc:515] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.431737 31102 leader_election.cc:290] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.436683 24524 leader_election.cc:336] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:45.437319 24525 leader_election.cc:336] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.437788 24525 leader_election.cc:304] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:45.438578 31102 raft_consensus.cc:2749] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:45.458913 24524 consensus_peers.cc:597] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Couldn't send request to peer e8bc734d763e4ddf87f7b930e35cbaa7. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:45.475840 31132 raft_consensus.cc:493] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.476413 31132 raft_consensus.cc:515] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.478626 31132 leader_election.cc:290] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.484014 24524 leader_election.cc:336] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:45.485011 24525 leader_election.cc:336] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.485407 24525 leader_election.cc:304] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:45.486127 31132 raft_consensus.cc:2749] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:45.486646 31102 raft_consensus.cc:493] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.487136 31102 raft_consensus.cc:515] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.488987 31102 leader_election.cc:290] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.503993 24524 leader_election.cc:336] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:45.504642 24525 leader_election.cc:336] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.505172 24525 leader_election.cc:304] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:45.508857 31102 raft_consensus.cc:2749] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:45.519927 31102 raft_consensus.cc:493] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.521241 31102 raft_consensus.cc:515] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
W20260709 12:23:45.522866 24524 consensus_peers.cc:597] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:45.523417 31102 leader_election.cc:290] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.529054 24524 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:45.529656 24525 leader_election.cc:336] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.530077 24525 leader_election.cc:304] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:45.530814 31102 raft_consensus.cc:2749] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:45.571616 31102 raft_consensus.cc:493] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.572178 31102 raft_consensus.cc:515] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.574385 31102 leader_election.cc:290] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.578385 24524 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:45.580720 24525 leader_election.cc:336] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.581163 24525 leader_election.cc:304] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:45.581400 31102 raft_consensus.cc:493] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.582039 31132 raft_consensus.cc:2749] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:45.581985 31102 raft_consensus.cc:515] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } attrs { replace: true } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.585528 31102 leader_election.cc:290] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.589737 24525 leader_election.cc:336] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
W20260709 12:23:45.593154 24524 leader_election.cc:336] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:45.593617 24524 leader_election.cc:304] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:45.594367 31102 raft_consensus.cc:2749] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:45.594465 24524 leader_election.cc:336] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:45.610718 31102 raft_consensus.cc:493] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.611308 31102 raft_consensus.cc:515] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.614770 31132 raft_consensus.cc:493] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.615293 31132 raft_consensus.cc:515] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.617202 31132 leader_election.cc:290] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.622180 24525 leader_election.cc:336] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
W20260709 12:23:45.622761 24525 leader_election.cc:336] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.623538 31102 leader_election.cc:290] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.627170 24524 leader_election.cc:336] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:45.627691 24524 leader_election.cc:304] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:45.628484 31102 raft_consensus.cc:2749] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:23:45.631970 24524 leader_election.cc:336] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:45.632565 24524 leader_election.cc:304] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:45.633817 31102 raft_consensus.cc:2749] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:45.679683 31102 raft_consensus.cc:493] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.680249 31102 raft_consensus.cc:515] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.682521 31102 leader_election.cc:290] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.687264 24525 leader_election.cc:336] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
W20260709 12:23:45.687799 24524 leader_election.cc:336] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:45.688251 24524 leader_election.cc:304] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:45.688931 31102 raft_consensus.cc:2749] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:45.781204 31102 raft_consensus.cc:493] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.781746 31102 raft_consensus.cc:515] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.786222 31102 leader_election.cc:290] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.788856 24524 leader_election.cc:336] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:45.789645 24525 leader_election.cc:336] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.790127 24525 leader_election.cc:304] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:45.790827 31102 raft_consensus.cc:2749] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:45.810750 31102 raft_consensus.cc:493] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.811277 31102 raft_consensus.cc:515] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.813416 31102 leader_election.cc:290] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.817821 24524 leader_election.cc:336] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:45.819262 24525 leader_election.cc:336] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.819720 24525 leader_election.cc:304] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:45.821632 31102 raft_consensus.cc:2749] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:45.848186 31102 raft_consensus.cc:493] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.848709 31102 raft_consensus.cc:515] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.850734 31102 leader_election.cc:290] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.855743 24525 leader_election.cc:336] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
W20260709 12:23:45.856801 24524 leader_election.cc:336] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:45.857195 24524 leader_election.cc:304] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, 604755d84b7e4ff8a2b75453dccb6f1b
I20260709 12:23:45.857862 31143 raft_consensus.cc:493] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.858323 31102 raft_consensus.cc:2749] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:45.858369 31143 raft_consensus.cc:515] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.860697 31143 leader_election.cc:290] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.863898 24524 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:45.866739 24525 leader_election.cc:336] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.867142 24525 leader_election.cc:304] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:45.867810 31143 raft_consensus.cc:2749] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:45.911940 31143 raft_consensus.cc:493] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:45.912498 31143 raft_consensus.cc:515] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:45.914683 31143 leader_election.cc:290] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:45.919749 24524 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:45.920495 24525 leader_election.cc:336] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
I20260709 12:23:45.920902 24525 leader_election.cc:304] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:45.921608 31143 raft_consensus.cc:2749] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:46.000128 23736 catalog_manager.cc:4755] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8630b76482c543a2a08e289b32b13ab6: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:46.000483 31143 raft_consensus.cc:493] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e8bc734d763e4ddf87f7b930e35cbaa7)
I20260709 12:23:46.001044 31143 raft_consensus.cc:515] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "22996f888daf435398b693481171c18c" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34895 } } peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:46.003124 31143 leader_election.cc:290] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 22996f888daf435398b693481171c18c (127.22.43.65:34895), e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453)
W20260709 12:23:46.008848 24524 leader_election.cc:336] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
W20260709 12:23:46.009497 24524 leader_election.cc:336] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:46.009856 24524 leader_election.cc:304] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 22996f888daf435398b693481171c18c, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:46.010601 31143 raft_consensus.cc:2749] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:46.054351 31143 raft_consensus.cc:493] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 604755d84b7e4ff8a2b75453dccb6f1b)
I20260709 12:23:46.055001 31143 raft_consensus.cc:515] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e8bc734d763e4ddf87f7b930e35cbaa7" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33453 } } peers { permanent_uuid: "604755d84b7e4ff8a2b75453dccb6f1b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 40331 } } peers { permanent_uuid: "35a9a1f8b1d847fb8f2063ced2a3c26d" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 43439 } attrs { promote: false } }
I20260709 12:23:46.057454 31143 leader_election.cc:290] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453), 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331)
W20260709 12:23:46.062660 24525 leader_election.cc:336] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 604755d84b7e4ff8a2b75453dccb6f1b (127.22.43.67:40331): Network error: Client connection negotiation failed: client connection to 127.22.43.67:40331: connect: Connection refused (error 111)
W20260709 12:23:46.063236 24524 leader_election.cc:336] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
I20260709 12:23:46.063687 24524 leader_election.cc:304] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35a9a1f8b1d847fb8f2063ced2a3c26d; no voters: 604755d84b7e4ff8a2b75453dccb6f1b, e8bc734d763e4ddf87f7b930e35cbaa7
I20260709 12:23:46.064429 31143 raft_consensus.cc:2749] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:46.094412 22701 tablet_server.cc:196] TabletServer@127.22.43.67:0 shutdown complete.
I20260709 12:23:46.204365 22701 tablet_server.cc:179] TabletServer@127.22.43.68:0 shutting down...
W20260709 12:23:46.228097 24524 consensus_peers.cc:597] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d -> Peer 22996f888daf435398b693481171c18c (127.22.43.65:34895): Couldn't send request to peer 22996f888daf435398b693481171c18c. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:23:46.257550 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:46.258508 22701 tablet_replica.cc:333] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.259599 22701 raft_consensus.cc:2243] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.260385 22701 raft_consensus.cc:2272] T f478cef7044d4597b6db8ead4067f592 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.263564 22701 tablet_replica.cc:333] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.264513 22701 raft_consensus.cc:2243] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.265254 22701 raft_consensus.cc:2272] T a9308162d63f49c4aa8dfccb14c1cf8a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.267679 22701 tablet_replica.cc:333] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.268275 22701 raft_consensus.cc:2243] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.268816 22701 raft_consensus.cc:2272] T 38d6b859dc2949aeaefe73fefd5829bb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.271296 22701 tablet_replica.cc:333] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.272204 22701 raft_consensus.cc:2243] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.272948 22701 raft_consensus.cc:2272] T 7b845c11f69f485889b01a0a648dc3bc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.275630 22701 tablet_replica.cc:333] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.276489 22701 raft_consensus.cc:2243] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.277026 22701 raft_consensus.cc:2272] T 375316edc4f14c939e96f8ce70294c81 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.279914 22701 tablet_replica.cc:333] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.280665 22701 raft_consensus.cc:2243] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.281247 22701 raft_consensus.cc:2272] T 0ade9323ef4a49b3b60c68243facc406 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.283392 22701 tablet_replica.cc:333] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.283944 22701 raft_consensus.cc:2243] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.284376 22701 raft_consensus.cc:2272] T 41807c0564934d23b20ac6f983e233d6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.286592 22701 tablet_replica.cc:333] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.287177 22701 raft_consensus.cc:2243] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.287732 22701 raft_consensus.cc:2272] T f82c4b60fcc242eda3a32f8f32d6d163 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.289822 22701 tablet_replica.cc:333] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.290402 22701 raft_consensus.cc:2243] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.290877 22701 raft_consensus.cc:2272] T 8630b76482c543a2a08e289b32b13ab6 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.292733 22701 tablet_replica.cc:333] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.293262 22701 raft_consensus.cc:2243] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.293717 22701 raft_consensus.cc:2272] T 729f7490c64342bebf0188dd2f975e39 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.295514 22701 tablet_replica.cc:333] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.296023 22701 raft_consensus.cc:2243] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.296833 22701 raft_consensus.cc:2272] T 9f65f9b948cd4a8d88db397a8232dace P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.298709 22701 tablet_replica.cc:333] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.299224 22701 raft_consensus.cc:2243] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.300065 22701 raft_consensus.cc:2272] T bed4315a53504a7a84ffb2b5e251ea08 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.301990 22701 tablet_replica.cc:333] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.302568 22701 raft_consensus.cc:2243] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.303043 22701 raft_consensus.cc:2272] T 880fc0774867427e9e9a605bad2bd375 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.304847 22701 tablet_replica.cc:333] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.305362 22701 raft_consensus.cc:2243] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.306023 22701 raft_consensus.cc:2272] T aa7130e46e524c588b99e0dfff2518c4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.308317 22701 tablet_replica.cc:333] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.309196 22701 raft_consensus.cc:2243] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.309868 22701 raft_consensus.cc:2272] T 01f15f801cf34333ad12954d0b614109 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.312470 22701 tablet_replica.cc:333] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.312991 22701 raft_consensus.cc:2243] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.313504 22701 raft_consensus.cc:2272] T 769e238f62804be6900a5660ed34e431 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.315448 22701 tablet_replica.cc:333] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.315941 22701 raft_consensus.cc:2243] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.316438 22701 raft_consensus.cc:2272] T 66100c48e39a42c7be31fa60db7a0d23 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.318360 22701 tablet_replica.cc:333] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.318953 22701 raft_consensus.cc:2243] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.319494 22701 raft_consensus.cc:2272] T d78d41f27ddd4a3fa2fe292b189ba372 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.321460 22701 tablet_replica.cc:333] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.322057 22701 raft_consensus.cc:2243] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.322851 22701 raft_consensus.cc:2272] T fe9ef9f9e0c249d5bdb5743853fa3308 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.324697 22701 tablet_replica.cc:333] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.325251 22701 raft_consensus.cc:2243] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.326030 22701 raft_consensus.cc:2272] T 5d2bef15f0a6452999bc8b6f4e360c3e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.327899 22701 tablet_replica.cc:333] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.328436 22701 raft_consensus.cc:2243] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.329341 22701 raft_consensus.cc:2272] T d78ef4be778a4d7fa19baf9815bd1d96 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.331365 22701 tablet_replica.cc:333] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.331908 22701 raft_consensus.cc:2243] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.332396 22701 raft_consensus.cc:2272] T 945f6253667d4ed18d5bf1c3fd3cc9e9 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.334244 22701 tablet_replica.cc:333] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.334772 22701 raft_consensus.cc:2243] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.335251 22701 raft_consensus.cc:2272] T d728437e541d463594bcfe1155df3a32 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.337133 22701 tablet_replica.cc:333] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.337630 22701 raft_consensus.cc:2243] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.338111 22701 raft_consensus.cc:2272] T 5d00e1a3cc444623bdf4910b98044d66 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.340119 22701 tablet_replica.cc:333] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.340647 22701 raft_consensus.cc:2243] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.341528 22701 raft_consensus.cc:2272] T c68dea7a8ca44705b1d5fe7b0748519d P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.343451 22701 tablet_replica.cc:333] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.343974 22701 raft_consensus.cc:2243] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.344821 22701 raft_consensus.cc:2272] T 5b6aae08bca4478b92abb367635b948e P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.346798 22701 tablet_replica.cc:333] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.347409 22701 raft_consensus.cc:2243] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.348093 22701 raft_consensus.cc:2272] T fadf34409dda41739b8f46dcf0a526b2 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.350226 22701 tablet_replica.cc:333] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.350757 22701 raft_consensus.cc:2243] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.351539 22701 raft_consensus.cc:2272] T 45f9750732564b8ebf9a7d205547b35c P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.353682 22701 tablet_replica.cc:333] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.354499 22701 raft_consensus.cc:2243] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.355171 22701 raft_consensus.cc:2272] T 83e1955dc5e84b5080e7ea8d739baff4 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.357918 22701 tablet_replica.cc:333] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.358534 22701 raft_consensus.cc:2243] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.359357 22701 raft_consensus.cc:2272] T cf7ddeeeb6384431bc2cc3bcf50c2a16 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.361238 22701 tablet_replica.cc:333] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.361747 22701 raft_consensus.cc:2243] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.362289 22701 raft_consensus.cc:2272] T d1b7bbae4eed4b9b88eeba1ae28c6ecb P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.364284 22701 tablet_replica.cc:333] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.364874 22701 raft_consensus.cc:2243] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.365756 22701 raft_consensus.cc:2272] T 362d811dc320452d8daaca5fda5cd52a P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.368117 22701 tablet_replica.cc:333] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.368813 22701 raft_consensus.cc:2243] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.369701 22701 raft_consensus.cc:2272] T 9527aa74b6e94801a45ae653023f6793 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.371728 22701 tablet_replica.cc:333] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.372362 22701 raft_consensus.cc:2243] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.372869 22701 raft_consensus.cc:2272] T f07a76a5d75e47acaff6a5ca2f03dcc5 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.374984 22701 tablet_replica.cc:333] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.375559 22701 raft_consensus.cc:2243] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.376237 22701 raft_consensus.cc:2272] T c4a453d774d845e59416b4429315c41f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.378798 22701 tablet_replica.cc:333] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.379554 22701 raft_consensus.cc:2243] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.380162 22701 raft_consensus.cc:2272] T 8d880a30519445959394501b6616f15f P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.382444 22701 tablet_replica.cc:333] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.382962 22701 raft_consensus.cc:2243] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.383765 22701 raft_consensus.cc:2272] T d53a1203874c465cbc2d50279fc76c4b P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.385650 22701 tablet_replica.cc:333] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.386246 22701 raft_consensus.cc:2243] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.387118 22701 raft_consensus.cc:2272] T d80eac81f44441f49acb9eba858e3637 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.389307 22701 tablet_replica.cc:333] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.389834 22701 raft_consensus.cc:2243] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.390452 22701 raft_consensus.cc:2272] T 73d2fbc1f30749eba64903d7e79de8a7 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.392289 22701 tablet_replica.cc:333] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.392838 22701 raft_consensus.cc:2243] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.393352 22701 raft_consensus.cc:2272] T d55123f416ba4e9a930f3a24bb6c88f3 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.395180 22701 tablet_replica.cc:333] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.395669 22701 raft_consensus.cc:2243] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.396430 22701 raft_consensus.cc:2272] T 536d25b8a1934dfd8c9ecb2fa2068928 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.398365 22701 tablet_replica.cc:333] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.398860 22701 raft_consensus.cc:2243] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.399622 22701 raft_consensus.cc:2272] T 4a79eabff38b4edebe70e32ff0d72afc P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.401487 22701 tablet_replica.cc:333] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.402097 22701 raft_consensus.cc:2243] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.403060 22701 raft_consensus.cc:2272] T 29a434c2919b4912a056d435a8992ff0 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.405167 22701 tablet_replica.cc:333] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d: stopping tablet replica
I20260709 12:23:46.405616 22701 raft_consensus.cc:2243] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:23:46.406499 22701 raft_consensus.cc:2272] T 3482cac0ee5745259004349e6078cf03 P 35a9a1f8b1d847fb8f2063ced2a3c26d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.898697 22701 tablet_server.cc:196] TabletServer@127.22.43.68:0 shutdown complete.
I20260709 12:23:47.061120 22701 master.cc:562] Master@127.22.43.126:38021 shutting down...
W20260709 12:23:47.109527 23800 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:23:47.109793 23800 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:23:47.110023 23800 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:23:50.147420 23736 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111) [suppressed 211 similar messages]
W20260709 12:23:50.152850 23736 catalog_manager.cc:4755] TS e8bc734d763e4ddf87f7b930e35cbaa7 (127.22.43.66:33453): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8630b76482c543a2a08e289b32b13ab6: Network error: Client connection negotiation failed: client connection to 127.22.43.66:33453: connect: Connection refused (error 111)
W20260709 12:23:51.986661 23736 catalog_manager.cc:4755] TS 22996f888daf435398b693481171c18c (127.22.43.65:34895): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 73d2fbc1f30749eba64903d7e79de8a7: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34895: connect: Connection refused (error 111)
I20260709 12:23:52.714735 22701 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:52.715742 22701 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.716161 22701 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8f9c39c095e54c96a7a90888b94785f5: stopping tablet replica
I20260709 12:23:52.930490 22701 master.cc:584] Master@127.22.43.126:38021 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (246339 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:23:53.040591 22701 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.43.126:35313
I20260709 12:23:53.041723 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:53.047647 31152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:53.048353 31153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:53.049041 31155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:53.049746 22701 server_base.cc:1061] running on GCE node
I20260709 12:23:53.053689 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:53.054296 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:53.054476 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599833054417 us; error 0 us; skew 500 ppm
I20260709 12:23:53.055032 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:53.057437 22701 webserver.cc:533] Webserver started at http://127.22.43.126:34815/ using document root <none> and password file <none>
I20260709 12:23:53.058012 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:53.058197 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:53.058488 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:53.059732 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/master-0-root/instance:
uuid: "e2cf68ea04f64e90a7182eb7eaaf1f91"
format_stamp: "Formatted at 2026-07-09 12:23:53 on dist-test-slave-0768"
I20260709 12:23:53.064486 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:53.067900 31160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.068665 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:53.068984 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/master-0-root
uuid: "e2cf68ea04f64e90a7182eb7eaaf1f91"
format_stamp: "Formatted at 2026-07-09 12:23:53 on dist-test-slave-0768"
I20260709 12:23:53.069289 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:53.097692 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:53.098977 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:53.137022 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.126:35313
I20260709 12:23:53.137125 31212 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.126:35313 every 8 connection(s)
I20260709 12:23:53.141372 31213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.152508 31213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91: Bootstrap starting.
I20260709 12:23:53.157476 31213 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:53.162005 31213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91: No bootstrap required, opened a new log
I20260709 12:23:53.164583 31213 raft_consensus.cc:359] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf68ea04f64e90a7182eb7eaaf1f91" member_type: VOTER }
I20260709 12:23:53.165079 31213 raft_consensus.cc:385] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:53.165366 31213 raft_consensus.cc:740] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2cf68ea04f64e90a7182eb7eaaf1f91, State: Initialized, Role: FOLLOWER
I20260709 12:23:53.166157 31213 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf68ea04f64e90a7182eb7eaaf1f91" member_type: VOTER }
I20260709 12:23:53.166695 31213 raft_consensus.cc:399] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:53.166955 31213 raft_consensus.cc:493] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:53.167274 31213 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:53.172821 31213 raft_consensus.cc:515] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf68ea04f64e90a7182eb7eaaf1f91" member_type: VOTER }
I20260709 12:23:53.173409 31213 leader_election.cc:304] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2cf68ea04f64e90a7182eb7eaaf1f91; no voters: 
I20260709 12:23:53.174646 31213 leader_election.cc:290] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:53.175056 31216 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:53.176407 31216 raft_consensus.cc:697] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [term 1 LEADER]: Becoming Leader. State: Replica: e2cf68ea04f64e90a7182eb7eaaf1f91, State: Running, Role: LEADER
I20260709 12:23:53.177127 31216 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf68ea04f64e90a7182eb7eaaf1f91" member_type: VOTER }
I20260709 12:23:53.178081 31213 sys_catalog.cc:565] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:53.184156 31217 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2cf68ea04f64e90a7182eb7eaaf1f91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf68ea04f64e90a7182eb7eaaf1f91" member_type: VOTER } }
I20260709 12:23:53.184197 31218 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2cf68ea04f64e90a7182eb7eaaf1f91. Latest consensus state: current_term: 1 leader_uuid: "e2cf68ea04f64e90a7182eb7eaaf1f91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf68ea04f64e90a7182eb7eaaf1f91" member_type: VOTER } }
I20260709 12:23:53.185459 31217 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:53.185498 31218 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:53.192539 31224 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:53.200269 31224 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:53.201248 22701 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:53.209685 31224 catalog_manager.cc:1383] Generated new cluster ID: db6f52b8504f403d995df4fedbe3308a
I20260709 12:23:53.209967 31224 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:53.228044 31224 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:53.229868 31224 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:53.245563 31224 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91: Generated new TSK 0
I20260709 12:23:53.246250 31224 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:53.267617 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:53.274776 31234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:53.275791 31235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:53.277494 31237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:53.278306 22701 server_base.cc:1061] running on GCE node
I20260709 12:23:53.280426 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:53.280612 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:53.280740 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599833280728 us; error 0 us; skew 500 ppm
I20260709 12:23:53.281224 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:53.283522 22701 webserver.cc:533] Webserver started at http://127.22.43.65:37783/ using document root <none> and password file <none>
I20260709 12:23:53.283977 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:53.284132 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:53.284349 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:53.285466 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/instance:
uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
format_stamp: "Formatted at 2026-07-09 12:23:53 on dist-test-slave-0768"
I20260709 12:23:53.289995 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:23:53.293356 31242 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.294242 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:23:53.294533 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-0-root
uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
format_stamp: "Formatted at 2026-07-09 12:23:53 on dist-test-slave-0768"
I20260709 12:23:53.294849 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:53.303143 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:53.304360 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:53.305838 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:53.308522 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:53.308707 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.308893 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:53.309026 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.348970 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.65:41673
I20260709 12:23:53.349174 31304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.65:41673 every 8 connection(s)
I20260709 12:23:53.354912 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:53.362943 31309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:53.365656 31310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:53.367673 31312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:53.368359 22701 server_base.cc:1061] running on GCE node
I20260709 12:23:53.368786 31305 heartbeater.cc:344] Connected to a master server at 127.22.43.126:35313
I20260709 12:23:53.369185 31305 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:53.371307 31305 heartbeater.cc:507] Master 127.22.43.126:35313 requested a full tablet report, sending...
I20260709 12:23:53.371681 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:53.371932 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:53.372112 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599833372078 us; error 0 us; skew 500 ppm
I20260709 12:23:53.372948 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:53.373935 31177 ts_manager.cc:194] Registered new tserver with Master: 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:53.375844 22701 webserver.cc:533] Webserver started at http://127.22.43.66:42197/ using document root <none> and password file <none>
I20260709 12:23:53.376308 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:53.376248 31177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34558
I20260709 12:23:53.376693 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:53.377067 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:53.378561 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/instance:
uuid: "998cd06c0be349879a0602496bc33640"
format_stamp: "Formatted at 2026-07-09 12:23:53 on dist-test-slave-0768"
I20260709 12:23:53.383797 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:23:53.387578 31317 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.388423 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:53.388746 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-1-root
uuid: "998cd06c0be349879a0602496bc33640"
format_stamp: "Formatted at 2026-07-09 12:23:53 on dist-test-slave-0768"
I20260709 12:23:53.389011 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:53.418746 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:53.420130 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:53.421700 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:53.424219 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:53.424476 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.424752 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:53.424949 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.467978 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.66:40387
I20260709 12:23:53.468060 31379 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.66:40387 every 8 connection(s)
I20260709 12:23:53.473301 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:53.482096 31383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:53.483770 31384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:53.485558 22701 server_base.cc:1061] running on GCE node
W20260709 12:23:53.487494 31386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:53.488286 31380 heartbeater.cc:344] Connected to a master server at 127.22.43.126:35313
I20260709 12:23:53.488730 31380 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:53.488685 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:53.489183 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:53.489413 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599833489395 us; error 0 us; skew 500 ppm
I20260709 12:23:53.489863 31380 heartbeater.cc:507] Master 127.22.43.126:35313 requested a full tablet report, sending...
I20260709 12:23:53.490281 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:53.492398 31177 ts_manager.cc:194] Registered new tserver with Master: 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:53.493381 22701 webserver.cc:533] Webserver started at http://127.22.43.67:41201/ using document root <none> and password file <none>
I20260709 12:23:53.494088 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:53.494343 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:53.494355 31177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34566
I20260709 12:23:53.494793 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:53.496426 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/instance:
uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
format_stamp: "Formatted at 2026-07-09 12:23:53 on dist-test-slave-0768"
I20260709 12:23:53.501184 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:23:53.504751 31391 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.505936 22701 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:23:53.506326 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-2-root
uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
format_stamp: "Formatted at 2026-07-09 12:23:53 on dist-test-slave-0768"
I20260709 12:23:53.506582 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:53.519690 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:53.520903 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:53.522401 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:53.524670 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:53.524916 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.525158 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:53.525341 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.567644 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.67:45167
I20260709 12:23:53.567720 31455 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.67:45167 every 8 connection(s)
I20260709 12:23:53.572614 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:53.580365 31459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:53.581022 31460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:53.584017 31462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:53.587044 22701 server_base.cc:1061] running on GCE node
I20260709 12:23:53.587762 31456 heartbeater.cc:344] Connected to a master server at 127.22.43.126:35313
I20260709 12:23:53.588155 31456 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:53.588240 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:53.588577 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:53.588783 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599833588762 us; error 0 us; skew 500 ppm
I20260709 12:23:53.589048 31456 heartbeater.cc:507] Master 127.22.43.126:35313 requested a full tablet report, sending...
I20260709 12:23:53.589504 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:53.591495 31177 ts_manager.cc:194] Registered new tserver with Master: e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:53.592748 22701 webserver.cc:533] Webserver started at http://127.22.43.68:45733/ using document root <none> and password file <none>
I20260709 12:23:53.593459 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:53.593640 31177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34572
I20260709 12:23:53.593732 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:53.594363 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:53.595778 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-3-root/instance:
uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
format_stamp: "Formatted at 2026-07-09 12:23:53 on dist-test-slave-0768"
I20260709 12:23:53.600823 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:53.604596 31467 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.605479 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:53.605772 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-3-root
uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
format_stamp: "Formatted at 2026-07-09 12:23:53 on dist-test-slave-0768"
I20260709 12:23:53.606141 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:53.645684 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:53.646962 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:53.648417 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:53.650676 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:53.650893 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.651171 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:53.651341 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:53.693826 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.68:34287
I20260709 12:23:53.693982 31530 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.68:34287 every 8 connection(s)
I20260709 12:23:53.707814 31531 heartbeater.cc:344] Connected to a master server at 127.22.43.126:35313
I20260709 12:23:53.708307 31531 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:53.709163 31531 heartbeater.cc:507] Master 127.22.43.126:35313 requested a full tablet report, sending...
I20260709 12:23:53.711077 31177 ts_manager.cc:194] Registered new tserver with Master: 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:53.712141 22701 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014905577s
I20260709 12:23:53.712692 31177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34582
I20260709 12:23:53.739179 31177 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34588:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:23:54.000277 31270 tablet_service.cc:1511] Processing CreateTablet for tablet 881b09b571934068b262cdee9a6064ca (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:54.003382 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 344ee99261a143ee9924131fc68c1ec3 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:54.006151 31268 tablet_service.cc:1511] Processing CreateTablet for tablet 58676338c84446f98d6653d9a31003ef (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:54.010362 31267 tablet_service.cc:1511] Processing CreateTablet for tablet 70bda5ad3f124108b9ac3050da12be43 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:54.014573 31266 tablet_service.cc:1511] Processing CreateTablet for tablet 34cd27f677614e42854b6618e07715a0 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:54.015336 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881b09b571934068b262cdee9a6064ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.016445 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 344ee99261a143ee9924131fc68c1ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.021584 31265 tablet_service.cc:1511] Processing CreateTablet for tablet ba9231e7b61847e29dac9f04c129f242 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:54.023309 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58676338c84446f98d6653d9a31003ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.023782 31345 tablet_service.cc:1511] Processing CreateTablet for tablet 344ee99261a143ee9924131fc68c1ec3 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:54.025276 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 344ee99261a143ee9924131fc68c1ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.027150 31344 tablet_service.cc:1511] Processing CreateTablet for tablet 58676338c84446f98d6653d9a31003ef (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:54.028605 31344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58676338c84446f98d6653d9a31003ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.028963 31339 tablet_service.cc:1511] Processing CreateTablet for tablet c135641325754ecdb94233454a817a7f (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:54.031361 31266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cd27f677614e42854b6618e07715a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.031299 31343 tablet_service.cc:1511] Processing CreateTablet for tablet 20e8dd80d0ac4a2e82a042b49b8bc0d3 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:54.031816 31340 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1c340f374545689f892f6136c5f92b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:54.032846 31341 tablet_service.cc:1511] Processing CreateTablet for tablet 34cd27f677614e42854b6618e07715a0 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:54.034286 31341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cd27f677614e42854b6618e07715a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.035185 31340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1c340f374545689f892f6136c5f92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.035341 31264 tablet_service.cc:1511] Processing CreateTablet for tablet c135641325754ecdb94233454a817a7f (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:54.036751 31264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c135641325754ecdb94233454a817a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.036516 31342 tablet_service.cc:1511] Processing CreateTablet for tablet 70bda5ad3f124108b9ac3050da12be43 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:54.038344 31267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bda5ad3f124108b9ac3050da12be43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.040980 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9231e7b61847e29dac9f04c129f242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.040886 31343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e8dd80d0ac4a2e82a042b49b8bc0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.043138 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c135641325754ecdb94233454a817a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.046226 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bda5ad3f124108b9ac3050da12be43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.096940 31270 tablet_service.cc:1511] Processing CreateTablet for tablet 7382bfbf93704e3fb4a71d8f048be405 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:54.097188 31421 tablet_service.cc:1511] Processing CreateTablet for tablet 881b09b571934068b262cdee9a6064ca (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:54.098382 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7382bfbf93704e3fb4a71d8f048be405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.099249 31420 tablet_service.cc:1511] Processing CreateTablet for tablet 344ee99261a143ee9924131fc68c1ec3 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:54.100631 31420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 344ee99261a143ee9924131fc68c1ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.103188 31419 tablet_service.cc:1511] Processing CreateTablet for tablet 20e8dd80d0ac4a2e82a042b49b8bc0d3 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:54.107882 31421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881b09b571934068b262cdee9a6064ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.108042 31416 tablet_service.cc:1511] Processing CreateTablet for tablet ba9231e7b61847e29dac9f04c129f242 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:54.109617 31415 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1c340f374545689f892f6136c5f92b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:54.110549 31416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9231e7b61847e29dac9f04c129f242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.112949 31418 tablet_service.cc:1511] Processing CreateTablet for tablet 70bda5ad3f124108b9ac3050da12be43 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:54.117645 31414 tablet_service.cc:1511] Processing CreateTablet for tablet c135641325754ecdb94233454a817a7f (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:54.120069 31415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1c340f374545689f892f6136c5f92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.120714 31414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c135641325754ecdb94233454a817a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.123191 31418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bda5ad3f124108b9ac3050da12be43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.128489 31551 tablet_bootstrap.cc:492] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:54.130100 31419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e8dd80d0ac4a2e82a042b49b8bc0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.135214 31493 tablet_service.cc:1511] Processing CreateTablet for tablet 34cd27f677614e42854b6618e07715a0 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:54.136018 31496 tablet_service.cc:1511] Processing CreateTablet for tablet 881b09b571934068b262cdee9a6064ca (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:54.136740 31493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cd27f677614e42854b6618e07715a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.138325 31495 tablet_service.cc:1511] Processing CreateTablet for tablet 58676338c84446f98d6653d9a31003ef (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:54.139734 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58676338c84446f98d6653d9a31003ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.143081 31494 tablet_service.cc:1511] Processing CreateTablet for tablet 20e8dd80d0ac4a2e82a042b49b8bc0d3 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:54.143224 31492 tablet_service.cc:1511] Processing CreateTablet for tablet ba9231e7b61847e29dac9f04c129f242 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:54.144546 31494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e8dd80d0ac4a2e82a042b49b8bc0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.145236 31491 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1c340f374545689f892f6136c5f92b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:54.147265 31489 tablet_service.cc:1511] Processing CreateTablet for tablet 7382bfbf93704e3fb4a71d8f048be405 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:54.148769 31491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1c340f374545689f892f6136c5f92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.154608 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7382bfbf93704e3fb4a71d8f048be405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.158588 31492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9231e7b61847e29dac9f04c129f242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.158597 31552 tablet_bootstrap.cc:492] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:54.162338 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881b09b571934068b262cdee9a6064ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.171710 31339 tablet_service.cc:1511] Processing CreateTablet for tablet 7382bfbf93704e3fb4a71d8f048be405 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:54.173274 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7382bfbf93704e3fb4a71d8f048be405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.183976 31551 tablet_bootstrap.cc:654] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:54.194120 31226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:54.202261 31552 tablet_bootstrap.cc:654] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.220669 31413 tablet_service.cc:1511] Processing CreateTablet for tablet a46ed529cd264980bac4a8656242966a (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:54.222126 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46ed529cd264980bac4a8656242966a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.223462 31488 tablet_service.cc:1511] Processing CreateTablet for tablet a46ed529cd264980bac4a8656242966a (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:54.224874 31488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46ed529cd264980bac4a8656242966a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.234951 31344 tablet_service.cc:1511] Processing CreateTablet for tablet 2f636bc19da04dd8b83cab524f85dd00 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:54.236366 31344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f636bc19da04dd8b83cab524f85dd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.249234 31421 tablet_service.cc:1511] Processing CreateTablet for tablet 2f636bc19da04dd8b83cab524f85dd00 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:54.252162 31265 tablet_service.cc:1511] Processing CreateTablet for tablet 8f29029e642247cb91cf3c64c81118a1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:54.252722 31421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f636bc19da04dd8b83cab524f85dd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.253486 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f29029e642247cb91cf3c64c81118a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.255311 31494 tablet_service.cc:1511] Processing CreateTablet for tablet 2f636bc19da04dd8b83cab524f85dd00 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:54.256600 31494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f636bc19da04dd8b83cab524f85dd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.259044 31268 tablet_service.cc:1511] Processing CreateTablet for tablet a46ed529cd264980bac4a8656242966a (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:54.260846 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46ed529cd264980bac4a8656242966a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.262974 31553 tablet_bootstrap.cc:492] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:54.274348 31552 tablet_bootstrap.cc:492] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:54.276074 31552 ts_tablet_manager.cc:1403] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.118s	user 0.017s	sys 0.006s
I20260709 12:23:54.276322 31553 tablet_bootstrap.cc:654] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.279220 31551 tablet_bootstrap.cc:492] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:54.279911 31551 ts_tablet_manager.cc:1403] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.022s
I20260709 12:23:54.283205 31551 raft_consensus.cc:359] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:54.283985 31551 raft_consensus.cc:385] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.284337 31551 raft_consensus.cc:740] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.285283 31551 consensus_queue.cc:260] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:54.291774 31552 raft_consensus.cc:359] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.292870 31552 raft_consensus.cc:385] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.293268 31552 raft_consensus.cc:740] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.296152 31556 tablet_bootstrap.cc:492] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:54.295811 31552 consensus_queue.cc:260] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.303063 31344 tablet_service.cc:1511] Processing CreateTablet for tablet 8f29029e642247cb91cf3c64c81118a1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:54.304466 31344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f29029e642247cb91cf3c64c81118a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.307533 31556 tablet_bootstrap.cc:654] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.309062 31415 tablet_service.cc:1511] Processing CreateTablet for tablet 8f29029e642247cb91cf3c64c81118a1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:54.309641 31553 tablet_bootstrap.cc:492] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:54.315910 31415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f29029e642247cb91cf3c64c81118a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.319355 31551 ts_tablet_manager.cc:1434] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.012s
I20260709 12:23:54.320210 31305 heartbeater.cc:499] Master 127.22.43.126:35313 was elected leader, sending a full tablet report...
I20260709 12:23:54.320526 31551 tablet_bootstrap.cc:492] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:54.327744 31551 tablet_bootstrap.cc:654] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.328742 31553 ts_tablet_manager.cc:1403] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.009s
I20260709 12:23:54.333479 31553 raft_consensus.cc:359] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:54.336786 31552 ts_tablet_manager.cc:1434] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.060s	user 0.017s	sys 0.017s
I20260709 12:23:54.337615 31380 heartbeater.cc:499] Master 127.22.43.126:35313 was elected leader, sending a full tablet report...
I20260709 12:23:54.337911 31552 tablet_bootstrap.cc:492] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:54.344841 31552 tablet_bootstrap.cc:654] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.345139 31496 tablet_service.cc:1511] Processing CreateTablet for tablet 92f215322251405ebe02666b49f6acd6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:54.346558 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f215322251405ebe02666b49f6acd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.351447 31265 tablet_service.cc:1511] Processing CreateTablet for tablet 92f215322251405ebe02666b49f6acd6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:54.352883 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f215322251405ebe02666b49f6acd6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:54.356388 31306 tablet.cc:2406] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:54.347822 31553 raft_consensus.cc:385] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.363183 31495 tablet_service.cc:1511] Processing CreateTablet for tablet b007219e2ff443068a7ec936b0d2a6d1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:54.363822 31553 raft_consensus.cc:740] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.364595 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b007219e2ff443068a7ec936b0d2a6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.365500 31553 consensus_queue.cc:260] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:54.362890 31421 tablet_service.cc:1511] Processing CreateTablet for tablet b007219e2ff443068a7ec936b0d2a6d1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:54.366791 31558 raft_consensus.cc:493] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.367290 31421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b007219e2ff443068a7ec936b0d2a6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.367341 31558 raft_consensus.cc:515] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:54.368737 31345 tablet_service.cc:1511] Processing CreateTablet for tablet bffd68df1877438aaa6dfe1ac64c81e4 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:54.372262 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffd68df1877438aaa6dfe1ac64c81e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.362440 31339 tablet_service.cc:1511] Processing CreateTablet for tablet 92f215322251405ebe02666b49f6acd6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:54.373840 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f215322251405ebe02666b49f6acd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.374694 31558 leader_election.cc:290] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:54.386690 31551 tablet_bootstrap.cc:492] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:54.387480 31551 ts_tablet_manager.cc:1403] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.001s
I20260709 12:23:54.388163 31413 tablet_service.cc:1511] Processing CreateTablet for tablet bffd68df1877438aaa6dfe1ac64c81e4 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:54.389561 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffd68df1877438aaa6dfe1ac64c81e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.394572 31556 tablet_bootstrap.cc:492] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:54.395212 31556 ts_tablet_manager.cc:1403] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.000s
I20260709 12:23:54.399448 31556 raft_consensus.cc:359] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.400254 31556 raft_consensus.cc:385] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.400543 31556 raft_consensus.cc:740] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.407514 31531 heartbeater.cc:499] Master 127.22.43.126:35313 was elected leader, sending a full tablet report...
I20260709 12:23:54.401436 31556 consensus_queue.cc:260] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.408591 31488 tablet_service.cc:1511] Processing CreateTablet for tablet bffd68df1877438aaa6dfe1ac64c81e4 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:54.410563 31488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffd68df1877438aaa6dfe1ac64c81e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.411204 31553 ts_tablet_manager.cc:1434] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.002s
I20260709 12:23:54.412597 31553 tablet_bootstrap.cc:492] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:54.417992 31268 tablet_service.cc:1511] Processing CreateTablet for tablet b007219e2ff443068a7ec936b0d2a6d1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:54.419417 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b007219e2ff443068a7ec936b0d2a6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.427569 31420 tablet_service.cc:1511] Processing CreateTablet for tablet 7b274862a58d4893959ebf0c52110287 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:54.429143 31420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b274862a58d4893959ebf0c52110287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.427677 31342 tablet_service.cc:1511] Processing CreateTablet for tablet 7b274862a58d4893959ebf0c52110287 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:54.434652 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b274862a58d4893959ebf0c52110287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.441979 31495 tablet_service.cc:1511] Processing CreateTablet for tablet 9caafdbf4faa4bdeb26c29a5454a5f94 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:54.443763 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9caafdbf4faa4bdeb26c29a5454a5f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.450910 31264 tablet_service.cc:1511] Processing CreateTablet for tablet 7b274862a58d4893959ebf0c52110287 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:54.452852 31264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b274862a58d4893959ebf0c52110287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.455155 31343 tablet_service.cc:1511] Processing CreateTablet for tablet 9caafdbf4faa4bdeb26c29a5454a5f94 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:54.456463 31343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9caafdbf4faa4bdeb26c29a5454a5f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.462733 31265 tablet_service.cc:1511] Processing CreateTablet for tablet 9caafdbf4faa4bdeb26c29a5454a5f94 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:54.464587 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9caafdbf4faa4bdeb26c29a5454a5f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.467140 31551 raft_consensus.cc:359] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.467914 31551 raft_consensus.cc:385] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.468212 31551 raft_consensus.cc:740] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.476581 31551 consensus_queue.cc:260] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.478983 31551 ts_tablet_manager.cc:1434] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 12:23:54.481684 31551 tablet_bootstrap.cc:492] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:54.475942 31553 tablet_bootstrap.cc:654] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.488334 31551 tablet_bootstrap.cc:654] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.512235 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cd27f677614e42854b6618e07715a0" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:54.513068 31506 raft_consensus.cc:2468] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:54.514329 31415 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff5a82bfbaf425ba4873d0f0e3e776c (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:54.515239 31245 leader_election.cc:304] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:54.515527 31552 tablet_bootstrap.cc:492] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:54.515654 31415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff5a82bfbaf425ba4873d0f0e3e776c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.516201 31558 raft_consensus.cc:2804] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:54.516600 31558 raft_consensus.cc:493] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.516974 31558 raft_consensus.cc:3060] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:54.516176 31552 ts_tablet_manager.cc:1403] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.179s	user 0.037s	sys 0.038s
I20260709 12:23:54.518983 31556 ts_tablet_manager.cc:1434] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.123s	user 0.018s	sys 0.000s
I20260709 12:23:54.519762 31456 heartbeater.cc:499] Master 127.22.43.126:35313 was elected leader, sending a full tablet report...
I20260709 12:23:54.520053 31556 tablet_bootstrap.cc:492] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:54.521426 31552 raft_consensus.cc:359] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:54.531142 31558 raft_consensus.cc:515] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:54.535468 31558 leader_election.cc:290] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:54.535768 31270 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff5a82bfbaf425ba4873d0f0e3e776c (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:54.540701 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff5a82bfbaf425ba4873d0f0e3e776c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.541445 31552 raft_consensus.cc:385] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.541839 31552 raft_consensus.cc:740] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.541942 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cd27f677614e42854b6618e07715a0" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:54.542593 31506 raft_consensus.cc:3060] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:54.542752 31552 consensus_queue.cc:260] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:54.545430 31552 ts_tablet_manager.cc:1434] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:23:54.546501 31552 tablet_bootstrap.cc:492] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:54.550740 31496 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff5a82bfbaf425ba4873d0f0e3e776c (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:54.539013 31342 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf6f2d6abcf4a32b80ba9e8c4ed0905 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:54.552130 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff5a82bfbaf425ba4873d0f0e3e776c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.552233 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf6f2d6abcf4a32b80ba9e8c4ed0905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.561087 31355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cd27f677614e42854b6618e07715a0" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:54.562572 31421 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf6f2d6abcf4a32b80ba9e8c4ed0905 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:54.564082 31421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf6f2d6abcf4a32b80ba9e8c4ed0905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.564437 31355 raft_consensus.cc:2468] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:54.562822 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cd27f677614e42854b6618e07715a0" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:54.565340 31354 raft_consensus.cc:3060] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:54.573606 31354 raft_consensus.cc:2468] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:54.581713 31506 raft_consensus.cc:2468] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:54.583055 31553 tablet_bootstrap.cc:492] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:54.583153 31245 leader_election.cc:304] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:54.583850 31553 ts_tablet_manager.cc:1403] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.172s	user 0.019s	sys 0.011s
I20260709 12:23:54.585706 31556 tablet_bootstrap.cc:654] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.584287 31558 raft_consensus.cc:2804] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:54.588879 31553 raft_consensus.cc:359] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:54.597051 31553 raft_consensus.cc:385] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.608008 31570 raft_consensus.cc:493] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.609603 31570 raft_consensus.cc:515] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.612264 31488 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf6f2d6abcf4a32b80ba9e8c4ed0905 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:54.613027 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881b09b571934068b262cdee9a6064ca" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:23:54.614650 31245 leader_election.cc:343] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:54.625137 31551 tablet_bootstrap.cc:492] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:54.625746 31551 ts_tablet_manager.cc:1403] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.005s
I20260709 12:23:54.626295 31265 tablet_service.cc:1511] Processing CreateTablet for tablet d96465747d074cce91dcec123d153e68 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:54.627674 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96465747d074cce91dcec123d153e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.627486 31345 tablet_service.cc:1511] Processing CreateTablet for tablet d96465747d074cce91dcec123d153e68 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:54.628772 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96465747d074cce91dcec123d153e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.628980 31551 raft_consensus.cc:359] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.604590 31553 raft_consensus.cc:740] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.631330 31268 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9ef281dbc6466ea1c1189cdc3fd144 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:54.629750 31551 raft_consensus.cc:385] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.632344 31551 raft_consensus.cc:740] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.632587 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9ef281dbc6466ea1c1189cdc3fd144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.633235 31551 consensus_queue.cc:260] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.613704 31488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf6f2d6abcf4a32b80ba9e8c4ed0905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.633963 31570 leader_election.cc:290] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:54.638450 31344 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9ef281dbc6466ea1c1189cdc3fd144 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:54.639765 31344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9ef281dbc6466ea1c1189cdc3fd144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.641837 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 4f26d3890ccd46ddb1160ee1529963a0 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:54.642575 31553 consensus_queue.cc:260] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:54.643210 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f26d3890ccd46ddb1160ee1529963a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.644913 31553 ts_tablet_manager.cc:1434] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 12:23:54.600374 31558 raft_consensus.cc:697] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:23:54.648824 31413 tablet_service.cc:1511] Processing CreateTablet for tablet 4f26d3890ccd46ddb1160ee1529963a0 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:54.648526 31420 tablet_service.cc:1511] Processing CreateTablet for tablet d96465747d074cce91dcec123d153e68 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:54.650490 31492 tablet_service.cc:1511] Processing CreateTablet for tablet 4f26d3890ccd46ddb1160ee1529963a0 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:54.655097 31556 tablet_bootstrap.cc:492] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:54.655635 31492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f26d3890ccd46ddb1160ee1529963a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.650606 31495 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9ef281dbc6466ea1c1189cdc3fd144 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:54.654174 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f26d3890ccd46ddb1160ee1529963a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.660081 31420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96465747d074cce91dcec123d153e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.660562 31552 tablet_bootstrap.cc:654] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.661085 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9ef281dbc6466ea1c1189cdc3fd144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.656719 31553 tablet_bootstrap.cc:492] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:54.667789 31551 ts_tablet_manager.cc:1434] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:23:54.674397 31551 tablet_bootstrap.cc:492] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:54.655627 31556 ts_tablet_manager.cc:1403] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.001s
I20260709 12:23:54.681241 31343 tablet_service.cc:1511] Processing CreateTablet for tablet e36bf368739149e1a96b5f15cbc86e6c (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:54.682667 31343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36bf368739149e1a96b5f15cbc86e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.683298 31414 tablet_service.cc:1511] Processing CreateTablet for tablet e36bf368739149e1a96b5f15cbc86e6c (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:54.684600 31414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36bf368739149e1a96b5f15cbc86e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.688314 31556 raft_consensus.cc:359] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:54.689071 31556 raft_consensus.cc:385] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.689357 31556 raft_consensus.cc:740] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.690275 31556 consensus_queue.cc:260] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:54.693228 31556 ts_tablet_manager.cc:1434] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:23:54.693289 31558 consensus_queue.cc:237] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:54.697672 31488 tablet_service.cc:1511] Processing CreateTablet for tablet e36bf368739149e1a96b5f15cbc86e6c (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:54.706246 31488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36bf368739149e1a96b5f15cbc86e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.711082 31270 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1cb5c621c6466c9692be5c82cd786f (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:54.712492 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1cb5c621c6466c9692be5c82cd786f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.719623 31418 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1cb5c621c6466c9692be5c82cd786f (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:54.721019 31418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1cb5c621c6466c9692be5c82cd786f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.725050 31559 raft_consensus.cc:493] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.725618 31559 raft_consensus.cc:515] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.713107 31553 tablet_bootstrap.cc:654] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.738159 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881b09b571934068b262cdee9a6064ca" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:54.731537 31551 tablet_bootstrap.cc:654] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.730268 31559 leader_election.cc:290] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:23:54.746428 31245 leader_election.cc:343] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:54.747030 31245 leader_election.cc:304] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:54.749593 31567 raft_consensus.cc:493] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.750162 31567 raft_consensus.cc:515] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:54.750449 31344 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1cb5c621c6466c9692be5c82cd786f (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:54.751816 31344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1cb5c621c6466c9692be5c82cd786f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.753002 31567 leader_election.cc:290] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:54.752847 31265 tablet_service.cc:1511] Processing CreateTablet for tablet d8345833c0f34e96af79e53d5eb8fbc0 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:54.754211 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8345833c0f34e96af79e53d5eb8fbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.744225 31556 tablet_bootstrap.cc:492] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:54.755321 31558 raft_consensus.cc:2749] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:54.738207 31496 tablet_service.cc:1511] Processing CreateTablet for tablet d8345833c0f34e96af79e53d5eb8fbc0 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:54.759307 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8345833c0f34e96af79e53d5eb8fbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.764542 31342 tablet_service.cc:1511] Processing CreateTablet for tablet d8345833c0f34e96af79e53d5eb8fbc0 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:54.766018 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8345833c0f34e96af79e53d5eb8fbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.766934 31491 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca14ac33e4d47d5959bcf7eb1e84e70 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:54.768285 31491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca14ac33e4d47d5959bcf7eb1e84e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.768030 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca14ac33e4d47d5959bcf7eb1e84e70 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:54.769322 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca14ac33e4d47d5959bcf7eb1e84e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.777422 31552 tablet_bootstrap.cc:492] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:54.778018 31552 ts_tablet_manager.cc:1403] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.232s	user 0.016s	sys 0.006s
I20260709 12:23:54.759336 31174 catalog_manager.cc:5697] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:54.779691 31567 raft_consensus.cc:493] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.780202 31567 raft_consensus.cc:515] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.782279 31552 raft_consensus.cc:359] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:54.783041 31552 raft_consensus.cc:385] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.776259 31339 tablet_service.cc:1511] Processing CreateTablet for tablet 033329b2f3e348ccac62b6620f611a8b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:54.793812 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033329b2f3e348ccac62b6620f611a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.786744 31567 leader_election.cc:290] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:54.787139 31552 raft_consensus.cc:740] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.833227 31556 tablet_bootstrap.cc:654] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.841745 31558 raft_consensus.cc:493] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.842489 31558 raft_consensus.cc:515] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.858413 31558 leader_election.cc:290] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:54.858616 31421 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca14ac33e4d47d5959bcf7eb1e84e70 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:54.859972 31421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca14ac33e4d47d5959bcf7eb1e84e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.860410 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bda5ad3f124108b9ac3050da12be43" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:54.862412 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bda5ad3f124108b9ac3050da12be43" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
W20260709 12:23:54.863981 31245 leader_election.cc:343] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:54.865574 31244 leader_election.cc:343] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:54.866226 31244 leader_election.cc:304] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:54.867796 31558 raft_consensus.cc:2749] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:54.868181 31413 tablet_service.cc:1511] Processing CreateTablet for tablet 033329b2f3e348ccac62b6620f611a8b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:54.869947 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033329b2f3e348ccac62b6620f611a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.877977 31552 consensus_queue.cc:260] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:54.882611 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135641325754ecdb94233454a817a7f" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:54.883448 31431 raft_consensus.cc:2468] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:54.884879 31320 leader_election.cc:304] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:54.902084 31559 raft_consensus.cc:2804] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:54.902539 31559 raft_consensus.cc:493] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.902894 31559 raft_consensus.cc:3060] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:54.909389 31488 tablet_service.cc:1511] Processing CreateTablet for tablet 033329b2f3e348ccac62b6620f611a8b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:54.910867 31488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033329b2f3e348ccac62b6620f611a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.911458 31553 tablet_bootstrap.cc:492] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:54.911201 31559 raft_consensus.cc:515] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.912106 31553 ts_tablet_manager.cc:1403] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.266s	user 0.026s	sys 0.013s
I20260709 12:23:54.914670 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135641325754ecdb94233454a817a7f" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:54.915336 31431 raft_consensus.cc:3060] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:54.917117 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135641325754ecdb94233454a817a7f" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:54.918859 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135641325754ecdb94233454a817a7f" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
W20260709 12:23:54.921866 31318 leader_election.cc:343] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:54.900890 31552 ts_tablet_manager.cc:1434] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.001s
W20260709 12:23:54.923547 31318 leader_election.cc:343] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:54.927910 31342 tablet_service.cc:1511] Processing CreateTablet for tablet c34c9c84b088402082232ada2f901768 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:54.940940 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34c9c84b088402082232ada2f901768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.941567 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:23:54.943267 31395 leader_election.cc:343] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:54.930018 31495 tablet_service.cc:1511] Processing CreateTablet for tablet 0071e37b60b04beb864d69169365283f (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:54.956645 31551 tablet_bootstrap.cc:492] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:54.956926 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0071e37b60b04beb864d69169365283f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.957219 31551 ts_tablet_manager.cc:1403] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.283s	user 0.019s	sys 0.004s
I20260709 12:23:54.936741 31431 raft_consensus.cc:2468] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:54.931427 31420 tablet_service.cc:1511] Processing CreateTablet for tablet c34c9c84b088402082232ada2f901768 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:54.974133 31320 leader_election.cc:304] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:54.928316 31552 tablet_bootstrap.cc:492] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:54.932468 31270 tablet_service.cc:1511] Processing CreateTablet for tablet c34c9c84b088402082232ada2f901768 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:54.976097 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34c9c84b088402082232ada2f901768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.976874 31551 raft_consensus.cc:359] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.977641 31551 raft_consensus.cc:385] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.977977 31551 raft_consensus.cc:740] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.942291 31265 tablet_service.cc:1511] Processing CreateTablet for tablet 0071e37b60b04beb864d69169365283f (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:54.983589 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0071e37b60b04beb864d69169365283f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.984233 31339 tablet_service.cc:1511] Processing CreateTablet for tablet 0071e37b60b04beb864d69169365283f (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:54.964174 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135641325754ecdb94233454a817a7f" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:54.985918 31354 raft_consensus.cc:2393] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 1: Already voted for candidate 998cd06c0be349879a0602496bc33640 in this term.
I20260709 12:23:54.967787 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
W20260709 12:23:54.988535 31393 leader_election.cc:343] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:54.989223 31393 leader_election.cc:304] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:54.936959 31553 raft_consensus.cc:359] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:54.968559 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135641325754ecdb94233454a817a7f" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:54.990360 31567 raft_consensus.cc:2749] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:54.974406 31420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34c9c84b088402082232ada2f901768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.991654 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0071e37b60b04beb864d69169365283f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.935545 31556 tablet_bootstrap.cc:492] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:54.983474 31551 consensus_queue.cc:260] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.923130 31559 leader_election.cc:290] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:54.994328 31556 ts_tablet_manager.cc:1403] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.250s	user 0.033s	sys 0.034s
I20260709 12:23:54.994524 31559 raft_consensus.cc:2804] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:54.995054 31559 raft_consensus.cc:697] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:23:54.995925 31559 consensus_queue.cc:237] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.996531 31551 ts_tablet_manager.cc:1434] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.023s	user 0.000s	sys 0.006s
I20260709 12:23:54.998097 31551 tablet_bootstrap.cc:492] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:54.997735 31556 raft_consensus.cc:359] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:54.998728 31556 raft_consensus.cc:385] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.999043 31556 raft_consensus.cc:740] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.999851 31556 consensus_queue.cc:260] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:55.001549 31496 tablet_service.cc:1511] Processing CreateTablet for tablet 0f931106f8ca4318980f68dfce295cc9 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:55.002957 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f931106f8ca4318980f68dfce295cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.005997 31553 raft_consensus.cc:385] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.006386 31553 raft_consensus.cc:740] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.007385 31553 consensus_queue.cc:260] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.013422 31413 tablet_service.cc:1511] Processing CreateTablet for tablet 0f931106f8ca4318980f68dfce295cc9 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:55.014921 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f931106f8ca4318980f68dfce295cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.021328 31551 tablet_bootstrap.cc:654] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.021183 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 0f931106f8ca4318980f68dfce295cc9 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
W20260709 12:23:55.021831 31393 leader_election.cc:343] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.022650 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f931106f8ca4318980f68dfce295cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.023837 31556 ts_tablet_manager.cc:1434] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:23:55.024977 31556 tablet_bootstrap.cc:492] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:55.031024 31553 ts_tablet_manager.cc:1434] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.001s
I20260709 12:23:55.032148 31553 tablet_bootstrap.cc:492] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:55.037441 31552 tablet_bootstrap.cc:654] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.042547 31553 tablet_bootstrap.cc:654] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.043201 31556 tablet_bootstrap.cc:654] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.048509 31562 raft_consensus.cc:493] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.049232 31562 raft_consensus.cc:515] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
W20260709 12:23:55.054813 31320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:45167, user_credentials={real_user=slave}} blocked reactor thread for 80779.6us
I20260709 12:23:55.053440 31562 leader_election.cc:290] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:55.067421 31342 tablet_service.cc:1511] Processing CreateTablet for tablet 1db9b56686874345a49f931200fdc7f8 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:55.069234 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db9b56686874345a49f931200fdc7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.070673 31394 leader_election.cc:304] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:23:55.086340 31559 raft_consensus.cc:493] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.088537 31567 raft_consensus.cc:2749] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:55.099802 31173 catalog_manager.cc:5697] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.092175 31559 raft_consensus.cc:515] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.106935 31413 tablet_service.cc:1511] Processing CreateTablet for tablet 1db9b56686874345a49f931200fdc7f8 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:55.108594 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db9b56686874345a49f931200fdc7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.112129 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c340f374545689f892f6136c5f92b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
W20260709 12:23:55.114092 31320 leader_election.cc:343] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.114737 31495 tablet_service.cc:1511] Processing CreateTablet for tablet 1db9b56686874345a49f931200fdc7f8 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:55.114995 31567 raft_consensus.cc:493] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.116127 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db9b56686874345a49f931200fdc7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.115753 31567 raft_consensus.cc:515] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:55.118916 31268 tablet_service.cc:1511] Processing CreateTablet for tablet 2622a99407874e409f4fb5248f2f404b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:55.120266 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2622a99407874e409f4fb5248f2f404b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.120992 31567 leader_election.cc:290] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:55.122828 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881b09b571934068b262cdee9a6064ca" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:55.122887 31344 tablet_service.cc:1511] Processing CreateTablet for tablet 2622a99407874e409f4fb5248f2f404b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:55.126852 31280 raft_consensus.cc:2468] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:55.127570 31344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2622a99407874e409f4fb5248f2f404b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.128175 31393 leader_election.cc:304] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:55.128968 31559 leader_election.cc:290] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:55.130963 31567 raft_consensus.cc:2804] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:55.131388 31567 raft_consensus.cc:493] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.131726 31567 raft_consensus.cc:3060] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.132879 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881b09b571934068b262cdee9a6064ca" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:55.138257 31558 raft_consensus.cc:493] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.138787 31558 raft_consensus.cc:515] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
W20260709 12:23:55.144332 31395 leader_election.cc:343] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.148859 31570 consensus_queue.cc:1048] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:55.161324 31264 tablet_service.cc:1511] Processing CreateTablet for tablet 50603727db744cf8aeb6da31ee6cbf18 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:55.162714 31264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50603727db744cf8aeb6da31ee6cbf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.163053 31558 leader_election.cc:290] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:55.163709 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ee99261a143ee9924131fc68c1ec3" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:55.164978 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ee99261a143ee9924131fc68c1ec3" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
W20260709 12:23:55.165231 31244 leader_election.cc:343] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:55.166582 31245 leader_election.cc:343] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.167030 31245 leader_election.cc:304] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:55.168887 31572 raft_consensus.cc:2749] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:55.161322 31496 tablet_service.cc:1511] Processing CreateTablet for tablet 50603727db744cf8aeb6da31ee6cbf18 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:55.177300 31556 tablet_bootstrap.cc:492] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:55.177731 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50603727db744cf8aeb6da31ee6cbf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.177860 31556 ts_tablet_manager.cc:1403] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.153s	user 0.020s	sys 0.004s
I20260709 12:23:55.181381 31556 raft_consensus.cc:359] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.182263 31556 raft_consensus.cc:385] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.182628 31556 raft_consensus.cc:740] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.182765 31421 tablet_service.cc:1511] Processing CreateTablet for tablet 2622a99407874e409f4fb5248f2f404b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:55.184137 31421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2622a99407874e409f4fb5248f2f404b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.183679 31556 consensus_queue.cc:260] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.186981 31345 tablet_service.cc:1511] Processing CreateTablet for tablet 50603727db744cf8aeb6da31ee6cbf18 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:55.188184 31551 tablet_bootstrap.cc:492] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:55.188269 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50603727db744cf8aeb6da31ee6cbf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.188810 31551 ts_tablet_manager.cc:1403] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.191s	user 0.024s	sys 0.025s
I20260709 12:23:55.189548 31562 raft_consensus.cc:493] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.190104 31562 raft_consensus.cc:515] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:55.192096 31551 raft_consensus.cc:359] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:55.192602 31562 leader_election.cc:290] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:55.192860 31551 raft_consensus.cc:385] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.193202 31551 raft_consensus.cc:740] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.185508 31567 raft_consensus.cc:515] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:55.196506 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881b09b571934068b262cdee9a6064ca" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:55.197132 31280 raft_consensus.cc:3060] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.200198 31558 consensus_queue.cc:1048] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:55.204226 31420 tablet_service.cc:1511] Processing CreateTablet for tablet 315f791c509f45baa49304f2085a8c2d (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:55.205560 31420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315f791c509f45baa49304f2085a8c2d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:55.196645 31226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:55.210636 31553 tablet_bootstrap.cc:492] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:55.211314 31553 ts_tablet_manager.cc:1403] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.179s	user 0.017s	sys 0.000s
I20260709 12:23:55.220052 31567 leader_election.cc:290] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:55.222942 31553 raft_consensus.cc:359] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.228237 31280 raft_consensus.cc:2468] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:23:55.233381 31551 consensus_queue.cc:260] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:55.238700 31265 tablet_service.cc:1511] Processing CreateTablet for tablet 315f791c509f45baa49304f2085a8c2d (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:55.240063 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315f791c509f45baa49304f2085a8c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.247797 31551 ts_tablet_manager.cc:1434] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:23:55.248979 31551 tablet_bootstrap.cc:492] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:55.248720 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c340f374545689f892f6136c5f92b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:23:55.250272 31320 leader_election.cc:343] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.250771 31320 leader_election.cc:304] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:55.229223 31553 raft_consensus.cc:385] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.252053 31559 raft_consensus.cc:2749] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:55.252444 31553 raft_consensus.cc:740] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.253459 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881b09b571934068b262cdee9a6064ca" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:55.255923 31491 tablet_service.cc:1511] Processing CreateTablet for tablet 315f791c509f45baa49304f2085a8c2d (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:55.257367 31491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315f791c509f45baa49304f2085a8c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.257714 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e8dd80d0ac4a2e82a042b49b8bc0d3" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:55.258460 31431 raft_consensus.cc:2468] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:55.260437 31470 leader_election.cc:304] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:55.261461 31562 raft_consensus.cc:2804] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:55.261858 31562 raft_consensus.cc:493] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.262409 31562 raft_consensus.cc:3060] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:55.258544 31395 leader_election.cc:343] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.266592 31418 tablet_service.cc:1511] Processing CreateTablet for tablet 2a807ba2b8d2417a8a13d2bf1bcef8c1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:55.267992 31418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a807ba2b8d2417a8a13d2bf1bcef8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.269909 31355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e8dd80d0ac4a2e82a042b49b8bc0d3" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:55.271389 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:55.253319 31553 consensus_queue.cc:260] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
W20260709 12:23:55.273830 31469 leader_election.cc:343] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:55.274963 31469 leader_election.cc:343] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.274861 31345 tablet_service.cc:1511] Processing CreateTablet for tablet 2a807ba2b8d2417a8a13d2bf1bcef8c1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:55.271740 31562 raft_consensus.cc:515] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.283433 31562 leader_election.cc:290] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:55.283883 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e8dd80d0ac4a2e82a042b49b8bc0d3" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:55.284466 31552 tablet_bootstrap.cc:492] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:55.285017 31552 ts_tablet_manager.cc:1403] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.357s	user 0.043s	sys 0.010s
I20260709 12:23:55.286201 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 656a43be5139490a9ab0b8bc38750ac6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:55.276255 31567 raft_consensus.cc:493] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.287487 31567 raft_consensus.cc:515] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
W20260709 12:23:55.288255 31469 leader_election.cc:343] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.290583 31393 leader_election.cc:304] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:23:55.287499 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 656a43be5139490a9ab0b8bc38750ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.298826 31552 raft_consensus.cc:359] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.299889 31556 ts_tablet_manager.cc:1434] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.012s
I20260709 12:23:55.301189 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e8dd80d0ac4a2e82a042b49b8bc0d3" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:55.291278 31488 tablet_service.cc:1511] Processing CreateTablet for tablet 2a807ba2b8d2417a8a13d2bf1bcef8c1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:55.308945 31431 raft_consensus.cc:3060] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.309672 31488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a807ba2b8d2417a8a13d2bf1bcef8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.312129 31414 tablet_service.cc:1511] Processing CreateTablet for tablet 656a43be5139490a9ab0b8bc38750ac6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:55.303299 31339 tablet_service.cc:1511] Processing CreateTablet for tablet 656a43be5139490a9ab0b8bc38750ac6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:55.318285 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a807ba2b8d2417a8a13d2bf1bcef8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.307262 31552 raft_consensus.cc:385] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.334399 31414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 656a43be5139490a9ab0b8bc38750ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.335747 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e8dd80d0ac4a2e82a042b49b8bc0d3" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:55.339828 31567 leader_election.cc:290] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:55.339756 31492 tablet_service.cc:1511] Processing CreateTablet for tablet 11bc57e4f3e241e0a32f281992c4d952 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:55.341259 31492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bc57e4f3e241e0a32f281992c4d952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.342440 31265 tablet_service.cc:1511] Processing CreateTablet for tablet 11bc57e4f3e241e0a32f281992c4d952 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:55.343636 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bc57e4f3e241e0a32f281992c4d952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.346484 31556 tablet_bootstrap.cc:492] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:55.348532 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e8dd80d0ac4a2e82a042b49b8bc0d3" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:55.349458 31505 raft_consensus.cc:2393] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:23:55.354291 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 656a43be5139490a9ab0b8bc38750ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.358510 31562 raft_consensus.cc:493] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.359026 31562 raft_consensus.cc:515] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.359052 31342 tablet_service.cc:1511] Processing CreateTablet for tablet 11bc57e4f3e241e0a32f281992c4d952 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:55.327189 31552 raft_consensus.cc:740] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.361606 31598 raft_consensus.cc:2804] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:55.321648 31431 raft_consensus.cc:2468] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:23:55.370103 31355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f636bc19da04dd8b83cab524f85dd00" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:55.373865 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f636bc19da04dd8b83cab524f85dd00" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
W20260709 12:23:55.374190 31469 leader_election.cc:343] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:55.375375 31470 leader_election.cc:343] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.375865 31470 leader_election.cc:304] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:55.376641 31264 tablet_service.cc:1511] Processing CreateTablet for tablet b69abb8bd62140f58770bec881e8ec59 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:55.377642 31344 tablet_service.cc:1511] Processing CreateTablet for tablet dc6e89a8a1d04b1e93e58d614c686d42 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:55.378723 31264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69abb8bd62140f58770bec881e8ec59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.380005 31598 raft_consensus.cc:697] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:23:55.380950 31415 tablet_service.cc:1511] Processing CreateTablet for tablet dc6e89a8a1d04b1e93e58d614c686d42 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:55.382284 31415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc6e89a8a1d04b1e93e58d614c686d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.384413 31556 tablet_bootstrap.cc:654] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.387121 31270 tablet_service.cc:1511] Processing CreateTablet for tablet ae28f8ed99514107ba0fc461d1829ce6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:55.388473 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae28f8ed99514107ba0fc461d1829ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.380965 31598 consensus_queue.cc:237] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:55.391276 31562 leader_election.cc:290] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:55.392376 31562 raft_consensus.cc:2749] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:55.393440 31413 tablet_service.cc:1511] Processing CreateTablet for tablet b69abb8bd62140f58770bec881e8ec59 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:55.394778 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69abb8bd62140f58770bec881e8ec59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.375584 31552 consensus_queue.cc:260] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.398352 31353 raft_consensus.cc:2468] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:55.399611 31496 tablet_service.cc:1511] Processing CreateTablet for tablet dc6e89a8a1d04b1e93e58d614c686d42 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:55.400955 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc6e89a8a1d04b1e93e58d614c686d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.401340 31552 ts_tablet_manager.cc:1434] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.116s	user 0.005s	sys 0.004s
I20260709 12:23:55.370929 31551 tablet_bootstrap.cc:654] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.409257 31470 leader_election.cc:304] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 998cd06c0be349879a0602496bc33640
I20260709 12:23:55.410734 31343 tablet_service.cc:1511] Processing CreateTablet for tablet ae28f8ed99514107ba0fc461d1829ce6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:55.413466 31394 leader_election.cc:304] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:23:55.413393 31418 tablet_service.cc:1511] Processing CreateTablet for tablet ae28f8ed99514107ba0fc461d1829ce6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:55.414904 31418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae28f8ed99514107ba0fc461d1829ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.414855 31567 raft_consensus.cc:2764] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:23:55.425354 31562 raft_consensus.cc:2804] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:55.408254 31572 raft_consensus.cc:493] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.433089 31265 tablet_service.cc:1511] Processing CreateTablet for tablet 455e5a199ea34658a55df3d05a441939 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:55.435684 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455e5a199ea34658a55df3d05a441939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.426069 31562 raft_consensus.cc:697] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:23:55.429703 31491 tablet_service.cc:1511] Processing CreateTablet for tablet 455e5a199ea34658a55df3d05a441939 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:55.447746 31491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455e5a199ea34658a55df3d05a441939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.450830 31420 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfa903d81ea4bcca153d01ec079d6d3 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:55.452975 31494 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfa903d81ea4bcca153d01ec079d6d3 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:55.453560 31552 tablet_bootstrap.cc:492] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:55.452242 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfa903d81ea4bcca153d01ec079d6d3 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:55.442513 31562 consensus_queue.cc:237] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.455744 31419 tablet_service.cc:1511] Processing CreateTablet for tablet 772880df0e044150b248d02eb59b08ce (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:55.456698 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:55.443177 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bc57e4f3e241e0a32f281992c4d952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.438163 31572 raft_consensus.cc:515] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:55.482577 31489 tablet_service.cc:1511] Processing CreateTablet for tablet 772880df0e044150b248d02eb59b08ce (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:55.484097 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772880df0e044150b248d02eb59b08ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.483835 31268 tablet_service.cc:1511] Processing CreateTablet for tablet fbfd97beba6040c69589994e8389028e (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 12:23:55.485447 31468 leader_election.cc:343] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:55.486135 31468 leader_election.cc:304] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:23:55.487385 31340 tablet_service.cc:1511] Processing CreateTablet for tablet 455e5a199ea34658a55df3d05a441939 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:55.487946 31601 raft_consensus.cc:2749] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:55.489691 31493 tablet_service.cc:1511] Processing CreateTablet for tablet fbfd97beba6040c69589994e8389028e (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:55.491712 31493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfd97beba6040c69589994e8389028e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.493712 31420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfa903d81ea4bcca153d01ec079d6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.494695 31487 tablet_service.cc:1511] Processing CreateTablet for tablet 42fcca57e9e24daea0e2dac26aedce05 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:55.495525 31494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfa903d81ea4bcca153d01ec079d6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.496435 31487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fcca57e9e24daea0e2dac26aedce05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.496814 31416 tablet_service.cc:1511] Processing CreateTablet for tablet 7323a3bd4ffe4eae8831fceee0397685 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:55.497773 31419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772880df0e044150b248d02eb59b08ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.498471 31416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7323a3bd4ffe4eae8831fceee0397685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.462535 31264 tablet_service.cc:1511] Processing CreateTablet for tablet 7323a3bd4ffe4eae8831fceee0397685 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:55.508013 31495 tablet_service.cc:1511] Processing CreateTablet for tablet b69abb8bd62140f58770bec881e8ec59 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 12:23:55.511588 31605 log.cc:927] Time spent T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:23:55.519661 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfa903d81ea4bcca153d01ec079d6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.521545 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfd97beba6040c69589994e8389028e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.522660 31340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455e5a199ea34658a55df3d05a441939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.523574 31264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7323a3bd4ffe4eae8831fceee0397685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.527108 31280 raft_consensus.cc:3060] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.528602 31553 ts_tablet_manager.cc:1434] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.317s	user 0.026s	sys 0.001s
I20260709 12:23:55.527325 31344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc6e89a8a1d04b1e93e58d614c686d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.530030 31553 tablet_bootstrap.cc:492] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:55.531108 31343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae28f8ed99514107ba0fc461d1829ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.548127 31177 catalog_manager.cc:5697] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.509712 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69abb8bd62140f58770bec881e8ec59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.554998 31572 leader_election.cc:290] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:55.556524 31266 tablet_service.cc:1511] Processing CreateTablet for tablet 42fcca57e9e24daea0e2dac26aedce05 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:55.556919 31341 tablet_service.cc:1511] Processing CreateTablet for tablet 772880df0e044150b248d02eb59b08ce (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:55.557873 31266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fcca57e9e24daea0e2dac26aedce05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.558308 31341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772880df0e044150b248d02eb59b08ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.560480 31559 consensus_queue.cc:1048] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:55.563124 31338 tablet_service.cc:1511] Processing CreateTablet for tablet 7323a3bd4ffe4eae8831fceee0397685 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:55.564448 31338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7323a3bd4ffe4eae8831fceee0397685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.567503 31337 tablet_service.cc:1511] Processing CreateTablet for tablet fbfd97beba6040c69589994e8389028e (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:55.568835 31337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfd97beba6040c69589994e8389028e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.570230 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135641325754ecdb94233454a817a7f" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:55.575068 31412 tablet_service.cc:1511] Processing CreateTablet for tablet 42fcca57e9e24daea0e2dac26aedce05 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:55.577162 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135641325754ecdb94233454a817a7f" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:55.580511 31244 leader_election.cc:304] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:55.621524 31412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fcca57e9e24daea0e2dac26aedce05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.628238 31553 tablet_bootstrap.cc:654] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.631019 31345 tablet_service.cc:1511] Processing CreateTablet for tablet e1ac93be0c8e4f939c700b1ac7fa43d6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:55.632498 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ac93be0c8e4f939c700b1ac7fa43d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.638679 31177 catalog_manager.cc:5697] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.642174 31414 tablet_service.cc:1511] Processing CreateTablet for tablet e1ac93be0c8e4f939c700b1ac7fa43d6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:55.646021 31414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ac93be0c8e4f939c700b1ac7fa43d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.620900 31552 tablet_bootstrap.cc:654] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.662303 31492 tablet_service.cc:1511] Processing CreateTablet for tablet e1ac93be0c8e4f939c700b1ac7fa43d6 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:55.664053 31492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ac93be0c8e4f939c700b1ac7fa43d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.677412 31556 tablet_bootstrap.cc:492] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:55.682003 31556 ts_tablet_manager.cc:1403] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.336s	user 0.014s	sys 0.010s
I20260709 12:23:55.685781 31556 raft_consensus.cc:359] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:55.686786 31556 raft_consensus.cc:385] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.687170 31556 raft_consensus.cc:740] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.688175 31556 consensus_queue.cc:260] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:55.691216 31556 ts_tablet_manager.cc:1434] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:55.692449 31556 tablet_bootstrap.cc:492] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:55.709137 31556 tablet_bootstrap.cc:654] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.720160 31558 raft_consensus.cc:2749] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:55.776542 31161 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.43.65:41673, user_credentials={real_user=slave}} blocked reactor thread for 52605.4us
I20260709 12:23:55.813825 31551 tablet_bootstrap.cc:492] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:55.825719 31551 ts_tablet_manager.cc:1403] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.576s	user 0.021s	sys 0.016s
I20260709 12:23:55.829793 31553 tablet_bootstrap.cc:492] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:55.838589 31553 ts_tablet_manager.cc:1403] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.309s	user 0.029s	sys 0.034s
I20260709 12:23:55.842806 31344 tablet_service.cc:1511] Processing CreateTablet for tablet c0b3ab9ea32b4118bdeaef97935b378b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:55.844234 31344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b3ab9ea32b4118bdeaef97935b378b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.819530 31266 tablet_service.cc:1511] Processing CreateTablet for tablet c0b3ab9ea32b4118bdeaef97935b378b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:55.833173 31415 tablet_service.cc:1511] Processing CreateTablet for tablet c0b3ab9ea32b4118bdeaef97935b378b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:23:55.834278 31395 consensus_peers.cc:597] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Couldn't send request to peer 41649f3a1d8346ada1e2a0e8b6cae5ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:55.835631 31489 tablet_service.cc:1511] Processing CreateTablet for tablet 3f373819fb7049ee9b511c4cad4374fd (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:55.836768 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 3f373819fb7049ee9b511c4cad4374fd (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:55.850145 31415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b3ab9ea32b4118bdeaef97935b378b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.849956 31553 raft_consensus.cc:359] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.850627 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f373819fb7049ee9b511c4cad4374fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.850934 31553 raft_consensus.cc:385] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.851344 31553 raft_consensus.cc:740] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.855501 31266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b3ab9ea32b4118bdeaef97935b378b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.856107 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f373819fb7049ee9b511c4cad4374fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.864079 31556 tablet_bootstrap.cc:492] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:55.852674 31559 consensus_queue.cc:1048] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:23:55.864758 31556 ts_tablet_manager.cc:1403] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.173s	user 0.021s	sys 0.013s
I20260709 12:23:55.868196 31342 tablet_service.cc:1511] Processing CreateTablet for tablet 3f373819fb7049ee9b511c4cad4374fd (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:55.871385 31553 consensus_queue.cc:260] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.875404 31553 ts_tablet_manager.cc:1434] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:23:55.884809 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f373819fb7049ee9b511c4cad4374fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.890209 31551 raft_consensus.cc:359] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:55.894603 31551 raft_consensus.cc:385] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.895035 31551 raft_consensus.cc:740] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.898877 31553 tablet_bootstrap.cc:492] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:55.910845 31598 consensus_queue.cc:1048] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:55.907548 31495 tablet_service.cc:1511] Processing CreateTablet for tablet 23abbe4a643c4fe59edd20b80397459b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:55.911616 31556 raft_consensus.cc:359] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.912456 31556 raft_consensus.cc:385] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.912851 31556 raft_consensus.cc:740] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.912993 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23abbe4a643c4fe59edd20b80397459b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.887285 31552 tablet_bootstrap.cc:492] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:55.924748 31416 tablet_service.cc:1511] Processing CreateTablet for tablet 23abbe4a643c4fe59edd20b80397459b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:55.928333 31343 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9eda698af44e0194bcc4cf3ccc7689 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:55.930301 31354 raft_consensus.cc:3060] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.938303 31556 consensus_queue.cc:260] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:55.939256 31343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9eda698af44e0194bcc4cf3ccc7689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.941495 31556 ts_tablet_manager.cc:1434] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 12:23:55.938043 31552 ts_tablet_manager.cc:1403] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.485s	user 0.008s	sys 0.038s
I20260709 12:23:55.937443 31414 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9eda698af44e0194bcc4cf3ccc7689 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:55.975144 31487 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9eda698af44e0194bcc4cf3ccc7689 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:55.976245 31556 tablet_bootstrap.cc:492] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:55.976809 31487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9eda698af44e0194bcc4cf3ccc7689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.979121 31414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9eda698af44e0194bcc4cf3ccc7689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.983590 31553 tablet_bootstrap.cc:654] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.983614 31556 tablet_bootstrap.cc:654] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.984797 31416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23abbe4a643c4fe59edd20b80397459b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.957974 31551 consensus_queue.cc:260] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:55.998935 31606 consensus_queue.cc:1048] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:55.988739 31551 ts_tablet_manager.cc:1434] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.144s	user 0.008s	sys 0.000s
I20260709 12:23:56.017303 31342 tablet_service.cc:1511] Processing CreateTablet for tablet fc7a9bea17c8409da9f38b8bc322e895 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:56.018626 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc7a9bea17c8409da9f38b8bc322e895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.019336 31415 tablet_service.cc:1511] Processing CreateTablet for tablet fc7a9bea17c8409da9f38b8bc322e895 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:56.019892 31494 tablet_service.cc:1511] Processing CreateTablet for tablet a32f85ad47fd43e997766faf8e9ae119 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:56.021160 31494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f85ad47fd43e997766faf8e9ae119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.021270 31415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc7a9bea17c8409da9f38b8bc322e895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.032560 31598 raft_consensus.cc:493] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.032557 31266 tablet_service.cc:1511] Processing CreateTablet for tablet fc7a9bea17c8409da9f38b8bc322e895 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:56.033320 31598 raft_consensus.cc:515] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.033740 31556 tablet_bootstrap.cc:492] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:56.034171 31266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc7a9bea17c8409da9f38b8bc322e895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.034547 31556 ts_tablet_manager.cc:1403] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.015s
I20260709 12:23:56.038141 31264 tablet_service.cc:1511] Processing CreateTablet for tablet 23abbe4a643c4fe59edd20b80397459b (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:56.039657 31264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23abbe4a643c4fe59edd20b80397459b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.043201 31268 tablet_service.cc:1511] Processing CreateTablet for tablet a32f85ad47fd43e997766faf8e9ae119 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:56.043773 31344 tablet_service.cc:1511] Processing CreateTablet for tablet a32f85ad47fd43e997766faf8e9ae119 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:56.045006 31344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f85ad47fd43e997766faf8e9ae119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.046972 31572 raft_consensus.cc:493] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.047477 31572 raft_consensus.cc:515] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:56.047600 31606 consensus_queue.cc:1048] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.045082 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f85ad47fd43e997766faf8e9ae119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.051092 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:56.051801 31506 raft_consensus.cc:2468] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:56.054198 31245 leader_election.cc:304] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:56.054499 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:56.055375 31558 raft_consensus.cc:2804] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.055852 31558 raft_consensus.cc:493] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:56.056113 31244 leader_election.cc:343] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:56.056291 31558 raft_consensus.cc:3060] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.049702 31572 leader_election.cc:290] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:56.063987 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bda5ad3f124108b9ac3050da12be43" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:56.064762 31278 raft_consensus.cc:2468] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:56.066040 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bda5ad3f124108b9ac3050da12be43" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:56.066113 31393 leader_election.cc:304] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.066040 31552 raft_consensus.cc:359] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.068681 31552 raft_consensus.cc:385] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.069034 31552 raft_consensus.cc:740] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.086422 31551 tablet_bootstrap.cc:492] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:56.074510 31598 leader_election.cc:290] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:56.081586 31552 consensus_queue.cc:260] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.104080 31353 raft_consensus.cc:2468] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:56.112288 31623 raft_consensus.cc:2804] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.113022 31623 raft_consensus.cc:493] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.113517 31623 raft_consensus.cc:3060] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.102800 31558 raft_consensus.cc:515] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:56.132328 31489 tablet_service.cc:1511] Processing CreateTablet for tablet 49b3b16774644d7e85c404e0fd485a60 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:56.142722 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b3b16774644d7e85c404e0fd485a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.137537 31552 ts_tablet_manager.cc:1434] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.184s	user 0.012s	sys 0.000s
I20260709 12:23:56.137431 31556 raft_consensus.cc:359] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.139113 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:56.154311 31506 raft_consensus.cc:3060] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.154585 31551 tablet_bootstrap.cc:654] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.136835 31598 raft_consensus.cc:493] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.148537 31553 tablet_bootstrap.cc:492] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:56.149151 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:56.149501 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 49b3b16774644d7e85c404e0fd485a60 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:56.150117 31558 leader_election.cc:290] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:56.152694 31342 tablet_service.cc:1511] Processing CreateTablet for tablet ff653c4c2e914776b9658d2b0d395afe (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:56.163424 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff653c4c2e914776b9658d2b0d395afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.164031 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b3b16774644d7e85c404e0fd485a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.164341 31487 tablet_service.cc:1511] Processing CreateTablet for tablet ff653c4c2e914776b9658d2b0d395afe (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:56.165657 31487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff653c4c2e914776b9658d2b0d395afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.157469 31556 raft_consensus.cc:385] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.156250 31598 raft_consensus.cc:515] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
W20260709 12:23:56.170092 31244 leader_election.cc:343] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:56.162880 31553 ts_tablet_manager.cc:1403] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.264s	user 0.008s	sys 0.009s
I20260709 12:23:56.173975 31552 tablet_bootstrap.cc:492] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:56.178002 31416 tablet_service.cc:1511] Processing CreateTablet for tablet 49b3b16774644d7e85c404e0fd485a60 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:56.179353 31416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b3b16774644d7e85c404e0fd485a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.179803 31506 raft_consensus.cc:2468] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:56.181332 31245 leader_election.cc:304] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 998cd06c0be349879a0602496bc33640
I20260709 12:23:56.182509 31558 raft_consensus.cc:2804] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.182993 31558 raft_consensus.cc:697] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:23:56.183823 31558 consensus_queue.cc:237] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:56.191330 31412 tablet_service.cc:1511] Processing CreateTablet for tablet ff653c4c2e914776b9658d2b0d395afe (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:56.192704 31412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff653c4c2e914776b9658d2b0d395afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.167254 31556 raft_consensus.cc:740] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.202809 31556 consensus_queue.cc:260] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.199059 31268 tablet_service.cc:1511] Processing CreateTablet for tablet aed7a6253b364f139cce7e085a12c9ad (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:56.207553 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed7a6253b364f139cce7e085a12c9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.207825 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c340f374545689f892f6136c5f92b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:56.208508 31354 raft_consensus.cc:2468] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:56.209834 31394 leader_election.cc:304] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.210680 31342 tablet_service.cc:1511] Processing CreateTablet for tablet aed7a6253b364f139cce7e085a12c9ad (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:56.212845 31495 tablet_service.cc:1511] Processing CreateTablet for tablet dc8b707960e641338e58cc2552304bb1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:23:56.213806 31226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:56.216392 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed7a6253b364f139cce7e085a12c9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.219617 31627 raft_consensus.cc:2804] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.232867 31552 tablet_bootstrap.cc:654] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.240427 31606 raft_consensus.cc:493] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.253495 31177 catalog_manager.cc:5697] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.261193 31414 tablet_service.cc:1511] Processing CreateTablet for tablet aed7a6253b364f139cce7e085a12c9ad (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:56.262619 31414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed7a6253b364f139cce7e085a12c9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.251212 31627 raft_consensus.cc:493] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.263579 31269 tablet_service.cc:1511] Processing CreateTablet for tablet dc8b707960e641338e58cc2552304bb1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:56.267297 31342 tablet_service.cc:1511] Processing CreateTablet for tablet dc8b707960e641338e58cc2552304bb1 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:56.273111 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8b707960e641338e58cc2552304bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.273325 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8b707960e641338e58cc2552304bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.266403 31606 raft_consensus.cc:515] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.265486 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c340f374545689f892f6136c5f92b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:56.275570 31506 raft_consensus.cc:2468] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:56.257665 31598 leader_election.cc:290] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:56.280097 31415 tablet_service.cc:1511] Processing CreateTablet for tablet 585fd08c8ecd43f38d46851ea9eca526 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:56.263551 31623 raft_consensus.cc:515] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.281745 31415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585fd08c8ecd43f38d46851ea9eca526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.286705 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bda5ad3f124108b9ac3050da12be43" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:56.287503 31280 raft_consensus.cc:3060] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.289470 31606 leader_election.cc:290] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:56.291293 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c340f374545689f892f6136c5f92b" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:56.291841 31551 tablet_bootstrap.cc:492] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:56.292078 31354 raft_consensus.cc:2468] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:56.292626 31551 ts_tablet_manager.cc:1403] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.211s	user 0.005s	sys 0.025s
I20260709 12:23:56.293780 31469 leader_election.cc:304] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:56.294872 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c340f374545689f892f6136c5f92b" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:56.298089 31606 raft_consensus.cc:2804] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.298529 31606 raft_consensus.cc:493] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.298905 31606 raft_consensus.cc:3060] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.301451 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bda5ad3f124108b9ac3050da12be43" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:56.302083 31354 raft_consensus.cc:3060] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.302824 31280 raft_consensus.cc:2468] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:23:56.303589 31551 raft_consensus.cc:359] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.304190 31393 leader_election.cc:304] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.304438 31551 raft_consensus.cc:385] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.304847 31551 raft_consensus.cc:740] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.305135 31598 raft_consensus.cc:2804] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.305797 31598 raft_consensus.cc:697] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:23:56.306794 31598 consensus_queue.cc:237] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.309368 31354 raft_consensus.cc:2468] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:23:56.265656 31627 raft_consensus.cc:3060] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.327205 31492 tablet_service.cc:1511] Processing CreateTablet for tablet 585fd08c8ecd43f38d46851ea9eca526 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:56.328725 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8b707960e641338e58cc2552304bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.328253 31553 raft_consensus.cc:359] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.339270 31492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585fd08c8ecd43f38d46851ea9eca526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.315070 31623 leader_election.cc:290] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:56.336851 31556 ts_tablet_manager.cc:1434] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.302s	user 0.028s	sys 0.016s
I20260709 12:23:56.339285 31606 raft_consensus.cc:515] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.334496 31553 raft_consensus.cc:385] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.348469 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 585fd08c8ecd43f38d46851ea9eca526 (DEFAULT_TABLE table=test-workload [id=9ce492610aad4b7b86a8d26d312463c8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:56.349714 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585fd08c8ecd43f38d46851ea9eca526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.351341 31552 tablet_bootstrap.cc:492] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:56.351902 31552 ts_tablet_manager.cc:1403] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.178s	user 0.010s	sys 0.019s
I20260709 12:23:56.351753 31627 raft_consensus.cc:515] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.354322 31431 raft_consensus.cc:2393] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:23:56.354959 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c340f374545689f892f6136c5f92b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:56.355551 31354 raft_consensus.cc:3060] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.359072 31552 raft_consensus.cc:359] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.359889 31552 raft_consensus.cc:385] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.360189 31552 raft_consensus.cc:740] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.360955 31552 consensus_queue.cc:260] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.362607 31556 tablet_bootstrap.cc:492] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:56.362991 31354 raft_consensus.cc:2468] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:23:56.365437 31627 leader_election.cc:290] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:56.366581 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c340f374545689f892f6136c5f92b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:56.367471 31505 raft_consensus.cc:2393] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:23:56.367566 31394 leader_election.cc:304] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.368471 31627 raft_consensus.cc:2804] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.368999 31627 raft_consensus.cc:697] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:23:56.369843 31556 tablet_bootstrap.cc:654] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.371968 31606 leader_election.cc:290] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:56.373871 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c340f374545689f892f6136c5f92b" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:56.373963 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c340f374545689f892f6136c5f92b" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:56.375023 31354 raft_consensus.cc:2393] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:23:56.376250 31469 leader_election.cc:304] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:56.377177 31606 raft_consensus.cc:2749] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:56.348104 31553 raft_consensus.cc:740] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.369855 31627 consensus_queue.cc:237] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.305714 31551 consensus_queue.cc:260] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.385934 31552 ts_tablet_manager.cc:1434] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:23:56.386049 31551 ts_tablet_manager.cc:1434] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.000s
I20260709 12:23:56.390707 31552 tablet_bootstrap.cc:492] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:56.391517 31553 consensus_queue.cc:260] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.399195 31551 tablet_bootstrap.cc:492] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:56.400741 31553 ts_tablet_manager.cc:1434] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.225s	user 0.007s	sys 0.001s
I20260709 12:23:56.403280 31553 tablet_bootstrap.cc:492] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:56.403420 31614 raft_consensus.cc:493] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.412357 31614 raft_consensus.cc:515] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.416267 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676338c84446f98d6653d9a31003ef" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:56.417110 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676338c84446f98d6653d9a31003ef" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:56.418912 31280 raft_consensus.cc:2468] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:56.419111 31614 leader_election.cc:290] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:56.422102 31552 tablet_bootstrap.cc:654] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:56.417975 31320 leader_election.cc:343] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:56.416656 31553 tablet_bootstrap.cc:654] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.425256 31318 leader_election.cc:304] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:23:56.426834 31551 tablet_bootstrap.cc:654] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.428025 31556 tablet_bootstrap.cc:492] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:56.427217 31175 catalog_manager.cc:5697] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.431766 31556 ts_tablet_manager.cc:1403] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.004s
I20260709 12:23:56.432720 31614 raft_consensus.cc:2804] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.434481 31614 raft_consensus.cc:493] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.434866 31614 raft_consensus.cc:3060] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.437080 31556 raft_consensus.cc:359] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.437844 31556 raft_consensus.cc:385] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.438174 31556 raft_consensus.cc:740] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.438930 31556 consensus_queue.cc:260] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.441507 31556 ts_tablet_manager.cc:1434] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:56.442518 31556 tablet_bootstrap.cc:492] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:56.465161 31627 raft_consensus.cc:493] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.465750 31627 raft_consensus.cc:515] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.466421 31552 tablet_bootstrap.cc:492] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:56.466993 31552 ts_tablet_manager.cc:1403] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.013s
I20260709 12:23:56.463089 31614 raft_consensus.cc:515] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.469521 31556 tablet_bootstrap.cc:654] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.472779 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ee99261a143ee9924131fc68c1ec3" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:56.475796 31552 raft_consensus.cc:359] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.477114 31552 raft_consensus.cc:385] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.477443 31552 raft_consensus.cc:740] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.477550 31627 leader_election.cc:290] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:56.478361 31552 consensus_queue.cc:260] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.479607 31354 raft_consensus.cc:2468] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:56.479818 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ee99261a143ee9924131fc68c1ec3" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:56.480616 31280 raft_consensus.cc:2468] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:56.482055 31393 leader_election.cc:304] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.482367 31553 tablet_bootstrap.cc:492] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:56.482858 31553 ts_tablet_manager.cc:1403] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.014s
I20260709 12:23:56.483011 31627 raft_consensus.cc:2804] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.483421 31627 raft_consensus.cc:493] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.483786 31627 raft_consensus.cc:3060] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.486133 31556 tablet_bootstrap.cc:492] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:56.486080 31553 raft_consensus.cc:359] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.486825 31556 ts_tablet_manager.cc:1403] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 12:23:56.487030 31553 raft_consensus.cc:385] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.487416 31553 raft_consensus.cc:740] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.488405 31553 consensus_queue.cc:260] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.489743 31614 leader_election.cc:290] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:56.490067 31556 raft_consensus.cc:359] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.490880 31556 raft_consensus.cc:385] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.491078 31551 tablet_bootstrap.cc:492] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:56.491194 31556 raft_consensus.cc:740] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.491750 31551 ts_tablet_manager.cc:1403] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.093s	user 0.018s	sys 0.014s
I20260709 12:23:56.493968 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676338c84446f98d6653d9a31003ef" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
W20260709 12:23:56.495569 31320 leader_election.cc:343] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:56.497852 31552 ts_tablet_manager.cc:1434] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 12:23:56.499166 31552 tablet_bootstrap.cc:492] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:56.499536 31553 ts_tablet_manager.cc:1434] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:23:56.495147 31556 consensus_queue.cc:260] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.502214 31556 ts_tablet_manager.cc:1434] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:23:56.503228 31556 tablet_bootstrap.cc:492] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:56.508773 31553 tablet_bootstrap.cc:492] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:56.510767 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676338c84446f98d6653d9a31003ef" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:56.511396 31280 raft_consensus.cc:3060] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.512236 31556 tablet_bootstrap.cc:654] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.518659 31553 tablet_bootstrap.cc:654] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.519709 31552 tablet_bootstrap.cc:654] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.510310 31551 raft_consensus.cc:359] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.506090 31627 raft_consensus.cc:515] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.520416 31551 raft_consensus.cc:385] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.520792 31551 raft_consensus.cc:740] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.521698 31551 consensus_queue.cc:260] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.531601 31551 ts_tablet_manager.cc:1434] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:23:56.539793 31551 tablet_bootstrap.cc:492] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:56.531774 31173 catalog_manager.cc:5697] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.519516 31280 raft_consensus.cc:2468] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:56.562925 31318 leader_election.cc:304] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:23:56.564111 31614 raft_consensus.cc:2804] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.564620 31614 raft_consensus.cc:697] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:23:56.565448 31614 consensus_queue.cc:237] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.568302 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ee99261a143ee9924131fc68c1ec3" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:56.568969 31279 raft_consensus.cc:3060] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.569741 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ee99261a143ee9924131fc68c1ec3" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:56.570390 31354 raft_consensus.cc:3060] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.570581 31627 leader_election.cc:290] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:56.571870 31551 tablet_bootstrap.cc:654] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.577131 31556 tablet_bootstrap.cc:492] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:56.577679 31556 ts_tablet_manager.cc:1403] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.013s
I20260709 12:23:56.578347 31279 raft_consensus.cc:2468] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:23:56.579475 31354 raft_consensus.cc:2468] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:23:56.580044 31393 leader_election.cc:304] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.582962 31627 raft_consensus.cc:2804] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.587839 31627 raft_consensus.cc:697] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
W20260709 12:23:56.589149 31244 consensus_peers.cc:597] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.588968 31627 consensus_queue.cc:237] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.590830 31553 tablet_bootstrap.cc:492] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:56.591558 31553 ts_tablet_manager.cc:1403] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.083s	user 0.027s	sys 0.004s
I20260709 12:23:56.592078 31552 tablet_bootstrap.cc:492] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:56.592609 31552 ts_tablet_manager.cc:1403] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.094s	user 0.035s	sys 0.029s
I20260709 12:23:56.586988 31556 raft_consensus.cc:359] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.593499 31556 raft_consensus.cc:385] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.593763 31556 raft_consensus.cc:740] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.595731 31556 consensus_queue.cc:260] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.597697 31553 raft_consensus.cc:359] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.598577 31553 raft_consensus.cc:385] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.599002 31553 raft_consensus.cc:740] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.599849 31553 consensus_queue.cc:260] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.601931 31552 raft_consensus.cc:359] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.602345 31553 ts_tablet_manager.cc:1434] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:56.602701 31552 raft_consensus.cc:385] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.603053 31552 raft_consensus.cc:740] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.603947 31553 tablet_bootstrap.cc:492] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:56.603848 31552 consensus_queue.cc:260] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.605963 31552 ts_tablet_manager.cc:1434] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:23:56.606868 31552 tablet_bootstrap.cc:492] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:56.609540 31556 ts_tablet_manager.cc:1434] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:23:56.609418 31175 catalog_manager.cc:5697] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.611991 31556 tablet_bootstrap.cc:492] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:56.612788 31552 tablet_bootstrap.cc:654] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.617743 31553 tablet_bootstrap.cc:654] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.625136 31551 tablet_bootstrap.cc:492] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:56.625767 31551 ts_tablet_manager.cc:1403] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.012s
I20260709 12:23:56.627997 31556 tablet_bootstrap.cc:654] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.632737 31551 raft_consensus.cc:359] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.633505 31551 raft_consensus.cc:385] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.634009 31551 raft_consensus.cc:740] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.634729 31552 tablet_bootstrap.cc:492] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:56.635360 31552 ts_tablet_manager.cc:1403] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.009s
I20260709 12:23:56.636368 31553 tablet_bootstrap.cc:492] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:56.636896 31553 ts_tablet_manager.cc:1403] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.004s
I20260709 12:23:56.640050 31553 raft_consensus.cc:359] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.640786 31553 raft_consensus.cc:385] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.641122 31553 raft_consensus.cc:740] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.641477 31552 raft_consensus.cc:359] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:56.642287 31552 raft_consensus.cc:385] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.642668 31552 raft_consensus.cc:740] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.642086 31553 consensus_queue.cc:260] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.643342 31552 consensus_queue.cc:260] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:56.645553 31552 ts_tablet_manager.cc:1434] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 12:23:56.646503 31552 tablet_bootstrap.cc:492] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:56.649813 31606 raft_consensus.cc:493] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.650591 31606 raft_consensus.cc:515] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.652495 31552 tablet_bootstrap.cc:654] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.653456 31606 leader_election.cc:290] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:56.654667 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881b09b571934068b262cdee9a6064ca" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:56.655639 31558 consensus_queue.cc:1048] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.657613 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881b09b571934068b262cdee9a6064ca" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:56.661706 31468 leader_election.cc:304] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:56.663151 31558 raft_consensus.cc:493] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.663650 31558 raft_consensus.cc:515] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.663877 31562 raft_consensus.cc:2749] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:56.664778 31562 raft_consensus.cc:493] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.634784 31551 consensus_queue.cc:260] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.665756 31558 leader_election.cc:290] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:56.665369 31562 raft_consensus.cc:515] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.667589 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:56.668242 31431 raft_consensus.cc:2468] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:56.669142 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:56.669449 31627 raft_consensus.cc:493] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.669654 31245 leader_election.cc:304] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.669530 31562 leader_election.cc:290] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:56.670096 31627 raft_consensus.cc:515] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.649909 31175 catalog_manager.cc:5697] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.670691 31572 raft_consensus.cc:2804] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.671231 31572 raft_consensus.cc:493] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.671581 31572 raft_consensus.cc:3060] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.672418 31627 leader_election.cc:290] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:56.672964 31552 tablet_bootstrap.cc:492] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:56.673239 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:56.673454 31552 ts_tablet_manager.cc:1403] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.003s
I20260709 12:23:56.673846 31506 raft_consensus.cc:2468] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:56.669795 31430 raft_consensus.cc:2468] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:56.674353 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f636bc19da04dd8b83cab524f85dd00" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:56.672452 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:56.675155 31354 raft_consensus.cc:2468] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:56.677901 31394 leader_election.cc:304] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.678922 31627 raft_consensus.cc:2804] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.679289 31627 raft_consensus.cc:493] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.679298 31470 leader_election.cc:304] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.679741 31627 raft_consensus.cc:3060] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.679602 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f636bc19da04dd8b83cab524f85dd00" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:56.680550 31506 raft_consensus.cc:2468] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:56.681841 31558 raft_consensus.cc:493] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.682338 31558 raft_consensus.cc:515] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.684478 31558 leader_election.cc:290] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:56.685081 31606 raft_consensus.cc:493] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.685636 31606 raft_consensus.cc:515] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.686967 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f29029e642247cb91cf3c64c81118a1" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:56.681561 31552 raft_consensus.cc:359] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:56.687716 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f29029e642247cb91cf3c64c81118a1" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:56.687527 31627 raft_consensus.cc:515] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.688064 31552 raft_consensus.cc:385] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.688416 31552 raft_consensus.cc:740] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
W20260709 12:23:56.688656 31244 leader_election.cc:343] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:56.689169 31245 leader_election.cc:343] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:56.689222 31552 consensus_queue.cc:260] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:56.689702 31245 leader_election.cc:304] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:56.690436 31558 raft_consensus.cc:2749] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:56.691061 31627 leader_election.cc:290] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:56.690495 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f636bc19da04dd8b83cab524f85dd00" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:56.692116 31354 raft_consensus.cc:3060] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.690363 31562 raft_consensus.cc:2804] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.692977 31562 raft_consensus.cc:493] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.692071 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f636bc19da04dd8b83cab524f85dd00" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:56.697503 31506 raft_consensus.cc:3060] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.697804 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ed529cd264980bac4a8656242966a" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:56.698629 31430 raft_consensus.cc:2468] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:56.699466 31552 ts_tablet_manager.cc:1434] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.004s
I20260709 12:23:56.699863 31470 leader_election.cc:304] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.700466 31552 tablet_bootstrap.cc:492] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:56.703886 31606 leader_election.cc:290] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:56.709342 31606 raft_consensus.cc:2804] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.710716 31606 raft_consensus.cc:493] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.705899 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ed529cd264980bac4a8656242966a" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:56.719890 31606 raft_consensus.cc:3060] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.705726 31551 ts_tablet_manager.cc:1434] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 12:23:56.707509 31614 raft_consensus.cc:493] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.720835 31614 raft_consensus.cc:515] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:23:56.721187 31468 leader_election.cc:343] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:56.723104 31614 leader_election.cc:290] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:56.715159 31572 raft_consensus.cc:515] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.725111 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f215322251405ebe02666b49f6acd6" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:56.725576 31279 raft_consensus.cc:2393] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in this term.
W20260709 12:23:56.726732 31318 leader_election.cc:343] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:56.725142 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f215322251405ebe02666b49f6acd6" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:56.728542 31551 tablet_bootstrap.cc:492] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
W20260709 12:23:56.729251 31320 leader_election.cc:343] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:56.730002 31320 leader_election.cc:304] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:56.731953 31614 raft_consensus.cc:2749] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:56.705020 31506 raft_consensus.cc:2468] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:23:56.734515 31551 tablet_bootstrap.cc:654] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.697247 31562 raft_consensus.cc:3060] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.710156 31354 raft_consensus.cc:2468] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:23:56.738011 31395 leader_election.cc:304] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.739274 31627 raft_consensus.cc:2804] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.739840 31627 raft_consensus.cc:697] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:23:56.740804 31627 consensus_queue.cc:237] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.712699 31552 tablet_bootstrap.cc:654] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.732987 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:56.754678 31430 raft_consensus.cc:3060] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.756541 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:56.757591 31556 tablet_bootstrap.cc:492] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:56.758208 31556 ts_tablet_manager.cc:1403] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.146s	user 0.025s	sys 0.036s
I20260709 12:23:56.762039 31572 leader_election.cc:290] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:56.765148 31430 raft_consensus.cc:2468] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:56.775188 31245 leader_election.cc:304] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.718485 31553 ts_tablet_manager.cc:1434] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 12:23:56.767174 31606 raft_consensus.cc:515] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.771770 31551 tablet_bootstrap.cc:492] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:56.776134 31572 raft_consensus.cc:2804] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.777192 31553 tablet_bootstrap.cc:492] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:56.778695 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ed529cd264980bac4a8656242966a" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:56.779028 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ed529cd264980bac4a8656242966a" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:56.779362 31431 raft_consensus.cc:3060] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:56.780668 31468 leader_election.cc:343] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:56.781255 31606 leader_election.cc:290] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:56.783612 31572 raft_consensus.cc:697] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:23:56.784605 31572 consensus_queue.cc:237] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.787177 31553 tablet_bootstrap.cc:654] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.787364 31551 ts_tablet_manager.cc:1403] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.059s	user 0.026s	sys 0.016s
I20260709 12:23:56.787783 31562 raft_consensus.cc:515] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.788973 31506 raft_consensus.cc:2393] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:23:56.792313 31551 raft_consensus.cc:359] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.793234 31551 raft_consensus.cc:385] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.793574 31551 raft_consensus.cc:740] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.793691 31552 tablet_bootstrap.cc:492] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:56.794409 31552 ts_tablet_manager.cc:1403] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.002s
I20260709 12:23:56.794369 31551 consensus_queue.cc:260] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.787217 31431 raft_consensus.cc:2468] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:23:56.796857 31551 ts_tablet_manager.cc:1434] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:56.798396 31551 tablet_bootstrap.cc:492] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:56.773857 31556 raft_consensus.cc:359] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.800701 31556 raft_consensus.cc:385] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.801270 31556 raft_consensus.cc:740] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.778659 31175 catalog_manager.cc:5697] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.802029 31556 consensus_queue.cc:260] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.803380 31551 tablet_bootstrap.cc:654] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.806260 31470 leader_election.cc:304] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:56.806627 31173 catalog_manager.cc:5697] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.808427 31606 raft_consensus.cc:2804] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.808929 31606 raft_consensus.cc:697] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:23:56.809803 31606 consensus_queue.cc:237] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.813740 31556 ts_tablet_manager.cc:1434] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:23:56.814792 31556 tablet_bootstrap.cc:492] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:56.814882 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:56.815765 31431 raft_consensus.cc:2393] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in this term.
I20260709 12:23:56.820214 31562 leader_election.cc:290] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:56.821519 31556 tablet_bootstrap.cc:654] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.821337 31552 raft_consensus.cc:359] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.822089 31552 raft_consensus.cc:385] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.822395 31552 raft_consensus.cc:740] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.822664 31551 tablet_bootstrap.cc:492] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:56.823252 31551 ts_tablet_manager.cc:1403] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.006s
I20260709 12:23:56.823046 31552 consensus_queue.cc:260] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.823431 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:56.825126 31468 leader_election.cc:304] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:56.826382 31624 consensus_queue.cc:1048] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:56.830659 31552 ts_tablet_manager.cc:1434] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:23:56.832420 31562 raft_consensus.cc:2749] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:56.836342 31505 raft_consensus.cc:3060] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.837165 31552 tablet_bootstrap.cc:492] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:56.834578 31624 consensus_queue.cc:1048] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:56.843302 31556 tablet_bootstrap.cc:492] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:56.843824 31556 ts_tablet_manager.cc:1403] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.006s
I20260709 12:23:56.846637 31556 raft_consensus.cc:359] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.846482 31173 catalog_manager.cc:5697] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.847397 31556 raft_consensus.cc:385] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.847755 31556 raft_consensus.cc:740] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.847491 31551 raft_consensus.cc:359] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:56.848470 31551 raft_consensus.cc:385] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.848866 31551 raft_consensus.cc:740] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.848485 31556 consensus_queue.cc:260] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.849673 31551 consensus_queue.cc:260] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:56.851032 31556 ts_tablet_manager.cc:1434] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:56.852741 31624 consensus_queue.cc:1048] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.856556 31551 ts_tablet_manager.cc:1434] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:23:56.857719 31551 tablet_bootstrap.cc:492] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:56.862509 31598 consensus_queue.cc:1048] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.865079 31551 tablet_bootstrap.cc:654] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.875794 31553 tablet_bootstrap.cc:492] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:56.876341 31553 ts_tablet_manager.cc:1403] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.000s
I20260709 12:23:56.884595 31553 raft_consensus.cc:359] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.885535 31553 raft_consensus.cc:385] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.885890 31553 raft_consensus.cc:740] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.886678 31553 consensus_queue.cc:260] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.888502 31556 tablet_bootstrap.cc:492] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:56.888952 31553 ts_tablet_manager.cc:1434] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:23:56.894657 31552 tablet_bootstrap.cc:654] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.898967 31624 raft_consensus.cc:493] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.899662 31624 raft_consensus.cc:515] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.903388 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b007219e2ff443068a7ec936b0d2a6d1" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:56.904068 31504 raft_consensus.cc:2468] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:56.904796 31552 tablet_bootstrap.cc:492] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:56.905297 31552 ts_tablet_manager.cc:1403] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.000s
I20260709 12:23:56.905372 31395 leader_election.cc:304] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.906317 31598 raft_consensus.cc:2804] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.906684 31598 raft_consensus.cc:493] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.907012 31598 raft_consensus.cc:3060] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.914165 31614 raft_consensus.cc:493] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.914846 31614 raft_consensus.cc:515] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.917663 31553 tablet_bootstrap.cc:492] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:56.918176 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f29029e642247cb91cf3c64c81118a1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:56.918673 31280 raft_consensus.cc:2468] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:56.918601 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f29029e642247cb91cf3c64c81118a1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:56.920050 31318 leader_election.cc:304] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:56.920634 31431 raft_consensus.cc:2468] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:56.921902 31646 raft_consensus.cc:2804] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.922394 31646 raft_consensus.cc:493] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.922793 31646 raft_consensus.cc:3060] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.925864 31552 raft_consensus.cc:359] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.931545 31552 raft_consensus.cc:385] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.932133 31552 raft_consensus.cc:740] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.926822 31614 leader_election.cc:290] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:56.935372 31552 consensus_queue.cc:260] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.938431 31552 ts_tablet_manager.cc:1434] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.004s
I20260709 12:23:56.939004 31598 raft_consensus.cc:515] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.940709 31552 tablet_bootstrap.cc:492] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:56.941416 31662 raft_consensus.cc:493] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.941965 31662 raft_consensus.cc:515] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:56.935788 31624 leader_election.cc:290] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:56.934334 31553 tablet_bootstrap.cc:654] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.942818 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b007219e2ff443068a7ec936b0d2a6d1" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:56.935827 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b007219e2ff443068a7ec936b0d2a6d1" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:56.945200 31505 raft_consensus.cc:3060] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.947624 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ed529cd264980bac4a8656242966a" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:23:56.950163 31393 leader_election.cc:343] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:56.950126 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ed529cd264980bac4a8656242966a" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:56.951100 31431 raft_consensus.cc:2393] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:23:56.953866 31245 leader_election.cc:304] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:56.955036 31667 raft_consensus.cc:3060] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.957037 31505 raft_consensus.cc:2468] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:23:56.959280 31552 tablet_bootstrap.cc:654] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.944468 31662 leader_election.cc:290] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:56.962718 31395 leader_election.cc:304] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:56.967866 31614 consensus_queue.cc:1048] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.969429 31627 raft_consensus.cc:2804] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.969511 31646 raft_consensus.cc:515] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:56.977667 31552 tablet_bootstrap.cc:492] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:56.974718 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f29029e642247cb91cf3c64c81118a1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:56.978865 31431 raft_consensus.cc:3060] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.979434 31552 ts_tablet_manager.cc:1403] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.002s
I20260709 12:23:56.980357 31556 tablet_bootstrap.cc:654] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.982504 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f29029e642247cb91cf3c64c81118a1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:56.983234 31279 raft_consensus.cc:3060] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.984473 31552 raft_consensus.cc:359] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.985503 31552 raft_consensus.cc:385] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.985944 31552 raft_consensus.cc:740] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.987058 31552 consensus_queue.cc:260] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:56.991320 31552 ts_tablet_manager.cc:1434] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:23:56.992935 31552 tablet_bootstrap.cc:492] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:56.993587 31279 raft_consensus.cc:2468] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:56.995249 31318 leader_election.cc:304] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:56.996204 31614 raft_consensus.cc:2804] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.996788 31614 raft_consensus.cc:697] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:23:56.997831 31614 consensus_queue.cc:237] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.000257 31553 tablet_bootstrap.cc:492] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:57.000865 31553 ts_tablet_manager.cc:1403] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.111s	user 0.009s	sys 0.003s
I20260709 12:23:57.001971 31662 raft_consensus.cc:493] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.005365 31646 leader_election.cc:290] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:57.007787 31598 leader_election.cc:290] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:57.008898 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b007219e2ff443068a7ec936b0d2a6d1" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:57.003232 31662 raft_consensus.cc:515] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:23:57.010593 31393 leader_election.cc:343] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.011480 31667 raft_consensus.cc:2749] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:57.014319 31355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f215322251405ebe02666b49f6acd6" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:57.015341 31355 raft_consensus.cc:2468] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:57.018402 31646 raft_consensus.cc:493] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.019404 31646 raft_consensus.cc:515] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.021083 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f215322251405ebe02666b49f6acd6" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:57.024883 31646 leader_election.cc:290] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:57.021286 31552 tablet_bootstrap.cc:654] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.020478 31662 leader_election.cc:290] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:57.028825 31553 raft_consensus.cc:359] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.029446 31553 raft_consensus.cc:385] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.029708 31553 raft_consensus.cc:740] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.030793 31553 consensus_queue.cc:260] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.034235 31553 ts_tablet_manager.cc:1434] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:23:57.035049 31627 raft_consensus.cc:697] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:23:57.035591 31556 tablet_bootstrap.cc:492] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:57.036733 31553 tablet_bootstrap.cc:492] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:57.036839 31556 ts_tablet_manager.cc:1403] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.149s	user 0.012s	sys 0.000s
I20260709 12:23:57.038794 31552 tablet_bootstrap.cc:492] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:57.038549 31627 consensus_queue.cc:237] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.039325 31552 ts_tablet_manager.cc:1403] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.004s
I20260709 12:23:57.039909 31556 raft_consensus.cc:359] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.075691 31244 leader_election.cc:304] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
W20260709 12:23:57.079636 31245 leader_election.cc:343] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.086189 31431 raft_consensus.cc:2468] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:57.095877 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:57.106601 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:57.034262 31551 tablet_bootstrap.cc:492] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:57.126761 31556 raft_consensus.cc:385] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.151968 31662 raft_consensus.cc:2804] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:57.222245 31662 raft_consensus.cc:493] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.222647 31551 ts_tablet_manager.cc:1403] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.365s	user 0.066s	sys 0.082s
I20260709 12:23:57.222734 31662 raft_consensus.cc:3060] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.228806 31552 raft_consensus.cc:359] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.231621 31353 raft_consensus.cc:3060] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.231441 31175 catalog_manager.cc:5697] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.233471 31553 tablet_bootstrap.cc:700] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent opening tablet: real 0.104s	user 0.005s	sys 0.003s
I20260709 12:23:57.229694 31552 raft_consensus.cc:385] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.234302 31552 raft_consensus.cc:740] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.234730 31553 tablet_bootstrap.cc:654] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.234545 31551 raft_consensus.cc:359] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.235359 31551 raft_consensus.cc:385] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.235248 31552 consensus_queue.cc:260] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.200793 31562 raft_consensus.cc:493] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.236613 31562 raft_consensus.cc:515] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.241161 31506 raft_consensus.cc:3060] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.203562 31624 raft_consensus.cc:493] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.212814 31598 consensus_queue.cc:1048] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:57.219946 31684 consensus_queue.cc:1048] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:57.221450 31556 raft_consensus.cc:740] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.235795 31551 raft_consensus.cc:740] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.109797 31318 leader_election.cc:304] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:57.237350 31552 ts_tablet_manager.cc:1434] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.198s	user 0.019s	sys 0.009s
I20260709 12:23:57.241976 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676338c84446f98d6653d9a31003ef" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:57.243350 31562 leader_election.cc:290] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:57.247426 31556 consensus_queue.cc:260] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.248394 31552 tablet_bootstrap.cc:492] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:57.248940 31624 raft_consensus.cc:515] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.251780 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676338c84446f98d6653d9a31003ef" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:57.253916 31469 leader_election.cc:304] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:23:57.256074 31684 consensus_queue.cc:1048] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:57.256639 31551 consensus_queue.cc:260] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.261538 31556 ts_tablet_manager.cc:1434] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.224s	user 0.007s	sys 0.001s
I20260709 12:23:57.263736 31556 tablet_bootstrap.cc:492] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:57.265278 31662 raft_consensus.cc:515] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.274061 31551 ts_tablet_manager.cc:1434] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.007s
W20260709 12:23:57.261603 31318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:41673, user_credentials={real_user=slave}} blocked reactor thread for 152031us
I20260709 12:23:57.284814 31646 raft_consensus.cc:493] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.285447 31646 raft_consensus.cc:515] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.286612 31662 leader_election.cc:290] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:57.287418 31662 raft_consensus.cc:493] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.288020 31662 raft_consensus.cc:515] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.288694 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f215322251405ebe02666b49f6acd6" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:57.289354 31355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f215322251405ebe02666b49f6acd6" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:57.290055 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caafdbf4faa4bdeb26c29a5454a5f94" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:57.290366 31355 raft_consensus.cc:3060] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.291337 31646 leader_election.cc:290] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:23:57.292042 31320 leader_election.cc:343] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.296953 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caafdbf4faa4bdeb26c29a5454a5f94" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
W20260709 12:23:57.299225 31318 leader_election.cc:343] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.289407 31505 raft_consensus.cc:3060] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.299899 31318 leader_election.cc:304] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:57.302305 31646 raft_consensus.cc:2749] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:57.305701 31667 consensus_queue.cc:1048] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:57.311631 31644 raft_consensus.cc:493] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.312114 31551 tablet_bootstrap.cc:492] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:57.312429 31644 raft_consensus.cc:515] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.313122 31606 consensus_queue.cc:1048] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:57.316582 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b274862a58d4893959ebf0c52110287" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:57.318915 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b274862a58d4893959ebf0c52110287" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:57.319818 31430 raft_consensus.cc:2468] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
W20260709 12:23:57.321008 31318 leader_election.cc:343] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.321661 31320 leader_election.cc:304] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:57.322785 31646 raft_consensus.cc:2804] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:57.323254 31646 raft_consensus.cc:493] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.323673 31646 raft_consensus.cc:3060] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.336585 31662 leader_election.cc:290] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:57.340035 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b007219e2ff443068a7ec936b0d2a6d1" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:57.341282 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b007219e2ff443068a7ec936b0d2a6d1" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:57.342459 31504 raft_consensus.cc:2393] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:23:57.342571 31644 leader_election.cc:290] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:57.346400 31245 leader_election.cc:304] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:57.349229 31667 raft_consensus.cc:3060] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.367831 31173 catalog_manager.cc:5697] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.374591 31684 consensus_queue.cc:1048] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:57.376085 31667 raft_consensus.cc:2749] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:57.377442 31562 raft_consensus.cc:2749] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:57.378959 31624 leader_election.cc:290] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:57.380347 31662 consensus_queue.cc:1048] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:57.384202 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd68df1877438aaa6dfe1ac64c81e4" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:23:57.388845 31395 leader_election.cc:343] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.388803 31606 consensus_queue.cc:1048] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:57.391119 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd68df1877438aaa6dfe1ac64c81e4" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:57.392045 31351 raft_consensus.cc:2468] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:23:57.391453 31552 tablet_bootstrap.cc:654] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.396106 31505 raft_consensus.cc:2468] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:57.397042 31394 leader_election.cc:304] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:23:57.403692 31556 tablet_bootstrap.cc:654] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.408779 31644 consensus_queue.cc:1048] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:57.421168 31553 tablet_bootstrap.cc:492] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:57.421710 31623 raft_consensus.cc:2804] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:57.422484 31623 raft_consensus.cc:493] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.423018 31623 raft_consensus.cc:3060] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.423112 31553 ts_tablet_manager.cc:1403] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.387s	user 0.013s	sys 0.024s
I20260709 12:23:57.439380 31646 raft_consensus.cc:515] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.455529 31553 raft_consensus.cc:359] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.456561 31553 raft_consensus.cc:385] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.456907 31553 raft_consensus.cc:740] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.460817 31551 tablet_bootstrap.cc:654] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.447762 31355 raft_consensus.cc:2468] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:57.470304 31614 raft_consensus.cc:2749] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:57.471413 31553 consensus_queue.cc:260] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.475468 31646 leader_election.cc:290] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:57.456955 31245 leader_election.cc:304] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:57.488574 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b274862a58d4893959ebf0c52110287" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
W20260709 12:23:57.490396 31318 leader_election.cc:343] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.512272 31692 consensus_queue.cc:1048] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:23:57.519840 31553 ts_tablet_manager.cc:1434] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.001s
I20260709 12:23:57.530004 31701 raft_consensus.cc:2804] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:57.530702 31701 raft_consensus.cc:697] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:23:57.531953 31701 consensus_queue.cc:237] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.532966 31553 tablet_bootstrap.cc:492] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
W20260709 12:23:57.538350 31226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:57.536592 31623 raft_consensus.cc:515] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.549535 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b274862a58d4893959ebf0c52110287" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:57.564576 31429 raft_consensus.cc:3060] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.575205 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd68df1877438aaa6dfe1ac64c81e4" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:57.576050 31353 raft_consensus.cc:3060] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.581171 31623 leader_election.cc:290] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:57.581218 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffd68df1877438aaa6dfe1ac64c81e4" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:57.582094 31504 raft_consensus.cc:3060] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.583232 31553 tablet_bootstrap.cc:654] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.594018 31624 consensus_queue.cc:1048] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:57.597821 31429 raft_consensus.cc:2468] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:57.601504 31353 raft_consensus.cc:2468] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:23:57.603396 31394 leader_election.cc:304] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:57.603683 31551 tablet_bootstrap.cc:492] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:57.604344 31551 ts_tablet_manager.cc:1403] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.293s	user 0.021s	sys 0.024s
I20260709 12:23:57.609939 31504 raft_consensus.cc:2468] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:23:57.615082 31646 consensus_queue.cc:1048] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:57.618809 31623 raft_consensus.cc:2804] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:57.619407 31623 raft_consensus.cc:697] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:23:57.620318 31623 consensus_queue.cc:237] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.629117 31320 leader_election.cc:304] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:57.632596 31552 tablet_bootstrap.cc:492] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:57.633263 31552 ts_tablet_manager.cc:1403] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.385s	user 0.030s	sys 0.023s
I20260709 12:23:57.633692 31551 raft_consensus.cc:359] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.634125 31646 raft_consensus.cc:2804] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:57.634824 31551 raft_consensus.cc:385] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.635283 31551 raft_consensus.cc:740] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.639032 31556 tablet_bootstrap.cc:492] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:57.639711 31556 ts_tablet_manager.cc:1403] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.377s	user 0.016s	sys 0.011s
I20260709 12:23:57.648277 31552 raft_consensus.cc:359] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.649031 31552 raft_consensus.cc:385] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.649303 31552 raft_consensus.cc:740] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.643126 31646 raft_consensus.cc:697] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:23:57.651381 31646 consensus_queue.cc:237] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.656258 31552 consensus_queue.cc:260] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.659538 31552 ts_tablet_manager.cc:1434] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 12:23:57.661384 31556 raft_consensus.cc:359] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.662122 31556 raft_consensus.cc:385] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.662375 31556 raft_consensus.cc:740] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.663043 31556 consensus_queue.cc:260] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.663473 31553 tablet_bootstrap.cc:492] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:57.663971 31553 ts_tablet_manager.cc:1403] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.009s
I20260709 12:23:57.655311 31551 consensus_queue.cc:260] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.668954 31551 ts_tablet_manager.cc:1434] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.002s
I20260709 12:23:57.669271 31553 raft_consensus.cc:359] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.670056 31553 raft_consensus.cc:385] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.670275 31551 tablet_bootstrap.cc:492] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:57.670331 31553 raft_consensus.cc:740] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.674389 31553 consensus_queue.cc:260] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.679847 31627 consensus_queue.cc:1048] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:57.680258 31553 ts_tablet_manager.cc:1434] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:57.681476 31553 tablet_bootstrap.cc:492] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:57.683988 31551 tablet_bootstrap.cc:654] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.696897 31552 tablet_bootstrap.cc:492] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:57.694299 31627 raft_consensus.cc:493] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.699662 31627 raft_consensus.cc:515] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.702343 31556 ts_tablet_manager.cc:1434] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:23:57.703549 31556 tablet_bootstrap.cc:492] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:57.721010 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5a82bfbaf425ba4873d0f0e3e776c" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:57.716863 31644 raft_consensus.cc:493] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.728972 31644 raft_consensus.cc:515] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.731949 31644 leader_election.cc:290] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:57.733541 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:23:57.735107 31395 leader_election.cc:343] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:57.735260 31320 leader_election.cc:343] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.735368 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
W20260709 12:23:57.737124 31318 leader_election.cc:343] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.738282 31318 leader_election.cc:304] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:57.740259 31627 leader_election.cc:290] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:57.737515 31173 catalog_manager.cc:5697] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.741480 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5a82bfbaf425ba4873d0f0e3e776c" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:57.744120 31553 tablet_bootstrap.cc:654] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.744887 31556 tablet_bootstrap.cc:654] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.746917 31646 raft_consensus.cc:2749] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:57.749486 31393 leader_election.cc:343] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.749958 31393 leader_election.cc:304] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:57.750689 31627 raft_consensus.cc:2749] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:57.751261 31552 tablet_bootstrap.cc:654] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.757906 31551 tablet_bootstrap.cc:492] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:57.758361 31551 ts_tablet_manager.cc:1403] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.012s
I20260709 12:23:57.761164 31551 raft_consensus.cc:359] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.761842 31551 raft_consensus.cc:385] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.762174 31551 raft_consensus.cc:740] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.763025 31551 consensus_queue.cc:260] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.765000 31551 ts_tablet_manager.cc:1434] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:57.765715 31551 tablet_bootstrap.cc:492] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:57.771281 31551 tablet_bootstrap.cc:654] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:57.776548 31718 log.cc:927] Time spent T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Append to log took a long time: real 0.088s	user 0.004s	sys 0.000s
I20260709 12:23:57.783356 31177 catalog_manager.cc:5697] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.783614 31175 catalog_manager.cc:5697] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.785243 31551 tablet_bootstrap.cc:492] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:57.785774 31551 ts_tablet_manager.cc:1403] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:23:57.788697 31551 raft_consensus.cc:359] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.789326 31551 raft_consensus.cc:385] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.789589 31551 raft_consensus.cc:740] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.790840 31699 raft_consensus.cc:493] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.791378 31699 raft_consensus.cc:515] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.795145 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caafdbf4faa4bdeb26c29a5454a5f94" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:57.795852 31505 raft_consensus.cc:2468] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:57.796821 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caafdbf4faa4bdeb26c29a5454a5f94" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:57.797492 31351 raft_consensus.cc:2468] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:57.799271 31244 leader_election.cc:304] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:57.800900 31701 raft_consensus.cc:2804] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:57.801306 31701 raft_consensus.cc:493] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.804004 31553 tablet_bootstrap.cc:492] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:57.801656 31701 raft_consensus.cc:3060] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.804557 31553 ts_tablet_manager.cc:1403] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.123s	user 0.020s	sys 0.004s
I20260709 12:23:57.793697 31699 leader_election.cc:290] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:57.807425 31552 tablet_bootstrap.cc:492] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:57.808444 31552 ts_tablet_manager.cc:1403] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.009s
I20260709 12:23:57.790565 31551 consensus_queue.cc:260] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.807575 31553 raft_consensus.cc:359] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.809517 31556 tablet_bootstrap.cc:492] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:57.811369 31556 ts_tablet_manager.cc:1403] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.014s
I20260709 12:23:57.811664 31552 raft_consensus.cc:359] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.812424 31552 raft_consensus.cc:385] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.812731 31552 raft_consensus.cc:740] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.813609 31552 consensus_queue.cc:260] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.814323 31551 ts_tablet_manager.cc:1434] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:23:57.814245 31556 raft_consensus.cc:359] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.815068 31556 raft_consensus.cc:385] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.815371 31556 raft_consensus.cc:740] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.815524 31551 tablet_bootstrap.cc:492] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:57.816033 31553 raft_consensus.cc:385] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.816435 31552 ts_tablet_manager.cc:1434] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:57.816386 31553 raft_consensus.cc:740] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.817662 31552 tablet_bootstrap.cc:492] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:57.817662 31553 consensus_queue.cc:260] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.824070 31552 tablet_bootstrap.cc:654] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.830901 31551 tablet_bootstrap.cc:654] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.835397 31701 raft_consensus.cc:515] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.835232 31556 consensus_queue.cc:260] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.837324 31553 ts_tablet_manager.cc:1434] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 12:23:57.838673 31553 tablet_bootstrap.cc:492] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:57.838784 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caafdbf4faa4bdeb26c29a5454a5f94" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:57.839534 31505 raft_consensus.cc:3060] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.842993 31556 ts_tablet_manager.cc:1434] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:23:57.844316 31556 tablet_bootstrap.cc:492] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:57.846253 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caafdbf4faa4bdeb26c29a5454a5f94" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:57.846864 31351 raft_consensus.cc:3060] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.856077 31552 tablet_bootstrap.cc:492] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:57.856673 31552 ts_tablet_manager.cc:1403] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.014s
I20260709 12:23:57.837635 31701 leader_election.cc:290] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:57.859026 31556 tablet_bootstrap.cc:654] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.859856 31552 raft_consensus.cc:359] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.860668 31552 raft_consensus.cc:385] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.861001 31552 raft_consensus.cc:740] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.861822 31552 consensus_queue.cc:260] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.862423 31505 raft_consensus.cc:2468] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:57.863734 31245 leader_election.cc:304] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:57.861073 31553 tablet_bootstrap.cc:654] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.866086 31552 ts_tablet_manager.cc:1434] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:57.868258 31552 tablet_bootstrap.cc:492] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:57.868993 31701 raft_consensus.cc:2804] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:57.869532 31701 raft_consensus.cc:697] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:23:57.870409 31701 consensus_queue.cc:237] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.876452 31552 tablet_bootstrap.cc:654] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.887392 31551 tablet_bootstrap.cc:492] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:57.887745 31553 tablet_bootstrap.cc:492] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:57.887848 31551 ts_tablet_manager.cc:1403] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.000s
I20260709 12:23:57.890473 31556 tablet_bootstrap.cc:492] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:57.888437 31553 ts_tablet_manager.cc:1403] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.011s
I20260709 12:23:57.888751 31552 tablet_bootstrap.cc:492] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:57.891505 31552 ts_tablet_manager.cc:1403] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.011s
I20260709 12:23:57.892604 31551 raft_consensus.cc:359] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.893364 31551 raft_consensus.cc:385] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.893643 31551 raft_consensus.cc:740] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.889387 31351 raft_consensus.cc:2468] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:57.890959 31556 ts_tablet_manager.cc:1403] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.004s
I20260709 12:23:57.895145 31552 raft_consensus.cc:359] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.894241 31553 raft_consensus.cc:359] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.895835 31552 raft_consensus.cc:385] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.896014 31553 raft_consensus.cc:385] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.896150 31552 raft_consensus.cc:740] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.896329 31553 raft_consensus.cc:740] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.897087 31553 consensus_queue.cc:260] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.897426 31175 catalog_manager.cc:5697] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.899858 31552 consensus_queue.cc:260] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.899299 31553 ts_tablet_manager.cc:1434] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:57.901526 31553 tablet_bootstrap.cc:492] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:57.903653 31646 raft_consensus.cc:493] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.904174 31646 raft_consensus.cc:515] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.906301 31646 leader_election.cc:290] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:57.908921 31553 tablet_bootstrap.cc:654] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.909709 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36bf368739149e1a96b5f15cbc86e6c" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:57.911093 31556 raft_consensus.cc:359] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:57.911864 31556 raft_consensus.cc:385] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.912200 31556 raft_consensus.cc:740] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.913041 31556 consensus_queue.cc:260] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
W20260709 12:23:57.917132 31320 leader_election.cc:343] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.918265 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36bf368739149e1a96b5f15cbc86e6c" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:23:57.919581 31320 leader_election.cc:343] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.920048 31320 leader_election.cc:304] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:57.921181 31646 raft_consensus.cc:2749] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:57.921475 31552 ts_tablet_manager.cc:1434] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 12:23:57.894397 31551 consensus_queue.cc:260] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.926906 31551 ts_tablet_manager.cc:1434] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:23:57.928721 31551 tablet_bootstrap.cc:492] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:57.934878 31551 tablet_bootstrap.cc:654] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.929103 31552 tablet_bootstrap.cc:492] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:57.942425 31553 tablet_bootstrap.cc:492] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:57.942485 31556 ts_tablet_manager.cc:1434] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:23:57.943121 31553 ts_tablet_manager.cc:1403] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.013s
I20260709 12:23:57.943190 31552 tablet_bootstrap.cc:654] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.946355 31553 raft_consensus.cc:359] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.947314 31553 raft_consensus.cc:385] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.947662 31553 raft_consensus.cc:740] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.948220 31556 tablet_bootstrap.cc:492] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:57.948608 31553 consensus_queue.cc:260] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.956166 31556 tablet_bootstrap.cc:654] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.959373 31551 tablet_bootstrap.cc:492] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:57.959558 31553 ts_tablet_manager.cc:1434] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:23:57.959931 31551 ts_tablet_manager.cc:1403] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.003s
I20260709 12:23:57.960798 31553 tablet_bootstrap.cc:492] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:57.963636 31551 raft_consensus.cc:359] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.964548 31551 raft_consensus.cc:385] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.964887 31551 raft_consensus.cc:740] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.965723 31551 consensus_queue.cc:260] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.966774 31553 tablet_bootstrap.cc:654] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.968657 31552 tablet_bootstrap.cc:492] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:57.968724 31556 tablet_bootstrap.cc:492] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:57.969271 31552 ts_tablet_manager.cc:1403] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.004s
I20260709 12:23:57.969367 31556 ts_tablet_manager.cc:1403] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 12:23:57.972313 31551 ts_tablet_manager.cc:1434] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:23:57.972239 31552 raft_consensus.cc:359] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.973038 31552 raft_consensus.cc:385] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.973326 31552 raft_consensus.cc:740] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.974175 31552 consensus_queue.cc:260] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:57.977063 31646 raft_consensus.cc:493] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.977142 31551 tablet_bootstrap.cc:492] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:57.977550 31646 raft_consensus.cc:515] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:57.984123 31699 raft_consensus.cc:493] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.984666 31699 raft_consensus.cc:515] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:57.985275 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96465747d074cce91dcec123d153e68" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:57.985987 31278 raft_consensus.cc:2468] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:57.986253 31551 tablet_bootstrap.cc:654] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.986815 31699 leader_election.cc:290] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:57.987421 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96465747d074cce91dcec123d153e68" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
W20260709 12:23:57.988900 31320 leader_election.cc:343] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:57.989547 31318 leader_election.cc:304] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:57.989827 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5a82bfbaf425ba4873d0f0e3e776c" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:57.990536 31644 raft_consensus.cc:2804] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:57.990917 31644 raft_consensus.cc:493] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.990971 31505 raft_consensus.cc:2468] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:57.991360 31644 raft_consensus.cc:3060] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.992321 31245 leader_election.cc:304] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:57.993649 31699 raft_consensus.cc:2804] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:57.994066 31699 raft_consensus.cc:493] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.994445 31699 raft_consensus.cc:3060] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.994525 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5a82bfbaf425ba4873d0f0e3e776c" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:57.995194 31429 raft_consensus.cc:2468] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:57.996407 31646 leader_election.cc:290] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:58.002509 31552 ts_tablet_manager.cc:1434] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 12:23:57.999476 31551 tablet_bootstrap.cc:492] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:58.006729 31551 ts_tablet_manager.cc:1403] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.011s
I20260709 12:23:58.009313 31556 raft_consensus.cc:359] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.010275 31556 raft_consensus.cc:385] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.010142 31699 raft_consensus.cc:515] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.010632 31556 raft_consensus.cc:740] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.011525 31556 consensus_queue.cc:260] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.012934 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5a82bfbaf425ba4873d0f0e3e776c" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:58.013746 31429 raft_consensus.cc:3060] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.013947 31556 ts_tablet_manager.cc:1434] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:23:58.015492 31556 tablet_bootstrap.cc:492] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:58.009790 31552 tablet_bootstrap.cc:492] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:58.007782 31644 raft_consensus.cc:515] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.018865 31644 leader_election.cc:290] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:58.019228 31701 consensus_queue.cc:1048] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:58.020881 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96465747d074cce91dcec123d153e68" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
W20260709 12:23:58.022470 31320 leader_election.cc:343] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.023785 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96465747d074cce91dcec123d153e68" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:58.024372 31278 raft_consensus.cc:3060] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.025352 31429 raft_consensus.cc:2468] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:58.026520 31551 raft_consensus.cc:359] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.027271 31551 raft_consensus.cc:385] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.026569 31245 leader_election.cc:304] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:58.027913 31701 raft_consensus.cc:2804] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.028396 31701 raft_consensus.cc:697] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:23:58.029248 31701 consensus_queue.cc:237] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.033156 31551 raft_consensus.cc:740] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.033952 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5a82bfbaf425ba4873d0f0e3e776c" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:58.034619 31505 raft_consensus.cc:3060] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.034780 31551 consensus_queue.cc:260] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.036439 31551 ts_tablet_manager.cc:1434] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.029s	user 0.001s	sys 0.004s
I20260709 12:23:58.037447 31551 tablet_bootstrap.cc:492] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:58.038751 31606 raft_consensus.cc:493] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.039289 31606 raft_consensus.cc:515] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.041502 31606 leader_election.cc:290] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:58.040490 31174 catalog_manager.cc:5697] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.042388 31505 raft_consensus.cc:2468] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:58.043736 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f26d3890ccd46ddb1160ee1529963a0" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:58.044381 31279 raft_consensus.cc:2468] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:58.046042 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f26d3890ccd46ddb1160ee1529963a0" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:58.047324 31551 tablet_bootstrap.cc:654] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.047605 31468 leader_election.cc:304] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:58.048475 31606 raft_consensus.cc:2804] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.048894 31606 raft_consensus.cc:493] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.049218 31606 raft_consensus.cc:3060] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.050621 31699 leader_election.cc:290] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:58.052712 31278 raft_consensus.cc:2468] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:58.046767 31429 raft_consensus.cc:2468] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:58.054765 31318 leader_election.cc:304] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:58.058743 31644 raft_consensus.cc:2804] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.059250 31644 raft_consensus.cc:697] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:23:58.061107 31553 tablet_bootstrap.cc:492] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:58.060087 31644 consensus_queue.cc:237] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.061789 31553 ts_tablet_manager.cc:1403] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.101s	user 0.026s	sys 0.015s
I20260709 12:23:58.076766 31552 tablet_bootstrap.cc:654] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.079000 31553 raft_consensus.cc:359] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.079730 31553 raft_consensus.cc:385] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.080003 31553 raft_consensus.cc:740] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.082110 31553 consensus_queue.cc:260] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.082525 31556 tablet_bootstrap.cc:654] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.087026 31553 ts_tablet_manager.cc:1434] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 12:23:58.088186 31553 tablet_bootstrap.cc:492] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:58.096957 31551 tablet_bootstrap.cc:492] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:58.109232 31551 ts_tablet_manager.cc:1403] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.011s
I20260709 12:23:58.110956 31658 raft_consensus.cc:493] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.115195 31658 raft_consensus.cc:515] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.117522 31658 leader_election.cc:290] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:58.119037 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf6f2d6abcf4a32b80ba9e8c4ed0905" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:58.119799 31354 raft_consensus.cc:2468] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:58.121057 31469 leader_election.cc:304] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:58.121712 31606 raft_consensus.cc:515] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.122008 31658 raft_consensus.cc:2804] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.121848 31627 consensus_queue.cc:1048] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:58.122645 31658 raft_consensus.cc:493] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.123046 31658 raft_consensus.cc:3060] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.124078 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf6f2d6abcf4a32b80ba9e8c4ed0905" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:58.126304 31429 raft_consensus.cc:2468] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:58.126940 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f26d3890ccd46ddb1160ee1529963a0" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:58.127589 31430 raft_consensus.cc:3060] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.130300 31553 tablet_bootstrap.cc:654] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.136775 31552 tablet_bootstrap.cc:492] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:58.137452 31552 ts_tablet_manager.cc:1403] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.128s	user 0.017s	sys 0.003s
I20260709 12:23:58.140208 31701 consensus_queue.cc:1048] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:58.140497 31551 raft_consensus.cc:359] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.141208 31551 raft_consensus.cc:385] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.141484 31551 raft_consensus.cc:740] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.135842 31430 raft_consensus.cc:2468] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:23:58.142130 31551 consensus_queue.cc:260] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.144549 31551 ts_tablet_manager.cc:1434] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.003s
I20260709 12:23:58.145375 31556 tablet_bootstrap.cc:492] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:58.146412 31556 ts_tablet_manager.cc:1403] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.131s	user 0.018s	sys 0.002s
I20260709 12:23:58.149127 31606 leader_election.cc:290] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:58.150092 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f26d3890ccd46ddb1160ee1529963a0" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:58.153434 31278 raft_consensus.cc:3060] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.154109 31552 raft_consensus.cc:359] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.154690 31627 consensus_queue.cc:1048] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:58.155159 31552 raft_consensus.cc:385] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.154493 31177 catalog_manager.cc:5697] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.155951 31556 raft_consensus.cc:359] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.158066 31556 raft_consensus.cc:385] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.158378 31556 raft_consensus.cc:740] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.155822 31552 raft_consensus.cc:740] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.163966 31552 consensus_queue.cc:260] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.167405 31552 ts_tablet_manager.cc:1434] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:23:58.168823 31552 tablet_bootstrap.cc:492] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:58.170087 31667 raft_consensus.cc:493] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.170435 31551 tablet_bootstrap.cc:492] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:58.170697 31667 raft_consensus.cc:515] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.172907 31667 leader_election.cc:290] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:58.174641 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b274862a58d4893959ebf0c52110287" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:58.175484 31430 raft_consensus.cc:2393] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate 998cd06c0be349879a0602496bc33640 in this term.
I20260709 12:23:58.176144 31552 tablet_bootstrap.cc:654] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.160015 31556 consensus_queue.cc:260] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.162113 31470 leader_election.cc:304] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:58.178079 31556 ts_tablet_manager.cc:1434] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:23:58.179154 31556 tablet_bootstrap.cc:492] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:58.145596 31658 raft_consensus.cc:515] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.185932 31553 tablet_bootstrap.cc:492] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:58.186465 31553 ts_tablet_manager.cc:1403] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.010s
I20260709 12:23:58.192674 31279 raft_consensus.cc:3060] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.193430 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf6f2d6abcf4a32b80ba9e8c4ed0905" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:58.194132 31353 raft_consensus.cc:3060] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.195128 31278 raft_consensus.cc:2468] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:23:58.199434 31355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b274862a58d4893959ebf0c52110287" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:58.201504 31244 leader_election.cc:304] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:58.205488 31658 leader_election.cc:290] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:58.205338 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf6f2d6abcf4a32b80ba9e8c4ed0905" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:58.206995 31430 raft_consensus.cc:3060] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.186767 31606 raft_consensus.cc:2804] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.220597 31701 raft_consensus.cc:2749] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:58.221926 31430 raft_consensus.cc:2468] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:23:58.224229 31606 raft_consensus.cc:697] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:23:58.224153 31470 leader_election.cc:304] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:58.224514 31644 consensus_queue.cc:1048] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:58.225343 31606 consensus_queue.cc:237] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.234509 31749 raft_consensus.cc:2804] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.235181 31749 raft_consensus.cc:697] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:23:58.236085 31749 consensus_queue.cc:237] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.238807 31553 raft_consensus.cc:359] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.240901 31553 raft_consensus.cc:385] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.241235 31553 raft_consensus.cc:740] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.219347 31353 raft_consensus.cc:2468] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:23:58.249287 31556 tablet_bootstrap.cc:654] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.259958 31553 consensus_queue.cc:260] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.262123 31553 ts_tablet_manager.cc:1434] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 12:23:58.262534 31551 tablet_bootstrap.cc:654] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.263266 31553 tablet_bootstrap.cc:492] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:58.268918 31701 raft_consensus.cc:493] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.285550 31552 tablet_bootstrap.cc:492] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
W20260709 12:23:58.284133 31470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.67:45167, user_credentials={real_user=slave}} blocked reactor thread for 60359.5us
I20260709 12:23:58.286736 31552 ts_tablet_manager.cc:1403] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.118s	user 0.016s	sys 0.007s
I20260709 12:23:58.269738 31701 raft_consensus.cc:515] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.293490 31701 leader_election.cc:290] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:58.294232 31646 consensus_queue.cc:1048] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:58.300012 31553 tablet_bootstrap.cc:654] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.306615 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1cb5c621c6466c9692be5c82cd786f" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
W20260709 12:23:58.308326 31245 leader_election.cc:343] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.308841 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1cb5c621c6466c9692be5c82cd786f" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:58.311480 31551 tablet_bootstrap.cc:492] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:58.312029 31551 ts_tablet_manager.cc:1403] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.142s	user 0.019s	sys 0.007s
I20260709 12:23:58.312316 31552 raft_consensus.cc:359] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.313017 31552 raft_consensus.cc:385] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.313297 31552 raft_consensus.cc:740] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.314982 31552 consensus_queue.cc:260] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.318307 31552 ts_tablet_manager.cc:1434] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.004s
I20260709 12:23:58.319361 31552 tablet_bootstrap.cc:492] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:58.320154 31556 tablet_bootstrap.cc:492] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:58.320695 31556 ts_tablet_manager.cc:1403] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.008s
I20260709 12:23:58.321733 31353 raft_consensus.cc:2468] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:58.324469 31244 leader_election.cc:304] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:58.326268 31701 raft_consensus.cc:2804] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.326699 31701 raft_consensus.cc:493] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.326388 31551 raft_consensus.cc:359] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.327121 31701 raft_consensus.cc:3060] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.327353 31551 raft_consensus.cc:385] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.327790 31551 raft_consensus.cc:740] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.328572 31551 consensus_queue.cc:260] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.330816 31551 ts_tablet_manager.cc:1434] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:23:58.333209 31551 tablet_bootstrap.cc:492] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:58.339287 31551 tablet_bootstrap.cc:654] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.331734 31556 raft_consensus.cc:359] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.339695 31556 raft_consensus.cc:385] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.339972 31556 raft_consensus.cc:740] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.340673 31556 consensus_queue.cc:260] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.342811 31556 ts_tablet_manager.cc:1434] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:23:58.344048 31556 tablet_bootstrap.cc:492] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:58.344098 31701 raft_consensus.cc:515] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.346473 31553 tablet_bootstrap.cc:492] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:58.346975 31553 ts_tablet_manager.cc:1403] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.002s
I20260709 12:23:58.347141 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1cb5c621c6466c9692be5c82cd786f" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:58.347750 31353 raft_consensus.cc:3060] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.351014 31556 tablet_bootstrap.cc:654] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.356170 31644 raft_consensus.cc:493] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.356705 31644 raft_consensus.cc:515] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.358352 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1cb5c621c6466c9692be5c82cd786f" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:58.359874 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8345833c0f34e96af79e53d5eb8fbc0" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:58.360210 31644 leader_election.cc:290] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:58.360551 31279 raft_consensus.cc:2468] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:58.361809 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8345833c0f34e96af79e53d5eb8fbc0" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:58.358963 31429 raft_consensus.cc:3060] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.361860 31318 leader_election.cc:304] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
W20260709 12:23:58.363931 31320 leader_election.cc:343] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.364842 31644 raft_consensus.cc:2804] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.365232 31644 raft_consensus.cc:493] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.365435 31551 tablet_bootstrap.cc:492] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:58.365579 31644 raft_consensus.cc:3060] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.366233 31551 ts_tablet_manager.cc:1403] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 12:23:58.369048 31551 raft_consensus.cc:359] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.369858 31551 raft_consensus.cc:385] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.370231 31551 raft_consensus.cc:740] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.371411 31551 consensus_queue.cc:260] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.374091 31429 raft_consensus.cc:2468] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:58.375203 31245 leader_election.cc:304] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:58.376122 31667 raft_consensus.cc:2804] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.355710 31353 raft_consensus.cc:2468] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:58.376590 31667 raft_consensus.cc:697] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:23:58.377995 31701 leader_election.cc:290] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:58.377687 31667 consensus_queue.cc:237] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.381462 31644 raft_consensus.cc:515] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.376493 31174 catalog_manager.cc:5697] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.383864 31174 catalog_manager.cc:5697] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.372367 31553 raft_consensus.cc:359] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.386605 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8345833c0f34e96af79e53d5eb8fbc0" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:58.386639 31553 raft_consensus.cc:385] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.387267 31279 raft_consensus.cc:3060] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.384606 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8345833c0f34e96af79e53d5eb8fbc0" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:58.387516 31553 raft_consensus.cc:740] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.388671 31551 ts_tablet_manager.cc:1434] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
W20260709 12:23:58.389093 31320 leader_election.cc:343] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.388813 31553 consensus_queue.cc:260] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.389773 31551 tablet_bootstrap.cc:492] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:58.376714 31552 tablet_bootstrap.cc:654] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.393911 31553 ts_tablet_manager.cc:1434] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 12:23:58.394140 31556 tablet_bootstrap.cc:492] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:58.394680 31556 ts_tablet_manager.cc:1403] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.005s
I20260709 12:23:58.395588 31701 consensus_queue.cc:1048] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:58.401242 31556 raft_consensus.cc:359] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.401948 31556 raft_consensus.cc:385] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.402220 31556 raft_consensus.cc:740] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.402884 31556 consensus_queue.cc:260] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.404381 31556 ts_tablet_manager.cc:1434] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:23:58.405404 31279 raft_consensus.cc:2468] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:58.406055 31644 leader_election.cc:290] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:58.395622 31553 tablet_bootstrap.cc:492] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:58.408457 31318 leader_election.cc:304] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:23:58.410317 31644 raft_consensus.cc:2804] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.411684 31644 raft_consensus.cc:697] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:23:58.412587 31644 consensus_queue.cc:237] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.414330 31556 tablet_bootstrap.cc:492] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:58.414523 31553 tablet_bootstrap.cc:654] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.422405 31556 tablet_bootstrap.cc:654] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.424765 31551 tablet_bootstrap.cc:654] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.426575 31606 raft_consensus.cc:493] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.427289 31606 raft_consensus.cc:515] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.434830 31614 raft_consensus.cc:493] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.435534 31614 raft_consensus.cc:515] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.438683 31699 consensus_queue.cc:1048] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:58.442835 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36bf368739149e1a96b5f15cbc86e6c" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:58.443411 31701 raft_consensus.cc:493] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.443849 31353 raft_consensus.cc:2468] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:58.444240 31701 raft_consensus.cc:515] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.445703 31469 leader_election.cc:304] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:58.446907 31753 raft_consensus.cc:2804] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.447388 31753 raft_consensus.cc:493] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.447783 31753 raft_consensus.cc:3060] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.455039 31701 leader_election.cc:290] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:58.458451 31749 raft_consensus.cc:493] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.458986 31749 raft_consensus.cc:515] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.460096 31614 leader_election.cc:290] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:58.461144 31749 leader_election.cc:290] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:58.462139 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033329b2f3e348ccac62b6620f611a8b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:58.462814 31503 raft_consensus.cc:2468] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:58.462889 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca14ac33e4d47d5959bcf7eb1e84e70" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:58.462821 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033329b2f3e348ccac62b6620f611a8b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:58.463876 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033329b2f3e348ccac62b6620f611a8b" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:58.464246 31429 raft_consensus.cc:2468] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
W20260709 12:23:58.464753 31245 leader_election.cc:343] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.465435 31320 leader_election.cc:304] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:58.466365 31646 consensus_queue.cc:1048] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:58.467810 31646 raft_consensus.cc:2804] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.468158 31646 raft_consensus.cc:493] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.468535 31646 raft_consensus.cc:3060] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.470867 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033329b2f3e348ccac62b6620f611a8b" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:58.463001 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca14ac33e4d47d5959bcf7eb1e84e70" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:58.472775 31606 leader_election.cc:290] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:58.472932 31552 tablet_bootstrap.cc:492] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:58.473603 31552 ts_tablet_manager.cc:1403] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.155s	user 0.003s	sys 0.011s
I20260709 12:23:58.474373 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36bf368739149e1a96b5f15cbc86e6c" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:58.475039 31430 raft_consensus.cc:2468] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:58.477710 31552 raft_consensus.cc:359] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.481994 31552 raft_consensus.cc:385] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:58.482300 31245 leader_election.cc:343] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.483021 31245 leader_election.cc:304] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:58.482353 31552 raft_consensus.cc:740] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.486714 31701 raft_consensus.cc:2749] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:58.488955 31623 raft_consensus.cc:493] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.486466 31552 consensus_queue.cc:260] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.489464 31623 raft_consensus.cc:515] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.493072 31552 ts_tablet_manager.cc:1434] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:23:58.500231 31552 tablet_bootstrap.cc:492] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:58.495230 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96465747d074cce91dcec123d153e68" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:58.500339 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96465747d074cce91dcec123d153e68" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:58.494280 31623 leader_election.cc:290] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:58.495219 31646 raft_consensus.cc:515] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.505795 31753 raft_consensus.cc:515] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.510197 31701 raft_consensus.cc:493] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.516040 31701 raft_consensus.cc:515] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.518280 31556 tablet_bootstrap.cc:492] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:58.518824 31556 ts_tablet_manager.cc:1403] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.037s
I20260709 12:23:58.519856 31394 leader_election.cc:304] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:23:58.520767 31623 raft_consensus.cc:2749] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:58.522022 31556 raft_consensus.cc:359] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.522722 31556 raft_consensus.cc:385] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.522972 31556 raft_consensus.cc:740] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.523731 31556 consensus_queue.cc:260] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.524710 31354 raft_consensus.cc:2393] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate 998cd06c0be349879a0602496bc33640 in this term.
I20260709 12:23:58.526875 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033329b2f3e348ccac62b6620f611a8b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:58.520749 31552 tablet_bootstrap.cc:654] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.528273 31429 raft_consensus.cc:3060] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.531076 31551 tablet_bootstrap.cc:492] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:58.531582 31551 ts_tablet_manager.cc:1403] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.142s	user 0.029s	sys 0.018s
I20260709 12:23:58.531729 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033329b2f3e348ccac62b6620f611a8b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:58.532478 31505 raft_consensus.cc:3060] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.534315 31551 raft_consensus.cc:359] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.535018 31551 raft_consensus.cc:385] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.535274 31551 raft_consensus.cc:740] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.535995 31753 leader_election.cc:290] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:58.536062 31551 consensus_queue.cc:260] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.537962 31469 leader_election.cc:304] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:58.538595 31551 ts_tablet_manager.cc:1434] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:23:58.539029 31553 tablet_bootstrap.cc:492] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:58.539537 31553 ts_tablet_manager.cc:1403] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.144s	user 0.034s	sys 0.023s
I20260709 12:23:58.539688 31551 tablet_bootstrap.cc:492] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:58.542346 31553 raft_consensus.cc:359] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.542737 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36bf368739149e1a96b5f15cbc86e6c" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:58.543025 31553 raft_consensus.cc:385] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.543320 31553 raft_consensus.cc:740] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.544173 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36bf368739149e1a96b5f15cbc86e6c" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:58.544291 31553 consensus_queue.cc:260] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.544842 31354 raft_consensus.cc:3060] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.544987 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:58.546362 31551 tablet_bootstrap.cc:654] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.546664 31701 leader_election.cc:290] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:58.547027 31553 ts_tablet_manager.cc:1434] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:58.545703 31503 raft_consensus.cc:2468] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:58.548146 31245 leader_election.cc:304] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:58.548625 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:58.549479 31351 raft_consensus.cc:2468] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:58.550570 31556 ts_tablet_manager.cc:1434] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:23:58.551700 31553 tablet_bootstrap.cc:492] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:58.551762 31556 tablet_bootstrap.cc:492] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:58.543365 31430 raft_consensus.cc:3060] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.524220 31646 leader_election.cc:290] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:58.563275 31556 tablet_bootstrap.cc:654] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.562656 31701 raft_consensus.cc:2804] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.580065 31553 tablet_bootstrap.cc:654] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.580201 31701 raft_consensus.cc:493] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.581015 31701 raft_consensus.cc:3060] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.597388 31177 catalog_manager.cc:5697] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.605581 31551 tablet_bootstrap.cc:492] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:58.606189 31551 ts_tablet_manager.cc:1403] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.009s
I20260709 12:23:58.608709 31428 raft_consensus.cc:3060] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.610263 31429 raft_consensus.cc:2468] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:58.609963 31174 catalog_manager.cc:5697] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.611653 31320 leader_election.cc:304] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:58.612524 31646 raft_consensus.cc:2804] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.613059 31646 raft_consensus.cc:697] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:23:58.613924 31646 consensus_queue.cc:237] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.634811 31778 consensus_queue.cc:1048] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:58.637822 31553 tablet_bootstrap.cc:492] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:58.638489 31553 ts_tablet_manager.cc:1403] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.007s
I20260709 12:23:58.641598 31553 raft_consensus.cc:359] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.642527 31553 raft_consensus.cc:385] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.642874 31553 raft_consensus.cc:740] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.645303 31553 consensus_queue.cc:260] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.651865 31552 tablet_bootstrap.cc:492] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:58.652328 31552 ts_tablet_manager.cc:1403] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.152s	user 0.009s	sys 0.010s
I20260709 12:23:58.654896 31553 ts_tablet_manager.cc:1434] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 12:23:58.656008 31553 tablet_bootstrap.cc:492] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:58.656699 31701 raft_consensus.cc:515] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.661902 31553 tablet_bootstrap.cc:654] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.653139 31699 consensus_queue.cc:1048] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:23:58.664546 31551 raft_consensus.cc:359] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.665207 31551 raft_consensus.cc:385] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.665458 31551 raft_consensus.cc:740] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.668319 31701 leader_election.cc:290] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:58.668460 31667 consensus_queue.cc:1048] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:58.669057 31552 raft_consensus.cc:359] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.669903 31552 raft_consensus.cc:385] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.670238 31552 raft_consensus.cc:740] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.670416 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:58.673652 31503 raft_consensus.cc:3060] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.673766 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:58.674412 31351 raft_consensus.cc:3060] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.677037 31430 raft_consensus.cc:2468] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:23:58.682392 31470 leader_election.cc:304] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:58.670727 31551 consensus_queue.cc:260] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.671487 31354 raft_consensus.cc:2468] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:23:58.683475 31753 raft_consensus.cc:2804] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.684051 31753 raft_consensus.cc:697] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:23:58.683528 31503 raft_consensus.cc:2468] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:58.684890 31753 consensus_queue.cc:237] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:58.685961 31351 raft_consensus.cc:2468] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:58.686264 31245 leader_election.cc:304] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:58.687188 31667 raft_consensus.cc:2804] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.687633 31551 ts_tablet_manager.cc:1434] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
I20260709 12:23:58.687773 31667 raft_consensus.cc:697] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:23:58.688803 31551 tablet_bootstrap.cc:492] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:58.689141 31667 consensus_queue.cc:237] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.692772 31505 raft_consensus.cc:2468] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:58.693403 31749 raft_consensus.cc:2749] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:58.673380 31552 consensus_queue.cc:260] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.707007 31552 ts_tablet_manager.cc:1434] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 12:23:58.702137 31606 consensus_queue.cc:1048] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:23:58.712898 31556 tablet_bootstrap.cc:492] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
W20260709 12:23:58.711875 31226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:58.714653 31556 ts_tablet_manager.cc:1403] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.163s	user 0.017s	sys 0.002s
I20260709 12:23:58.725613 31606 raft_consensus.cc:493] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.726502 31606 raft_consensus.cc:515] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.756948 31552 tablet_bootstrap.cc:492] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:58.737766 31627 raft_consensus.cc:493] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.762586 31627 raft_consensus.cc:515] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.738920 31749 consensus_queue.cc:1048] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 12:23:58.809744 31556 raft_consensus.cc:359] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.811060 31556 raft_consensus.cc:385] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.811460 31556 raft_consensus.cc:740] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.812484 31556 consensus_queue.cc:260] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.816370 31556 ts_tablet_manager.cc:1434] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.101s	user 0.015s	sys 0.006s
I20260709 12:23:58.818037 31556 tablet_bootstrap.cc:492] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:58.831192 31627 leader_election.cc:290] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:58.831492 31551 tablet_bootstrap.cc:654] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.833074 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:58.843950 31553 tablet_bootstrap.cc:492] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:58.844532 31553 ts_tablet_manager.cc:1403] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.189s	user 0.025s	sys 0.012s
I20260709 12:23:58.846323 31606 leader_election.cc:290] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:23:58.822909 31394 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:40387, user_credentials={real_user=slave}} blocked reactor thread for 55216.5us
I20260709 12:23:58.855577 31553 raft_consensus.cc:359] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.856487 31553 raft_consensus.cc:385] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.856786 31553 raft_consensus.cc:740] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.857956 31606 consensus_queue.cc:1048] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:58.859026 31777 consensus_queue.cc:1048] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:58.845825 31393 leader_election.cc:343] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.862679 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:23:58.867311 31395 leader_election.cc:343] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.867859 31395 leader_election.cc:304] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:58.869307 31606 consensus_queue.cc:1048] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:58.873317 31553 consensus_queue.cc:260] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:58.874948 31623 raft_consensus.cc:2749] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:58.878335 31553 ts_tablet_manager.cc:1434] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:23:58.879640 31553 tablet_bootstrap.cc:492] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:58.879432 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca14ac33e4d47d5959bcf7eb1e84e70" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:58.880298 31279 raft_consensus.cc:2468] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:58.882735 31699 consensus_queue.cc:1048] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:58.886025 31468 leader_election.cc:304] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:58.887040 31785 raft_consensus.cc:2804] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.887413 31785 raft_consensus.cc:493] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.887760 31785 raft_consensus.cc:3060] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.888607 31173 catalog_manager.cc:5697] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.891754 31552 tablet_bootstrap.cc:654] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.906405 31785 raft_consensus.cc:515] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.915539 31505 raft_consensus.cc:3060] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.918080 31551 tablet_bootstrap.cc:492] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:58.918671 31551 ts_tablet_manager.cc:1403] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.230s	user 0.013s	sys 0.013s
I20260709 12:23:58.919339 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca14ac33e4d47d5959bcf7eb1e84e70" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:58.919976 31279 raft_consensus.cc:3060] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.921655 31551 raft_consensus.cc:359] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.932181 31551 raft_consensus.cc:385] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.926060 31785 leader_election.cc:290] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:58.931586 31279 raft_consensus.cc:2468] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:23:58.932715 31551 raft_consensus.cc:740] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.932915 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca14ac33e4d47d5959bcf7eb1e84e70" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:58.935400 31468 leader_election.cc:304] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:58.935621 31551 consensus_queue.cc:260] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.936489 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca14ac33e4d47d5959bcf7eb1e84e70" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:58.936764 31667 consensus_queue.cc:1048] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:58.938609 31785 raft_consensus.cc:2804] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.939393 31785 raft_consensus.cc:697] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:23:58.940220 31785 consensus_queue.cc:237] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:58.968719 31778 raft_consensus.cc:493] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.974911 31778 raft_consensus.cc:515] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.980113 31778 leader_election.cc:290] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:58.982133 31427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34c9c84b088402082232ada2f901768" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:58.982903 31427 raft_consensus.cc:2468] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:58.986474 31701 raft_consensus.cc:493] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.987317 31701 raft_consensus.cc:515] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:58.996954 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34c9c84b088402082232ada2f901768" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:58.998021 31279 raft_consensus.cc:2468] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:58.999511 31320 leader_election.cc:304] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:59.000680 31614 raft_consensus.cc:2804] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.001052 31614 raft_consensus.cc:493] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.001405 31614 raft_consensus.cc:3060] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:59.001194 31470 leader_election.cc:343] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.002799 31606 raft_consensus.cc:493] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.003546 31606 raft_consensus.cc:515] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.007954 31778 consensus_queue.cc:1048] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.011514 31556 tablet_bootstrap.cc:654] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.011201 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8345833c0f34e96af79e53d5eb8fbc0" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:59.012436 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34c9c84b088402082232ada2f901768" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:59.013720 31749 raft_consensus.cc:493] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.015971 31551 ts_tablet_manager.cc:1434] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.001s
I20260709 12:23:59.018344 31777 raft_consensus.cc:493] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:59.026050 31470 leader_election.cc:343] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.022161 31749 raft_consensus.cc:515] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.035662 31777 raft_consensus.cc:515] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.037418 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0071e37b60b04beb864d69169365283f" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:59.038139 31353 raft_consensus.cc:2468] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:59.038771 31777 leader_election.cc:290] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:59.039659 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0071e37b60b04beb864d69169365283f" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:59.040294 31506 raft_consensus.cc:2468] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:59.042032 31749 leader_election.cc:290] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:59.041934 31469 leader_election.cc:304] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:59.041931 31320 leader_election.cc:304] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:59.044102 31427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34c9c84b088402082232ada2f901768" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:59.045130 31427 raft_consensus.cc:2468] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:59.045425 31778 raft_consensus.cc:2804] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.045917 31778 raft_consensus.cc:493] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.046257 31778 raft_consensus.cc:3060] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.046341 31606 leader_election.cc:290] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:59.046909 31606 raft_consensus.cc:2804] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.046994 31552 tablet_bootstrap.cc:492] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:59.047348 31606 raft_consensus.cc:493] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.047750 31606 raft_consensus.cc:3060] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.047798 31552 ts_tablet_manager.cc:1403] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.328s	user 0.050s	sys 0.043s
I20260709 12:23:59.028323 31701 leader_election.cc:290] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:59.049926 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0071e37b60b04beb864d69169365283f" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:59.050657 31280 raft_consensus.cc:2468] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:59.051148 31552 raft_consensus.cc:359] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.051885 31552 raft_consensus.cc:385] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.052207 31552 raft_consensus.cc:740] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.052906 31552 consensus_queue.cc:260] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.055450 31552 ts_tablet_manager.cc:1434] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:59.056444 31553 tablet_bootstrap.cc:654] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.056627 31552 tablet_bootstrap.cc:492] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:59.057149 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8345833c0f34e96af79e53d5eb8fbc0" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:59.059298 31245 leader_election.cc:304] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:59.060854 31699 raft_consensus.cc:2804] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.061411 31699 raft_consensus.cc:493] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.062599 31469 leader_election.cc:304] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:23:59.061426 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0071e37b60b04beb864d69169365283f" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:59.064680 31280 raft_consensus.cc:2468] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:59.067099 31552 tablet_bootstrap.cc:654] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.070374 31699 raft_consensus.cc:3060] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.066849 31777 consensus_queue.cc:1048] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.031451 31551 tablet_bootstrap.cc:492] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:59.079989 31644 consensus_queue.cc:1048] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:23:59.081607 31174 catalog_manager.cc:5697] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.090365 31614 raft_consensus.cc:515] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.131493 31351 raft_consensus.cc:2393] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate 998cd06c0be349879a0602496bc33640 in this term.
I20260709 12:23:59.159565 31614 leader_election.cc:290] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:59.130548 31606 raft_consensus.cc:515] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.164124 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34c9c84b088402082232ada2f901768" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:59.164578 31606 leader_election.cc:290] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:59.164793 31430 raft_consensus.cc:3060] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.166504 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34c9c84b088402082232ada2f901768" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:59.167330 31614 raft_consensus.cc:493] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.167819 31614 raft_consensus.cc:515] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.171069 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50603727db744cf8aeb6da31ee6cbf18" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:59.172076 31614 leader_election.cc:290] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:23:59.173159 31318 leader_election.cc:343] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.173764 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50603727db744cf8aeb6da31ee6cbf18" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:59.175088 31177 catalog_manager.cc:5697] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:59.176222 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0071e37b60b04beb864d69169365283f" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:59.177666 31551 tablet_bootstrap.cc:654] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:59.178494 31320 leader_election.cc:343] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.180274 31320 leader_election.cc:304] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:59.180321 31658 consensus_queue.cc:1048] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.182823 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0071e37b60b04beb864d69169365283f" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:59.183475 31279 raft_consensus.cc:3060] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.183125 31614 raft_consensus.cc:2749] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:59.217617 31553 tablet_bootstrap.cc:492] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:59.218324 31553 ts_tablet_manager.cc:1403] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.339s	user 0.030s	sys 0.021s
I20260709 12:23:59.205461 31430 raft_consensus.cc:2468] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:59.177863 31778 raft_consensus.cc:515] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.222219 31798 raft_consensus.cc:493] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.228825 31798 raft_consensus.cc:515] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.229688 31320 leader_election.cc:304] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:59.230618 31614 raft_consensus.cc:2804] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.231045 31798 leader_election.cc:290] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:59.231070 31614 raft_consensus.cc:697] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:23:59.232795 31614 consensus_queue.cc:237] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.234339 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:59.223083 31753 raft_consensus.cc:2749] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.236687 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:59.237370 31430 raft_consensus.cc:2468] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:59.238627 31245 leader_election.cc:304] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:59.239959 31667 raft_consensus.cc:2804] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.240316 31667 raft_consensus.cc:493] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.240643 31667 raft_consensus.cc:3060] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.241350 31279 raft_consensus.cc:2468] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:23:59.216048 31699 raft_consensus.cc:515] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.255869 31354 raft_consensus.cc:2393] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate 998cd06c0be349879a0602496bc33640 in this term.
I20260709 12:23:59.256183 31778 leader_election.cc:290] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:23:59.256697 31553 raft_consensus.cc:359] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.257480 31553 raft_consensus.cc:385] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.257743 31553 raft_consensus.cc:740] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.261678 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0071e37b60b04beb864d69169365283f" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:59.261868 31468 leader_election.cc:304] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:59.262574 31280 raft_consensus.cc:2393] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 998cd06c0be349879a0602496bc33640 in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:23:59.262976 31658 raft_consensus.cc:2804] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.263523 31658 raft_consensus.cc:697] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:23:59.265532 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0071e37b60b04beb864d69169365283f" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:59.266384 31658 consensus_queue.cc:237] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.270516 31553 consensus_queue.cc:260] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.295085 31552 tablet_bootstrap.cc:492] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:59.295585 31552 ts_tablet_manager.cc:1403] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.239s	user 0.024s	sys 0.013s
I20260709 12:23:59.299376 31556 tablet_bootstrap.cc:492] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:59.299446 31551 tablet_bootstrap.cc:492] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:59.300048 31556 ts_tablet_manager.cc:1403] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.482s	user 0.041s	sys 0.026s
I20260709 12:23:59.300063 31551 ts_tablet_manager.cc:1403] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.269s	user 0.018s	sys 0.011s
I20260709 12:23:59.284940 31506 raft_consensus.cc:2468] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:23:59.296149 31278 raft_consensus.cc:2393] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 998cd06c0be349879a0602496bc33640 in current term 1: Already voted for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in this term.
I20260709 12:23:59.300290 31174 catalog_manager.cc:5697] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.287406 31320 leader_election.cc:304] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:23:59.304864 31701 consensus_queue.cc:1048] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.308669 31614 raft_consensus.cc:2749] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:59.309790 31556 raft_consensus.cc:359] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.310555 31556 raft_consensus.cc:385] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.310803 31556 raft_consensus.cc:740] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.312160 31699 leader_election.cc:290] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:59.312330 31553 ts_tablet_manager.cc:1434] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.000s
I20260709 12:23:59.313725 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34c9c84b088402082232ada2f901768" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:23:59.314412 31556 consensus_queue.cc:260] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.316608 31556 ts_tablet_manager.cc:1434] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.003s
I20260709 12:23:59.313413 31667 raft_consensus.cc:515] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.319361 31667 leader_election.cc:290] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:59.320456 31553 tablet_bootstrap.cc:492] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:59.325743 31556 tablet_bootstrap.cc:492] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:59.330020 31753 consensus_queue.cc:1048] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:59.334594 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:59.335249 31429 raft_consensus.cc:3060] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.334949 31552 raft_consensus.cc:359] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.335705 31552 raft_consensus.cc:385] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.336001 31552 raft_consensus.cc:740] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.337841 31552 consensus_queue.cc:260] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.346114 31428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34c9c84b088402082232ada2f901768" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:59.347007 31428 raft_consensus.cc:2393] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate 998cd06c0be349879a0602496bc33640 in this term.
I20260709 12:23:59.353699 31556 tablet_bootstrap.cc:654] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.358718 31553 tablet_bootstrap.cc:654] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.356356 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:59.361301 31505 raft_consensus.cc:3060] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.361841 31245 leader_election.cc:304] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:59.363474 31667 raft_consensus.cc:2749] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:59.343343 31798 consensus_queue.cc:1048] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:23:59.371733 31427 raft_consensus.cc:3060] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.392992 31551 raft_consensus.cc:359] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.394307 31552 ts_tablet_manager.cc:1434] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.001s
I20260709 12:23:59.394790 31551 raft_consensus.cc:385] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.395120 31551 raft_consensus.cc:740] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.395781 31551 consensus_queue.cc:260] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.406283 31551 ts_tablet_manager.cc:1434] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 12:23:59.412959 31552 tablet_bootstrap.cc:492] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:59.414217 31551 tablet_bootstrap.cc:492] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:59.422268 31551 tablet_bootstrap.cc:654] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.435056 31175 catalog_manager.cc:5697] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.438993 31556 tablet_bootstrap.cc:492] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:59.439539 31556 ts_tablet_manager.cc:1403] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.122s	user 0.028s	sys 0.012s
I20260709 12:23:59.412729 31505 raft_consensus.cc:2468] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:59.448753 31553 tablet_bootstrap.cc:492] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:59.449298 31553 ts_tablet_manager.cc:1403] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.136s	user 0.019s	sys 0.002s
I20260709 12:23:59.450407 31552 tablet_bootstrap.cc:654] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.452215 31553 raft_consensus.cc:359] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.452986 31553 raft_consensus.cc:385] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.453351 31553 raft_consensus.cc:740] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.453385 31245 leader_election.cc:304] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:23:59.472018 31749 consensus_queue.cc:1048] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:23:59.481122 31556 raft_consensus.cc:359] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.482031 31556 raft_consensus.cc:385] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.486982 31556 raft_consensus.cc:740] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.484349 31667 raft_consensus.cc:2804] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.452289 31429 raft_consensus.cc:2468] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:59.488979 31667 raft_consensus.cc:697] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:23:59.470256 31177 catalog_manager.cc:5697] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.489851 31667 consensus_queue.cc:237] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.477641 31553 consensus_queue.cc:260] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.494120 31553 ts_tablet_manager.cc:1434] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:23:59.488108 31556 consensus_queue.cc:260] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.503384 31553 tablet_bootstrap.cc:492] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:59.507373 31552 tablet_bootstrap.cc:492] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:59.507913 31552 ts_tablet_manager.cc:1403] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.097s	user 0.005s	sys 0.032s
I20260709 12:23:59.514184 31551 tablet_bootstrap.cc:492] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:59.514755 31551 ts_tablet_manager.cc:1403] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.101s	user 0.019s	sys 0.005s
I20260709 12:23:59.523439 31556 ts_tablet_manager.cc:1434] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.001s
I20260709 12:23:59.524633 31556 tablet_bootstrap.cc:492] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:59.524803 31551 raft_consensus.cc:359] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.524549 31174 catalog_manager.cc:5697] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:59.525599 31551 raft_consensus.cc:385] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.525965 31551 raft_consensus.cc:740] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.527285 31551 consensus_queue.cc:260] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.532992 31551 ts_tablet_manager.cc:1434] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:23:59.533609 31553 tablet_bootstrap.cc:654] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.534039 31551 tablet_bootstrap.cc:492] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:59.538153 31552 raft_consensus.cc:359] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.538874 31552 raft_consensus.cc:385] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.539157 31552 raft_consensus.cc:740] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.539785 31552 consensus_queue.cc:260] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.541651 31551 tablet_bootstrap.cc:654] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.542030 31552 ts_tablet_manager.cc:1434] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 12:23:59.543102 31552 tablet_bootstrap.cc:492] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:59.543828 31556 tablet_bootstrap.cc:654] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.549922 31552 tablet_bootstrap.cc:654] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.554538 31553 tablet_bootstrap.cc:492] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:59.555028 31553 ts_tablet_manager.cc:1403] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.002s
I20260709 12:23:59.557770 31553 raft_consensus.cc:359] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.558856 31553 raft_consensus.cc:385] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.559193 31553 raft_consensus.cc:740] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.560145 31553 consensus_queue.cc:260] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.562531 31553 ts_tablet_manager.cc:1434] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:59.563745 31553 tablet_bootstrap.cc:492] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:59.564411 31785 consensus_queue.cc:1048] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:59.575512 31551 tablet_bootstrap.cc:492] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:59.576124 31551 ts_tablet_manager.cc:1403] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.003s
I20260709 12:23:59.569739 31553 tablet_bootstrap.cc:654] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.579510 31551 raft_consensus.cc:359] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.583356 31551 raft_consensus.cc:385] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.583730 31551 raft_consensus.cc:740] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.584486 31551 consensus_queue.cc:260] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.586614 31551 ts_tablet_manager.cc:1434] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:59.587934 31551 tablet_bootstrap.cc:492] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:59.598289 31553 tablet_bootstrap.cc:492] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:59.601296 31553 ts_tablet_manager.cc:1403] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.006s
I20260709 12:23:59.604146 31553 raft_consensus.cc:359] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.604861 31553 raft_consensus.cc:385] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.605187 31553 raft_consensus.cc:740] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.606835 31553 consensus_queue.cc:260] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.608531 31551 tablet_bootstrap.cc:654] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.611486 31553 ts_tablet_manager.cc:1434] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:59.612432 31553 tablet_bootstrap.cc:492] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:59.615445 31552 tablet_bootstrap.cc:492] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:59.616098 31552 ts_tablet_manager.cc:1403] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.073s	user 0.032s	sys 0.035s
I20260709 12:23:59.620821 31551 tablet_bootstrap.cc:492] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:59.620371 31614 raft_consensus.cc:493] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.622884 31614 raft_consensus.cc:515] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.623335 31552 raft_consensus.cc:359] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.624188 31552 raft_consensus.cc:385] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.624497 31552 raft_consensus.cc:740] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.625016 31614 leader_election.cc:290] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:59.625190 31552 consensus_queue.cc:260] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.626438 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2622a99407874e409f4fb5248f2f404b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:59.626932 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2622a99407874e409f4fb5248f2f404b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:59.627126 31279 raft_consensus.cc:2468] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:59.627720 31552 ts_tablet_manager.cc:1434] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:23:59.628470 31318 leader_election.cc:304] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:59.628816 31552 tablet_bootstrap.cc:492] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
W20260709 12:23:59.629439 31320 leader_election.cc:343] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.629755 31777 raft_consensus.cc:2804] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.630211 31777 raft_consensus.cc:493] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.630571 31777 raft_consensus.cc:3060] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.632470 31551 ts_tablet_manager.cc:1403] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.001s
I20260709 12:23:59.640813 31777 raft_consensus.cc:515] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.643195 31777 leader_election.cc:290] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:59.641443 31551 raft_consensus.cc:359] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.644078 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2622a99407874e409f4fb5248f2f404b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:23:59.644698 31279 raft_consensus.cc:3060] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.644857 31552 tablet_bootstrap.cc:654] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.646760 31556 tablet_bootstrap.cc:492] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:59.647271 31556 ts_tablet_manager.cc:1403] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.020s
I20260709 12:23:59.649535 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2622a99407874e409f4fb5248f2f404b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:59.649933 31556 raft_consensus.cc:359] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.650604 31556 raft_consensus.cc:385] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.650883 31556 raft_consensus.cc:740] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
W20260709 12:23:59.651278 31320 leader_election.cc:343] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.651563 31556 consensus_queue.cc:260] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.652827 31553 tablet_bootstrap.cc:654] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.644727 31551 raft_consensus.cc:385] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.655066 31551 raft_consensus.cc:740] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.655764 31551 consensus_queue.cc:260] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.656701 31552 tablet_bootstrap.cc:492] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:59.657166 31552 ts_tablet_manager.cc:1403] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.005s
I20260709 12:23:59.657868 31551 ts_tablet_manager.cc:1434] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.000s
I20260709 12:23:59.659812 31279 raft_consensus.cc:2468] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:59.659940 31552 raft_consensus.cc:359] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.660646 31552 raft_consensus.cc:385] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.660914 31552 raft_consensus.cc:740] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.661387 31551 tablet_bootstrap.cc:492] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:59.661700 31552 consensus_queue.cc:260] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.663347 31318 leader_election.cc:304] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:59.664067 31552 ts_tablet_manager.cc:1434] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:59.664508 31777 raft_consensus.cc:2804] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.665022 31777 raft_consensus.cc:697] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:23:59.665620 31552 tablet_bootstrap.cc:492] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:59.665866 31777 consensus_queue.cc:237] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.668018 31551 tablet_bootstrap.cc:654] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.669476 31667 raft_consensus.cc:493] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.670455 31667 raft_consensus.cc:515] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.672405 31552 tablet_bootstrap.cc:654] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.672729 31667 leader_election.cc:290] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:59.677680 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:59.678958 31556 ts_tablet_manager.cc:1434] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:23:59.680609 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:59.681686 31506 raft_consensus.cc:2468] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
W20260709 12:23:59.682957 31245 leader_election.cc:343] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.685357 31551 tablet_bootstrap.cc:492] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:59.686071 31551 ts_tablet_manager.cc:1403] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.000s
I20260709 12:23:59.689188 31551 raft_consensus.cc:359] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.689872 31551 raft_consensus.cc:385] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.689602 31785 consensus_queue.cc:1048] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.690223 31551 raft_consensus.cc:740] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.690800 31245 leader_election.cc:304] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:59.691601 31556 tablet_bootstrap.cc:492] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:59.691119 31551 consensus_queue.cc:260] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.695454 31785 consensus_queue.cc:1048] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.697494 31699 raft_consensus.cc:2804] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.697782 31777 raft_consensus.cc:493] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.698136 31699 raft_consensus.cc:493] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.698390 31777 raft_consensus.cc:515] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.698697 31699 raft_consensus.cc:3060] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.700582 31777 leader_election.cc:290] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:59.706367 31777 raft_consensus.cc:493] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.706825 31777 raft_consensus.cc:515] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.708436 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a807ba2b8d2417a8a13d2bf1bcef8c1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:59.708518 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a807ba2b8d2417a8a13d2bf1bcef8c1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:59.709399 31429 raft_consensus.cc:2468] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
W20260709 12:23:59.710083 31320 leader_election.cc:343] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.710980 31553 tablet_bootstrap.cc:492] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:59.710872 31320 leader_election.cc:304] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:23:59.711493 31553 ts_tablet_manager.cc:1403] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.099s	user 0.006s	sys 0.003s
I20260709 12:23:59.711707 31644 raft_consensus.cc:2804] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.712087 31644 raft_consensus.cc:493] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.712415 31644 raft_consensus.cc:3060] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.722074 31614 consensus_queue.cc:1048] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.724220 31552 tablet_bootstrap.cc:492] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:59.724857 31552 ts_tablet_manager.cc:1403] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.011s
I20260709 12:23:59.725697 31553 raft_consensus.cc:359] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.726471 31553 raft_consensus.cc:385] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.726751 31553 raft_consensus.cc:740] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.727458 31553 consensus_queue.cc:260] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.728479 31644 raft_consensus.cc:515] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.729341 31553 ts_tablet_manager.cc:1434] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:23:59.731765 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a807ba2b8d2417a8a13d2bf1bcef8c1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:59.732103 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656a43be5139490a9ab0b8bc38750ac6" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
W20260709 12:23:59.734232 31320 leader_election.cc:343] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.734342 31429 raft_consensus.cc:3060] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.734906 31614 consensus_queue.cc:1048] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.732556 31777 leader_election.cc:290] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:23:59.732558 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656a43be5139490a9ab0b8bc38750ac6" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:23:59.737543 31777 raft_consensus.cc:493] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.742671 31777 raft_consensus.cc:515] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
W20260709 12:23:59.744047 31318 leader_election.cc:343] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.744570 31552 raft_consensus.cc:359] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.744957 31318 leader_election.cc:304] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:59.745316 31552 raft_consensus.cc:385] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.745460 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a807ba2b8d2417a8a13d2bf1bcef8c1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:59.746173 31506 raft_consensus.cc:3060] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.746265 31614 raft_consensus.cc:2749] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:59.753170 31699 raft_consensus.cc:515] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.745666 31552 raft_consensus.cc:740] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.724138 31551 ts_tablet_manager.cc:1434] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:23:59.755492 31552 consensus_queue.cc:260] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.756551 31551 tablet_bootstrap.cc:492] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:59.757690 31552 ts_tablet_manager.cc:1434] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:23:59.759155 31552 tablet_bootstrap.cc:492] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:23:59.738679 31553 tablet_bootstrap.cc:492] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:23:59.763754 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db9b56686874345a49f931200fdc7f8" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:23:59.764503 31430 raft_consensus.cc:2468] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:59.766255 31320 leader_election.cc:304] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:59.767215 31614 raft_consensus.cc:2804] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.767648 31614 raft_consensus.cc:493] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.768096 31614 raft_consensus.cc:3060] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.769513 31506 raft_consensus.cc:2468] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:59.770442 31556 tablet_bootstrap.cc:654] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.771984 31320 leader_election.cc:304] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:59.772884 31778 raft_consensus.cc:2804] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.773459 31778 raft_consensus.cc:697] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:23:59.774478 31778 consensus_queue.cc:237] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.779021 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
W20260709 12:23:59.782613 31245 leader_election.cc:343] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.744359 31644 leader_election.cc:290] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:59.807857 31699 leader_election.cc:290] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:59.810096 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:59.810180 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db9b56686874345a49f931200fdc7f8" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:59.810742 31506 raft_consensus.cc:3060] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.810916 31505 raft_consensus.cc:2468] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:23:59.811813 31551 tablet_bootstrap.cc:654] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.821416 31777 leader_election.cc:290] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:59.824924 31553 tablet_bootstrap.cc:654] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.837757 31429 raft_consensus.cc:2468] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:59.839655 31667 raft_consensus.cc:493] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.840225 31667 raft_consensus.cc:515] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.844218 31667 leader_election.cc:290] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:59.844321 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bc57e4f3e241e0a32f281992c4d952" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:23:59.846764 31245 leader_election.cc:343] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.828343 31552 tablet_bootstrap.cc:654] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.859097 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bc57e4f3e241e0a32f281992c4d952" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
W20260709 12:23:59.860841 31244 leader_election.cc:343] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.861438 31244 leader_election.cc:304] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640
I20260709 12:23:59.868229 31506 raft_consensus.cc:2468] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:23:59.869657 31245 leader_election.cc:304] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:23:59.870787 31809 raft_consensus.cc:2749] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:59.871304 31701 raft_consensus.cc:2804] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.874828 31556 tablet_bootstrap.cc:492] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:23:59.875562 31556 ts_tablet_manager.cc:1403] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.000s
W20260709 12:23:59.878986 31833 log.cc:927] Time spent T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.004s
W20260709 12:23:59.880573 31835 log.cc:927] Time spent T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: Append to log took a long time: real 0.112s	user 0.010s	sys 0.000s
I20260709 12:23:59.884634 31175 catalog_manager.cc:5697] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.853458 31614 raft_consensus.cc:515] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.871894 31701 raft_consensus.cc:697] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
W20260709 12:23:59.900794 31832 log.cc:927] Time spent T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640: Append to log took a long time: real 0.109s	user 0.010s	sys 0.008s
W20260709 12:23:59.906394 31244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:40387, user_credentials={real_user=slave}} blocked reactor thread for 45616.9us
W20260709 12:23:59.915303 31245 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:34287, user_credentials={real_user=slave}} blocked reactor thread for 45786us
I20260709 12:23:59.924352 31551 tablet_bootstrap.cc:492] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:23:59.924916 31551 ts_tablet_manager.cc:1403] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.169s	user 0.026s	sys 0.001s
I20260709 12:23:59.923815 31701 consensus_queue.cc:237] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.932361 31551 raft_consensus.cc:359] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.933173 31551 raft_consensus.cc:385] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.933501 31551 raft_consensus.cc:740] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.934262 31551 consensus_queue.cc:260] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:23:59.934684 31174 catalog_manager.cc:5697] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.936010 31551 ts_tablet_manager.cc:1434] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:23:59.936980 31551 tablet_bootstrap.cc:492] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:23:59.938850 31614 leader_election.cc:290] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:23:59.940675 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db9b56686874345a49f931200fdc7f8" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:23:59.941279 31506 raft_consensus.cc:3060] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.946575 31753 raft_consensus.cc:493] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.947132 31753 raft_consensus.cc:515] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.948086 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db9b56686874345a49f931200fdc7f8" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:23:59.948711 31429 raft_consensus.cc:3060] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.949309 31753 leader_election.cc:290] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:59.951247 31556 raft_consensus.cc:359] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.952011 31556 raft_consensus.cc:385] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.952278 31556 raft_consensus.cc:740] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.952888 31556 consensus_queue.cc:260] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:23:59.954922 31556 ts_tablet_manager.cc:1434] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 12:23:59.955502 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50603727db744cf8aeb6da31ee6cbf18" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:23:59.956182 31354 raft_consensus.cc:2468] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:23:59.957449 31469 leader_election.cc:304] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:23:59.960525 31844 raft_consensus.cc:493] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.961040 31844 raft_consensus.cc:515] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.961323 31429 raft_consensus.cc:2468] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:23:59.962041 31753 raft_consensus.cc:2804] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.962510 31753 raft_consensus.cc:493] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.962925 31753 raft_consensus.cc:3060] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.963161 31844 leader_election.cc:290] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:23:59.968703 31552 tablet_bootstrap.cc:492] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:23:59.969238 31552 ts_tablet_manager.cc:1403] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.210s	user 0.024s	sys 0.009s
I20260709 12:23:59.971956 31552 raft_consensus.cc:359] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.972644 31552 raft_consensus.cc:385] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.972905 31552 raft_consensus.cc:740] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.974265 31556 tablet_bootstrap.cc:492] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:23:59.981067 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50603727db744cf8aeb6da31ee6cbf18" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:23:59.987509 31699 consensus_queue.cc:1048] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.992208 31320 leader_election.cc:304] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:23:59.992085 31553 tablet_bootstrap.cc:492] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:23:59.993161 31553 ts_tablet_manager.cc:1403] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.255s	user 0.017s	sys 0.003s
I20260709 12:23:59.993312 31837 raft_consensus.cc:2804] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.973505 31552 consensus_queue.cc:260] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.994386 31837 raft_consensus.cc:697] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:23:59.996614 31552 ts_tablet_manager.cc:1434] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:23:59.996529 31837 consensus_queue.cc:237] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:23:59.997865 31552 tablet_bootstrap.cc:492] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
W20260709 12:23:59.998193 31226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:59.996389 31553 raft_consensus.cc:359] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:23:59.998966 31553 raft_consensus.cc:385] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.999305 31553 raft_consensus.cc:740] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.000131 31553 consensus_queue.cc:260] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.003306 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50603727db744cf8aeb6da31ee6cbf18" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:00.004210 31354 raft_consensus.cc:2468] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:24:00.004413 31553 ts_tablet_manager.cc:1434] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:24:00.005645 31553 tablet_bootstrap.cc:492] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:00.010264 31175 catalog_manager.cc:5697] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:00.015753 31556 tablet_bootstrap.cc:654] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.028517 31553 tablet_bootstrap.cc:654] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.034090 31174 catalog_manager.cc:5697] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.035449 31699 consensus_queue.cc:1048] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:00.037585 31552 tablet_bootstrap.cc:654] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.038316 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50603727db744cf8aeb6da31ee6cbf18" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:00.039034 31278 raft_consensus.cc:2468] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:24:00.042732 31785 raft_consensus.cc:493] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.043318 31785 raft_consensus.cc:515] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.048554 31244 leader_election.cc:304] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:00.049283 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bc57e4f3e241e0a32f281992c4d952" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:00.050135 31552 tablet_bootstrap.cc:492] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:00.049860 31785 leader_election.cc:290] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:00.050622 31552 ts_tablet_manager.cc:1403] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.002s
W20260709 12:24:00.051440 31469 leader_election.cc:343] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.055824 31506 raft_consensus.cc:2468] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:00.057343 31556 tablet_bootstrap.cc:492] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:00.057928 31556 ts_tablet_manager.cc:1403] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.007s
I20260709 12:24:00.059232 31843 raft_consensus.cc:2804] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:00.059636 31843 raft_consensus.cc:493] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.059969 31843 raft_consensus.cc:3060] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.060807 31556 raft_consensus.cc:359] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.061525 31556 raft_consensus.cc:385] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.061484 31753 raft_consensus.cc:515] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.062058 31556 raft_consensus.cc:740] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.063447 31501 raft_consensus.cc:2393] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:24:00.067255 31556 consensus_queue.cc:260] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.068192 31843 raft_consensus.cc:515] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.074855 31843 leader_election.cc:290] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:00.068814 31551 tablet_bootstrap.cc:654] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.068720 31552 raft_consensus.cc:359] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.079159 31552 raft_consensus.cc:385] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.069864 31753 leader_election.cc:290] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:00.079489 31552 raft_consensus.cc:740] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.080215 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bc57e4f3e241e0a32f281992c4d952" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:00.080859 31278 raft_consensus.cc:2468] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:24:00.080717 31552 consensus_queue.cc:260] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.071069 31556 ts_tablet_manager.cc:1434] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:24:00.071476 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50603727db744cf8aeb6da31ee6cbf18" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:00.082029 31354 raft_consensus.cc:3060] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.082628 31556 tablet_bootstrap.cc:492] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:00.082790 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50603727db744cf8aeb6da31ee6cbf18" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:00.083603 31278 raft_consensus.cc:2393] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in this term.
I20260709 12:24:00.086143 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50603727db744cf8aeb6da31ee6cbf18" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:00.087055 31506 raft_consensus.cc:2393] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:24:00.089540 31556 tablet_bootstrap.cc:654] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.080107 31843 raft_consensus.cc:493] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.090926 31843 raft_consensus.cc:515] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.091620 31552 ts_tablet_manager.cc:1434] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 12:24:00.093536 31468 leader_election.cc:304] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 998cd06c0be349879a0602496bc33640
I20260709 12:24:00.094177 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656a43be5139490a9ab0b8bc38750ac6" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:00.094476 31753 raft_consensus.cc:2804] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:00.094870 31753 raft_consensus.cc:493] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.095265 31753 raft_consensus.cc:3060] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.095266 31843 leader_election.cc:290] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:00.095103 31354 raft_consensus.cc:2468] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:00.097105 31469 leader_election.cc:304] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:00.098001 31606 raft_consensus.cc:2804] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:00.098492 31606 raft_consensus.cc:697] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:00.099371 31606 consensus_queue.cc:237] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.094883 31429 raft_consensus.cc:2468] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:24:00.104521 31245 leader_election.cc:304] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:00.108407 31844 raft_consensus.cc:2804] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:00.109062 31844 raft_consensus.cc:493] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.109550 31844 raft_consensus.cc:3060] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.115164 31843 raft_consensus.cc:493] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.105690 31753 raft_consensus.cc:515] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.115846 31843 raft_consensus.cc:515] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.119220 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69abb8bd62140f58770bec881e8ec59" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
W20260709 12:24:00.120950 31245 leader_election.cc:343] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.121557 31355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50603727db744cf8aeb6da31ee6cbf18" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:00.122424 31355 raft_consensus.cc:2393] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:24:00.124879 31843 leader_election.cc:290] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:00.128263 31552 tablet_bootstrap.cc:492] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:00.129170 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656a43be5139490a9ab0b8bc38750ac6" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:00.129896 31354 raft_consensus.cc:2468] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:24:00.131131 31244 leader_election.cc:304] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640
I20260709 12:24:00.132911 31843 raft_consensus.cc:2749] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:00.134271 31753 leader_election.cc:290] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:00.136782 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69abb8bd62140f58770bec881e8ec59" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:24:00.138526 31245 leader_election.cc:343] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.138659 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bc57e4f3e241e0a32f281992c4d952" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:00.139142 31245 leader_election.cc:304] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:00.139824 31354 raft_consensus.cc:3060] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.140266 31843 raft_consensus.cc:2749] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:00.141659 31553 tablet_bootstrap.cc:492] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:00.142230 31553 ts_tablet_manager.cc:1403] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.008s
W20260709 12:24:00.150914 31320 consensus_peers.cc:597] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.152423 31354 raft_consensus.cc:2468] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:00.153630 31469 leader_election.cc:304] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:00.154711 31844 raft_consensus.cc:515] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.155252 31551 tablet_bootstrap.cc:492] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:00.155805 31551 ts_tablet_manager.cc:1403] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.219s	user 0.015s	sys 0.023s
I20260709 12:24:00.157044 31844 leader_election.cc:290] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:00.157672 31553 raft_consensus.cc:359] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.158154 31614 raft_consensus.cc:493] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.158430 31553 raft_consensus.cc:385] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.158735 31553 raft_consensus.cc:740] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.158641 31614 raft_consensus.cc:515] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.159518 31553 consensus_queue.cc:260] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.159745 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bc57e4f3e241e0a32f281992c4d952" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:00.160480 31279 raft_consensus.cc:3060] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.160776 31614 leader_election.cc:290] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:00.162861 31552 tablet_bootstrap.cc:654] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.164321 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772880df0e044150b248d02eb59b08ce" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
W20260709 12:24:00.166057 31320 leader_election.cc:343] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.166205 31606 raft_consensus.cc:2804] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:00.166730 31606 raft_consensus.cc:697] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:00.167577 31606 consensus_queue.cc:237] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.168527 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772880df0e044150b248d02eb59b08ce" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:00.170706 31279 raft_consensus.cc:2468] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:00.159791 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656a43be5139490a9ab0b8bc38750ac6" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:00.172277 31354 raft_consensus.cc:3060] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:00.173712 31320 leader_election.cc:343] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.174401 31320 leader_election.cc:304] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:00.173713 31553 ts_tablet_manager.cc:1434] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.031s	user 0.001s	sys 0.004s
I20260709 12:24:00.175971 31614 raft_consensus.cc:2749] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:00.176222 31553 tablet_bootstrap.cc:492] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:00.177060 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656a43be5139490a9ab0b8bc38750ac6" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:00.158651 31551 raft_consensus.cc:359] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.177958 31429 raft_consensus.cc:3060] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.178134 31551 raft_consensus.cc:385] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.178679 31551 raft_consensus.cc:740] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.179581 31551 consensus_queue.cc:260] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.187942 31553 tablet_bootstrap.cc:654] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.172379 31175 catalog_manager.cc:5697] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.192840 31556 tablet_bootstrap.cc:492] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:00.199994 31553 tablet_bootstrap.cc:492] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:00.200558 31553 ts_tablet_manager.cc:1403] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.000s
I20260709 12:24:00.200832 31556 ts_tablet_manager.cc:1403] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.018s
I20260709 12:24:00.201574 31786 raft_consensus.cc:493] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.202131 31786 raft_consensus.cc:515] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.203485 31553 raft_consensus.cc:359] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.218039 31553 raft_consensus.cc:385] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.206171 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:00.218767 31553 raft_consensus.cc:740] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.219650 31552 tablet_bootstrap.cc:492] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:00.219514 31553 consensus_queue.cc:260] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.220093 31552 ts_tablet_manager.cc:1403] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.030s
I20260709 12:24:00.221010 31501 raft_consensus.cc:2393] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 1: Already voted for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in this term.
I20260709 12:24:00.221083 31837 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.222056 31553 ts_tablet_manager.cc:1434] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 12:24:00.204330 31786 leader_election.cc:290] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:00.206857 31551 ts_tablet_manager.cc:1434] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 12:24:00.223191 31553 tablet_bootstrap.cc:492] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:00.223759 31551 tablet_bootstrap.cc:492] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:00.223472 31552 raft_consensus.cc:359] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.224198 31552 raft_consensus.cc:385] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.224468 31552 raft_consensus.cc:740] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.225167 31552 consensus_queue.cc:260] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.212384 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:00.215833 31175 catalog_manager.cc:5697] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.228472 31393 leader_election.cc:304] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:00.229337 31552 ts_tablet_manager.cc:1434] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:24:00.229717 31786 raft_consensus.cc:3060] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.230070 31553 tablet_bootstrap.cc:654] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.211014 31354 raft_consensus.cc:2468] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:24:00.213924 31614 consensus_queue.cc:1048] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:00.205341 31556 raft_consensus.cc:359] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.221720 31837 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.230796 31556 raft_consensus.cc:385] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.231423 31556 raft_consensus.cc:740] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.205056 31429 raft_consensus.cc:2468] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:24:00.247303 31245 leader_election.cc:304] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:00.248724 31844 raft_consensus.cc:2804] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:00.248977 31786 raft_consensus.cc:2749] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:00.249287 31844 raft_consensus.cc:697] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:00.232221 31556 consensus_queue.cc:260] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.251493 31556 ts_tablet_manager.cc:1434] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.001s
I20260709 12:24:00.252532 31556 tablet_bootstrap.cc:492] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:00.252974 31844 consensus_queue.cc:237] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.234259 31551 tablet_bootstrap.cc:654] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.241894 31837 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:00.244346 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
W20260709 12:24:00.262246 31320 leader_election.cc:343] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.245092 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:00.263300 31501 raft_consensus.cc:2468] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:24:00.231959 31552 tablet_bootstrap.cc:492] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:00.266427 31320 leader_election.cc:304] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:00.267266 31837 raft_consensus.cc:2804] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:00.267666 31837 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.268035 31837 raft_consensus.cc:3060] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.270812 31556 tablet_bootstrap.cc:654] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.272593 31553 tablet_bootstrap.cc:492] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:00.273247 31553 ts_tablet_manager.cc:1403] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.008s
I20260709 12:24:00.275539 31552 tablet_bootstrap.cc:654] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.276443 31553 raft_consensus.cc:359] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.277235 31553 raft_consensus.cc:385] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.277551 31553 raft_consensus.cc:740] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.280745 31553 consensus_queue.cc:260] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.277518 31837 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.294426 31606 raft_consensus.cc:493] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.297768 31553 ts_tablet_manager.cc:1434] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:24:00.295939 31606 raft_consensus.cc:515] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.304358 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:00.304605 31646 raft_consensus.cc:493] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.306289 31606 leader_election.cc:290] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:00.306479 31320 leader_election.cc:343] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.305565 31646 raft_consensus.cc:515] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.308794 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772880df0e044150b248d02eb59b08ce" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:00.309795 31353 raft_consensus.cc:2468] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:24:00.311455 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772880df0e044150b248d02eb59b08ce" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:00.312698 31469 leader_election.cc:304] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
W20260709 12:24:00.313395 31470 leader_election.cc:343] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.314018 31606 raft_consensus.cc:2804] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:00.314522 31606 raft_consensus.cc:493] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.314881 31606 raft_consensus.cc:3060] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.318255 31553 tablet_bootstrap.cc:492] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:00.321269 31556 tablet_bootstrap.cc:492] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:00.321802 31556 ts_tablet_manager.cc:1403] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.005s
I20260709 12:24:00.324545 31556 raft_consensus.cc:359] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.325276 31556 raft_consensus.cc:385] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.325546 31556 raft_consensus.cc:740] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.328876 31646 leader_election.cc:290] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:00.324451 31552 tablet_bootstrap.cc:492] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:00.330817 31552 ts_tablet_manager.cc:1403] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.019s
I20260709 12:24:00.331195 31173 catalog_manager.cc:5697] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.334056 31552 raft_consensus.cc:359] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.335768 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd97beba6040c69589994e8389028e" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:00.338281 31552 raft_consensus.cc:385] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.338676 31552 raft_consensus.cc:740] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.340334 31777 consensus_queue.cc:1048] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:00.338840 31551 tablet_bootstrap.cc:492] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:00.340817 31552 consensus_queue.cc:260] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.341701 31551 ts_tablet_manager.cc:1403] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.005s
I20260709 12:24:00.341778 31844 consensus_queue.cc:1048] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:00.343377 31552 ts_tablet_manager.cc:1434] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:24:00.343564 31556 consensus_queue.cc:260] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.344625 31552 tablet_bootstrap.cc:492] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:00.345243 31556 ts_tablet_manager.cc:1434] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
W20260709 12:24:00.346526 31320 leader_election.cc:343] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.351338 31552 tablet_bootstrap.cc:654] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.336076 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd97beba6040c69589994e8389028e" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
W20260709 12:24:00.360175 31318 leader_election.cc:343] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.360916 31318 leader_election.cc:304] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:00.364730 31777 raft_consensus.cc:2749] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:00.367473 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:00.368405 31506 raft_consensus.cc:3060] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.340037 31553 tablet_bootstrap.cc:654] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.374835 31837 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:00.376442 31556 tablet_bootstrap.cc:492] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:00.393723 31606 raft_consensus.cc:515] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.398901 31551 raft_consensus.cc:359] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.399602 31551 raft_consensus.cc:385] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.399860 31551 raft_consensus.cc:740] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.400516 31551 consensus_queue.cc:260] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.419059 31551 ts_tablet_manager.cc:1434] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.001s
I20260709 12:24:00.422037 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772880df0e044150b248d02eb59b08ce" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:00.422736 31354 raft_consensus.cc:3060] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.428628 31786 raft_consensus.cc:493] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.429174 31786 raft_consensus.cc:515] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.430929 31606 leader_election.cc:290] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:00.431309 31786 leader_election.cc:290] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:00.433228 31427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772880df0e044150b248d02eb59b08ce" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:00.433871 31427 raft_consensus.cc:3060] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.437182 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772880df0e044150b248d02eb59b08ce" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:00.438061 31503 raft_consensus.cc:2393] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:24:00.438659 31627 raft_consensus.cc:493] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.439191 31627 raft_consensus.cc:515] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.441774 31627 leader_election.cc:290] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:00.445957 31551 tablet_bootstrap.cc:492] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:00.452816 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2622a99407874e409f4fb5248f2f404b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:00.453681 31354 raft_consensus.cc:2468] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:00.456425 31469 leader_election.cc:304] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:00.458036 31606 raft_consensus.cc:2804] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:00.459403 31606 raft_consensus.cc:697] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:00.460393 31606 consensus_queue.cc:237] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.467612 31552 tablet_bootstrap.cc:492] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:00.468212 31552 ts_tablet_manager.cc:1403] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.124s	user 0.023s	sys 0.019s
I20260709 12:24:00.471444 31506 raft_consensus.cc:2468] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:00.472784 31552 raft_consensus.cc:359] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.474737 31552 raft_consensus.cc:385] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.475082 31552 raft_consensus.cc:740] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.475833 31552 consensus_queue.cc:260] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.480187 31753 raft_consensus.cc:493] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.481375 31556 tablet_bootstrap.cc:654] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.483481 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772880df0e044150b248d02eb59b08ce" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:00.484541 31354 raft_consensus.cc:2393] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:24:00.480799 31753 raft_consensus.cc:515] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.481933 31843 raft_consensus.cc:493] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.494076 31552 ts_tablet_manager.cc:1434] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 12:24:00.494589 31843 raft_consensus.cc:515] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.518222 31843 leader_election.cc:290] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:00.496251 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e5a199ea34658a55df3d05a441939" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:00.499687 31809 consensus_queue.cc:1048] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:24:00.500098 31753 leader_election.cc:290] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:00.507710 31394 leader_election.cc:304] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640
W20260709 12:24:00.526142 31468 leader_election.cc:343] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.527010 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae28f8ed99514107ba0fc461d1829ce6" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:00.509151 31844 raft_consensus.cc:493] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.528337 31844 raft_consensus.cc:515] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.528712 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2622a99407874e409f4fb5248f2f404b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
W20260709 12:24:00.531069 31245 leader_election.cc:343] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.534233 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae28f8ed99514107ba0fc461d1829ce6" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:00.535449 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e5a199ea34658a55df3d05a441939" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:00.536228 31353 raft_consensus.cc:2468] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:24:00.536477 31553 tablet_bootstrap.cc:492] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:00.537122 31553 ts_tablet_manager.cc:1403] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.227s	user 0.028s	sys 0.006s
I20260709 12:24:00.537024 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:00.537868 31844 leader_election.cc:290] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
W20260709 12:24:00.539559 31245 leader_election.cc:343] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.541040 31553 raft_consensus.cc:359] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.541786 31553 raft_consensus.cc:385] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.542074 31553 raft_consensus.cc:740] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.514591 31427 raft_consensus.cc:2468] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:00.543905 31627 raft_consensus.cc:2749] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:00.536525 31244 leader_election.cc:343] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.546794 31244 leader_election.cc:304] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:00.514876 31551 tablet_bootstrap.cc:654] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.546546 31553 consensus_queue.cc:260] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.550597 31844 raft_consensus.cc:2749] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:00.550669 31606 consensus_queue.cc:1048] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:00.546293 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:00.515286 31320 leader_election.cc:304] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
W20260709 12:24:00.553165 31245 leader_election.cc:343] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.553596 31245 leader_election.cc:304] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:00.554078 31646 raft_consensus.cc:2804] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:00.554327 31844 raft_consensus.cc:2749] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:00.554593 31646 raft_consensus.cc:697] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:00.555729 31646 consensus_queue.cc:237] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.564428 31837 consensus_queue.cc:1048] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:00.565054 31556 tablet_bootstrap.cc:492] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:00.565822 31556 ts_tablet_manager.cc:1403] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.190s	user 0.016s	sys 0.012s
I20260709 12:24:00.560043 31469 leader_election.cc:304] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:00.564742 31614 consensus_queue.cc:1048] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:00.569034 31556 raft_consensus.cc:359] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.569787 31556 raft_consensus.cc:385] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.570135 31556 raft_consensus.cc:740] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.571036 31556 consensus_queue.cc:260] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.568861 31394 leader_election.cc:304] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:00.573361 31627 raft_consensus.cc:2749] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:00.574867 31556 ts_tablet_manager.cc:1434] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:24:00.576288 31556 tablet_bootstrap.cc:492] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:00.577072 31753 raft_consensus.cc:2804] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:00.577510 31753 raft_consensus.cc:493] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.577855 31753 raft_consensus.cc:3060] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.556994 31553 ts_tablet_manager.cc:1434] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:24:00.583096 31556 tablet_bootstrap.cc:654] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.591921 31552 tablet_bootstrap.cc:492] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:00.609822 31556 tablet_bootstrap.cc:492] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:00.610472 31556 ts_tablet_manager.cc:1403] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.010s
I20260709 12:24:00.613636 31556 raft_consensus.cc:359] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.613108 31175 catalog_manager.cc:5697] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:00.614459 31556 raft_consensus.cc:385] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.614823 31556 raft_consensus.cc:740] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.615562 31556 consensus_queue.cc:260] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.615630 31177 catalog_manager.cc:5697] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.618395 31556 ts_tablet_manager.cc:1434] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:24:00.621026 31556 tablet_bootstrap.cc:492] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:00.627869 31556 tablet_bootstrap.cc:654] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.628628 31753 raft_consensus.cc:515] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.637360 31753 leader_election.cc:290] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:00.638264 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e5a199ea34658a55df3d05a441939" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:00.643572 31785 consensus_queue.cc:1048] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:00.657580 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e5a199ea34658a55df3d05a441939" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:00.658617 31351 raft_consensus.cc:3060] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:00.659039 31468 leader_election.cc:343] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.666025 31614 raft_consensus.cc:493] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.672848 31785 consensus_queue.cc:1048] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:00.644496 31553 tablet_bootstrap.cc:492] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
W20260709 12:24:00.654284 31318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:41673, user_credentials={real_user=slave}} blocked reactor thread for 62953us
I20260709 12:24:00.670238 31614 raft_consensus.cc:515] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.654573 31606 raft_consensus.cc:493] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.679466 31606 raft_consensus.cc:515] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.680053 31614 leader_election.cc:290] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:00.656677 31556 tablet_bootstrap.cc:492] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:00.666200 31551 tablet_bootstrap.cc:492] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:00.667157 31552 tablet_bootstrap.cc:654] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:00.653203 31320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:45167, user_credentials={real_user=slave}} blocked reactor thread for 63231.5us
I20260709 12:24:00.683007 31556 ts_tablet_manager.cc:1403] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.004s
I20260709 12:24:00.683336 31551 ts_tablet_manager.cc:1403] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.238s	user 0.044s	sys 0.059s
I20260709 12:24:00.681620 31606 leader_election.cc:290] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:00.682737 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd97beba6040c69589994e8389028e" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:00.686813 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7323a3bd4ffe4eae8831fceee0397685" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:00.699206 31556 raft_consensus.cc:359] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:00.700726 31556 raft_consensus.cc:385] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.701148 31556 raft_consensus.cc:740] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
W20260709 12:24:00.699541 31318 leader_election.cc:343] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.702440 31556 consensus_queue.cc:260] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
W20260709 12:24:00.706391 31468 leader_election.cc:343] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.708384 31556 ts_tablet_manager.cc:1434] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 12:24:00.709367 31553 tablet_bootstrap.cc:654] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.710495 31556 tablet_bootstrap.cc:492] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:00.711783 31753 consensus_queue.cc:1048] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:00.715611 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7323a3bd4ffe4eae8831fceee0397685" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:00.728925 31429 raft_consensus.cc:3060] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.731866 31844 consensus_queue.cc:1048] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:00.731904 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd97beba6040c69589994e8389028e" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:00.735350 31353 raft_consensus.cc:2468] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:24:00.737602 31469 leader_election.cc:304] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:00.740294 31753 raft_consensus.cc:2804] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:00.740721 31551 raft_consensus.cc:359] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:24:00.748934 31320 leader_election.cc:343] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.741569 31551 raft_consensus.cc:385] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.749578 31320 leader_election.cc:304] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:00.749948 31351 raft_consensus.cc:2468] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:00.750268 31551 raft_consensus.cc:740] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.763361 31551 consensus_queue.cc:260] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.756100 31556 tablet_bootstrap.cc:654] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.751652 31646 raft_consensus.cc:2749] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:00.740752 31753 raft_consensus.cc:493] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.766093 31753 raft_consensus.cc:3060] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.780273 31551 ts_tablet_manager.cc:1434] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.002s
I20260709 12:24:00.797374 31556 tablet_bootstrap.cc:492] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:00.798189 31556 ts_tablet_manager.cc:1403] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.007s
I20260709 12:24:00.775427 31844 consensus_queue.cc:1048] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:24:00.788599 31701 raft_consensus.cc:493] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.809116 31551 tablet_bootstrap.cc:492] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:00.787215 31777 consensus_queue.cc:1048] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:24:00.814842 31701 raft_consensus.cc:515] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.823467 31701 leader_election.cc:290] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:00.828953 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e5a199ea34658a55df3d05a441939" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:24:00.810447 31469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:40387, user_credentials={real_user=slave}} blocked reactor thread for 72971.6us
I20260709 12:24:00.836170 31503 raft_consensus.cc:2393] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:24:00.843294 31556 raft_consensus.cc:359] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.846688 31556 raft_consensus.cc:385] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.847084 31556 raft_consensus.cc:740] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.847972 31556 consensus_queue.cc:260] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.861495 31355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455e5a199ea34658a55df3d05a441939" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:00.864431 31355 raft_consensus.cc:2393] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:24:00.870066 31244 leader_election.cc:304] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640
I20260709 12:24:00.871906 31551 tablet_bootstrap.cc:654] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.878142 31553 tablet_bootstrap.cc:492] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:00.878906 31553 ts_tablet_manager.cc:1403] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.235s	user 0.016s	sys 0.017s
I20260709 12:24:00.879563 31844 raft_consensus.cc:3060] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.889249 31556 ts_tablet_manager.cc:1434] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.091s	user 0.017s	sys 0.014s
I20260709 12:24:00.890403 31556 tablet_bootstrap.cc:492] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:00.907390 31553 raft_consensus.cc:359] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.908540 31553 raft_consensus.cc:385] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.908903 31553 raft_consensus.cc:740] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.911620 31552 tablet_bootstrap.cc:492] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:00.912129 31552 ts_tablet_manager.cc:1403] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.321s	user 0.039s	sys 0.021s
I20260709 12:24:00.913210 31553 consensus_queue.cc:260] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.919056 31556 tablet_bootstrap.cc:654] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.939775 31753 raft_consensus.cc:515] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.941045 31844 raft_consensus.cc:2749] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:00.943244 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd97beba6040c69589994e8389028e" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
W20260709 12:24:00.944811 31468 leader_election.cc:343] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:00.952272 31552 raft_consensus.cc:359] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.952884 31786 raft_consensus.cc:493] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.953121 31552 raft_consensus.cc:385] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:00.953496 31552 raft_consensus.cc:740] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:00.958758 31552 consensus_queue.cc:260] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:00.953518 31786 raft_consensus.cc:515] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.960707 31552 ts_tablet_manager.cc:1434] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 12:24:00.961251 31786 leader_election.cc:290] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:00.963074 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69abb8bd62140f58770bec881e8ec59" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:00.963609 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69abb8bd62140f58770bec881e8ec59" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:00.963830 31503 raft_consensus.cc:2468] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:00.965368 31395 leader_election.cc:304] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:00.966560 31786 raft_consensus.cc:2804] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:00.966490 31552 tablet_bootstrap.cc:492] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:00.967064 31786 raft_consensus.cc:493] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.967595 31786 raft_consensus.cc:3060] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.964250 31279 raft_consensus.cc:2468] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:00.973359 31429 raft_consensus.cc:3060] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.954944 31553 ts_tablet_manager.cc:1434] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 12:24:00.978514 31893 raft_consensus.cc:493] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.955749 31753 leader_election.cc:290] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:00.957746 31469 leader_election.cc:304] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:00.980360 31886 raft_consensus.cc:2804] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:00.980860 31886 raft_consensus.cc:697] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:00.981715 31886 consensus_queue.cc:237] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:00.987241 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd97beba6040c69589994e8389028e" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:00.987879 31354 raft_consensus.cc:3060] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:00.988320 31553 tablet_bootstrap.cc:492] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:00.979106 31893 raft_consensus.cc:515] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:00.991508 31893 leader_election.cc:290] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:00.992686 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:00.993451 31277 raft_consensus.cc:2468] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:00.994267 31552 tablet_bootstrap.cc:654] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:00.995002 31393 leader_election.cc:304] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:00.996237 31627 raft_consensus.cc:2804] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:00.996407 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:00.996734 31627 raft_consensus.cc:493] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.997854 31627 raft_consensus.cc:3060] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:00.998749 31395 leader_election.cc:343] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:01.001856 31885 consensus_queue.cc:1048] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:01.008936 31552 tablet_bootstrap.cc:492] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:01.009524 31552 ts_tablet_manager.cc:1403] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.003s
I20260709 12:24:01.011705 31893 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.012295 31893 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:01.015435 31614 consensus_queue.cc:1048] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:01.024297 31551 tablet_bootstrap.cc:492] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:01.024688 31553 tablet_bootstrap.cc:654] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.024853 31551 ts_tablet_manager.cc:1403] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.220s	user 0.019s	sys 0.008s
I20260709 12:24:01.027683 31551 raft_consensus.cc:359] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.028347 31551 raft_consensus.cc:385] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.028190 31786 raft_consensus.cc:515] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.029456 31893 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:01.032405 31552 raft_consensus.cc:359] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:01.033100 31552 raft_consensus.cc:385] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.033356 31552 raft_consensus.cc:740] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.034015 31552 consensus_queue.cc:260] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:01.035480 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:01.036177 31501 raft_consensus.cc:2468] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:01.028702 31551 raft_consensus.cc:740] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.039405 31552 ts_tablet_manager.cc:1434] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:24:01.039268 31627 raft_consensus.cc:515] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.040169 31551 consensus_queue.cc:260] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.040989 31177 catalog_manager.cc:5697] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:01.043812 31551 ts_tablet_manager.cc:1434] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:24:01.044888 31551 tablet_bootstrap.cc:492] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:01.047050 31552 tablet_bootstrap.cc:492] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:01.048094 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69abb8bd62140f58770bec881e8ec59" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:01.048296 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69abb8bd62140f58770bec881e8ec59" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:01.048717 31277 raft_consensus.cc:3060] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.048924 31501 raft_consensus.cc:3060] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.058586 31354 raft_consensus.cc:2468] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:01.079329 31551 tablet_bootstrap.cc:654] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.061532 31786 leader_election.cc:290] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:01.081497 31627 leader_election.cc:290] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:01.086285 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:01.091724 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:01.092321 31279 raft_consensus.cc:3060] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.097652 31552 tablet_bootstrap.cc:654] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.104499 31469 leader_election.cc:304] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:01.098838 31277 raft_consensus.cc:2468] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:01.099615 31556 tablet_bootstrap.cc:492] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:01.108645 31556 ts_tablet_manager.cc:1403] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.218s	user 0.017s	sys 0.029s
I20260709 12:24:01.109035 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:01.114421 31279 raft_consensus.cc:2468] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:01.108369 31886 raft_consensus.cc:2804] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:01.129002 31501 raft_consensus.cc:2468] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:01.130877 31786 raft_consensus.cc:493] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.115739 31809 raft_consensus.cc:493] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.131417 31786 raft_consensus.cc:515] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.131845 31809 raft_consensus.cc:515] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.134311 31886 raft_consensus.cc:697] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:01.135421 31786 leader_election.cc:290] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:01.135277 31886 consensus_queue.cc:237] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.140182 31395 leader_election.cc:304] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
W20260709 12:24:01.141252 31395 leader_election.cc:343] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:01.144925 31553 tablet_bootstrap.cc:492] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:01.148548 31553 ts_tablet_manager.cc:1403] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.160s	user 0.022s	sys 0.021s
I20260709 12:24:01.159533 31556 raft_consensus.cc:359] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.163544 31556 raft_consensus.cc:385] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.163975 31556 raft_consensus.cc:740] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.164824 31556 consensus_queue.cc:260] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.175318 31556 ts_tablet_manager.cc:1434] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.002s
I20260709 12:24:01.181692 31551 tablet_bootstrap.cc:492] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:01.182336 31551 ts_tablet_manager.cc:1403] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.138s	user 0.018s	sys 0.007s
I20260709 12:24:01.185319 31556 tablet_bootstrap.cc:492] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:01.185062 31551 raft_consensus.cc:359] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.185745 31551 raft_consensus.cc:385] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.186067 31551 raft_consensus.cc:740] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.194422 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fcca57e9e24daea0e2dac26aedce05" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:01.158708 31395 leader_election.cc:304] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:01.198239 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae28f8ed99514107ba0fc461d1829ce6" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
W20260709 12:24:01.198334 31395 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:34287, user_credentials={real_user=slave}} blocked reactor thread for 56444us
I20260709 12:24:01.198997 31354 raft_consensus.cc:2468] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:01.199563 31893 raft_consensus.cc:2804] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:01.200099 31893 raft_consensus.cc:697] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:01.201119 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fcca57e9e24daea0e2dac26aedce05" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:01.200961 31893 consensus_queue.cc:237] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
W20260709 12:24:01.198374 31245 leader_election.cc:343] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:01.203128 31393 leader_election.cc:304] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:24:01.201911 31426 raft_consensus.cc:2468] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:24:01.204119 31892 raft_consensus.cc:2804] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:01.204600 31892 raft_consensus.cc:697] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:01.205421 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae28f8ed99514107ba0fc461d1829ce6" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:01.206554 31279 raft_consensus.cc:2468] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:01.190060 31786 raft_consensus.cc:2804] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:01.190547 31551 consensus_queue.cc:260] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.211476 31701 raft_consensus.cc:493] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.205410 31892 consensus_queue.cc:237] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.212569 31701 raft_consensus.cc:515] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.188701 31809 leader_election.cc:290] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:01.221542 31394 leader_election.cc:304] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:01.222743 31627 raft_consensus.cc:2804] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:01.223088 31627 raft_consensus.cc:493] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.223374 31627 raft_consensus.cc:3060] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.224320 31553 raft_consensus.cc:359] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:01.225003 31553 raft_consensus.cc:385] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.225862 31245 leader_election.cc:304] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:24:01.225267 31553 raft_consensus.cc:740] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.232769 31809 raft_consensus.cc:2804] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:01.233167 31809 raft_consensus.cc:493] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.233494 31809 raft_consensus.cc:3060] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.236133 31777 consensus_queue.cc:1048] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:01.236920 31786 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:01.237414 31786 raft_consensus.cc:3060] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.245610 31701 leader_election.cc:290] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:01.247292 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd97beba6040c69589994e8389028e" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:01.248003 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd97beba6040c69589994e8389028e" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:01.248986 31354 raft_consensus.cc:2393] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:24:01.252251 31627 raft_consensus.cc:515] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.253355 31244 leader_election.cc:304] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640
I20260709 12:24:01.260551 31551 ts_tablet_manager.cc:1434] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.001s
I20260709 12:24:01.261741 31551 tablet_bootstrap.cc:492] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:01.274269 31553 consensus_queue.cc:260] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
W20260709 12:24:01.276656 31226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:01.277487 31552 tablet_bootstrap.cc:492] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:01.287065 31552 ts_tablet_manager.cc:1403] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.240s	user 0.014s	sys 0.025s
I20260709 12:24:01.289583 31556 tablet_bootstrap.cc:654] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.285372 31809 raft_consensus.cc:515] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.293872 31907 consensus_queue.cc:1048] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:01.295029 31552 raft_consensus.cc:359] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.295743 31552 raft_consensus.cc:385] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.295993 31552 raft_consensus.cc:740] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.297011 31552 consensus_queue.cc:260] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.298552 31551 tablet_bootstrap.cc:654] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.299299 31786 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:01.276804 31701 raft_consensus.cc:3060] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.303006 31552 ts_tablet_manager.cc:1434] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:24:01.306447 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae28f8ed99514107ba0fc461d1829ce6" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:01.307003 31279 raft_consensus.cc:3060] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.306538 31428 raft_consensus.cc:1240] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Rejecting Update request from peer 998cd06c0be349879a0602496bc33640 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:01.316650 31553 ts_tablet_manager.cc:1434] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.168s	user 0.004s	sys 0.006s
I20260709 12:24:01.316802 31279 raft_consensus.cc:2468] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:01.318292 31552 tablet_bootstrap.cc:492] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:01.323737 31553 tablet_bootstrap.cc:492] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:01.326894 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae28f8ed99514107ba0fc461d1829ce6" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:01.327520 31353 raft_consensus.cc:3060] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.330982 31177 catalog_manager.cc:5697] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:01.333258 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:01.334841 31552 tablet_bootstrap.cc:654] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.335623 31177 catalog_manager.cc:5697] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:01.339625 31786 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:01.341969 31809 leader_election.cc:290] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:01.342041 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:01.344619 31701 raft_consensus.cc:2749] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:01.351213 31175 catalog_manager.cc:5697] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:01.372328 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fcca57e9e24daea0e2dac26aedce05" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
W20260709 12:24:01.378041 31245 leader_election.cc:343] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:01.380044 31395 leader_election.cc:304] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640
I20260709 12:24:01.380988 31893 raft_consensus.cc:2749] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:01.378955 31353 raft_consensus.cc:2468] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:01.392809 31393 leader_election.cc:304] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:01.394992 31893 raft_consensus.cc:2804] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:01.395505 31893 raft_consensus.cc:697] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:01.396350 31893 consensus_queue.cc:237] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.390762 31427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fcca57e9e24daea0e2dac26aedce05" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:01.401006 31427 raft_consensus.cc:3060] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.401429 31552 tablet_bootstrap.cc:492] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:01.401989 31552 ts_tablet_manager.cc:1403] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.088s	user 0.022s	sys 0.003s
I20260709 12:24:01.402462 31553 tablet_bootstrap.cc:654] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.404846 31552 raft_consensus.cc:359] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.405565 31552 raft_consensus.cc:385] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.405839 31552 raft_consensus.cc:740] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.406687 31552 consensus_queue.cc:260] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.407298 31551 tablet_bootstrap.cc:492] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:01.407806 31551 ts_tablet_manager.cc:1403] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.146s	user 0.022s	sys 0.005s
I20260709 12:24:01.408978 31552 ts_tablet_manager.cc:1434] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:01.410137 31552 tablet_bootstrap.cc:492] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:01.410629 31551 raft_consensus.cc:359] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.411345 31551 raft_consensus.cc:385] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.411624 31551 raft_consensus.cc:740] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.412254 31551 consensus_queue.cc:260] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.414310 31551 ts_tablet_manager.cc:1434] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:24:01.415068 31627 leader_election.cc:290] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:01.417848 31552 tablet_bootstrap.cc:654] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.420707 31551 tablet_bootstrap.cc:492] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:01.429786 31553 tablet_bootstrap.cc:492] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:01.430330 31553 ts_tablet_manager.cc:1403] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.008s
I20260709 12:24:01.430389 31552 tablet_bootstrap.cc:492] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:01.431039 31552 ts_tablet_manager.cc:1403] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 12:24:01.434865 31553 raft_consensus.cc:359] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.435842 31556 tablet_bootstrap.cc:492] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:01.436369 31556 ts_tablet_manager.cc:1403] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.251s	user 0.020s	sys 0.014s
I20260709 12:24:01.438952 31556 raft_consensus.cc:359] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.439544 31556 raft_consensus.cc:385] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.439803 31556 raft_consensus.cc:740] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.440510 31556 consensus_queue.cc:260] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.442860 31556 ts_tablet_manager.cc:1434] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:01.443864 31556 tablet_bootstrap.cc:492] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:01.449515 31556 tablet_bootstrap.cc:654] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.435833 31553 raft_consensus.cc:385] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.452224 31553 raft_consensus.cc:740] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.452904 31553 consensus_queue.cc:260] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.455298 31553 ts_tablet_manager.cc:1434] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:24:01.456296 31553 tablet_bootstrap.cc:492] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:01.456983 31427 raft_consensus.cc:2468] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:24:01.461397 31777 consensus_queue.cc:1059] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:01.462396 31777 raft_consensus.cc:3055] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:01.462728 31777 raft_consensus.cc:740] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:01.463546 31777 consensus_queue.cc:260] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:01.464192 31553 tablet_bootstrap.cc:654] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.468703 31777 raft_consensus.cc:3060] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.470368 31907 consensus_queue.cc:1048] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:01.472961 31552 raft_consensus.cc:359] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.473948 31552 raft_consensus.cc:385] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.474309 31552 raft_consensus.cc:740] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.477793 31552 consensus_queue.cc:260] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.479161 31245 leader_election.cc:304] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:24:01.483894 31551 tablet_bootstrap.cc:654] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.488852 31552 ts_tablet_manager.cc:1434] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 12:24:01.493920 31809 raft_consensus.cc:2804] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:01.494426 31552 tablet_bootstrap.cc:492] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:01.513538 31556 tablet_bootstrap.cc:492] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:01.514431 31556 ts_tablet_manager.cc:1403] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.019s
I20260709 12:24:01.503101 31809 raft_consensus.cc:697] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:01.520350 31174 catalog_manager.cc:5697] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:01.521823 31844 raft_consensus.cc:493] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.523010 31844 raft_consensus.cc:515] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.524338 31809 consensus_queue.cc:237] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.525278 31844 leader_election.cc:290] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:01.528260 31909 raft_consensus.cc:493] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.535401 31837 raft_consensus.cc:493] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.536026 31837 raft_consensus.cc:515] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:01.539500 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ac93be0c8e4f939c700b1ac7fa43d6" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:01.540573 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7323a3bd4ffe4eae8831fceee0397685" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:01.541291 31352 raft_consensus.cc:2468] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:24:01.543015 31427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7323a3bd4ffe4eae8831fceee0397685" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:01.543205 31244 leader_election.cc:304] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:01.543802 31427 raft_consensus.cc:2468] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:24:01.528848 31909 raft_consensus.cc:515] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.545002 31699 raft_consensus.cc:2804] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:01.546173 31699 raft_consensus.cc:493] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.546530 31699 raft_consensus.cc:3060] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.547382 31909 leader_election.cc:290] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:01.548637 31837 leader_election.cc:290] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:01.548864 31428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:01.549726 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ac93be0c8e4f939c700b1ac7fa43d6" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:01.550470 31503 raft_consensus.cc:2468] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:24:01.550637 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:01.551400 31279 raft_consensus.cc:2393] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:24:01.552457 31320 leader_election.cc:304] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:01.554196 31468 leader_election.cc:304] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:01.555387 31909 raft_consensus.cc:3060] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.557008 31551 tablet_bootstrap.cc:492] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:01.557634 31551 ts_tablet_manager.cc:1403] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.137s	user 0.020s	sys 0.004s
I20260709 12:24:01.553845 31837 raft_consensus.cc:2804] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:01.567723 31837 raft_consensus.cc:493] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.568132 31837 raft_consensus.cc:3060] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.571933 31777 raft_consensus.cc:493] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.569000 31551 raft_consensus.cc:359] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.572803 31551 raft_consensus.cc:385] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.572486 31777 raft_consensus.cc:515] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.574761 31777 leader_election.cc:290] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:01.575853 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b3ab9ea32b4118bdeaef97935b378b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:01.576318 31428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b3ab9ea32b4118bdeaef97935b378b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:01.572930 31552 tablet_bootstrap.cc:654] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.578080 31908 consensus_queue.cc:1048] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:01.578074 31320 leader_election.cc:343] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:01.578810 31551 raft_consensus.cc:740] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.583815 31551 consensus_queue.cc:260] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.584863 31279 raft_consensus.cc:2468] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:24:01.586447 31551 ts_tablet_manager.cc:1434] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
I20260709 12:24:01.603569 31551 tablet_bootstrap.cc:492] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:01.606127 31553 tablet_bootstrap.cc:492] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:01.606676 31553 ts_tablet_manager.cc:1403] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.151s	user 0.016s	sys 0.011s
I20260709 12:24:01.610087 31556 raft_consensus.cc:359] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:01.610366 31318 leader_election.cc:304] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:01.610848 31556 raft_consensus.cc:385] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.609160 31175 catalog_manager.cc:5697] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:01.611145 31556 raft_consensus.cc:740] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
W20260709 12:24:01.611972 31320 leader_election.cc:343] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:01.612777 31614 raft_consensus.cc:493] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.613252 31614 raft_consensus.cc:515] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.613543 31777 raft_consensus.cc:2804] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:01.614089 31777 raft_consensus.cc:493] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.614496 31777 raft_consensus.cc:3060] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.615274 31614 leader_election.cc:290] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:01.622991 31909 raft_consensus.cc:2749] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:01.624861 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f85ad47fd43e997766faf8e9ae119" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:01.624369 31699 raft_consensus.cc:515] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.632249 31556 consensus_queue.cc:260] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:01.634897 31551 tablet_bootstrap.cc:654] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.639883 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f85ad47fd43e997766faf8e9ae119" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:01.645764 31556 ts_tablet_manager.cc:1434] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.131s	user 0.006s	sys 0.001s
W20260709 12:24:01.643148 31318 leader_election.cc:343] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:01.672320 31320 leader_election.cc:343] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:01.678013 31320 leader_election.cc:304] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:01.683326 31614 raft_consensus.cc:2749] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:01.684170 31553 raft_consensus.cc:359] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.684746 31553 raft_consensus.cc:385] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.686642 31556 tablet_bootstrap.cc:492] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:01.684974 31553 raft_consensus.cc:740] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.687928 31553 consensus_queue.cc:260] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.693425 31551 tablet_bootstrap.cc:492] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:01.695672 31551 ts_tablet_manager.cc:1403] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.013s
I20260709 12:24:01.688673 31646 raft_consensus.cc:493] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.698791 31646 raft_consensus.cc:515] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.700208 31552 tablet_bootstrap.cc:492] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:01.700773 31552 ts_tablet_manager.cc:1403] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.209s	user 0.026s	sys 0.028s
I20260709 12:24:01.700948 31646 leader_election.cc:290] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:01.703670 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f373819fb7049ee9b511c4cad4374fd" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:01.704478 31777 raft_consensus.cc:515] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.709579 31556 tablet_bootstrap.cc:654] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.710322 31606 consensus_queue.cc:1048] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:01.720228 31553 ts_tablet_manager.cc:1434] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260709 12:24:01.722816 31699 leader_election.cc:290] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:01.713217 31892 consensus_queue.cc:1048] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:24:01.731511 31552 raft_consensus.cc:359] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.732537 31552 raft_consensus.cc:385] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.732877 31552 raft_consensus.cc:740] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.736708 31777 leader_election.cc:290] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:01.733765 31552 consensus_queue.cc:260] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.740317 31627 consensus_queue.cc:1048] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:01.742935 31320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:45167, user_credentials={real_user=slave}} blocked reactor thread for 60747.4us
I20260709 12:24:01.693656 31837 raft_consensus.cc:515] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:01.744982 31553 tablet_bootstrap.cc:492] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:01.751277 31552 ts_tablet_manager.cc:1434] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.003s
I20260709 12:24:01.745482 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b3ab9ea32b4118bdeaef97935b378b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:01.758163 31278 raft_consensus.cc:3060] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.758421 31606 consensus_queue.cc:1048] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:01.760618 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f373819fb7049ee9b511c4cad4374fd" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:01.760915 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b3ab9ea32b4118bdeaef97935b378b" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:01.766387 31278 raft_consensus.cc:2468] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:01.766827 31837 leader_election.cc:290] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:01.758263 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7323a3bd4ffe4eae8831fceee0397685" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:01.768939 31355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7323a3bd4ffe4eae8831fceee0397685" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:01.774235 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ac93be0c8e4f939c700b1ac7fa43d6" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:01.774827 31553 tablet_bootstrap.cc:654] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.774991 31892 consensus_queue.cc:1048] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:01.774247 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ac93be0c8e4f939c700b1ac7fa43d6" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
W20260709 12:24:01.776257 31320 leader_election.cc:343] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:01.777053 31429 raft_consensus.cc:3060] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.792922 31506 raft_consensus.cc:3060] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.796300 31551 raft_consensus.cc:359] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:24:01.787395 31320 leader_election.cc:343] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:01.802135 31551 raft_consensus.cc:385] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.802524 31551 raft_consensus.cc:740] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.806320 31552 tablet_bootstrap.cc:492] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:01.782907 31355 raft_consensus.cc:3060] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.808259 31429 raft_consensus.cc:2468] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:24:01.815641 31551 consensus_queue.cc:260] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.799574 31426 raft_consensus.cc:3060] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.817768 31245 leader_election.cc:304] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:01.818222 31844 raft_consensus.cc:493] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.815335 31506 raft_consensus.cc:2468] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:01.821002 31551 ts_tablet_manager.cc:1434] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.000s
W20260709 12:24:01.801303 31318 leader_election.cc:343] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:01.823325 31320 leader_election.cc:304] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:01.824530 31556 tablet_bootstrap.cc:492] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:01.823257 31844 raft_consensus.cc:515] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:01.830154 31844 leader_election.cc:290] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:01.831727 31318 leader_election.cc:304] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:01.832085 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f373819fb7049ee9b511c4cad4374fd" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:01.832592 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f373819fb7049ee9b511c4cad4374fd" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:01.833504 31318 leader_election.cc:304] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
W20260709 12:24:01.834649 31245 leader_election.cc:343] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:01.835381 31930 raft_consensus.cc:2804] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:01.835934 31930 raft_consensus.cc:697] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:01.836849 31930 consensus_queue.cc:237] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.838125 31837 raft_consensus.cc:2804] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:01.832719 31354 raft_consensus.cc:2468] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:24:01.838646 31837 raft_consensus.cc:697] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:01.839326 31646 raft_consensus.cc:2749] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:01.822157 31925 raft_consensus.cc:2804] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:01.840019 31925 raft_consensus.cc:697] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:01.840852 31925 consensus_queue.cc:237] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.846750 31244 leader_election.cc:304] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:24:01.839519 31837 consensus_queue.cc:237] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:01.847085 31355 raft_consensus.cc:2468] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:24:01.848196 31701 raft_consensus.cc:2804] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:01.859899 31701 raft_consensus.cc:493] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.860330 31701 raft_consensus.cc:3060] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:01.860598 31551 tablet_bootstrap.cc:492] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:01.848564 31552 tablet_bootstrap.cc:654] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.866285 31556 ts_tablet_manager.cc:1403] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.186s	user 0.032s	sys 0.020s
I20260709 12:24:01.848641 31786 consensus_queue.cc:1048] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:24:01.864408 31426 raft_consensus.cc:2468] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:01.869257 31553 tablet_bootstrap.cc:492] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:01.878716 31553 ts_tablet_manager.cc:1403] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.005s
I20260709 12:24:01.869127 31556 raft_consensus.cc:359] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.881464 31556 raft_consensus.cc:385] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.903837 31551 tablet_bootstrap.cc:654] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:01.881853 31556 raft_consensus.cc:740] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.912366 31556 consensus_queue.cc:260] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.937528 31556 ts_tablet_manager.cc:1434] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.071s	user 0.014s	sys 0.011s
I20260709 12:24:01.938673 31556 tablet_bootstrap.cc:492] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:01.952414 31553 raft_consensus.cc:359] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.953156 31553 raft_consensus.cc:385] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:01.953433 31553 raft_consensus.cc:740] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:01.955921 31553 consensus_queue.cc:260] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:01.971658 31552 tablet_bootstrap.cc:492] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:01.972484 31552 ts_tablet_manager.cc:1403] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.193s	user 0.012s	sys 0.007s
I20260709 12:24:01.974604 31644 raft_consensus.cc:493] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.967952 31892 raft_consensus.cc:493] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.990620 31892 raft_consensus.cc:515] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:01.980060 31644 raft_consensus.cc:515] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:02.000924 31892 leader_election.cc:290] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:02.005456 31908 raft_consensus.cc:493] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.998528 31553 ts_tablet_manager.cc:1434] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.001s
I20260709 12:24:02.016042 31701 raft_consensus.cc:515] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:02.018149 31908 raft_consensus.cc:515] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.021858 31908 leader_election.cc:290] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:02.024466 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a9bea17c8409da9f38b8bc322e895" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:02.034410 31556 tablet_bootstrap.cc:654] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.039963 31701 leader_election.cc:290] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:02.001657 31644 leader_election.cc:290] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:02.042495 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f373819fb7049ee9b511c4cad4374fd" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:02.045986 31893 consensus_queue.cc:1048] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:02.046494 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fcca57e9e24daea0e2dac26aedce05" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:02.054607 31426 raft_consensus.cc:2393] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in this term.
I20260709 12:24:02.056588 31553 tablet_bootstrap.cc:492] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
W20260709 12:24:02.047634 31245 leader_election.cc:343] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:02.045215 31174 catalog_manager.cc:5697] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.051496 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b3ab9ea32b4118bdeaef97935b378b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:02.052213 31552 raft_consensus.cc:359] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.066020 31552 raft_consensus.cc:385] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.066334 31552 raft_consensus.cc:740] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.067006 31552 consensus_queue.cc:260] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.069543 31552 ts_tablet_manager.cc:1434] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.097s	user 0.001s	sys 0.005s
W20260709 12:24:02.049805 31318 leader_election.cc:343] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:02.072956 31552 tablet_bootstrap.cc:492] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:02.074064 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b3ab9ea32b4118bdeaef97935b378b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:02.074971 31276 raft_consensus.cc:2393] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 1: Already voted for candidate 998cd06c0be349879a0602496bc33640 in this term.
I20260709 12:24:02.065331 31174 catalog_manager.cc:5697] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.079779 31553 tablet_bootstrap.cc:654] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.082962 31556 tablet_bootstrap.cc:492] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:02.083344 31552 tablet_bootstrap.cc:654] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.083475 31556 ts_tablet_manager.cc:1403] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.145s	user 0.014s	sys 0.005s
I20260709 12:24:02.087052 31556 raft_consensus.cc:359] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.087947 31556 raft_consensus.cc:385] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.088280 31556 raft_consensus.cc:740] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.089080 31556 consensus_queue.cc:260] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.108707 31551 tablet_bootstrap.cc:492] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:02.109283 31551 ts_tablet_manager.cc:1403] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.249s	user 0.024s	sys 0.048s
I20260709 12:24:02.110780 31556 ts_tablet_manager.cc:1434] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:24:02.111790 31556 tablet_bootstrap.cc:492] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:02.111917 31551 raft_consensus.cc:359] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:02.112663 31551 raft_consensus.cc:385] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.112953 31551 raft_consensus.cc:740] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.113649 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f373819fb7049ee9b511c4cad4374fd" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:02.113590 31551 consensus_queue.cc:260] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:02.114524 31354 raft_consensus.cc:3060] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:02.116552 31551 ts_tablet_manager.cc:1434] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:02.119014 31556 tablet_bootstrap.cc:654] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.120791 31551 tablet_bootstrap.cc:492] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:02.124847 31553 tablet_bootstrap.cc:492] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:02.125339 31553 ts_tablet_manager.cc:1403] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.010s
I20260709 12:24:02.125377 31908 raft_consensus.cc:493] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.126065 31908 raft_consensus.cc:515] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.128175 31553 raft_consensus.cc:359] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:02.128858 31553 raft_consensus.cc:385] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.129137 31553 raft_consensus.cc:740] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.129838 31908 leader_election.cc:290] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:02.129827 31177 catalog_manager.cc:5697] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.136163 31551 tablet_bootstrap.cc:654] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.146252 31553 consensus_queue.cc:260] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:02.148393 31553 ts_tablet_manager.cc:1434] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:24:02.148929 31551 tablet_bootstrap.cc:492] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:02.149468 31551 ts_tablet_manager.cc:1403] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.008s
I20260709 12:24:02.150148 31553 tablet_bootstrap.cc:492] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:02.151286 31501 raft_consensus.cc:3060] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:02.153025 31556 tablet_bootstrap.cc:492] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:02.153702 31551 raft_consensus.cc:359] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.158180 31551 raft_consensus.cc:385] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.158265 31556 ts_tablet_manager.cc:1403] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
I20260709 12:24:02.158494 31551 raft_consensus.cc:740] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.159238 31551 consensus_queue.cc:260] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.161309 31551 ts_tablet_manager.cc:1434] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:24:02.162317 31551 tablet_bootstrap.cc:492] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:02.162386 31701 consensus_queue.cc:1048] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:02.156919 31553 tablet_bootstrap.cc:654] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.171860 31556 raft_consensus.cc:359] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:02.172621 31556 raft_consensus.cc:385] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.172869 31556 raft_consensus.cc:740] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.173381 31556 consensus_queue.cc:260] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:02.175132 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fcca57e9e24daea0e2dac26aedce05" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:02.175546 31556 ts_tablet_manager.cc:1434] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:24:02.176647 31556 tablet_bootstrap.cc:492] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:02.178921 31947 raft_consensus.cc:493] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.179512 31947 raft_consensus.cc:515] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.183988 31947 leader_election.cc:290] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:02.185827 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:02.186657 31503 raft_consensus.cc:2468] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:02.188436 31395 leader_election.cc:304] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:02.188829 31556 tablet_bootstrap.cc:654] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.191800 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a9bea17c8409da9f38b8bc322e895" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:02.192495 31431 raft_consensus.cc:2468] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:24:02.192659 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:02.193351 31277 raft_consensus.cc:2468] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:24:02.197137 31551 tablet_bootstrap.cc:654] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.189640 31947 raft_consensus.cc:2804] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:02.198930 31947 raft_consensus.cc:493] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.199440 31947 raft_consensus.cc:3060] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:02.207376 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:02.257987 31393 leader_election.cc:304] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:02.260856 31893 consensus_queue.cc:1048] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:24:02.266638 31354 raft_consensus.cc:2468] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:24:02.305516 31556 tablet_bootstrap.cc:492] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:02.306291 31556 ts_tablet_manager.cc:1403] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.130s	user 0.032s	sys 0.037s
W20260709 12:24:02.311949 31393 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:41673, user_credentials={real_user=slave}} blocked reactor thread for 54125.1us
I20260709 12:24:02.315904 31468 leader_election.cc:304] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:02.320590 31553 tablet_bootstrap.cc:492] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:02.321094 31553 ts_tablet_manager.cc:1403] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.171s	user 0.022s	sys 0.044s
I20260709 12:24:02.322775 31244 leader_election.cc:304] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:24:02.312069 31946 raft_consensus.cc:3060] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:02.331277 31468 leader_election.cc:304] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:24:02.332160 31606 raft_consensus.cc:2804] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:02.332659 31606 raft_consensus.cc:493] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.333113 31606 raft_consensus.cc:3060] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:02.335954 31552 tablet_bootstrap.cc:492] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:02.337679 31552 ts_tablet_manager.cc:1403] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.265s	user 0.070s	sys 0.102s
I20260709 12:24:02.345464 31809 raft_consensus.cc:493] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.318863 31701 consensus_queue.cc:1048] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:24:02.355806 31553 raft_consensus.cc:359] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.356562 31553 raft_consensus.cc:385] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.356945 31553 raft_consensus.cc:740] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.353487 31556 raft_consensus.cc:359] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.347532 31809 raft_consensus.cc:515] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:02.358052 31556 raft_consensus.cc:385] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.358384 31556 raft_consensus.cc:740] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.359752 31809 leader_election.cc:290] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:02.348042 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:02.360530 31277 raft_consensus.cc:2468] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:02.363504 31551 tablet_bootstrap.cc:492] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:02.364038 31551 ts_tablet_manager.cc:1403] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.202s	user 0.004s	sys 0.017s
I20260709 12:24:02.360479 31556 consensus_queue.cc:260] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.348179 31948 raft_consensus.cc:2804] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:02.366422 31355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f85ad47fd43e997766faf8e9ae119" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:02.367156 31948 raft_consensus.cc:697] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:02.367273 31355 raft_consensus.cc:2468] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:24:02.368019 31948 consensus_queue.cc:237] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:02.368681 31925 consensus_queue.cc:1048] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:02.369900 31556 ts_tablet_manager.cc:1434] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:24:02.370936 31556 tablet_bootstrap.cc:492] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:02.334100 31909 raft_consensus.cc:2749] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:02.377136 31244 leader_election.cc:304] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:02.357779 31553 consensus_queue.cc:260] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.379575 31551 raft_consensus.cc:359] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.380342 31551 raft_consensus.cc:385] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.380579 31551 raft_consensus.cc:740] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.380816 31553 ts_tablet_manager.cc:1434] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.003s
I20260709 12:24:02.356609 31552 raft_consensus.cc:359] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.387341 31552 raft_consensus.cc:385] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:24:02.388809 31320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:45167, user_credentials={real_user=slave}} blocked reactor thread for 71799.4us
I20260709 12:24:02.387833 31552 raft_consensus.cc:740] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.389833 31320 leader_election.cc:304] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:02.394066 31930 raft_consensus.cc:2804] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:02.394505 31930 raft_consensus.cc:493] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.394834 31930 raft_consensus.cc:3060] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:02.391088 31809 raft_consensus.cc:2804] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:02.396727 31809 raft_consensus.cc:493] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.397089 31809 raft_consensus.cc:3060] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:02.398949 31552 consensus_queue.cc:260] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
W20260709 12:24:02.399911 31226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:02.381230 31551 consensus_queue.cc:260] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.392939 31606 raft_consensus.cc:515] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.404268 31606 leader_election.cc:290] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:02.405697 31551 ts_tablet_manager.cc:1434] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.003s
I20260709 12:24:02.408219 31646 raft_consensus.cc:493] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.408298 31552 ts_tablet_manager.cc:1434] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.000s
I20260709 12:24:02.408800 31646 raft_consensus.cc:515] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.409781 31552 tablet_bootstrap.cc:492] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:02.391208 31947 raft_consensus.cc:515] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.413961 31646 leader_election.cc:290] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:02.415866 31947 leader_election.cc:290] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:02.415957 31429 raft_consensus.cc:2393] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:24:02.404639 31930 raft_consensus.cc:515] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:02.422236 31930 leader_election.cc:290] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:02.422057 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff653c4c2e914776b9658d2b0d395afe" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:02.434347 31553 tablet_bootstrap.cc:492] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
W20260709 12:24:02.437923 31468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:41673, user_credentials={real_user=slave}} blocked reactor thread for 105393us
I20260709 12:24:02.446128 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f85ad47fd43e997766faf8e9ae119" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:02.448523 31930 consensus_queue.cc:1048] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:24:02.449064 31427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff653c4c2e914776b9658d2b0d395afe" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:02.460630 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:02.438263 31699 consensus_queue.cc:1048] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:24:02.461443 31275 raft_consensus.cc:3060] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:02.456792 31320 leader_election.cc:343] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:02.486868 31320 leader_election.cc:343] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:02.487334 31320 leader_election.cc:304] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:02.488070 31614 raft_consensus.cc:2749] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:02.447885 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a9bea17c8409da9f38b8bc322e895" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:02.511864 31946 raft_consensus.cc:2749] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:02.517755 31553 tablet_bootstrap.cc:654] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.525684 31556 tablet_bootstrap.cc:654] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.531898 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:02.533005 31506 raft_consensus.cc:2393] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:24:02.468000 31837 consensus_queue.cc:1048] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.066s
I20260709 12:24:02.599565 31947 raft_consensus.cc:493] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.600158 31947 raft_consensus.cc:515] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.602355 31947 leader_election.cc:290] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:02.603837 31552 tablet_bootstrap.cc:654] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.604079 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9eda698af44e0194bcc4cf3ccc7689" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:02.604780 31349 raft_consensus.cc:2468] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:02.607903 31394 leader_election.cc:304] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:02.615146 31975 raft_consensus.cc:493] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.615868 31975 raft_consensus.cc:515] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
W20260709 12:24:02.617182 31245 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:45167, user_credentials={real_user=slave}} blocked reactor thread for 108251us
W20260709 12:24:02.619938 31245 leader_election.cc:343] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:02.625492 31469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:40387, user_credentials={real_user=slave}} blocked reactor thread for 114943us
W20260709 12:24:02.607052 31953 log.cc:927] Time spent T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:02.545315 31425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a9bea17c8409da9f38b8bc322e895" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:02.634568 31551 tablet_bootstrap.cc:492] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
W20260709 12:24:02.646183 31244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:40387, user_credentials={real_user=slave}} blocked reactor thread for 140619us
W20260709 12:24:02.617841 31318 leader_election.cc:343] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:02.636116 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:02.643229 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:02.647944 31425 raft_consensus.cc:3060] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:02.659221 31318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:41673, user_credentials={real_user=slave}} blocked reactor thread for 46039.1us
I20260709 12:24:02.703181 31975 leader_election.cc:290] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:02.710875 31431 raft_consensus.cc:2393] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:24:02.724342 31556 tablet_bootstrap.cc:492] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:02.706401 31644 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.724977 31556 ts_tablet_manager.cc:1403] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.354s	user 0.022s	sys 0.014s
I20260709 12:24:02.729254 31966 raft_consensus.cc:2804] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:02.725157 31644 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.732721 31966 raft_consensus.cc:493] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.733161 31966 raft_consensus.cc:3060] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:02.734760 31644 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:02.736810 31837 consensus_queue.cc:1048] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:02.739293 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9eda698af44e0194bcc4cf3ccc7689" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:02.745843 31553 tablet_bootstrap.cc:492] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:02.746665 31553 ts_tablet_manager.cc:1403] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.322s	user 0.016s	sys 0.001s
I20260709 12:24:02.743836 31644 consensus_queue.cc:1048] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:24:02.757233 31970 raft_consensus.cc:493] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.757896 31970 raft_consensus.cc:515] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.760022 31970 leader_election.cc:290] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:02.760462 31964 raft_consensus.cc:493] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.743961 31275 raft_consensus.cc:2468] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:02.761013 31964 raft_consensus.cc:515] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:02.763422 31964 leader_election.cc:290] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:02.730104 31809 raft_consensus.cc:515] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:02.785076 31553 raft_consensus.cc:359] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:02.788508 31553 raft_consensus.cc:385] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.788900 31553 raft_consensus.cc:740] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.789904 31553 consensus_queue.cc:260] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:24:02.799530 31974 log.cc:927] Time spent T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:24:02.803182 31809 leader_election.cc:290] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:02.804952 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:02.811668 31553 ts_tablet_manager.cc:1434] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 12:24:02.816895 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f85ad47fd43e997766faf8e9ae119" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:02.817770 31354 raft_consensus.cc:3060] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:02.827956 31354 raft_consensus.cc:2468] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:24:02.847263 31556 raft_consensus.cc:359] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.848379 31556 raft_consensus.cc:385] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.848686 31556 raft_consensus.cc:740] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.855221 31556 consensus_queue.cc:260] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.874732 31393 leader_election.cc:304] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:02.875517 31556 ts_tablet_manager.cc:1434] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.150s	user 0.003s	sys 0.006s
I20260709 12:24:02.879599 31551 tablet_bootstrap.cc:654] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.886238 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9eda698af44e0194bcc4cf3ccc7689" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:02.886891 31352 raft_consensus.cc:2468] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:24:02.893643 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f373819fb7049ee9b511c4cad4374fd" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:02.894508 31349 raft_consensus.cc:2393] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in this term.
I20260709 12:24:02.900863 31894 raft_consensus.cc:2749] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:02.897950 31244 leader_election.cc:304] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:02.904954 31951 raft_consensus.cc:2804] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:02.902182 31966 raft_consensus.cc:515] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.917404 31429 raft_consensus.cc:2393] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:24:02.910444 31893 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.911746 31951 raft_consensus.cc:697] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:02.914209 31982 consensus_queue.cc:1048] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:24:02.935801 31552 tablet_bootstrap.cc:492] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:02.936390 31552 ts_tablet_manager.cc:1403] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.527s	user 0.014s	sys 0.014s
I20260709 12:24:02.939280 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:02.929412 31893 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.942124 31893 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:02.954887 31553 tablet_bootstrap.cc:492] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:02.960984 31978 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:02.961608 31978 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:02.961043 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f373819fb7049ee9b511c4cad4374fd" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:02.963814 31978 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:02.967748 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b3b16774644d7e85c404e0fd485a60" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:02.973057 31431 raft_consensus.cc:2468] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 2.
W20260709 12:24:02.974642 31245 leader_election.cc:343] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:02.977380 31320 leader_election.cc:304] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:24:02.978938 31614 raft_consensus.cc:2804] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:02.979319 31614 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.979427 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:02.980149 31504 raft_consensus.cc:2468] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:02.980957 31614 raft_consensus.cc:3060] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.982139 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9eda698af44e0194bcc4cf3ccc7689" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:02.982844 31503 raft_consensus.cc:2468] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:02.984026 31468 leader_election.cc:304] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:02.985277 31972 raft_consensus.cc:2804] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:02.985766 31972 raft_consensus.cc:697] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:02.986608 31972 consensus_queue.cc:237] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:02.945016 31951 consensus_queue.cc:237] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:02.993759 31966 leader_election.cc:290] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:02.999490 31556 tablet_bootstrap.cc:492] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:03.000774 31552 raft_consensus.cc:359] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.001520 31552 raft_consensus.cc:385] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.001948 31614 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:03.004434 31425 raft_consensus.cc:2468] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:03.001782 31552 raft_consensus.cc:740] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.015627 31552 consensus_queue.cc:260] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.018040 31552 ts_tablet_manager.cc:1434] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.000s
I20260709 12:24:03.018698 31320 leader_election.cc:304] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:03.017665 31556 tablet_bootstrap.cc:654] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.019788 31553 tablet_bootstrap.cc:654] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.019924 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b3b16774644d7e85c404e0fd485a60" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:03.020865 31930 raft_consensus.cc:2804] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.021414 31930 raft_consensus.cc:697] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:03.051172 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f85ad47fd43e997766faf8e9ae119" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:03.051885 31506 raft_consensus.cc:3060] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.052022 31614 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 3 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:03.053807 31353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:03.054700 31353 raft_consensus.cc:2393] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 3: Already voted for candidate 998cd06c0be349879a0602496bc33640 in this term.
I20260709 12:24:03.056159 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:03.056819 31500 raft_consensus.cc:3060] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.060505 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:03.061326 31426 raft_consensus.cc:2393] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 2: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:24:03.067382 31552 tablet_bootstrap.cc:492] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640: Bootstrap starting.
I20260709 12:24:03.067054 31506 raft_consensus.cc:2468] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
I20260709 12:24:03.073485 31174 catalog_manager.cc:5697] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:03.078558 31989 log.cc:927] Time spent T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:24:03.082017 31930 consensus_queue.cc:237] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.097673 31551 tablet_bootstrap.cc:492] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:03.098313 31551 ts_tablet_manager.cc:1403] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.479s	user 0.025s	sys 0.006s
I20260709 12:24:03.068444 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9eda698af44e0194bcc4cf3ccc7689" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:03.100226 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:03.114742 31354 raft_consensus.cc:2368] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed for earlier term 2. Current term is 3.
W20260709 12:24:03.103093 31245 leader_election.cc:343] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.115468 31245 leader_election.cc:304] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:03.116639 31945 raft_consensus.cc:2749] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:03.117292 31351 raft_consensus.cc:3060] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.118651 31556 tablet_bootstrap.cc:492] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:03.119136 31556 ts_tablet_manager.cc:1403] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.001s
I20260709 12:24:03.112200 31499 raft_consensus.cc:3060] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.122088 31556 raft_consensus.cc:359] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:03.122792 31556 raft_consensus.cc:385] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.123057 31556 raft_consensus.cc:740] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.123672 31556 consensus_queue.cc:260] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:03.112816 31551 raft_consensus.cc:359] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.125074 31551 raft_consensus.cc:385] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.114863 31395 leader_election.cc:304] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 998cd06c0be349879a0602496bc33640
I20260709 12:24:03.125352 31556 ts_tablet_manager.cc:1434] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:03.126350 31556 tablet_bootstrap.cc:492] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:03.126565 31966 raft_consensus.cc:2804] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:03.125355 31551 raft_consensus.cc:740] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.127157 31966 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.127705 31966 raft_consensus.cc:3060] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:03.130913 31995 log.cc:927] Time spent T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:03.127718 31551 consensus_queue.cc:260] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.133455 31551 ts_tablet_manager.cc:1434] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 12:24:03.134060 31556 tablet_bootstrap.cc:654] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.134443 31551 tablet_bootstrap.cc:492] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:03.135044 31469 leader_election.cc:304] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:03.136464 31469 leader_election.cc:304] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:03.141623 31962 raft_consensus.cc:2804] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.142279 31962 raft_consensus.cc:493] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.142693 31962 raft_consensus.cc:3060] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.068288 31500 raft_consensus.cc:2468] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 3.
I20260709 12:24:03.148082 31425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:03.201702 31320 leader_election.cc:304] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:03.208863 31963 raft_consensus.cc:2804] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:03.209431 31963 raft_consensus.cc:697] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 3 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:03.210300 31963 consensus_queue.cc:237] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:03.212087 31351 raft_consensus.cc:2468] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:03.214600 31469 leader_election.cc:400] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Vote denied by peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387) with higher term. Message: Invalid argument: T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed for earlier term 2. Current term is 3.
I20260709 12:24:03.216811 31469 leader_election.cc:403] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:03.217839 31553 tablet_bootstrap.cc:492] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:03.218683 31553 ts_tablet_manager.cc:1403] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.264s	user 0.030s	sys 0.024s
I20260709 12:24:03.197590 31966 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:03.219457 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9eda698af44e0194bcc4cf3ccc7689" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:03.229305 31425 raft_consensus.cc:2393] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 998cd06c0be349879a0602496bc33640 in current term 3: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:24:03.228608 31394 leader_election.cc:304] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:03.237388 31551 tablet_bootstrap.cc:654] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.239912 31980 raft_consensus.cc:2749] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387) with higher term. Message: Invalid argument: T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed for earlier term 2. Current term is 3.
I20260709 12:24:03.240931 31946 raft_consensus.cc:493] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.241425 31946 raft_consensus.cc:515] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:03.243705 31966 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:03.245421 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:03.246243 31274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b3b16774644d7e85c404e0fd485a60" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:03.247118 31993 raft_consensus.cc:2804] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.247197 31946 leader_election.cc:290] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:03.247112 31274 raft_consensus.cc:2468] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:03.258212 31552 tablet_bootstrap.cc:654] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.258560 31393 leader_election.cc:304] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:03.259289 31993 raft_consensus.cc:697] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:03.259819 31966 raft_consensus.cc:2804] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.260380 31966 raft_consensus.cc:493] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.260892 31966 raft_consensus.cc:3060] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.260550 31993 consensus_queue.cc:237] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:03.268577 31173 catalog_manager.cc:5697] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.283172 31970 raft_consensus.cc:493] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.283792 31970 raft_consensus.cc:515] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
W20260709 12:24:03.300473 31469 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:40387, user_credentials={real_user=slave}} blocked reactor thread for 49672us
I20260709 12:24:03.309105 31556 tablet_bootstrap.cc:492] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:03.309607 31556 ts_tablet_manager.cc:1403] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.183s	user 0.033s	sys 0.020s
I20260709 12:24:03.310607 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b3b16774644d7e85c404e0fd485a60" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:03.311306 31425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed7a6253b364f139cce7e085a12c9ad" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:03.312057 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6e89a8a1d04b1e93e58d614c686d42" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
W20260709 12:24:03.314240 31245 leader_election.cc:343] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.299681 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed7a6253b364f139cce7e085a12c9ad" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:03.298236 31970 leader_election.cc:290] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:03.307503 31972 raft_consensus.cc:2749] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:03.320344 31352 raft_consensus.cc:2468] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 0.
I20260709 12:24:03.326831 31244 leader_election.cc:304] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:03.328258 31970 raft_consensus.cc:2804] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.328796 31504 raft_consensus.cc:2393] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 3: Already voted for candidate 998cd06c0be349879a0602496bc33640 in this term.
I20260709 12:24:03.328815 31970 raft_consensus.cc:493] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.329505 31970 raft_consensus.cc:3060] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.332530 31556 raft_consensus.cc:359] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:03.333292 31556 raft_consensus.cc:385] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.333554 31556 raft_consensus.cc:740] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.322517 31553 raft_consensus.cc:359] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:03.334213 31553 raft_consensus.cc:385] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:24:03.334138 31395 leader_election.cc:343] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.334738 31553 raft_consensus.cc:740] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.335443 31553 consensus_queue.cc:260] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:03.336495 31395 leader_election.cc:304] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640
I20260709 12:24:03.335680 31786 raft_consensus.cc:493] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.337450 31962 raft_consensus.cc:515] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:03.337621 31786 raft_consensus.cc:515] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:03.328043 31966 raft_consensus.cc:515] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:03.337663 31553 ts_tablet_manager.cc:1434] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.119s	user 0.004s	sys 0.000s
I20260709 12:24:03.343075 31786 leader_election.cc:290] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:03.343531 31962 leader_election.cc:290] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:03.347684 31925 consensus_queue.cc:1048] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.347949 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff653c4c2e914776b9658d2b0d395afe" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:03.348878 31352 raft_consensus.cc:2468] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:03.351954 31394 leader_election.cc:304] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:03.346650 31893 raft_consensus.cc:2749] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:03.359411 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9eda698af44e0194bcc4cf3ccc7689" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:03.361375 31500 raft_consensus.cc:2393] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 1: Already voted for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in this term.
I20260709 12:24:03.364295 31966 leader_election.cc:290] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:03.364979 31556 consensus_queue.cc:260] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:03.362423 31786 raft_consensus.cc:2804] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.375428 31556 ts_tablet_manager.cc:1434] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:24:03.376497 31556 tablet_bootstrap.cc:492] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b: Bootstrap starting.
I20260709 12:24:03.380448 31553 tablet_bootstrap.cc:492] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:03.382807 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b3b16774644d7e85c404e0fd485a60" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:03.386343 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b3b16774644d7e85c404e0fd485a60" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:03.386996 31278 raft_consensus.cc:3060] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:03.391754 31395 leader_election.cc:343] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.367774 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9eda698af44e0194bcc4cf3ccc7689" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:03.378698 31786 raft_consensus.cc:493] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.394272 31786 raft_consensus.cc:3060] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.402742 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff653c4c2e914776b9658d2b0d395afe" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:03.404237 31504 raft_consensus.cc:2468] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 0.
I20260709 12:24:03.393719 31349 raft_consensus.cc:2393] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:24:03.409004 31469 leader_election.cc:304] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:03.410082 31972 raft_consensus.cc:2749] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:03.443145 31278 raft_consensus.cc:2468] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:03.445115 31393 leader_election.cc:304] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:24:03.457049 31970 raft_consensus.cc:515] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.459345 31970 leader_election.cc:290] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:03.446604 32006 log.cc:927] Time spent T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:24:03.466115 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed7a6253b364f139cce7e085a12c9ad" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:03.472262 31177 catalog_manager.cc:5697] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.474117 31177 catalog_manager.cc:5697] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.461632 31894 raft_consensus.cc:2804] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.490015 31556 tablet_bootstrap.cc:654] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.478122 31352 raft_consensus.cc:3060] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.512902 31551 tablet_bootstrap.cc:492] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
W20260709 12:24:03.512990 31226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:03.513789 31551 ts_tablet_manager.cc:1403] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.380s	user 0.021s	sys 0.015s
I20260709 12:24:03.501108 31894 raft_consensus.cc:697] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:03.544874 31553 tablet_bootstrap.cc:654] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.548368 31552 tablet_bootstrap.cc:492] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640: No bootstrap required, opened a new log
I20260709 12:24:03.548904 31552 ts_tablet_manager.cc:1403] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640: Time spent bootstrapping tablet: real 0.498s	user 0.035s	sys 0.021s
I20260709 12:24:03.522862 31786 raft_consensus.cc:515] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:03.552064 31786 leader_election.cc:290] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:03.554330 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed7a6253b364f139cce7e085a12c9ad" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:03.557286 31971 consensus_queue.cc:1048] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:03.539585 31894 consensus_queue.cc:237] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:03.554409 31978 consensus_queue.cc:1048] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:03.573259 31614 consensus_queue.cc:1048] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.579389 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff653c4c2e914776b9658d2b0d395afe" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:03.585623 31964 consensus_queue.cc:1048] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.586211 31504 raft_consensus.cc:3060] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.580605 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff653c4c2e914776b9658d2b0d395afe" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:03.575201 31175 catalog_manager.cc:5697] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.598834 31551 raft_consensus.cc:359] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.599601 31551 raft_consensus.cc:385] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.599886 31551 raft_consensus.cc:740] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.603955 31349 raft_consensus.cc:3060] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.605228 31552 raft_consensus.cc:359] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:03.605995 31552 raft_consensus.cc:385] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.606263 31552 raft_consensus.cc:740] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.606972 31552 consensus_queue.cc:260] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:03.626051 31551 consensus_queue.cc:260] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.631302 31174 catalog_manager.cc:5697] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.637867 31951 consensus_queue.cc:1048] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:03.643369 31504 raft_consensus.cc:2468] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:03.645040 31556 tablet_bootstrap.cc:492] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b: No bootstrap required, opened a new log
I20260709 12:24:03.645584 31556 ts_tablet_manager.cc:1403] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent bootstrapping tablet: real 0.269s	user 0.014s	sys 0.018s
W20260709 12:24:03.652571 31245 leader_election.cc:343] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.670892 31552 ts_tablet_manager.cc:1434] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640: Time spent starting tablet: real 0.122s	user 0.008s	sys 0.000s
I20260709 12:24:03.679668 31551 ts_tablet_manager.cc:1434] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.166s	user 0.008s	sys 0.000s
I20260709 12:24:03.680699 31352 raft_consensus.cc:2468] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 1.
W20260709 12:24:03.671841 31318 consensus_peers.cc:597] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:03.685933 31395 leader_election.cc:304] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:03.686066 31244 leader_election.cc:304] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:03.687256 31349 raft_consensus.cc:2468] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:03.687455 31946 raft_consensus.cc:2804] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.687973 31946 raft_consensus.cc:697] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:03.688844 31946 consensus_queue.cc:237] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:03.692826 31556 raft_consensus.cc:359] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.695045 31553 tablet_bootstrap.cc:492] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:03.693584 31556 raft_consensus.cc:385] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.696187 31553 ts_tablet_manager.cc:1403] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.316s	user 0.028s	sys 0.031s
I20260709 12:24:03.695976 31556 raft_consensus.cc:740] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.716535 31556 consensus_queue.cc:260] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.717679 31551 tablet_bootstrap.cc:492] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:03.699456 31948 raft_consensus.cc:2804] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.736553 31948 raft_consensus.cc:697] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:03.737479 31948 consensus_queue.cc:237] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.743183 31502 raft_consensus.cc:1275] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Refusing update from remote peer 998cd06c0be349879a0602496bc33640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:03.755622 31553 raft_consensus.cc:359] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:03.756438 31553 raft_consensus.cc:385] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.756729 31553 raft_consensus.cc:740] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.761498 31551 tablet_bootstrap.cc:654] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.765774 31930 consensus_queue.cc:1048] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:03.770673 31556 ts_tablet_manager.cc:1434] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.001s
I20260709 12:24:03.804396 31553 consensus_queue.cc:260] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:03.807039 31553 ts_tablet_manager.cc:1434] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.002s
I20260709 12:24:03.808501 31553 tablet_bootstrap.cc:492] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:03.819706 31988 raft_consensus.cc:493] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.875602 31553 tablet_bootstrap.cc:654] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.876879 31425 raft_consensus.cc:1275] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Refusing update from remote peer 998cd06c0be349879a0602496bc33640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:03.878751 31988 raft_consensus.cc:515] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:03.881044 31988 leader_election.cc:290] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:03.882560 31982 raft_consensus.cc:493] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.883044 31982 raft_consensus.cc:515] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:03.885227 31982 leader_election.cc:290] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:03.820856 31993 consensus_queue.cc:1048] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 12:24:03.891309 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a9bea17c8409da9f38b8bc322e895" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:03.894254 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8b707960e641338e58cc2552304bb1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:03.913719 31499 raft_consensus.cc:2468] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 0.
I20260709 12:24:03.914659 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc7a9bea17c8409da9f38b8bc322e895" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:03.899535 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8b707960e641338e58cc2552304bb1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:03.918008 31320 leader_election.cc:304] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:03.923830 31174 catalog_manager.cc:5697] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.939491 31551 tablet_bootstrap.cc:492] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:03.940223 31551 ts_tablet_manager.cc:1403] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.240s	user 0.018s	sys 0.000s
I20260709 12:24:03.927733 31988 raft_consensus.cc:2804] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.894697 32015 consensus_queue.cc:1048] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:24:03.922979 31946 raft_consensus.cc:493] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.942502 31988 raft_consensus.cc:493] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.948693 31988 raft_consensus.cc:3060] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.995760 31553 tablet_bootstrap.cc:492] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:03.996327 31553 ts_tablet_manager.cc:1403] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.188s	user 0.014s	sys 0.004s
I20260709 12:24:03.957202 31946 raft_consensus.cc:515] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:04.001061 31946 leader_election.cc:290] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:04.004156 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585fd08c8ecd43f38d46851ea9eca526" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:04.005789 31988 raft_consensus.cc:515] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:24:04.007218 31395 leader_election.cc:343] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.008342 31988 leader_election.cc:290] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:04.010352 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8b707960e641338e58cc2552304bb1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:04.010948 31500 raft_consensus.cc:3060] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.021955 31551 raft_consensus.cc:359] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:04.023945 31551 raft_consensus.cc:385] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.024317 31551 raft_consensus.cc:740] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.024293 31553 raft_consensus.cc:359] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:04.025563 31553 raft_consensus.cc:385] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.026003 31553 raft_consensus.cc:740] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.025666 31551 consensus_queue.cc:260] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:04.043769 31551 ts_tablet_manager.cc:1434] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.103s	user 0.010s	sys 0.000s
I20260709 12:24:04.044816 31551 tablet_bootstrap.cc:492] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:04.053508 31245 leader_election.cc:304] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:04.054550 31948 raft_consensus.cc:2749] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:04.055001 31551 tablet_bootstrap.cc:654] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.056187 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585fd08c8ecd43f38d46851ea9eca526" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:04.070173 31553 consensus_queue.cc:260] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:04.081475 31175 catalog_manager.cc:5697] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:04.087953 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8b707960e641338e58cc2552304bb1" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:04.088699 31275 raft_consensus.cc:3060] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.075518 31894 consensus_queue.cc:1048] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:24:04.097245 31275 raft_consensus.cc:2468] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
W20260709 12:24:04.077338 31318 leader_election.cc:343] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.110528 31551 tablet_bootstrap.cc:492] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9: No bootstrap required, opened a new log
I20260709 12:24:04.110790 31279 raft_consensus.cc:3060] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.111042 31551 ts_tablet_manager.cc:1403] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.066s	user 0.028s	sys 0.003s
I20260709 12:24:04.111979 31553 ts_tablet_manager.cc:1434] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.115s	user 0.011s	sys 0.000s
I20260709 12:24:04.116063 31551 raft_consensus.cc:359] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:04.116881 31551 raft_consensus.cc:385] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.117139 31551 raft_consensus.cc:740] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.117808 31551 consensus_queue.cc:260] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:04.119850 31551 ts_tablet_manager.cc:1434] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:24:04.120451 31962 raft_consensus.cc:493] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.120947 31962 raft_consensus.cc:515] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:04.113713 31318 leader_election.cc:304] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:04.127707 31962 leader_election.cc:290] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:04.127830 31614 raft_consensus.cc:2804] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:04.128058 31500 raft_consensus.cc:2468] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:04.129494 31614 raft_consensus.cc:697] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:04.130396 31614 consensus_queue.cc:237] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:04.143513 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b3b16774644d7e85c404e0fd485a60" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:04.145859 31275 raft_consensus.cc:2393] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in current term 1: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:24:04.168054 31428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b3b16774644d7e85c404e0fd485a60" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:04.174747 31470 leader_election.cc:304] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:04.175946 32023 raft_consensus.cc:3060] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.185063 32023 raft_consensus.cc:2749] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:04.186122 31393 leader_election.cc:343] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.186623 31393 leader_election.cc:304] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:04.187315 31893 raft_consensus.cc:2749] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:04.193130 31553 tablet_bootstrap.cc:492] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Bootstrap starting.
I20260709 12:24:04.206820 31553 tablet_bootstrap.cc:654] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.209836 31966 consensus_queue.cc:1048] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:04.211818 31893 raft_consensus.cc:493] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.212456 31893 raft_consensus.cc:515] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:04.216302 31893 leader_election.cc:290] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:04.218083 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed7a6253b364f139cce7e085a12c9ad" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:04.222632 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed7a6253b364f139cce7e085a12c9ad" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:04.223645 31349 raft_consensus.cc:2393] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3c9c70e306d465ebdbcd2b8e9849f3b in current term 1: Already voted for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in this term.
I20260709 12:24:04.227489 31393 leader_election.cc:304] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:04.230876 31175 catalog_manager.cc:5697] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 1 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:04.235893 31966 raft_consensus.cc:3060] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.236212 31553 tablet_bootstrap.cc:492] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed: No bootstrap required, opened a new log
I20260709 12:24:04.236126 31894 consensus_queue.cc:1048] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:04.237038 31553 ts_tablet_manager.cc:1403] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.003s
I20260709 12:24:04.240538 31553 raft_consensus.cc:359] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:04.241525 31553 raft_consensus.cc:385] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.241904 31553 raft_consensus.cc:740] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.242964 31553 consensus_queue.cc:260] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:04.244325 31966 raft_consensus.cc:2749] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:04.246820 31553 ts_tablet_manager.cc:1434] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:24:04.256882 31174 catalog_manager.cc:5697] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.274993 31894 consensus_queue.cc:1048] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:04.290683 31993 consensus_queue.cc:1048] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:04.312556 31970 consensus_queue.cc:1048] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:04.336485 31982 consensus_queue.cc:1048] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:04.421959 32024 raft_consensus.cc:493] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.422436 32024 raft_consensus.cc:515] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:04.424302 32024 leader_election.cc:290] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:04.425029 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585fd08c8ecd43f38d46851ea9eca526" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:04.425616 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585fd08c8ecd43f38d46851ea9eca526" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" is_pre_election: true
I20260709 12:24:04.425746 31422 raft_consensus.cc:2468] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:24:04.426304 31279 raft_consensus.cc:2468] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 0.
I20260709 12:24:04.426862 31470 leader_election.cc:304] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:04.427783 32024 raft_consensus.cc:2804] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:04.428133 32024 raft_consensus.cc:493] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.428443 32024 raft_consensus.cc:3060] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.434795 32024 raft_consensus.cc:515] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:04.436590 32024 leader_election.cc:290] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:04.437810 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585fd08c8ecd43f38d46851ea9eca526" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:04.437799 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585fd08c8ecd43f38d46851ea9eca526" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
I20260709 12:24:04.438804 31275 raft_consensus.cc:3060] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.442924 31422 raft_consensus.cc:3060] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.444248 31275 raft_consensus.cc:2468] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:04.445261 31468 leader_election.cc:304] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:24:04.446053 32024 raft_consensus.cc:2804] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:04.446552 32024 raft_consensus.cc:697] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:04.447407 32024 consensus_queue.cc:237] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:04.449386 31422 raft_consensus.cc:2468] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:04.457563 31173 catalog_manager.cc:5697] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 1 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:04.654551 31930 consensus_queue.cc:1048] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:04.664680 31930 consensus_queue.cc:1048] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:04.935460 32024 consensus_queue.cc:1048] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:04.974251 32057 consensus_queue.cc:1048] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:06.272511 22701 tablet_server.cc:179] TabletServer@127.22.43.65:0 shutting down...
I20260709 12:24:06.314191 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:06.315240 22701 tablet_replica.cc:333] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.316006 22701 raft_consensus.cc:2243] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.316565 22701 raft_consensus.cc:2272] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.318856 22701 tablet_replica.cc:333] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.319687 22701 raft_consensus.cc:2243] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.320444 22701 raft_consensus.cc:2272] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.322325 22701 tablet_replica.cc:333] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.322902 22701 raft_consensus.cc:2243] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.323405 22701 raft_consensus.cc:2272] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.325268 22701 tablet_replica.cc:333] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.326014 22701 raft_consensus.cc:2243] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.326954 22701 raft_consensus.cc:2272] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.329166 22701 tablet_replica.cc:333] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.329849 22701 raft_consensus.cc:2243] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.330310 22701 raft_consensus.cc:2272] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.332098 22701 tablet_replica.cc:333] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.332684 22701 raft_consensus.cc:2243] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.333585 22701 raft_consensus.cc:2272] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.335640 22701 tablet_replica.cc:333] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.336359 22701 raft_consensus.cc:2243] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.336768 22701 raft_consensus.cc:2272] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.338765 22701 tablet_replica.cc:333] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.339359 22701 raft_consensus.cc:2243] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.340092 22701 raft_consensus.cc:2272] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.341743 22701 tablet_replica.cc:333] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.342432 22701 raft_consensus.cc:2243] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.342866 22701 raft_consensus.cc:2272] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.344995 22701 tablet_replica.cc:333] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.345566 22701 raft_consensus.cc:2243] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.345988 22701 raft_consensus.cc:2272] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.347640 22701 tablet_replica.cc:333] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.348476 22701 raft_consensus.cc:2243] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.349398 22701 raft_consensus.cc:2272] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:06.350540 31393 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 12:24:06.351711 22701 tablet_replica.cc:333] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.352522 22701 raft_consensus.cc:2243] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.353001 22701 raft_consensus.cc:2272] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:06.354314 31393 consensus_peers.cc:597] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.355077 22701 tablet_replica.cc:333] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.355846 22701 raft_consensus.cc:2243] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.356264 22701 raft_consensus.cc:2272] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.358064 22701 tablet_replica.cc:333] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.358630 22701 raft_consensus.cc:2243] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.359373 22701 raft_consensus.cc:2272] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.361111 22701 tablet_replica.cc:333] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.361774 22701 raft_consensus.cc:2243] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.362164 22701 raft_consensus.cc:2272] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.364029 22701 tablet_replica.cc:333] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.364954 22701 raft_consensus.cc:2243] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.365404 22701 raft_consensus.cc:2272] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.367516 22701 tablet_replica.cc:333] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
W20260709 12:24:06.368240 31318 consensus_peers.cc:597] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.368299 22701 raft_consensus.cc:2243] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.369655 22701 raft_consensus.cc:2272] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.372215 22701 tablet_replica.cc:333] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.372997 22701 raft_consensus.cc:2243] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.373576 22701 raft_consensus.cc:2272] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:06.374811 31318 consensus_peers.cc:597] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.375802 22701 tablet_replica.cc:333] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.376559 22701 raft_consensus.cc:2243] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.376983 22701 raft_consensus.cc:2272] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:06.377717 31468 consensus_peers.cc:597] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.379163 22701 tablet_replica.cc:333] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.380098 22701 raft_consensus.cc:2243] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.380606 22701 raft_consensus.cc:2272] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.382905 22701 tablet_replica.cc:333] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.383682 22701 raft_consensus.cc:2243] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:24:06.384562 31393 consensus_peers.cc:597] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.384563 22701 raft_consensus.cc:2272] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.387199 22701 tablet_replica.cc:333] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.388089 22701 raft_consensus.cc:2243] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.388605 22701 raft_consensus.cc:2272] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.390713 22701 tablet_replica.cc:333] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.391680 22701 raft_consensus.cc:2243] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.392535 22701 raft_consensus.cc:2272] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.394662 22701 tablet_replica.cc:333] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
W20260709 12:24:06.395251 31468 consensus_peers.cc:597] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.395431 22701 raft_consensus.cc:2243] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.395973 22701 raft_consensus.cc:2272] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.398356 22701 tablet_replica.cc:333] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.399142 22701 raft_consensus.cc:2243] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.399598 22701 raft_consensus.cc:2272] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:06.400734 31393 consensus_peers.cc:597] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.402141 22701 tablet_replica.cc:333] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.402783 22701 raft_consensus.cc:2243] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.403756 22701 raft_consensus.cc:2272] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.406013 22701 tablet_replica.cc:333] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.406517 22701 raft_consensus.cc:2243] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.406967 22701 raft_consensus.cc:2272] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.408774 22701 tablet_replica.cc:333] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.409330 22701 raft_consensus.cc:2243] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.409742 22701 raft_consensus.cc:2272] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.411789 22701 tablet_replica.cc:333] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.412452 22701 raft_consensus.cc:2243] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.413232 22701 raft_consensus.cc:2272] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.415508 22701 tablet_replica.cc:333] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.416129 22701 raft_consensus.cc:2243] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.416563 22701 raft_consensus.cc:2272] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.418325 22701 tablet_replica.cc:333] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.418874 22701 raft_consensus.cc:2243] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.419287 22701 raft_consensus.cc:2272] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.421401 22701 tablet_replica.cc:333] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.422158 22701 raft_consensus.cc:2243] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.422668 22701 raft_consensus.cc:2272] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:06.423705 31318 consensus_peers.cc:597] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.424772 22701 tablet_replica.cc:333] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.425585 22701 raft_consensus.cc:2243] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.426551 22701 raft_consensus.cc:2272] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.428998 22701 tablet_replica.cc:333] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.429770 22701 raft_consensus.cc:2243] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.430258 22701 raft_consensus.cc:2272] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.432174 22701 tablet_replica.cc:333] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.432753 22701 raft_consensus.cc:2243] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.433461 22701 raft_consensus.cc:2272] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.435353 22701 tablet_replica.cc:333] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.435937 22701 raft_consensus.cc:2243] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.436349 22701 raft_consensus.cc:2272] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.438237 22701 tablet_replica.cc:333] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.438774 22701 raft_consensus.cc:2243] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.439631 22701 raft_consensus.cc:2272] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.441411 22701 tablet_replica.cc:333] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.442044 22701 raft_consensus.cc:2243] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.442469 22701 raft_consensus.cc:2272] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.444303 22701 tablet_replica.cc:333] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.444818 22701 raft_consensus.cc:2243] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.445235 22701 raft_consensus.cc:2272] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.447113 22701 tablet_replica.cc:333] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.447618 22701 raft_consensus.cc:2243] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.448032 22701 raft_consensus.cc:2272] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.449975 22701 tablet_replica.cc:333] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.450475 22701 raft_consensus.cc:2243] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.450881 22701 raft_consensus.cc:2272] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.452620 22701 tablet_replica.cc:333] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.453136 22701 raft_consensus.cc:2243] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.453553 22701 raft_consensus.cc:2272] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.455446 22701 tablet_replica.cc:333] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.455951 22701 raft_consensus.cc:2243] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.456693 22701 raft_consensus.cc:2272] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.458854 22701 tablet_replica.cc:333] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.459365 22701 raft_consensus.cc:2243] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.459766 22701 raft_consensus.cc:2272] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.461632 22701 tablet_replica.cc:333] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: stopping tablet replica
I20260709 12:24:06.462232 22701 raft_consensus.cc:2243] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.463165 22701 raft_consensus.cc:2272] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:06.467896 31468 consensus_peers.cc:597] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.484719 31468 consensus_peers.cc:597] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.490154 31393 consensus_peers.cc:597] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.493995 31468 consensus_peers.cc:597] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.520704 31318 consensus_peers.cc:597] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.542201 22701 tablet_server.cc:196] TabletServer@127.22.43.65:0 shutdown complete.
W20260709 12:24:06.574424 31393 consensus_peers.cc:597] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.579771 31468 consensus_peers.cc:597] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.583073 31318 consensus_peers.cc:597] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.590010 31393 consensus_peers.cc:597] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.612334 31468 consensus_peers.cc:597] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.612916 31468 consensus_peers.cc:597] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.615523 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:06.622795 32067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:06.623677 32068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:06.625808 32070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:06.626358 22701 server_base.cc:1061] running on GCE node
I20260709 12:24:06.628401 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:06.628681 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:06.628895 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599846628857 us; error 0 us; skew 500 ppm
I20260709 12:24:06.629535 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:06.632596 22701 webserver.cc:533] Webserver started at http://127.22.43.65:37783/ using document root <none> and password file <none>
I20260709 12:24:06.633133 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:06.633345 22701 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:24:06.637591 22701 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
W20260709 12:24:06.642638 31318 consensus_peers.cc:597] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.645808 31318 consensus_peers.cc:597] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.648667 32075 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:06.649827 22701 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:24:06.650323 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-0-root
uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
format_stamp: "Formatted at 2026-07-09 12:23:53 on dist-test-slave-0768"
I20260709 12:24:06.650957 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599526815862-22701-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:24:06.671928 31468 consensus_peers.cc:597] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.674819 31318 consensus_peers.cc:597] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.680117 31318 consensus_peers.cc:597] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.686971 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:06.688951 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:06.692399 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 12:24:06.693967 31393 consensus_peers.cc:597] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.701480 32082 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:24:06.708894 31318 consensus_peers.cc:597] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.747085 31393 consensus_peers.cc:597] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.754724 31318 consensus_peers.cc:597] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:06.798043 31468 consensus_peers.cc:597] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:07.000207 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:24:07.000625 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.302s	user 0.011s	sys 0.000s
I20260709 12:24:07.000990 22701 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:24:07.008912 32082 tablet_bootstrap.cc:492] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:07.025979 32082 tablet_bootstrap.cc:492] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:07.027130 32082 tablet_bootstrap.cc:492] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:07.027858 32082 ts_tablet_manager.cc:1403] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 12:24:07.030746 32082 raft_consensus.cc:359] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.031548 32082 raft_consensus.cc:740] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.032394 32082 consensus_queue.cc:260] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.040735 32082 ts_tablet_manager.cc:1434] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 12:24:07.041735 32082 tablet_bootstrap.cc:492] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:07.070787 32082 tablet_bootstrap.cc:492] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:07.071900 32082 tablet_bootstrap.cc:492] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:07.089372 32082 ts_tablet_manager.cc:1403] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.012s
I20260709 12:24:07.092218 32082 raft_consensus.cc:359] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.093080 32082 raft_consensus.cc:740] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.094050 32082 consensus_queue.cc:260] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.096112 32082 ts_tablet_manager.cc:1434] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:07.097196 32082 tablet_bootstrap.cc:492] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:07.180393 32082 tablet_bootstrap.cc:492] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:07.181310 32082 tablet_bootstrap.cc:492] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:07.182015 32082 ts_tablet_manager.cc:1403] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.085s	user 0.030s	sys 0.032s
I20260709 12:24:07.184506 32082 raft_consensus.cc:359] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.185235 32082 raft_consensus.cc:740] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.186391 32082 consensus_queue.cc:260] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.188725 32082 ts_tablet_manager.cc:1434] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:07.195247 32082 tablet_bootstrap.cc:492] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:07.222611 32082 tablet_bootstrap.cc:492] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:07.223618 32082 tablet_bootstrap.cc:492] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:07.224359 32082 ts_tablet_manager.cc:1403] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.004s
I20260709 12:24:07.227066 32082 raft_consensus.cc:359] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.227826 32082 raft_consensus.cc:740] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.228698 32082 consensus_queue.cc:260] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.231032 32082 ts_tablet_manager.cc:1434] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:24:07.231880 32082 tablet_bootstrap.cc:492] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:07.268715 32082 tablet_bootstrap.cc:492] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:07.308733 32082 tablet_bootstrap.cc:492] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:07.317049 31984 raft_consensus.cc:493] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.319723 31984 raft_consensus.cc:515] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.340826 31984 leader_election.cc:290] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.342983 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f373819fb7049ee9b511c4cad4374fd" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:07.357510 32057 raft_consensus.cc:493] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.365433 32057 raft_consensus.cc:515] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.369544 32057 leader_election.cc:290] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.394515 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:07.399628 32082 ts_tablet_manager.cc:1403] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.168s	user 0.022s	sys 0.004s
I20260709 12:24:07.411850 32054 raft_consensus.cc:493] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.412799 32054 raft_consensus.cc:515] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.417097 32083 raft_consensus.cc:493] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.418226 32083 raft_consensus.cc:515] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.422974 32054 leader_election.cc:290] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.424551 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656a43be5139490a9ab0b8bc38750ac6" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
W20260709 12:24:07.439038 31470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:45167, user_credentials={real_user=slave}} blocked reactor thread for 57954.4us
I20260709 12:24:07.444530 32054 raft_consensus.cc:493] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.446220 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:07.445621 32054 raft_consensus.cc:515] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.421725 32083 leader_election.cc:290] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.460635 32054 leader_election.cc:290] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.462208 32084 raft_consensus.cc:493] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.462860 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed7a6253b364f139cce7e085a12c9ad" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:07.463038 32084 raft_consensus.cc:515] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.466288 32084 leader_election.cc:290] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.467406 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7323a3bd4ffe4eae8831fceee0397685" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
W20260709 12:24:07.470911 31393 leader_election.cc:336] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.471633 31393 leader_election.cc:304] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:07.473016 32085 raft_consensus.cc:493] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.473948 32085 raft_consensus.cc:515] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:24:07.476325 31393 leader_election.cc:336] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.476907 31393 leader_election.cc:304] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:07.477200 32085 leader_election.cc:290] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:07.478190 31468 leader_election.cc:336] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.472445 32084 raft_consensus.cc:2749] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.478731 31468 leader_election.cc:304] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:07.479740 32083 raft_consensus.cc:2749] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.481909 32084 raft_consensus.cc:2749] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.484658 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f215322251405ebe02666b49f6acd6" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:07.485631 31993 raft_consensus.cc:493] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
W20260709 12:24:07.486277 31318 leader_election.cc:336] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.486657 31993 raft_consensus.cc:515] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
W20260709 12:24:07.487660 31393 leader_election.cc:336] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:07.487926 31468 leader_election.cc:336] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.453208 32082 raft_consensus.cc:359] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.488648 31468 leader_election.cc:304] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:07.488638 32099 raft_consensus.cc:493] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.490272 32096 raft_consensus.cc:2749] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.490119 31320 leader_election.cc:304] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.488281 31393 leader_election.cc:304] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:07.491120 32085 raft_consensus.cc:493] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.488839 32082 raft_consensus.cc:740] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.490198 32099 raft_consensus.cc:515] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.493247 32084 raft_consensus.cc:2749] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.494143 32082 consensus_queue.cc:260] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
W20260709 12:24:07.494937 31468 leader_election.cc:336] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.495602 31468 leader_election.cc:304] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:07.497763 32085 raft_consensus.cc:515] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.499238 32057 raft_consensus.cc:2749] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.502548 31993 leader_election.cc:290] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.503085 32099 leader_election.cc:290] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.504387 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5a82bfbaf425ba4873d0f0e3e776c" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:07.506410 32082 ts_tablet_manager.cc:1434] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.003s
W20260709 12:24:07.509261 31318 leader_election.cc:336] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.513021 32082 tablet_bootstrap.cc:492] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
W20260709 12:24:07.512748 31393 leader_election.cc:336] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:07.513613 31468 leader_election.cc:336] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.515060 31395 leader_election.cc:304] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.516328 32097 raft_consensus.cc:2749] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.519870 32089 raft_consensus.cc:2749] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.520957 32092 raft_consensus.cc:493] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.521739 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f85ad47fd43e997766faf8e9ae119" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:07.528236 32092 raft_consensus.cc:515] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.529382 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cd27f677614e42854b6618e07715a0" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:07.531430 32092 leader_election.cc:290] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:07.530552 32089 raft_consensus.cc:493] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
W20260709 12:24:07.538616 31318 leader_election.cc:336] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.539251 32089 raft_consensus.cc:515] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.541564 32089 leader_election.cc:290] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.525489 32085 leader_election.cc:290] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:07.550418 31318 leader_election.cc:336] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.556281 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7323a3bd4ffe4eae8831fceee0397685" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:07.556633 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caafdbf4faa4bdeb26c29a5454a5f94" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:07.557123 31431 raft_consensus.cc:2468] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:07.562386 31320 leader_election.cc:304] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.563093 32085 raft_consensus.cc:2749] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.565408 31469 leader_election.cc:304] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:07.566111 32096 raft_consensus.cc:2749] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.569175 31320 leader_election.cc:304] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.571456 32100 raft_consensus.cc:2749] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.574975 32096 raft_consensus.cc:493] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.575798 32096 raft_consensus.cc:515] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.579784 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5a82bfbaf425ba4873d0f0e3e776c" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:07.580534 31431 raft_consensus.cc:2468] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:07.581945 31470 leader_election.cc:304] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:07.582870 32083 raft_consensus.cc:2804] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.583451 32083 raft_consensus.cc:493] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.584045 32083 raft_consensus.cc:3060] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.585361 32096 leader_election.cc:290] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:07.586110 31468 leader_election.cc:336] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.590178 31320 leader_election.cc:304] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.591005 32092 raft_consensus.cc:2804] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.591440 32092 raft_consensus.cc:493] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.591871 32092 raft_consensus.cc:3060] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.598119 32083 raft_consensus.cc:515] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.600420 32092 raft_consensus.cc:515] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.602474 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5a82bfbaf425ba4873d0f0e3e776c" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:07.603219 31422 raft_consensus.cc:3060] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.604563 32092 leader_election.cc:290] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:07.611951 32100 raft_consensus.cc:493] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.612746 32100 raft_consensus.cc:515] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.612763 32099 raft_consensus.cc:493] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.614346 32099 raft_consensus.cc:515] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.617151 32100 leader_election.cc:290] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.618019 32083 leader_election.cc:290] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.619740 32082 tablet_bootstrap.cc:492] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:07.622651 32082 tablet_bootstrap.cc:492] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:07.623411 32082 ts_tablet_manager.cc:1403] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.025s
W20260709 12:24:07.624244 31318 leader_election.cc:336] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.626188 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f85ad47fd43e997766faf8e9ae119" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:24:07.626380 31468 leader_election.cc:336] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.624291 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7323a3bd4ffe4eae8831fceee0397685" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:07.627012 31502 raft_consensus.cc:2468] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
W20260709 12:24:07.627045 31468 leader_election.cc:336] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.629240 32099 leader_election.cc:290] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:07.629927 31318 leader_election.cc:336] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.630637 22701 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:24:07.630831 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:07.633533 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.633s	user 0.308s	sys 0.027s
I20260709 12:24:07.633082 32082 raft_consensus.cc:359] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.634181 32082 raft_consensus.cc:740] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.634444 31320 leader_election.cc:304] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.635140 31469 leader_election.cc:304] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:07.627200 31431 raft_consensus.cc:3060] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.635516 32092 raft_consensus.cc:2804] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.636186 32092 raft_consensus.cc:493] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.635443 32082 consensus_queue.cc:260] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.636617 32092 raft_consensus.cc:3060] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.639052 32082 ts_tablet_manager.cc:1434] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 12:24:07.642247 32099 raft_consensus.cc:493] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.642930 32099 raft_consensus.cc:515] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.644318 32083 raft_consensus.cc:2749] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.646632 32099 leader_election.cc:290] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.646723 32100 raft_consensus.cc:493] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.654870 32100 raft_consensus.cc:515] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:24:07.655478 31468 leader_election.cc:336] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.656461 32082 tablet_bootstrap.cc:492] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:07.656904 31431 raft_consensus.cc:2468] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 2.
I20260709 12:24:07.648331 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fcca57e9e24daea0e2dac26aedce05" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:07.658980 31470 leader_election.cc:304] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:07.650624 31993 raft_consensus.cc:493] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.660089 32085 raft_consensus.cc:493] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.660393 31993 raft_consensus.cc:515] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.661098 32085 raft_consensus.cc:515] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.663012 31993 leader_election.cc:290] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.663640 31993 raft_consensus.cc:493] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.664233 31993 raft_consensus.cc:515] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.664585 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:07.664911 32085 leader_election.cc:290] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.666895 32099 raft_consensus.cc:2749] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.667075 31993 leader_election.cc:290] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.669466 32085 raft_consensus.cc:493] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.670315 32085 raft_consensus.cc:515] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.671504 31422 raft_consensus.cc:2468] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 2.
I20260709 12:24:07.657089 32100 leader_election.cc:290] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.672545 32099 raft_consensus.cc:493] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.673215 32099 raft_consensus.cc:515] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
W20260709 12:24:07.673667 31393 leader_election.cc:336] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.674196 31393 leader_election.cc:304] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.676317 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:07.679317 32084 raft_consensus.cc:2749] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.680217 31470 leader_election.cc:304] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.682678 32100 raft_consensus.cc:493] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.683368 32083 raft_consensus.cc:2804] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:07.683530 31318 leader_election.cc:336] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.684101 32083 raft_consensus.cc:697] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:07.686203 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:07.685899 32084 raft_consensus.cc:493] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.686896 31502 raft_consensus.cc:2468] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:07.687496 32084 raft_consensus.cc:515] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
W20260709 12:24:07.684134 31318 leader_election.cc:336] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.691290 32084 leader_election.cc:290] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.685510 32083 consensus_queue.cc:237] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.683368 32100 raft_consensus.cc:515] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.693473 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f373819fb7049ee9b511c4cad4374fd" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:07.694223 31502 raft_consensus.cc:2468] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:07.695420 32100 leader_election.cc:290] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:07.677385 32099 leader_election.cc:290] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:07.699777 31393 leader_election.cc:336] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.699193 31320 leader_election.cc:304] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
W20260709 12:24:07.701797 31468 leader_election.cc:336] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.702497 31468 leader_election.cc:304] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:07.703161 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1cb5c621c6466c9692be5c82cd786f" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:07.703811 31352 raft_consensus.cc:2468] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:07.705250 32085 leader_election.cc:290] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:07.706039 32096 raft_consensus.cc:2749] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.645449 32092 raft_consensus.cc:515] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.702075 32100 raft_consensus.cc:2804] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:07.711757 32100 raft_consensus.cc:697] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:07.711102 31394 leader_election.cc:304] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
W20260709 12:24:07.712860 31318 leader_election.cc:336] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.713537 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:07.714594 31502 raft_consensus.cc:2468] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:07.712641 31320 leader_election.cc:304] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.716032 32085 raft_consensus.cc:2804] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.716475 32085 raft_consensus.cc:493] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.716900 32085 raft_consensus.cc:3060] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:07.717577 31393 leader_election.cc:336] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.713893 31993 raft_consensus.cc:2804] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.718400 31993 raft_consensus.cc:493] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.718755 31993 raft_consensus.cc:3060] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.714843 32100 consensus_queue.cc:237] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.726518 32089 raft_consensus.cc:493] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.722903 31320 leader_election.cc:304] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.727222 32089 raft_consensus.cc:515] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.727752 31988 raft_consensus.cc:2804] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.728168 31988 raft_consensus.cc:493] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.728500 31988 raft_consensus.cc:3060] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.729548 32089 leader_election.cc:290] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:07.730399 31395 leader_election.cc:304] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.731537 32084 raft_consensus.cc:2804] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.731951 32084 raft_consensus.cc:493] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.732299 32084 raft_consensus.cc:3060] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.710204 32092 leader_election.cc:290] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:07.737967 31318 leader_election.cc:336] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.725847 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656a43be5139490a9ab0b8bc38750ac6" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:07.739082 31431 raft_consensus.cc:2468] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:07.741865 31988 raft_consensus.cc:515] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.744273 32057 raft_consensus.cc:493] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.745002 32057 raft_consensus.cc:515] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.747666 32057 leader_election.cc:290] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.750682 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caafdbf4faa4bdeb26c29a5454a5f94" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:07.751572 31351 raft_consensus.cc:2468] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:07.753242 31469 leader_election.cc:304] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:07.755439 32099 raft_consensus.cc:2804] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.755983 32099 raft_consensus.cc:493] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.756484 32099 raft_consensus.cc:3060] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.762070 31988 leader_election.cc:290] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.764811 32097 raft_consensus.cc:493] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.765545 31993 raft_consensus.cc:515] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.768661 32097 raft_consensus.cc:515] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.771080 32097 leader_election.cc:290] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:07.768065 31318 leader_election.cc:336] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:07.774559 31393 leader_election.cc:336] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:07.778163 31468 leader_election.cc:336] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.779459 32092 raft_consensus.cc:493] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.780087 32092 raft_consensus.cc:515] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.784026 32092 leader_election.cc:290] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:07.784291 31393 leader_election.cc:336] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:07.777604 31318 leader_election.cc:336] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.788439 31993 leader_election.cc:290] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.792660 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fcca57e9e24daea0e2dac26aedce05" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:07.793725 31502 raft_consensus.cc:2468] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:07.795769 31395 leader_election.cc:304] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.796926 32054 raft_consensus.cc:2804] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:07.801013 31318 leader_election.cc:336] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.804159 32057 raft_consensus.cc:493] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.805757 32057 raft_consensus.cc:515] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.808521 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1cb5c621c6466c9692be5c82cd786f" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:07.809118 32057 leader_election.cc:290] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.809186 31351 raft_consensus.cc:3060] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.802559 32054 raft_consensus.cc:493] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.815990 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f85ad47fd43e997766faf8e9ae119" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:07.819099 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f373819fb7049ee9b511c4cad4374fd" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:07.820115 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:07.825481 31504 raft_consensus.cc:2468] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
I20260709 12:24:07.826550 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed7a6253b364f139cce7e085a12c9ad" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:07.827234 31422 raft_consensus.cc:2468] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 1.
W20260709 12:24:07.827636 31468 leader_election.cc:336] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.828563 32057 raft_consensus.cc:493] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.823144 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1cb5c621c6466c9692be5c82cd786f" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:07.829172 32057 raft_consensus.cc:515] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.824877 31499 raft_consensus.cc:3060] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.829698 31431 raft_consensus.cc:2393] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 998cd06c0be349879a0602496bc33640 in current term 2: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:24:07.824304 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cd27f677614e42854b6618e07715a0" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:07.832597 31350 raft_consensus.cc:2468] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:07.838107 31502 raft_consensus.cc:3060] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.839985 32099 raft_consensus.cc:515] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.835568 31320 leader_election.cc:304] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.822218 32054 raft_consensus.cc:3060] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.848593 31172 catalog_manager.cc:5697] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 2 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.852948 31469 leader_election.cc:304] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.851979 32084 raft_consensus.cc:515] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.854019 32083 raft_consensus.cc:493] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.856326 31320 leader_election.cc:304] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
W20260709 12:24:07.855289 31318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:41673, user_credentials={real_user=slave}} blocked reactor thread for 50369.4us
I20260709 12:24:07.857962 31988 raft_consensus.cc:2804] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.858232 32098 raft_consensus.cc:2804] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.858337 31988 raft_consensus.cc:493] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.858728 32098 raft_consensus.cc:493] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.859229 32098 raft_consensus.cc:3060] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.859972 32084 leader_election.cc:290] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.858853 31988 raft_consensus.cc:3060] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.858194 32104 raft_consensus.cc:2804] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.862954 32104 raft_consensus.cc:493] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.863477 32104 raft_consensus.cc:3060] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.861799 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:07.864531 31504 raft_consensus.cc:3060] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.867843 32082 tablet_bootstrap.cc:492] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:07.877075 31177 catalog_manager.cc:5697] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:07.877475 31318 leader_election.cc:336] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.878221 31988 raft_consensus.cc:515] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.858407 32083 raft_consensus.cc:515] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.879649 32082 tablet_bootstrap.cc:492] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:07.880451 32082 ts_tablet_manager.cc:1403] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.240s	user 0.017s	sys 0.013s
I20260709 12:24:07.880831 32083 leader_election.cc:290] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.882194 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f215322251405ebe02666b49f6acd6" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
I20260709 12:24:07.882957 31350 raft_consensus.cc:2468] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:07.884210 31469 leader_election.cc:304] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:07.884507 31320 leader_election.cc:304] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.886170 31988 leader_election.cc:290] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.886773 32096 raft_consensus.cc:2804] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.887204 32096 raft_consensus.cc:493] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.887578 32096 raft_consensus.cc:3060] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.887943 32092 raft_consensus.cc:2804] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.888348 32092 raft_consensus.cc:493] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.888671 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:07.888727 32092 raft_consensus.cc:3060] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.889503 31431 raft_consensus.cc:2468] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 1.
I20260709 12:24:07.890698 31504 raft_consensus.cc:2468] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 2.
I20260709 12:24:07.890951 31470 leader_election.cc:304] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:07.877442 32098 raft_consensus.cc:515] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.891999 31984 raft_consensus.cc:2804] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:07.892382 31984 raft_consensus.cc:493] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.892786 31984 raft_consensus.cc:3060] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.894441 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cd27f677614e42854b6618e07715a0" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:07.895062 31350 raft_consensus.cc:3060] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.900830 31984 raft_consensus.cc:515] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.901183 32082 raft_consensus.cc:359] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.902109 32082 raft_consensus.cc:740] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.902942 32082 consensus_queue.cc:260] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.905997 32092 raft_consensus.cc:515] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.907264 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:07.907873 31431 raft_consensus.cc:3060] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.908052 31350 raft_consensus.cc:2468] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 2.
I20260709 12:24:07.908178 32104 raft_consensus.cc:515] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:07.909260 31469 leader_election.cc:304] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:07.910089 32083 raft_consensus.cc:2804] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:07.913785 31499 raft_consensus.cc:2468] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 2.
I20260709 12:24:07.914678 31993 raft_consensus.cc:493] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:07.886053 32085 raft_consensus.cc:515] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.904124 31320 leader_election.cc:304] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
W20260709 12:24:07.916188 31468 leader_election.cc:336] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:07.905215 31393 leader_election.cc:336] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.903965 32057 leader_election.cc:290] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.915223 31993 raft_consensus.cc:515] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.919463 31395 leader_election.cc:304] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.920562 31993 leader_election.cc:290] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.921065 31993 raft_consensus.cc:2804] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:07.921480 31993 raft_consensus.cc:697] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:07.915608 32092 leader_election.cc:290] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:07.904567 31318 leader_election.cc:336] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.905617 32098 leader_election.cc:290] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.925318 31320 leader_election.cc:304] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.927273 31988 raft_consensus.cc:2804] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:07.925943 31468 leader_election.cc:336] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:07.928421 31468 leader_election.cc:336] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.928845 32082 ts_tablet_manager.cc:1434] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 12:24:07.930604 32082 tablet_bootstrap.cc:492] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:07.933660 31431 raft_consensus.cc:2468] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 2.
I20260709 12:24:07.936661 31988 raft_consensus.cc:697] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:07.936884 31984 leader_election.cc:290] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:07.937462 31502 raft_consensus.cc:2468] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 2.
I20260709 12:24:07.937743 31988 consensus_queue.cc:237] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.943125 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed7a6253b364f139cce7e085a12c9ad" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:07.943850 31431 raft_consensus.cc:3060] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.944195 31320 leader_election.cc:304] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:07.944994 32092 raft_consensus.cc:2804] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:07.945502 32092 raft_consensus.cc:697] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:07.946417 32092 consensus_queue.cc:237] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.916746 32099 leader_election.cc:290] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:07.959332 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:07.957396 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caafdbf4faa4bdeb26c29a5454a5f94" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:07.915241 32096 raft_consensus.cc:515] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:07.963058 31431 raft_consensus.cc:2468] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 2.
I20260709 12:24:07.954865 32083 raft_consensus.cc:697] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:07.967593 31499 raft_consensus.cc:3060] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:07.972486 31468 leader_election.cc:336] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:07.969995 31470 leader_election.cc:304] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:07.974372 31993 consensus_queue.cc:237] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:07.967677 31350 raft_consensus.cc:3060] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.968338 32104 leader_election.cc:290] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:07.970903 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:08.003052 31351 raft_consensus.cc:2468] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 2.
I20260709 12:24:07.978720 32057 raft_consensus.cc:2804] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.016160 32057 raft_consensus.cc:697] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:08.005645 32100 raft_consensus.cc:2749] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:08.003108 32085 leader_election.cc:290] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:08.019061 32057 consensus_queue.cc:237] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:08.020035 32096 leader_election.cc:290] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Requested vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:08.021663 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f215322251405ebe02666b49f6acd6" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:08.001986 31502 raft_consensus.cc:2468] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 1.
I20260709 12:24:08.026765 31351 raft_consensus.cc:3060] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.026252 32083 consensus_queue.cc:237] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:24:08.024499 31318 leader_election.cc:336] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:08.031494 31318 leader_election.cc:336] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:08.031227 31395 leader_election.cc:304] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
W20260709 12:24:08.038698 31320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:45167, user_credentials={real_user=slave}} blocked reactor thread for 69172.1us
I20260709 12:24:08.039682 31320 leader_election.cc:304] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
W20260709 12:24:08.048316 31318 leader_election.cc:336] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:08.035593 32097 raft_consensus.cc:2804] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:08.050040 32104 raft_consensus.cc:2804] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.050283 32097 raft_consensus.cc:493] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:08.050654 32104 raft_consensus.cc:697] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:08.051676 32104 consensus_queue.cc:237] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:08.042506 31394 leader_election.cc:304] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
W20260709 12:24:08.054801 31468 leader_election.cc:336] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:08.058277 32109 raft_consensus.cc:2804] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.058830 32109 raft_consensus.cc:697] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:08.050724 32097 raft_consensus.cc:3060] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.059857 32109 consensus_queue.cc:237] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:08.059752 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:08.068637 31500 raft_consensus.cc:3060] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:08.077410 31468 leader_election.cc:336] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:08.080911 31393 leader_election.cc:336] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:08.083964 32054 raft_consensus.cc:515] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:08.131281 31350 raft_consensus.cc:2468] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 2.
I20260709 12:24:08.136098 31469 leader_election.cc:304] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
W20260709 12:24:08.149405 31394 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:40387, user_credentials={real_user=slave}} blocked reactor thread for 58970.4us
I20260709 12:24:08.140736 32099 raft_consensus.cc:2804] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.143151 31499 raft_consensus.cc:2468] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 2.
I20260709 12:24:08.155347 31500 raft_consensus.cc:2468] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 2.
I20260709 12:24:08.179674 32054 leader_election.cc:290] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:08.183897 32097 raft_consensus.cc:515] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:08.185973 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "656a43be5139490a9ab0b8bc38750ac6" candidate_uuid: "998cd06c0be349879a0602496bc33640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:08.186760 31426 raft_consensus.cc:3060] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.164392 32099 raft_consensus.cc:697] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:08.191624 32099 consensus_queue.cc:237] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:24:08.195920 32114 log.cc:927] Time spent T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:24:08.198891 31320 leader_election.cc:304] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:08.209988 31320 leader_election.cc:304] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:08.212605 32116 raft_consensus.cc:2804] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.213479 32116 raft_consensus.cc:697] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:08.214807 32116 consensus_queue.cc:237] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:08.217077 31351 raft_consensus.cc:2468] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 2.
I20260709 12:24:08.218286 31469 leader_election.cc:304] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:08.220014 32096 raft_consensus.cc:2804] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.220687 32096 raft_consensus.cc:697] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:08.222093 32096 consensus_queue.cc:237] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:24:08.225142 31468 consensus_peers.cc:597] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.247548 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fcca57e9e24daea0e2dac26aedce05" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:08.249846 31499 raft_consensus.cc:3060] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.238916 32085 raft_consensus.cc:2804] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.274469 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9231e7b61847e29dac9f04c129f242" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:08.275354 31500 raft_consensus.cc:3060] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.269438 32085 raft_consensus.cc:697] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:08.272094 32097 leader_election.cc:290] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:08.290820 32085 consensus_queue.cc:237] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
W20260709 12:24:08.306640 31318 consensus_peers.cc:597] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.314985 32082 tablet_bootstrap.cc:492] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:24:08.312054 31393 leader_election.cc:336] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:08.335300 31431 raft_consensus.cc:1275] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 41649f3a1d8346ada1e2a0e8b6cae5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.340467 32057 consensus_queue.cc:1048] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.341773 31173 catalog_manager.cc:5697] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 2 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.325234 31426 raft_consensus.cc:2468] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998cd06c0be349879a0602496bc33640 in term 2.
W20260709 12:24:08.351665 31393 leader_election.cc:336] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:08.353231 31320 leader_election.cc:304] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:08.362583 32082 tablet_bootstrap.cc:492] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:08.363407 32082 ts_tablet_manager.cc:1403] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.433s	user 0.019s	sys 0.024s
I20260709 12:24:08.366355 31930 raft_consensus.cc:2804] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.366930 31930 raft_consensus.cc:697] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Becoming Leader. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:08.367777 31930 consensus_queue.cc:237] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:08.381227 31426 raft_consensus.cc:1275] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 998cd06c0be349879a0602496bc33640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.389539 32082 raft_consensus.cc:359] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:08.390477 32082 raft_consensus.cc:740] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:08.391733 32082 consensus_queue.cc:260] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:08.394348 32082 ts_tablet_manager.cc:1434] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:24:08.380539 31500 raft_consensus.cc:2468] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 2.
I20260709 12:24:08.400542 32082 tablet_bootstrap.cc:492] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:08.401751 31395 leader_election.cc:304] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:08.404407 32100 consensus_queue.cc:1048] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.406913 31499 raft_consensus.cc:2468] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 2.
I20260709 12:24:08.406173 32084 raft_consensus.cc:2804] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.408805 32084 raft_consensus.cc:697] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:08.410284 32084 consensus_queue.cc:237] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:08.411809 31395 leader_election.cc:304] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:08.413107 32109 raft_consensus.cc:2804] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.413630 32109 raft_consensus.cc:697] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:08.414573 32109 consensus_queue.cc:237] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
W20260709 12:24:08.425545 31318 consensus_peers.cc:597] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:08.467043 31468 consensus_peers.cc:597] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.467818 31177 catalog_manager.cc:5697] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.470788 31355 raft_consensus.cc:1275] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer 41649f3a1d8346ada1e2a0e8b6cae5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.470534 31172 catalog_manager.cc:5697] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 2 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.480852 31177 catalog_manager.cc:5697] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:08.487035 31499 raft_consensus.cc:1275] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer 998cd06c0be349879a0602496bc33640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.484980 32110 consensus_queue.cc:1048] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:24:08.481477 31172 catalog_manager.cc:5697] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 2 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.500056 31177 catalog_manager.cc:5697] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:08.500788 32085 consensus_queue.cc:1048] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.508244 31500 raft_consensus.cc:1275] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer 998cd06c0be349879a0602496bc33640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.509950 31172 catalog_manager.cc:5697] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 2 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.512243 32100 consensus_queue.cc:1048] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:08.517171 31468 consensus_peers.cc:597] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:08.518850 31318 consensus_peers.cc:597] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.512406 31177 catalog_manager.cc:5697] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:08.535243 31177 catalog_manager.cc:5697] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:08.539892 31177 catalog_manager.cc:5697] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 998cd06c0be349879a0602496bc33640 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "998cd06c0be349879a0602496bc33640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.545719 31173 catalog_manager.cc:5697] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 2 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.547653 31173 catalog_manager.cc:5697] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 2 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:08.549438 31173 catalog_manager.cc:5697] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 2 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.551345 31423 raft_consensus.cc:1275] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 998cd06c0be349879a0602496bc33640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:08.575845 31393 consensus_peers.cc:597] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.545722 31355 raft_consensus.cc:1275] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer e3c9c70e306d465ebdbcd2b8e9849f3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.577335 31172 catalog_manager.cc:5697] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 1 to 2, leader changed from 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65) to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 2 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.585925 32084 consensus_queue.cc:1048] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:08.595521 32100 consensus_queue.cc:1048] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:08.600219 31318 consensus_peers.cc:597] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:08.604390 32147 log.cc:927] Time spent T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:24:08.608341 31501 raft_consensus.cc:1275] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer e3c9c70e306d465ebdbcd2b8e9849f3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.629251 32109 consensus_queue.cc:1048] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:08.657454 31426 raft_consensus.cc:1275] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 41649f3a1d8346ada1e2a0e8b6cae5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.660748 32110 consensus_queue.cc:1048] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:08.684727 32087 raft_consensus.cc:493] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.685539 32087 raft_consensus.cc:515] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
W20260709 12:24:08.689568 31393 consensus_peers.cc:597] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.694785 31355 raft_consensus.cc:1275] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer 41649f3a1d8346ada1e2a0e8b6cae5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.697278 32096 consensus_queue.cc:1048] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:08.702227 31468 consensus_peers.cc:597] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:08.715417 32087 leader_election.cc:290] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:08.718982 32082 tablet_bootstrap.cc:492] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:08.720201 32082 tablet_bootstrap.cc:492] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:08.723451 32082 ts_tablet_manager.cc:1403] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.324s	user 0.022s	sys 0.044s
I20260709 12:24:08.732717 31501 raft_consensus.cc:1275] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer 998cd06c0be349879a0602496bc33640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.734726 32085 consensus_queue.cc:1048] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:08.737525 31468 consensus_peers.cc:597] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.744524 31499 raft_consensus.cc:1275] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer 998cd06c0be349879a0602496bc33640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.746986 32100 consensus_queue.cc:1048] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:08.754709 31393 consensus_peers.cc:597] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:08.756719 31318 consensus_peers.cc:597] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:08.770215 31393 consensus_peers.cc:597] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:08.778645 32082 raft_consensus.cc:359] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:08.779623 32082 raft_consensus.cc:740] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
W20260709 12:24:08.790426 31318 consensus_peers.cc:597] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.789454 32082 consensus_queue.cc:260] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:08.802052 32082 ts_tablet_manager.cc:1434] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 12:24:08.810789 32082 tablet_bootstrap.cc:492] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:08.861837 32087 raft_consensus.cc:493] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.868471 32087 raft_consensus.cc:515] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:08.870999 32087 leader_election.cc:290] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:08.884219 31468 consensus_peers.cc:597] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:08.886535 31393 consensus_peers.cc:597] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.886643 31350 raft_consensus.cc:1275] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer 41649f3a1d8346ada1e2a0e8b6cae5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.925542 31498 raft_consensus.cc:1275] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer e3c9c70e306d465ebdbcd2b8e9849f3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.964656 32083 consensus_queue.cc:1048] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:08.970194 31395 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.68:34287, user_credentials={real_user=slave}} blocked reactor thread for 50940.5us
W20260709 12:24:08.993484 32159 log.cc:927] Time spent T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:24:08.994408 31426 raft_consensus.cc:1275] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 998cd06c0be349879a0602496bc33640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.981379 32084 consensus_queue.cc:1048] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 12:24:09.000028 31393 consensus_peers.cc:597] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:09.000592 31393 consensus_peers.cc:597] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:09.000996 31393 consensus_peers.cc:597] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:09.001420 31393 consensus_peers.cc:597] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.001828 32087 raft_consensus.cc:493] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.002686 32087 raft_consensus.cc:515] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.003347 32085 consensus_queue.cc:1048] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:09.005152 32087 leader_election.cc:290] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
W20260709 12:24:09.009425 31318 consensus_peers.cc:597] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:09.010262 31318 consensus_peers.cc:597] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:09.010697 31318 consensus_peers.cc:597] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:09.011901 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:09.012862 32087 raft_consensus.cc:493] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.013581 32087 raft_consensus.cc:515] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
W20260709 12:24:09.014536 31318 consensus_peers.cc:597] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.015779 31501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fcca57e9e24daea0e2dac26aedce05" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:09.028091 31501 raft_consensus.cc:2393] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in current term 2: Already voted for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in this term.
I20260709 12:24:09.018807 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:09.019659 32087 leader_election.cc:290] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:09.014518 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caafdbf4faa4bdeb26c29a5454a5f94" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:09.021402 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881b09b571934068b262cdee9a6064ca" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:09.025756 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fcca57e9e24daea0e2dac26aedce05" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:09.042891 31428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881b09b571934068b262cdee9a6064ca" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
W20260709 12:24:09.046072 31318 consensus_peers.cc:597] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.050899 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caafdbf4faa4bdeb26c29a5454a5f94" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998cd06c0be349879a0602496bc33640" is_pre_election: true
W20260709 12:24:09.047040 31468 consensus_peers.cc:597] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.062621 32087 raft_consensus.cc:493] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.065374 32087 raft_consensus.cc:515] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
W20260709 12:24:09.063346 31393 consensus_peers.cc:597] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:09.068643 31393 consensus_peers.cc:597] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.069785 32087 leader_election.cc:290] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:09.075067 32082 tablet_bootstrap.cc:492] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.072808 32078 leader_election.cc:304] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:09.078954 32078 leader_election.cc:304] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
W20260709 12:24:09.084651 31468 consensus_peers.cc:597] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.093147 32082 tablet_bootstrap.cc:492] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.093987 32082 ts_tablet_manager.cc:1403] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.286s	user 0.020s	sys 0.007s
I20260709 12:24:09.099846 32087 raft_consensus.cc:2749] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:09.102838 32082 raft_consensus.cc:359] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.107544 32082 raft_consensus.cc:740] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.109064 32082 consensus_queue.cc:260] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.111083 32087 raft_consensus.cc:3060] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:09.090659 31468 consensus_peers.cc:597] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.120477 32179 raft_consensus.cc:493] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.126452 32179 raft_consensus.cc:515] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.129956 32082 ts_tablet_manager.cc:1434] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:24:09.131081 32082 tablet_bootstrap.cc:492] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.131170 31498 raft_consensus.cc:1275] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer e3c9c70e306d465ebdbcd2b8e9849f3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:09.135250 32179 leader_election.cc:290] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:09.139744 32054 consensus_queue.cc:1048] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:09.142441 32078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.68:34287, user_credentials={real_user=slave}} blocked reactor thread for 63566.8us
I20260709 12:24:09.143266 32078 leader_election.cc:304] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640
I20260709 12:24:09.151185 32078 leader_election.cc:304] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:09.151577 32177 raft_consensus.cc:2749] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:09.152396 32179 raft_consensus.cc:2749] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:09.153764 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69abb8bd62140f58770bec881e8ec59" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:09.154119 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69abb8bd62140f58770bec881e8ec59" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:09.155858 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" is_pre_election: true
I20260709 12:24:09.153085 32087 raft_consensus.cc:2749] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:09.157456 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:09.167021 32078 leader_election.cc:304] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:09.168443 32078 leader_election.cc:304] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:09.169178 32087 raft_consensus.cc:2749] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:09.171077 31468 consensus_peers.cc:597] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:09.171610 31468 consensus_peers.cc:597] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.173513 32179 raft_consensus.cc:2749] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:09.176597 31318 consensus_peers.cc:597] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:09.178822 31468 consensus_peers.cc:597] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:09.195462 31318 consensus_peers.cc:597] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.216048 32082 tablet_bootstrap.cc:492] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.217150 32082 tablet_bootstrap.cc:492] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.217779 32082 ts_tablet_manager.cc:1403] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.000s
I20260709 12:24:09.220777 32082 raft_consensus.cc:359] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.221530 32082 raft_consensus.cc:740] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.222450 32082 consensus_queue.cc:260] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.224992 32082 ts_tablet_manager.cc:1434] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:09.225932 32082 tablet_bootstrap.cc:492] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.243391 32082 tablet_bootstrap.cc:492] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.245548 32082 tablet_bootstrap.cc:492] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.251608 32082 ts_tablet_manager.cc:1403] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.000s
I20260709 12:24:09.254072 32082 raft_consensus.cc:359] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.254801 32082 raft_consensus.cc:740] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
W20260709 12:24:09.255614 31468 consensus_peers.cc:597] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.255419 32082 consensus_queue.cc:260] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.257251 32082 ts_tablet_manager.cc:1434] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:24:09.258060 32082 tablet_bootstrap.cc:492] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.275410 32082 tablet_bootstrap.cc:492] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.276485 32082 tablet_bootstrap.cc:492] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.277204 32082 ts_tablet_manager.cc:1403] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:24:09.279958 32082 raft_consensus.cc:359] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.280795 32082 raft_consensus.cc:740] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.281585 32082 consensus_queue.cc:260] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.284113 32082 ts_tablet_manager.cc:1434] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:09.285048 32082 tablet_bootstrap.cc:492] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.294148 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.65:41673
I20260709 12:24:09.294968 32227 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.65:41673 every 8 connection(s)
I20260709 12:24:09.309240 32082 tablet_bootstrap.cc:492] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.310379 32082 tablet_bootstrap.cc:492] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.311115 32082 ts_tablet_manager.cc:1403] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.006s
I20260709 12:24:09.313867 32082 raft_consensus.cc:359] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.314632 32082 raft_consensus.cc:740] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.315498 32082 consensus_queue.cc:260] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.317019 32082 ts_tablet_manager.cc:1434] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:24:09.317804 32082 tablet_bootstrap.cc:492] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.366582 32082 tablet_bootstrap.cc:492] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.367765 32082 tablet_bootstrap.cc:492] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.368536 32082 ts_tablet_manager.cc:1403] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.000s
W20260709 12:24:09.371268 31318 consensus_peers.cc:597] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.371536 32082 raft_consensus.cc:359] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
W20260709 12:24:09.372411 31318 consensus_peers.cc:597] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.372565 32082 raft_consensus.cc:740] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
W20260709 12:24:09.374063 31318 consensus_peers.cc:597] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.373812 32082 consensus_queue.cc:260] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.374739 32228 heartbeater.cc:344] Connected to a master server at 127.22.43.126:35313
I20260709 12:24:09.375226 32228 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:09.376269 32228 heartbeater.cc:507] Master 127.22.43.126:35313 requested a full tablet report, sending...
I20260709 12:24:09.378983 32082 ts_tablet_manager.cc:1434] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:24:09.380005 32082 tablet_bootstrap.cc:492] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
W20260709 12:24:09.383064 31468 consensus_peers.cc:597] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:09.387773 31393 consensus_peers.cc:597] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.391023 32199 raft_consensus.cc:3060] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.405165 31172 ts_manager.cc:194] Re-registered known tserver with Master: 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:09.405589 32082 tablet_bootstrap.cc:492] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.416884 32082 tablet_bootstrap.cc:492] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.417552 32082 ts_tablet_manager.cc:1403] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.008s
I20260709 12:24:09.420643 32082 raft_consensus.cc:359] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.421470 32082 raft_consensus.cc:740] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.422312 32082 consensus_queue.cc:260] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.424827 32082 ts_tablet_manager.cc:1434] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:09.426026 32082 tablet_bootstrap.cc:492] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.429620 32198 raft_consensus.cc:3060] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.485939 32082 tablet_bootstrap.cc:492] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.486943 32082 tablet_bootstrap.cc:492] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.487627 32082 ts_tablet_manager.cc:1403] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.062s	user 0.039s	sys 0.009s
I20260709 12:24:09.490504 32082 raft_consensus.cc:359] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.491320 32082 raft_consensus.cc:740] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.492126 32082 consensus_queue.cc:260] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.495509 32082 ts_tablet_manager.cc:1434] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:24:09.496379 32082 tablet_bootstrap.cc:492] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.511514 31172 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49028
I20260709 12:24:09.527956 32228 heartbeater.cc:499] Master 127.22.43.126:35313 was elected leader, sending a full tablet report...
I20260709 12:24:09.545274 32082 tablet_bootstrap.cc:492] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.546182 32082 tablet_bootstrap.cc:492] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.546723 32082 ts_tablet_manager.cc:1403] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.008s
I20260709 12:24:09.550179 32082 raft_consensus.cc:359] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.550869 32082 raft_consensus.cc:740] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.551508 32082 consensus_queue.cc:260] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.553622 32082 ts_tablet_manager.cc:1434] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:24:09.554545 32082 tablet_bootstrap.cc:492] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.569283 32082 tablet_bootstrap.cc:492] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.570356 32082 tablet_bootstrap.cc:492] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.570998 32082 ts_tablet_manager.cc:1403] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 12:24:09.573501 32082 raft_consensus.cc:359] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.574283 32082 raft_consensus.cc:740] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.575141 32082 consensus_queue.cc:260] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.577488 32082 ts_tablet_manager.cc:1434] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:09.578442 32082 tablet_bootstrap.cc:492] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.585023 32199 raft_consensus.cc:3060] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:09.592260 31318 consensus_peers.cc:597] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:09.629731 32082 tablet_bootstrap.cc:492] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.630566 32082 tablet_bootstrap.cc:492] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.631328 32082 ts_tablet_manager.cc:1403] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.053s	user 0.023s	sys 0.020s
I20260709 12:24:09.634011 32082 raft_consensus.cc:359] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.634716 32082 raft_consensus.cc:740] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.635432 32082 consensus_queue.cc:260] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.637053 32082 ts_tablet_manager.cc:1434] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:24:09.637789 32082 tablet_bootstrap.cc:492] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.651124 32082 tablet_bootstrap.cc:492] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.651837 32082 tablet_bootstrap.cc:492] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.652333 32082 ts_tablet_manager.cc:1403] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 12:24:09.654546 32082 raft_consensus.cc:359] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.655227 32082 raft_consensus.cc:740] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.655926 32082 consensus_queue.cc:260] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.658133 32082 ts_tablet_manager.cc:1434] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:24:09.658958 32082 tablet_bootstrap.cc:492] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.674410 32082 tablet_bootstrap.cc:492] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.675235 32082 tablet_bootstrap.cc:492] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.675815 32082 ts_tablet_manager.cc:1403] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:24:09.677690 32082 raft_consensus.cc:359] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.678249 32082 raft_consensus.cc:740] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.678856 32082 consensus_queue.cc:260] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.681092 32082 ts_tablet_manager.cc:1434] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:24:09.682179 32082 tablet_bootstrap.cc:492] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.700085 32082 tablet_bootstrap.cc:492] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.701026 32082 tablet_bootstrap.cc:492] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.701627 32082 ts_tablet_manager.cc:1403] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 12:24:09.704356 32082 raft_consensus.cc:359] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.705052 32082 raft_consensus.cc:740] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.705806 32082 consensus_queue.cc:260] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.707741 32082 ts_tablet_manager.cc:1434] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:09.708477 32082 tablet_bootstrap.cc:492] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.722922 32082 tablet_bootstrap.cc:492] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.723950 32082 tablet_bootstrap.cc:492] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.724639 32082 ts_tablet_manager.cc:1403] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:24:09.727241 32082 raft_consensus.cc:359] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.727952 32082 raft_consensus.cc:740] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.728614 32082 consensus_queue.cc:260] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.730706 32082 ts_tablet_manager.cc:1434] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:09.731479 32082 tablet_bootstrap.cc:492] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.746332 32082 tablet_bootstrap.cc:492] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.747346 32082 tablet_bootstrap.cc:492] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.748093 32082 ts_tablet_manager.cc:1403] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:24:09.752485 32082 raft_consensus.cc:359] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.753173 32082 raft_consensus.cc:740] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.754001 32082 consensus_queue.cc:260] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:09.756294 32082 ts_tablet_manager.cc:1434] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:24:09.757625 32082 tablet_bootstrap.cc:492] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.771518 32082 tablet_bootstrap.cc:492] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.772307 32082 tablet_bootstrap.cc:492] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.772871 32082 ts_tablet_manager.cc:1403] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:24:09.774963 32082 raft_consensus.cc:359] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.775524 32082 raft_consensus.cc:740] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.776050 32082 consensus_queue.cc:260] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.777593 32082 ts_tablet_manager.cc:1434] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:09.778894 32082 tablet_bootstrap.cc:492] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.787701 32198 raft_consensus.cc:3060] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.798215 32082 tablet_bootstrap.cc:492] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.799310 32082 tablet_bootstrap.cc:492] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.800094 32082 ts_tablet_manager.cc:1403] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 12:24:09.801177 32200 raft_consensus.cc:3060] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.802397 32082 raft_consensus.cc:359] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.804673 32082 raft_consensus.cc:740] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.805464 32082 consensus_queue.cc:260] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.807631 32082 ts_tablet_manager.cc:1434] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:24:09.808588 32082 tablet_bootstrap.cc:492] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.823251 32198 raft_consensus.cc:3060] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.837761 32200 raft_consensus.cc:3060] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.853461 32082 tablet_bootstrap.cc:492] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.854581 32082 tablet_bootstrap.cc:492] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.855326 32082 ts_tablet_manager.cc:1403] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.011s
I20260709 12:24:09.859743 32082 raft_consensus.cc:359] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.860474 32082 raft_consensus.cc:740] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.861222 32082 consensus_queue.cc:260] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.863767 32082 ts_tablet_manager.cc:1434] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:09.864650 32082 tablet_bootstrap.cc:492] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
W20260709 12:24:09.879684 31393 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:41673, user_credentials={real_user=slave}} blocked reactor thread for 58536.5us
I20260709 12:24:09.909130 32082 tablet_bootstrap.cc:492] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.910146 32082 tablet_bootstrap.cc:492] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.910823 32082 ts_tablet_manager.cc:1403] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.007s
I20260709 12:24:09.914422 32082 raft_consensus.cc:359] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.916683 32082 raft_consensus.cc:740] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.917368 32082 consensus_queue.cc:260] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.925275 32082 ts_tablet_manager.cc:1434] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:24:09.926172 32082 tablet_bootstrap.cc:492] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.939775 32082 tablet_bootstrap.cc:492] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.940544 32082 tablet_bootstrap.cc:492] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.941224 32082 ts_tablet_manager.cc:1403] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 12:24:09.943257 32082 raft_consensus.cc:359] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.943816 32082 raft_consensus.cc:740] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.944326 32082 consensus_queue.cc:260] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.945866 32082 ts_tablet_manager.cc:1434] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:24:09.946794 32082 tablet_bootstrap.cc:492] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.960067 32082 tablet_bootstrap.cc:492] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.960789 32082 tablet_bootstrap.cc:492] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.961335 32082 ts_tablet_manager.cc:1403] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:24:09.963248 32082 raft_consensus.cc:359] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.963763 32082 raft_consensus.cc:740] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.964363 32082 consensus_queue.cc:260] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:09.965991 32082 ts_tablet_manager.cc:1434] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.004s	user 0.008s	sys 0.000s
I20260709 12:24:09.967061 32082 tablet_bootstrap.cc:492] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:09.981695 32082 tablet_bootstrap.cc:492] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:09.982378 32198 raft_consensus.cc:3060] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.982740 32082 tablet_bootstrap.cc:492] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:09.983471 32082 ts_tablet_manager.cc:1403] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:24:09.985719 32082 raft_consensus.cc:359] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.986428 32082 raft_consensus.cc:740] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.987085 32082 consensus_queue.cc:260] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:09.989145 32082 ts_tablet_manager.cc:1434] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:09.990269 32082 tablet_bootstrap.cc:492] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.016868 32082 tablet_bootstrap.cc:492] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.017978 32082 tablet_bootstrap.cc:492] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.018778 32082 ts_tablet_manager.cc:1403] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.005s
I20260709 12:24:10.025813 32082 raft_consensus.cc:359] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:10.026703 32082 raft_consensus.cc:740] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.028584 32082 consensus_queue.cc:260] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:10.030895 32082 ts_tablet_manager.cc:1434] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:24:10.031796 32082 tablet_bootstrap.cc:492] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.055238 32082 tablet_bootstrap.cc:492] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.056107 32082 tablet_bootstrap.cc:492] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.056645 32082 ts_tablet_manager.cc:1403] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.003s
I20260709 12:24:10.059499 32082 raft_consensus.cc:359] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.060113 32082 raft_consensus.cc:740] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.060777 32082 consensus_queue.cc:260] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.062412 32082 ts_tablet_manager.cc:1434] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:24:10.063120 32082 tablet_bootstrap.cc:492] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.070725 32198 raft_consensus.cc:3060] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.078099 32082 tablet_bootstrap.cc:492] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.079234 32082 tablet_bootstrap.cc:492] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.079877 32082 ts_tablet_manager.cc:1403] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:24:10.082902 32082 raft_consensus.cc:359] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:10.083668 32082 raft_consensus.cc:740] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.084462 32082 consensus_queue.cc:260] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:10.086839 32082 ts_tablet_manager.cc:1434] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:10.087724 32082 tablet_bootstrap.cc:492] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.106240 32082 tablet_bootstrap.cc:492] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.112739 32082 tablet_bootstrap.cc:492] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.113555 32082 ts_tablet_manager.cc:1403] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 12:24:10.116550 32082 raft_consensus.cc:359] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:10.117347 32082 raft_consensus.cc:740] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.118258 32082 consensus_queue.cc:260] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:10.120615 32082 ts_tablet_manager.cc:1434] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:10.121323 32082 tablet_bootstrap.cc:492] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.139874 32082 tablet_bootstrap.cc:492] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.140712 32082 tablet_bootstrap.cc:492] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.141307 32082 ts_tablet_manager.cc:1403] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.002s
I20260709 12:24:10.143615 32082 raft_consensus.cc:359] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.144341 32082 raft_consensus.cc:740] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.145047 32082 consensus_queue.cc:260] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.147279 32082 ts_tablet_manager.cc:1434] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:24:10.148697 32082 tablet_bootstrap.cc:492] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.165503 32198 raft_consensus.cc:3060] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.173450 32200 raft_consensus.cc:3060] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.208833 32082 tablet_bootstrap.cc:492] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.209852 32082 tablet_bootstrap.cc:492] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.210548 32082 ts_tablet_manager.cc:1403] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.022s
I20260709 12:24:10.213279 32082 raft_consensus.cc:359] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.214175 32082 raft_consensus.cc:740] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.214847 32082 consensus_queue.cc:260] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.217026 32082 ts_tablet_manager.cc:1434] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.006s
I20260709 12:24:10.218168 32082 tablet_bootstrap.cc:492] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.234508 32197 raft_consensus.cc:3060] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.249452 32082 tablet_bootstrap.cc:492] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.251137 32082 tablet_bootstrap.cc:492] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.251840 32082 ts_tablet_manager.cc:1403] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.000s
I20260709 12:24:10.255038 32082 raft_consensus.cc:359] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.255822 32082 raft_consensus.cc:740] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.256565 32082 consensus_queue.cc:260] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.259008 32082 ts_tablet_manager.cc:1434] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:10.259954 32082 tablet_bootstrap.cc:492] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.277148 32082 tablet_bootstrap.cc:492] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.278204 32082 tablet_bootstrap.cc:492] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.278913 32082 ts_tablet_manager.cc:1403] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:24:10.281646 32082 raft_consensus.cc:359] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:10.281904 32197 raft_consensus.cc:3060] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.282409 32082 raft_consensus.cc:740] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.285332 32082 consensus_queue.cc:260] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:10.288664 32082 ts_tablet_manager.cc:1434] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:24:10.291102 32082 tablet_bootstrap.cc:492] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.319964 32082 tablet_bootstrap.cc:492] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.321029 32082 tablet_bootstrap.cc:492] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.321744 32082 ts_tablet_manager.cc:1403] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.004s
I20260709 12:24:10.324576 32082 raft_consensus.cc:359] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.325335 32082 raft_consensus.cc:740] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.326077 32082 consensus_queue.cc:260] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.328516 32082 ts_tablet_manager.cc:1434] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:24:10.329406 32082 tablet_bootstrap.cc:492] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.344635 32082 tablet_bootstrap.cc:492] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.345779 32082 tablet_bootstrap.cc:492] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.346581 32082 ts_tablet_manager.cc:1403] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:24:10.349349 32082 raft_consensus.cc:359] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:10.354997 32082 raft_consensus.cc:740] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.355794 32082 consensus_queue.cc:260] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:10.358246 32082 ts_tablet_manager.cc:1434] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:24:10.359138 32082 tablet_bootstrap.cc:492] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.385442 32082 tablet_bootstrap.cc:492] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.386389 32082 tablet_bootstrap.cc:492] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.386983 32082 ts_tablet_manager.cc:1403] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.001s
I20260709 12:24:10.388932 32082 raft_consensus.cc:359] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.389492 32082 raft_consensus.cc:740] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.390165 32082 consensus_queue.cc:260] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.392287 32082 ts_tablet_manager.cc:1434] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:10.393573 32082 tablet_bootstrap.cc:492] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.408738 32082 tablet_bootstrap.cc:492] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.409797 32082 tablet_bootstrap.cc:492] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.410595 32082 ts_tablet_manager.cc:1403] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:24:10.413113 32082 raft_consensus.cc:359] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.413846 32082 raft_consensus.cc:740] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.414549 32082 consensus_queue.cc:260] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.416877 32082 ts_tablet_manager.cc:1434] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:10.418016 32082 tablet_bootstrap.cc:492] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap starting.
I20260709 12:24:10.445447 32082 tablet_bootstrap.cc:492] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.446625 32082 tablet_bootstrap.cc:492] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9: Bootstrap complete.
I20260709 12:24:10.447428 32082 ts_tablet_manager.cc:1403] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.011s
I20260709 12:24:10.449676 32082 raft_consensus.cc:359] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.450284 32082 raft_consensus.cc:740] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.450832 32082 consensus_queue.cc:260] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:10.452808 32082 ts_tablet_manager.cc:1434] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:24:10.688969 32197 raft_consensus.cc:3060] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.693696 32199 raft_consensus.cc:3060] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.303043 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:19.366752 31499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9"
dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:55468
I20260709 12:24:19.367439 31499 raft_consensus.cc:606] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:19.370358 31499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b"
dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:55468
I20260709 12:24:19.370985 31499 raft_consensus.cc:606] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:19.373682 32310 raft_consensus.cc:993] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:19.374577 32298 raft_consensus.cc:1081] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:19.376425 32198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54634
I20260709 12:24:19.376988 32198 raft_consensus.cc:493] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:19.377391 32198 raft_consensus.cc:3060] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.389004 32198 raft_consensus.cc:515] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:19.392851 32198 leader_election.cc:290] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:19.394598 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:19.394351 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:19.395391 31499 raft_consensus.cc:3055] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.395531 31426 raft_consensus.cc:3060] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.395807 31499 raft_consensus.cc:740] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:19.396826 31499 consensus_queue.cc:260] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:19.446696 31499 raft_consensus.cc:3060] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.448976 31426 raft_consensus.cc:2468] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:19.464496 31431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "344ee99261a143ee9924131fc68c1ec3"
dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:38480
I20260709 12:24:19.465165 31431 raft_consensus.cc:606] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:19.455462 32313 raft_consensus.cc:993] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:19.465941 32313 raft_consensus.cc:1081] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:19.468178 32078 leader_election.cc:304] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:19.469784 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f26d3890ccd46ddb1160ee1529963a0"
dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:55468
I20260709 12:24:19.470378 31498 raft_consensus.cc:606] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:19.471731 32321 raft_consensus.cc:2804] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:19.472698 32200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54634
I20260709 12:24:19.476761 32200 raft_consensus.cc:493] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:19.477137 32200 raft_consensus.cc:3060] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.484580 31499 raft_consensus.cc:2468] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:19.487044 32302 raft_consensus.cc:993] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:19.499382 32302 raft_consensus.cc:1081] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:19.502188 32198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "344ee99261a143ee9924131fc68c1ec3"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54642
I20260709 12:24:19.502817 32198 raft_consensus.cc:493] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:19.503208 32198 raft_consensus.cc:3060] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.505144 32200 raft_consensus.cc:515] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:19.513792 32200 leader_election.cc:290] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 3 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:19.519539 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:19.520170 32321 raft_consensus.cc:697] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:19.520231 31498 raft_consensus.cc:3055] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:19.520695 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:19.520891 31498 raft_consensus.cc:740] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:19.521364 31431 raft_consensus.cc:3060] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.521791 31498 consensus_queue.cc:260] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:19.523319 31498 raft_consensus.cc:3060] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.531962 31431 raft_consensus.cc:2468] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 3.
I20260709 12:24:19.531016 32321 consensus_queue.cc:237] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:19.534607 32078 leader_election.cc:304] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:19.535982 32323 raft_consensus.cc:2804] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:19.536482 32323 raft_consensus.cc:697] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:19.537674 32323 consensus_queue.cc:237] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:19.540961 32198 raft_consensus.cc:515] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:19.545542 32198 leader_election.cc:290] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:19.546380 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ee99261a143ee9924131fc68c1ec3" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:19.547072 31351 raft_consensus.cc:3060] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.534715 31498 raft_consensus.cc:2468] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 3.
I20260709 12:24:19.553408 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ee99261a143ee9924131fc68c1ec3" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:19.554276 31431 raft_consensus.cc:3055] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.554538 31431 raft_consensus.cc:740] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:19.555313 31431 consensus_queue.cc:260] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:19.556763 31431 raft_consensus.cc:3060] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.556846 31174 catalog_manager.cc:5697] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 1 to 2, leader changed from 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:19.565313 31351 raft_consensus.cc:2468] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:19.566211 31350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144"
dest_uuid: "998cd06c0be349879a0602496bc33640"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:57438
I20260709 12:24:19.567019 31350 raft_consensus.cc:606] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:19.567621 32077 leader_election.cc:304] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:19.568516 32321 raft_consensus.cc:2804] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:19.568991 32321 raft_consensus.cc:697] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:19.570574 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbfd97beba6040c69589994e8389028e"
dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:55468
I20260709 12:24:19.571312 31498 raft_consensus.cc:606] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:19.574422 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:19.575984 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:19.579032 31431 raft_consensus.cc:2468] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:19.569996 32321 consensus_queue.cc:237] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:19.588577 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:19.621506 32313 raft_consensus.cc:993] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:19.622044 32313 raft_consensus.cc:1081] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:19.623888 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f26d3890ccd46ddb1160ee1529963a0"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54634
I20260709 12:24:19.624392 32197 raft_consensus.cc:493] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:19.624748 32197 raft_consensus.cc:3060] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.636338 32197 raft_consensus.cc:515] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:19.636677 31174 catalog_manager.cc:5697] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 2 to 3, leader changed from 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 3 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:19.641266 31174 catalog_manager.cc:5697] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 1 to 2, leader changed from e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:19.644809 32197 leader_election.cc:290] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:19.646220 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f26d3890ccd46ddb1160ee1529963a0" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:19.646929 31423 raft_consensus.cc:3060] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.647135 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f26d3890ccd46ddb1160ee1529963a0" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:19.647732 31498 raft_consensus.cc:3055] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.648005 31498 raft_consensus.cc:740] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:19.648773 31498 consensus_queue.cc:260] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:19.650921 31498 raft_consensus.cc:3060] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.658919 31498 raft_consensus.cc:2468] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:19.658991 31423 raft_consensus.cc:2468] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:19.660084 32078 leader_election.cc:304] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:24:19.660954 32321 raft_consensus.cc:2804] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:19.661506 32321 raft_consensus.cc:697] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:19.662616 32321 consensus_queue.cc:237] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:19.676465 31174 catalog_manager.cc:5697] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 1 to 2, leader changed from 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:19.825806 32320 raft_consensus.cc:993] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:19.826404 32310 raft_consensus.cc:1081] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:19.827824 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbfd97beba6040c69589994e8389028e"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54634
I20260709 12:24:19.828307 32197 raft_consensus.cc:493] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:19.828683 32197 raft_consensus.cc:3060] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.833595 32197 raft_consensus.cc:515] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:19.835050 32197 leader_election.cc:290] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:19.835853 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd97beba6040c69589994e8389028e" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:19.836061 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd97beba6040c69589994e8389028e" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:19.836416 31498 raft_consensus.cc:3055] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.836647 31351 raft_consensus.cc:3060] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.836762 31498 raft_consensus.cc:740] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:19.837692 31498 consensus_queue.cc:260] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:19.838923 31498 raft_consensus.cc:3060] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.844173 31351 raft_consensus.cc:2468] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:19.845567 32077 leader_election.cc:304] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:19.846381 31498 raft_consensus.cc:2468] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:19.846830 32321 raft_consensus.cc:2804] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:19.848167 32321 raft_consensus.cc:697] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:19.849047 32321 consensus_queue.cc:237] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:19.862175 31174 catalog_manager.cc:5697] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 1 to 2, leader changed from 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:19.928581 31431 raft_consensus.cc:1275] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:19.929984 32321 consensus_queue.cc:1048] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:19.945210 31498 raft_consensus.cc:1275] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:19.949020 31423 raft_consensus.cc:1275] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:19.950048 32321 consensus_queue.cc:1048] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:19.953846 32321 consensus_queue.cc:1048] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:19.990451 31499 raft_consensus.cc:1275] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:19.991935 32323 consensus_queue.cc:1048] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.017194 32316 raft_consensus.cc:993] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:20.017850 32309 raft_consensus.cc:1081] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:20.020339 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54626
I20260709 12:24:20.020891 32197 raft_consensus.cc:493] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.021262 32197 raft_consensus.cc:3060] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.028396 32197 raft_consensus.cc:515] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:20.029167 31351 raft_consensus.cc:1275] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:20.030288 32197 leader_election.cc:290] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 3 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:20.030963 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:20.031128 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9ef281dbc6466ea1c1189cdc3fd144" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:20.031649 31499 raft_consensus.cc:3060] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.031388 32323 consensus_queue.cc:1048] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.031742 31351 raft_consensus.cc:3055] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.032147 31351 raft_consensus.cc:740] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:20.032817 31351 consensus_queue.cc:260] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:20.034034 31351 raft_consensus.cc:3060] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.041487 31351 raft_consensus.cc:2468] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 3.
I20260709 12:24:20.042021 31499 raft_consensus.cc:2468] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 3.
I20260709 12:24:20.042407 32077 leader_election.cc:304] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:20.043316 32323 raft_consensus.cc:2804] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:20.043970 32323 raft_consensus.cc:697] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:20.045267 32323 consensus_queue.cc:237] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:20.053381 31499 raft_consensus.cc:1275] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:20.055552 32321 consensus_queue.cc:1048] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.060283 31174 catalog_manager.cc:5697] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 2 to 3, leader changed from 998cd06c0be349879a0602496bc33640 (127.22.43.66) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 3 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.086068 31423 raft_consensus.cc:1275] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:20.087723 32321 consensus_queue.cc:1048] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.093397 31426 raft_consensus.cc:1275] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:20.098614 32323 consensus_queue.cc:1048] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.295843 31498 raft_consensus.cc:1275] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:20.297232 32321 consensus_queue.cc:1048] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.313467 31351 raft_consensus.cc:1275] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:20.314973 32321 consensus_queue.cc:1048] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.554842 31498 raft_consensus.cc:1275] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:20.556077 32323 consensus_queue.cc:1048] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:20.565563 31351 raft_consensus.cc:1275] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:20.567428 32321 consensus_queue.cc:1048] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:20.648250 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:20.683534 31423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3"
dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:38480
I20260709 12:24:20.684104 31423 raft_consensus.cc:606] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:20.686858 31351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405"
dest_uuid: "998cd06c0be349879a0602496bc33640"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:57438
I20260709 12:24:20.687469 31351 raft_consensus.cc:606] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:20.689991 31351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0b3ab9ea32b4118bdeaef97935b378b"
dest_uuid: "998cd06c0be349879a0602496bc33640"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:57438
I20260709 12:24:20.690485 31351 raft_consensus.cc:606] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:20.693202 31351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8345833c0f34e96af79e53d5eb8fbc0"
dest_uuid: "998cd06c0be349879a0602496bc33640"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:57438
I20260709 12:24:20.693770 31351 raft_consensus.cc:606] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:20.696427 31351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc8b707960e641338e58cc2552304bb1"
dest_uuid: "998cd06c0be349879a0602496bc33640"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:57438
I20260709 12:24:20.696892 31351 raft_consensus.cc:606] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:20.699400 31351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1ac93be0c8e4f939c700b1ac7fa43d6"
dest_uuid: "998cd06c0be349879a0602496bc33640"
mode: GRACEFUL
new_leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
 from {username='slave'} at 127.0.0.1:57438
I20260709 12:24:20.699926 31351 raft_consensus.cc:606] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Received request to transfer leadership to TS 41649f3a1d8346ada1e2a0e8b6cae5ed
I20260709 12:24:20.701198 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:20.702953 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:20.704002 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:20.731807 32294 raft_consensus.cc:993] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:20.732327 32294 raft_consensus.cc:1081] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:20.733839 32198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc8b707960e641338e58cc2552304bb1"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54626
I20260709 12:24:20.734406 32198 raft_consensus.cc:493] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.734742 32198 raft_consensus.cc:3060] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.741775 32198 raft_consensus.cc:515] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:20.744366 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8b707960e641338e58cc2552304bb1" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:20.744963 31499 raft_consensus.cc:3060] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.745821 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8b707960e641338e58cc2552304bb1" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:20.744403 32198 leader_election.cc:290] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:20.746413 31351 raft_consensus.cc:3055] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:20.746770 31351 raft_consensus.cc:740] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:20.747522 31351 consensus_queue.cc:260] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:20.748651 31351 raft_consensus.cc:3060] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.750979 32294 raft_consensus.cc:993] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:20.751137 31499 raft_consensus.cc:2468] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:20.751550 32317 raft_consensus.cc:1081] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:20.752660 32078 leader_election.cc:304] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:24:20.753191 32198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54626
I20260709 12:24:20.753480 32321 raft_consensus.cc:2804] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:20.753870 32198 raft_consensus.cc:493] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.754115 32321 raft_consensus.cc:697] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:20.754312 32198 raft_consensus.cc:3060] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.755082 31351 raft_consensus.cc:2468] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:20.755184 32321 consensus_queue.cc:237] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:20.760810 32198 raft_consensus.cc:515] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:20.763202 32198 leader_election.cc:290] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 3 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:20.764354 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:20.764889 31351 raft_consensus.cc:3055] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.765161 31351 raft_consensus.cc:740] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:20.766230 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382bfbf93704e3fb4a71d8f048be405" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:20.766902 31498 raft_consensus.cc:3060] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.769414 31177 catalog_manager.cc:5697] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 1 to 2, leader changed from 998cd06c0be349879a0602496bc33640 (127.22.43.66) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.765813 31351 consensus_queue.cc:260] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:20.772924 31351 raft_consensus.cc:3060] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.773972 31498 raft_consensus.cc:2468] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 3.
I20260709 12:24:20.775302 32078 leader_election.cc:304] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:24:20.776103 32321 raft_consensus.cc:2804] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:20.776779 32321 raft_consensus.cc:697] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:20.777671 32321 consensus_queue.cc:237] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:20.780522 31351 raft_consensus.cc:2468] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 3.
I20260709 12:24:20.786212 32294 raft_consensus.cc:993] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:20.786775 32317 raft_consensus.cc:1081] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:20.788268 32198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0b3ab9ea32b4118bdeaef97935b378b"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54626
I20260709 12:24:20.788749 32198 raft_consensus.cc:493] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.789045 32198 raft_consensus.cc:3060] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.793115 31177 catalog_manager.cc:5697] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 2 to 3, leader changed from 998cd06c0be349879a0602496bc33640 (127.22.43.66) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 3 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.795687 32198 raft_consensus.cc:515] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:20.798488 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b3ab9ea32b4118bdeaef97935b378b" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:20.799048 31423 raft_consensus.cc:3060] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.802595 32198 leader_election.cc:290] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:20.804849 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b3ab9ea32b4118bdeaef97935b378b" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:20.805399 31351 raft_consensus.cc:3055] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:20.805696 31351 raft_consensus.cc:740] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:20.806447 31351 consensus_queue.cc:260] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:20.807729 31351 raft_consensus.cc:3060] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.808415 31423 raft_consensus.cc:2468] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:20.809656 32078 leader_election.cc:304] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:20.810575 32321 raft_consensus.cc:2804] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:20.811275 32321 raft_consensus.cc:697] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:20.812258 32321 consensus_queue.cc:237] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:20.817868 31351 raft_consensus.cc:2468] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:20.823196 31177 catalog_manager.cc:5697] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 1 to 2, leader changed from 998cd06c0be349879a0602496bc33640 (127.22.43.66) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:21.065449 32308 raft_consensus.cc:993] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:21.066007 32302 raft_consensus.cc:1081] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:21.067520 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54642
I20260709 12:24:21.068042 32197 raft_consensus.cc:493] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.068660 32197 raft_consensus.cc:3060] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.076483 32197 raft_consensus.cc:515] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:21.079090 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:21.079754 32197 leader_election.cc:290] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:21.079919 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa903d81ea4bcca153d01ec079d6d3" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:21.080480 31498 raft_consensus.cc:3060] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.079936 31423 raft_consensus.cc:3055] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:21.084946 31423 raft_consensus.cc:740] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:21.085781 31423 consensus_queue.cc:260] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:21.086670 31498 raft_consensus.cc:2468] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:21.086222 32294 raft_consensus.cc:993] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640: : Instructing follower 41649f3a1d8346ada1e2a0e8b6cae5ed to start an election
I20260709 12:24:21.087751 32078 leader_election.cc:304] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:24:21.087752 32294 raft_consensus.cc:1081] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Signalling peer 41649f3a1d8346ada1e2a0e8b6cae5ed to start an election
I20260709 12:24:21.087929 31423 raft_consensus.cc:3060] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.088722 32321 raft_consensus.cc:2804] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.089205 32321 raft_consensus.cc:697] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:21.090090 32321 consensus_queue.cc:237] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:21.090971 31498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1ac93be0c8e4f939c700b1ac7fa43d6"
dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
 from {username='slave'} at 127.0.0.1:51502
I20260709 12:24:21.091565 31498 raft_consensus.cc:493] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.091981 31498 raft_consensus.cc:3060] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.098421 31423 raft_consensus.cc:2468] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:21.105023 31498 raft_consensus.cc:515] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:21.107714 31498 leader_election.cc:290] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:21.108700 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ac93be0c8e4f939c700b1ac7fa43d6" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:21.109463 31351 raft_consensus.cc:3055] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:21.108668 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ac93be0c8e4f939c700b1ac7fa43d6" candidate_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:21.109773 31351 raft_consensus.cc:740] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:21.110039 31426 raft_consensus.cc:3060] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.110198 31177 catalog_manager.cc:5697] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 1 to 2, leader changed from e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.110590 31351 consensus_queue.cc:260] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:21.111804 31351 raft_consensus.cc:3060] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.118626 31351 raft_consensus.cc:2468] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 2.
I20260709 12:24:21.122010 31469 leader_election.cc:304] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:21.122197 31426 raft_consensus.cc:2468] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41649f3a1d8346ada1e2a0e8b6cae5ed in term 2.
I20260709 12:24:21.123257 32310 raft_consensus.cc:2804] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.123796 32310 raft_consensus.cc:697] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Becoming Leader. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:21.124981 32310 consensus_queue.cc:237] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:21.129236 32294 raft_consensus.cc:993] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:21.129992 32361 raft_consensus.cc:1081] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:21.133682 32198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8345833c0f34e96af79e53d5eb8fbc0"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54626
I20260709 12:24:21.134220 32198 raft_consensus.cc:493] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.134569 32198 raft_consensus.cc:3060] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.138509 31177 catalog_manager.cc:5697] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed reported cstate change: term changed from 1 to 2, leader changed from 998cd06c0be349879a0602496bc33640 (127.22.43.66) to 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68). New cstate: current_term: 2 leader_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.143846 32198 raft_consensus.cc:515] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:21.145941 32198 leader_election.cc:290] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Requested vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:21.146685 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8345833c0f34e96af79e53d5eb8fbc0" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:21.147293 31498 raft_consensus.cc:3060] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.147394 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8345833c0f34e96af79e53d5eb8fbc0" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:21.148415 31351 raft_consensus.cc:3055] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:21.148669 31351 raft_consensus.cc:740] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:21.149340 31351 consensus_queue.cc:260] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:21.150341 31351 raft_consensus.cc:3060] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.152212 31498 raft_consensus.cc:2468] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:21.153209 32078 leader_election.cc:304] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:24:21.153923 32321 raft_consensus.cc:2804] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.154388 32321 raft_consensus.cc:697] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:21.155486 31351 raft_consensus.cc:2468] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:21.155294 32321 consensus_queue.cc:237] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:21.165323 31177 catalog_manager.cc:5697] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 1 to 2, leader changed from 998cd06c0be349879a0602496bc33640 (127.22.43.66) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:21.215528 31351 raft_consensus.cc:1275] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:21.216741 32321 consensus_queue.cc:1048] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:21.238477 31355 raft_consensus.cc:1275] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.242139 32325 consensus_queue.cc:1048] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:21.253108 31499 raft_consensus.cc:1275] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:21.256354 32323 consensus_queue.cc:1048] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:21.277745 31500 raft_consensus.cc:1275] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.281013 32321 consensus_queue.cc:1048] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:21.309417 31349 raft_consensus.cc:1275] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.311802 32325 consensus_queue.cc:1048] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:21.326522 31423 raft_consensus.cc:1275] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.328497 32321 consensus_queue.cc:1048] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:21.563060 31349 raft_consensus.cc:1275] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer 41649f3a1d8346ada1e2a0e8b6cae5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.564584 32310 consensus_queue.cc:1048] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:21.574119 31426 raft_consensus.cc:1275] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 41649f3a1d8346ada1e2a0e8b6cae5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.578539 32380 consensus_queue.cc:1048] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:21.627655 31426 raft_consensus.cc:1275] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.629047 32325 consensus_queue.cc:1048] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:21.637956 31499 raft_consensus.cc:1275] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.639534 32321 consensus_queue.cc:1048] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:21.728256 31349 raft_consensus.cc:1275] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.729362 32323 consensus_queue.cc:1048] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:21.740691 31498 raft_consensus.cc:1275] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.742326 32323 consensus_queue.cc:1048] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:21.746632 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:21.808012 31349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c34c9c84b088402082232ada2f901768"
dest_uuid: "998cd06c0be349879a0602496bc33640"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:57438
I20260709 12:24:21.808595 31349 raft_consensus.cc:606] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:21.812381 31349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d96465747d074cce91dcec123d153e68"
dest_uuid: "998cd06c0be349879a0602496bc33640"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:57438
I20260709 12:24:21.813014 31349 raft_consensus.cc:606] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:21.815675 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e36bf368739149e1a96b5f15cbc86e6c"
dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
mode: GRACEFUL
new_leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
 from {username='slave'} at 127.0.0.1:55468
I20260709 12:24:21.816229 31498 raft_consensus.cc:606] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Received request to transfer leadership to TS e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:21.817523 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:21.819252 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:21.819942 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:21.864705 32361 raft_consensus.cc:993] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:21.865275 32317 raft_consensus.cc:1081] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:21.866796 32198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c34c9c84b088402082232ada2f901768"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54626
I20260709 12:24:21.867336 32198 raft_consensus.cc:493] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.867717 32198 raft_consensus.cc:3060] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.874819 32198 raft_consensus.cc:515] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:21.878142 31355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34c9c84b088402082232ada2f901768" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:21.878655 31355 raft_consensus.cc:3055] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:21.878867 31355 raft_consensus.cc:740] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:21.879583 31355 consensus_queue.cc:260] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:21.880661 31355 raft_consensus.cc:3060] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.886790 32198 leader_election.cc:290] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:21.886942 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34c9c84b088402082232ada2f901768" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:21.887506 31431 raft_consensus.cc:3060] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.886926 31355 raft_consensus.cc:2468] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:21.889467 32077 leader_election.cc:304] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640; no voters: 
I20260709 12:24:21.890152 32321 raft_consensus.cc:2804] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.890707 32321 raft_consensus.cc:697] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:21.891567 32321 consensus_queue.cc:237] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:21.893496 31431 raft_consensus.cc:2468] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:21.901541 31174 catalog_manager.cc:5697] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 1 to 2, leader changed from 998cd06c0be349879a0602496bc33640 (127.22.43.66) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:21.912245 32361 raft_consensus.cc:993] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:21.912746 32317 raft_consensus.cc:1081] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:21.914732 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d96465747d074cce91dcec123d153e68"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54626
I20260709 12:24:21.915267 32197 raft_consensus.cc:493] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.915601 32197 raft_consensus.cc:3060] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.923552 32197 raft_consensus.cc:515] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:21.925254 32197 leader_election.cc:290] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:21.925923 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96465747d074cce91dcec123d153e68" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:21.926187 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96465747d074cce91dcec123d153e68" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:21.926482 31349 raft_consensus.cc:3055] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:21.926822 31349 raft_consensus.cc:740] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 998cd06c0be349879a0602496bc33640, State: Running, Role: LEADER
I20260709 12:24:21.926841 31431 raft_consensus.cc:3060] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.927582 31349 consensus_queue.cc:260] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:21.928545 31349 raft_consensus.cc:3060] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.931751 31431 raft_consensus.cc:2468] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:21.932832 32078 leader_election.cc:304] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:21.933668 32321 raft_consensus.cc:2804] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.934178 31349 raft_consensus.cc:2468] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 2.
I20260709 12:24:21.934226 32321 raft_consensus.cc:697] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:21.935325 32321 consensus_queue.cc:237] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:21.944284 31174 catalog_manager.cc:5697] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 1 to 2, leader changed from 998cd06c0be349879a0602496bc33640 (127.22.43.66) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:21.986836 32380 raft_consensus.cc:993] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed: : Instructing follower e3c9c70e306d465ebdbcd2b8e9849f3b to start an election
I20260709 12:24:21.987370 32310 raft_consensus.cc:1081] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Signalling peer e3c9c70e306d465ebdbcd2b8e9849f3b to start an election
I20260709 12:24:21.988941 31431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e36bf368739149e1a96b5f15cbc86e6c"
dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
 from {username='slave'} at 127.0.0.1:37190
I20260709 12:24:21.989446 31431 raft_consensus.cc:493] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.989719 31431 raft_consensus.cc:3060] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.995537 31431 raft_consensus.cc:515] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:21.997503 31431 leader_election.cc:290] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Requested vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:21.998165 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36bf368739149e1a96b5f15cbc86e6c" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "998cd06c0be349879a0602496bc33640"
I20260709 12:24:21.998528 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36bf368739149e1a96b5f15cbc86e6c" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:21.998791 31349 raft_consensus.cc:3060] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.999184 31498 raft_consensus.cc:3055] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:21.999511 31498 raft_consensus.cc:740] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41649f3a1d8346ada1e2a0e8b6cae5ed, State: Running, Role: LEADER
I20260709 12:24:22.000239 31498 consensus_queue.cc:260] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:22.001438 31498 raft_consensus.cc:3060] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.005676 31349 raft_consensus.cc:2468] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 2.
I20260709 12:24:22.007200 31394 leader_election.cc:304] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 
I20260709 12:24:22.008009 32372 raft_consensus.cc:2804] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:22.009469 31498 raft_consensus.cc:2468] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c9c70e306d465ebdbcd2b8e9849f3b in term 2.
I20260709 12:24:22.010311 32372 raft_consensus.cc:697] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Becoming Leader. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:22.011438 32372 consensus_queue.cc:237] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:22.021600 31174 catalog_manager.cc:5697] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b reported cstate change: term changed from 1 to 2, leader changed from 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68) to e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67). New cstate: current_term: 2 leader_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:22.350773 31349 raft_consensus.cc:1275] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.351953 32325 consensus_queue.cc:1048] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.367352 31426 raft_consensus.cc:1275] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.369304 32323 consensus_queue.cc:1048] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.418550 31423 raft_consensus.cc:1275] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.419821 32323 consensus_queue.cc:1048] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.432487 31355 raft_consensus.cc:1275] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.434278 32323 consensus_queue.cc:1048] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.467721 31355 raft_consensus.cc:1275] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Refusing update from remote peer e3c9c70e306d465ebdbcd2b8e9849f3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.469131 32392 consensus_queue.cc:1048] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.481984 31499 raft_consensus.cc:1275] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Refusing update from remote peer e3c9c70e306d465ebdbcd2b8e9849f3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.485106 32372 consensus_queue.cc:1048] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.859092 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:22.901784 31423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d"
dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
mode: GRACEFUL
new_leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:38480
I20260709 12:24:22.902403 31423 raft_consensus.cc:606] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Received request to transfer leadership to TS 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:22.903575 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:22.904781 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:22.905350 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:22.972631 32302 raft_consensus.cc:993] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b: : Instructing follower 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:22.973176 32372 raft_consensus.cc:1081] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Signalling peer 6d8f665ef2fc4df7a59ae96d4086dba9 to start an election
I20260709 12:24:22.974753 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d"
dest_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9"
 from {username='slave'} at 127.0.0.1:54642
I20260709 12:24:22.975293 32197 raft_consensus.cc:493] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:22.975649 32197 raft_consensus.cc:3060] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.983512 32197 raft_consensus.cc:515] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:22.984961 32197 leader_election.cc:290] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 3 election: Requested vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287)
I20260709 12:24:22.985740 31426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b"
I20260709 12:24:22.986405 31426 raft_consensus.cc:3055] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:22.986308 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315f791c509f45baa49304f2085a8c2d" candidate_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed"
I20260709 12:24:22.987001 31499 raft_consensus.cc:3060] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.989387 31426 raft_consensus.cc:740] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3c9c70e306d465ebdbcd2b8e9849f3b, State: Running, Role: LEADER
I20260709 12:24:22.990229 31426 consensus_queue.cc:260] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:22.991528 31426 raft_consensus.cc:3060] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.993067 31499 raft_consensus.cc:2468] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 3.
I20260709 12:24:22.994295 32078 leader_election.cc:304] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9; no voters: 
I20260709 12:24:22.995054 32325 raft_consensus.cc:2804] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:22.995528 32325 raft_consensus.cc:697] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8f665ef2fc4df7a59ae96d4086dba9, State: Running, Role: LEADER
I20260709 12:24:22.996418 32325 consensus_queue.cc:237] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:22.998288 31426 raft_consensus.cc:2468] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8f665ef2fc4df7a59ae96d4086dba9 in term 3.
I20260709 12:24:23.006894 31174 catalog_manager.cc:5697] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 reported cstate change: term changed from 2 to 3, leader changed from e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67) to 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65). New cstate: current_term: 3 leader_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.387044 31426 raft_consensus.cc:1275] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:23.388348 32321 consensus_queue.cc:1048] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:23.402889 31498 raft_consensus.cc:1275] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Refusing update from remote peer 6d8f665ef2fc4df7a59ae96d4086dba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:23.410305 32321 consensus_queue.cc:1048] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:24:23.950016 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:23.991132 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:23.992623 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:23.993287 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:24.030109 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:24.066221 22701 tablet_server.cc:179] TabletServer@127.22.43.65:41673 shutting down...
W20260709 12:24:24.072016 31318 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 248 similar messages]
W20260709 12:24:24.083392 31318 consensus_peers.cc:597] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.095628 31393 consensus_peers.cc:597] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.097289 31468 consensus_peers.cc:597] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.116046 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:24.116937 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.117663 22701 raft_consensus.cc:2243] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.118484 22701 raft_consensus.cc:2272] T c34c9c84b088402082232ada2f901768 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.120714 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.121352 22701 raft_consensus.cc:2243] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.122203 22701 raft_consensus.cc:2272] T d96465747d074cce91dcec123d153e68 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.124287 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.124866 22701 raft_consensus.cc:2243] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.125386 22701 raft_consensus.cc:2272] T 455e5a199ea34658a55df3d05a441939 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.127938 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.128772 22701 raft_consensus.cc:2243] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.129513 22701 raft_consensus.cc:2272] T 315f791c509f45baa49304f2085a8c2d P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.133136 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.133776 22701 raft_consensus.cc:2243] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.134294 22701 raft_consensus.cc:2272] T c135641325754ecdb94233454a817a7f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.136724 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.137553 22701 raft_consensus.cc:2243] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.138377 22701 raft_consensus.cc:2272] T c0b3ab9ea32b4118bdeaef97935b378b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.140480 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.141116 22701 raft_consensus.cc:2243] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.141539 22701 raft_consensus.cc:2272] T a46ed529cd264980bac4a8656242966a P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.144115 22701 tablet_replica.cc:333] stopping tablet replica
W20260709 12:24:24.144795 31468 consensus_peers.cc:597] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.144837 22701 raft_consensus.cc:2243] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.145538 22701 raft_consensus.cc:2272] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.147893 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.148522 22701 raft_consensus.cc:2243] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.148948 22701 raft_consensus.cc:2272] T 0071e37b60b04beb864d69169365283f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.151245 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.151988 22701 raft_consensus.cc:2243] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.152791 22701 raft_consensus.cc:2272] T 7382bfbf93704e3fb4a71d8f048be405 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.154894 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.155707 22701 raft_consensus.cc:2243] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.156198 22701 raft_consensus.cc:2272] T 58676338c84446f98d6653d9a31003ef P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.159075 22701 tablet_replica.cc:333] stopping tablet replica
W20260709 12:24:24.159312 31318 consensus_peers.cc:597] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.159767 22701 raft_consensus.cc:2243] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.160401 22701 raft_consensus.cc:2272] T 34cd27f677614e42854b6618e07715a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.163539 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.164373 22701 raft_consensus.cc:2243] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.164906 22701 raft_consensus.cc:2272] T 11bc57e4f3e241e0a32f281992c4d952 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.167330 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.167851 22701 raft_consensus.cc:2243] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.168252 22701 raft_consensus.cc:2272] T 656a43be5139490a9ab0b8bc38750ac6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.170245 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.170799 22701 raft_consensus.cc:2243] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.171319 22701 raft_consensus.cc:2272] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.174132 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.174809 22701 raft_consensus.cc:2243] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.175354 22701 raft_consensus.cc:2272] T 70bda5ad3f124108b9ac3050da12be43 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.175956 31393 consensus_peers.cc:597] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.178267 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.179188 22701 raft_consensus.cc:2243] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:24:24.179989 31318 consensus_peers.cc:597] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.180269 22701 raft_consensus.cc:2272] T fbfd97beba6040c69589994e8389028e P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.183089 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.183665 22701 raft_consensus.cc:2243] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.184144 22701 raft_consensus.cc:2272] T 7b274862a58d4893959ebf0c52110287 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.186769 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.187359 22701 raft_consensus.cc:2243] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.188097 22701 raft_consensus.cc:2272] T 4f26d3890ccd46ddb1160ee1529963a0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.190152 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.190688 22701 raft_consensus.cc:2243] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.191102 22701 raft_consensus.cc:2272] T 50603727db744cf8aeb6da31ee6cbf18 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.194021 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.194914 22701 raft_consensus.cc:2243] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:24:24.195165 31468 consensus_peers.cc:597] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.195866 22701 raft_consensus.cc:2272] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.198366 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.199048 22701 raft_consensus.cc:2243] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.199462 22701 raft_consensus.cc:2272] T b69abb8bd62140f58770bec881e8ec59 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.201635 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.202327 22701 raft_consensus.cc:2243] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.202735 22701 raft_consensus.cc:2272] T ba9231e7b61847e29dac9f04c129f242 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.204762 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.205343 22701 raft_consensus.cc:2243] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.205773 22701 raft_consensus.cc:2272] T 92f215322251405ebe02666b49f6acd6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.208034 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.208806 22701 raft_consensus.cc:2243] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.209251 22701 raft_consensus.cc:2272] T a32f85ad47fd43e997766faf8e9ae119 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.211920 22701 tablet_replica.cc:333] stopping tablet replica
W20260709 12:24:24.212133 31318 consensus_peers.cc:597] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.212729 22701 raft_consensus.cc:2243] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.213568 22701 raft_consensus.cc:2272] T d8345833c0f34e96af79e53d5eb8fbc0 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.215744 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.216439 22701 raft_consensus.cc:2243] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.217192 22701 raft_consensus.cc:2272] T 0f931106f8ca4318980f68dfce295cc9 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.219548 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.220155 22701 raft_consensus.cc:2243] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.220533 22701 raft_consensus.cc:2272] T ae28f8ed99514107ba0fc461d1829ce6 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.222661 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.223245 22701 raft_consensus.cc:2243] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.224023 22701 raft_consensus.cc:2272] T 344ee99261a143ee9924131fc68c1ec3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.226104 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.226745 22701 raft_consensus.cc:2243] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.227273 22701 raft_consensus.cc:2272] T 7323a3bd4ffe4eae8831fceee0397685 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.229655 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.230338 22701 raft_consensus.cc:2243] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.230777 22701 raft_consensus.cc:2272] T 7d1cb5c621c6466c9692be5c82cd786f P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.233520 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.234325 22701 raft_consensus.cc:2243] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.234838 22701 raft_consensus.cc:2272] T 49b3b16774644d7e85c404e0fd485a60 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.237600 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.238364 22701 raft_consensus.cc:2243] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.239290 22701 raft_consensus.cc:2272] T 23abbe4a643c4fe59edd20b80397459b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.242113 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.242856 22701 raft_consensus.cc:2243] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.243391 22701 raft_consensus.cc:2272] T 881b09b571934068b262cdee9a6064ca P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.246430 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.247114 22701 raft_consensus.cc:2243] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.247529 22701 raft_consensus.cc:2272] T 585fd08c8ecd43f38d46851ea9eca526 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.250420 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.250983 22701 raft_consensus.cc:2243] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.251464 22701 raft_consensus.cc:2272] T b007219e2ff443068a7ec936b0d2a6d1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.253856 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.254608 22701 raft_consensus.cc:2243] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.255553 22701 raft_consensus.cc:2272] T 4dfa903d81ea4bcca153d01ec079d6d3 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.255431 31468 consensus_peers.cc:597] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.257164 31318 consensus_peers.cc:597] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.258473 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.259284 22701 raft_consensus.cc:2243] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.259590 22701 raft_consensus.cc:2272] T 2622a99407874e409f4fb5248f2f404b P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.262300 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.262858 22701 raft_consensus.cc:2243] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:24:24.263497 31468 consensus_peers.cc:597] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.263700 22701 raft_consensus.cc:2272] T dc8b707960e641338e58cc2552304bb1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.264197 31468 consensus_peers.cc:597] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.266296 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.267025 22701 raft_consensus.cc:2243] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.267534 22701 raft_consensus.cc:2272] T aed7a6253b364f139cce7e085a12c9ad P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.268100 31318 consensus_peers.cc:597] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.270025 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.270723 22701 raft_consensus.cc:2243] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.271137 22701 raft_consensus.cc:2272] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.273157 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.273687 22701 raft_consensus.cc:2243] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.274127 22701 raft_consensus.cc:2272] T 3f373819fb7049ee9b511c4cad4374fd P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.276067 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.276583 22701 raft_consensus.cc:2243] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.276969 22701 raft_consensus.cc:2272] T fc7a9bea17c8409da9f38b8bc322e895 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.278992 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.279476 22701 raft_consensus.cc:2243] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.280011 22701 raft_consensus.cc:2272] T 8f29029e642247cb91cf3c64c81118a1 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.282728 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:24.283344 22701 raft_consensus.cc:2243] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.283942 22701 raft_consensus.cc:2272] T 42fcca57e9e24daea0e2dac26aedce05 P 6d8f665ef2fc4df7a59ae96d4086dba9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.284562 31393 consensus_peers.cc:597] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.305083 31318 consensus_peers.cc:597] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.325730 31468 consensus_peers.cc:597] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.334885 31468 consensus_peers.cc:597] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.360647 22701 tablet_server.cc:196] TabletServer@127.22.43.65:41673 shutdown complete.
W20260709 12:24:24.376752 31393 consensus_peers.cc:597] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.405135 31468 consensus_peers.cc:597] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.424680 31318 consensus_peers.cc:597] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.427201 31393 consensus_peers.cc:597] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.461438 22701 tablet_server.cc:179] TabletServer@127.22.43.66:0 shutting down...
W20260709 12:24:24.473565 31318 consensus_peers.cc:597] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.492242 31393 consensus_peers.cc:597] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.492889 31469 consensus_peers.cc:597] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.509660 31468 consensus_peers.cc:597] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.518604 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:24.519484 22701 tablet_replica.cc:333] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.520233 22701 raft_consensus.cc:2243] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.520747 22701 raft_consensus.cc:2272] T 8d9eda698af44e0194bcc4cf3ccc7689 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.523694 22701 tablet_replica.cc:333] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.524511 22701 raft_consensus.cc:2243] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.525558 22701 raft_consensus.cc:2272] T 3f373819fb7049ee9b511c4cad4374fd P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.529259 22701 tablet_replica.cc:333] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.530164 22701 raft_consensus.cc:2243] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.530671 22701 raft_consensus.cc:2272] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.531277 31393 consensus_peers.cc:597] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.533247 22701 tablet_replica.cc:333] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.534088 22701 raft_consensus.cc:2243] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.534643 22701 raft_consensus.cc:2272] T 455e5a199ea34658a55df3d05a441939 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.536897 22701 tablet_replica.cc:333] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.537546 22701 raft_consensus.cc:2243] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.538407 22701 raft_consensus.cc:2272] T 7323a3bd4ffe4eae8831fceee0397685 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.540345 22701 tablet_replica.cc:333] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.540896 22701 raft_consensus.cc:2243] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.541340 22701 raft_consensus.cc:2272] T fbfd97beba6040c69589994e8389028e P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.543218 22701 tablet_replica.cc:333] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.543803 22701 raft_consensus.cc:2243] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.544317 22701 raft_consensus.cc:2272] T 11bc57e4f3e241e0a32f281992c4d952 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.547313 22701 tablet_replica.cc:333] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.548074 22701 raft_consensus.cc:2243] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.549129 22701 raft_consensus.cc:2272] T 656a43be5139490a9ab0b8bc38750ac6 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.550993 31469 consensus_peers.cc:597] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.551489 31393 consensus_peers.cc:597] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.552085 22701 tablet_replica.cc:333] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.552768 22701 raft_consensus.cc:2243] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.553211 22701 raft_consensus.cc:2272] T dc8b707960e641338e58cc2552304bb1 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.555178 22701 tablet_replica.cc:333] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.556000 22701 raft_consensus.cc:2243] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.556861 22701 raft_consensus.cc:2272] T aed7a6253b364f139cce7e085a12c9ad P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.559279 22701 tablet_replica.cc:333] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.560014 22701 raft_consensus.cc:2243] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:24:24.560242 31468 consensus_peers.cc:597] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.561089 22701 raft_consensus.cc:2272] T 2622a99407874e409f4fb5248f2f404b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.564388 22701 tablet_replica.cc:333] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.565114 22701 raft_consensus.cc:2243] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.566170 22701 raft_consensus.cc:2272] T 1db9b56686874345a49f931200fdc7f8 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.568389 22701 tablet_replica.cc:333] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.569142 22701 raft_consensus.cc:2243] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.569592 22701 raft_consensus.cc:2272] T c34c9c84b088402082232ada2f901768 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.570557 31394 consensus_peers.cc:597] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.573181 22701 tablet_replica.cc:333] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.573927 22701 raft_consensus.cc:2243] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:24:24.574117 31469 consensus_peers.cc:597] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.574739 31469 consensus_peers.cc:597] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.574801 22701 raft_consensus.cc:2272] T dc6e89a8a1d04b1e93e58d614c686d42 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.577287 22701 tablet_replica.cc:333] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.578065 22701 raft_consensus.cc:2243] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.578635 22701 raft_consensus.cc:2272] T 7d1cb5c621c6466c9692be5c82cd786f P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.580730 22701 tablet_replica.cc:333] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.581307 22701 raft_consensus.cc:2243] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.582083 22701 raft_consensus.cc:2272] T 033329b2f3e348ccac62b6620f611a8b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.583814 22701 tablet_replica.cc:333] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.584537 22701 raft_consensus.cc:2243] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.584957 22701 raft_consensus.cc:2272] T 0071e37b60b04beb864d69169365283f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.587168 22701 tablet_replica.cc:333] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.587710 22701 raft_consensus.cc:2243] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.588130 22701 raft_consensus.cc:2272] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.590260 22701 tablet_replica.cc:333] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.590823 22701 raft_consensus.cc:2243] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.591372 22701 raft_consensus.cc:2272] T 50603727db744cf8aeb6da31ee6cbf18 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.593576 22701 tablet_replica.cc:333] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.594135 22701 raft_consensus.cc:2243] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.594555 22701 raft_consensus.cc:2272] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.596369 22701 tablet_replica.cc:333] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.596908 22701 raft_consensus.cc:2243] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.597338 22701 raft_consensus.cc:2272] T 5e1c340f374545689f892f6136c5f92b P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.599318 22701 tablet_replica.cc:333] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.599840 22701 raft_consensus.cc:2243] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.600251 22701 raft_consensus.cc:2272] T 70bda5ad3f124108b9ac3050da12be43 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.602229 22701 tablet_replica.cc:333] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.602830 22701 raft_consensus.cc:2243] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.603339 22701 raft_consensus.cc:2272] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.605960 22701 tablet_replica.cc:333] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.606635 22701 raft_consensus.cc:2243] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.607188 22701 raft_consensus.cc:2272] T 92f215322251405ebe02666b49f6acd6 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.609581 22701 tablet_replica.cc:333] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.610383 22701 raft_consensus.cc:2243] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.610858 22701 raft_consensus.cc:2272] T bffd68df1877438aaa6dfe1ac64c81e4 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.613204 22701 tablet_replica.cc:333] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.613886 22701 raft_consensus.cc:2243] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.614900 22701 raft_consensus.cc:2272] T 58676338c84446f98d6653d9a31003ef P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.615691 31394 consensus_peers.cc:597] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.617308 22701 tablet_replica.cc:333] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.618162 22701 raft_consensus.cc:2243] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.618635 22701 raft_consensus.cc:2272] T ff653c4c2e914776b9658d2b0d395afe P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.620095 31469 consensus_peers.cc:597] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.621029 31393 consensus_peers.cc:597] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.621227 22701 tablet_replica.cc:333] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.622129 22701 raft_consensus.cc:2243] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.622967 22701 raft_consensus.cc:2272] T fc7a9bea17c8409da9f38b8bc322e895 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.625138 22701 tablet_replica.cc:333] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.625731 22701 raft_consensus.cc:2243] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.626221 22701 raft_consensus.cc:2272] T 772880df0e044150b248d02eb59b08ce P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.628567 22701 tablet_replica.cc:333] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.629202 22701 raft_consensus.cc:2243] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:24:24.629590 31394 consensus_peers.cc:597] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.630215 22701 raft_consensus.cc:2272] T 8f29029e642247cb91cf3c64c81118a1 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.631572 31469 consensus_peers.cc:597] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.632654 22701 tablet_replica.cc:333] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.633266 22701 raft_consensus.cc:2243] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.634130 22701 raft_consensus.cc:2272] T 7b274862a58d4893959ebf0c52110287 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.636162 22701 tablet_replica.cc:333] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.636694 22701 raft_consensus.cc:2243] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.637085 22701 raft_consensus.cc:2272] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.639168 22701 tablet_replica.cc:333] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.639740 22701 raft_consensus.cc:2243] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.640143 22701 raft_consensus.cc:2272] T 7382bfbf93704e3fb4a71d8f048be405 P 998cd06c0be349879a0602496bc33640 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.642028 22701 tablet_replica.cc:333] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.642545 22701 raft_consensus.cc:2243] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.643394 22701 raft_consensus.cc:2272] T a32f85ad47fd43e997766faf8e9ae119 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.646502 22701 tablet_replica.cc:333] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.647305 22701 raft_consensus.cc:2243] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.647815 22701 raft_consensus.cc:2272] T d8345833c0f34e96af79e53d5eb8fbc0 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.649930 22701 tablet_replica.cc:333] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.650468 22701 raft_consensus.cc:2243] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.651410 22701 raft_consensus.cc:2272] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.654011 22701 tablet_replica.cc:333] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.654584 22701 raft_consensus.cc:2243] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.655118 22701 raft_consensus.cc:2272] T 2f636bc19da04dd8b83cab524f85dd00 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.657346 22701 tablet_replica.cc:333] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.657845 22701 raft_consensus.cc:2243] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.658335 22701 raft_consensus.cc:2272] T d96465747d074cce91dcec123d153e68 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.660250 22701 tablet_replica.cc:333] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.660761 22701 raft_consensus.cc:2243] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.661255 22701 raft_consensus.cc:2272] T c0b3ab9ea32b4118bdeaef97935b378b P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.663664 22701 tablet_replica.cc:333] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640: stopping tablet replica
W20260709 12:24:24.663655 31394 consensus_peers.cc:597] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.664579 22701 raft_consensus.cc:2243] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.664965 22701 raft_consensus.cc:2272] T e36bf368739149e1a96b5f15cbc86e6c P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.667155 22701 tablet_replica.cc:333] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.667642 22701 raft_consensus.cc:2243] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.668042 22701 raft_consensus.cc:2272] T ae28f8ed99514107ba0fc461d1829ce6 P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.669960 22701 tablet_replica.cc:333] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.670449 22701 raft_consensus.cc:2243] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.670928 22701 raft_consensus.cc:2272] T 344ee99261a143ee9924131fc68c1ec3 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.672803 22701 tablet_replica.cc:333] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.673468 22701 raft_consensus.cc:2243] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:24.674531 22701 raft_consensus.cc:2272] T c135641325754ecdb94233454a817a7f P 998cd06c0be349879a0602496bc33640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:24.677158 22701 tablet_replica.cc:333] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640: stopping tablet replica
I20260709 12:24:24.677685 22701 raft_consensus.cc:2243] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:24.678164 22701 raft_consensus.cc:2272] T 34cd27f677614e42854b6618e07715a0 P 998cd06c0be349879a0602496bc33640 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:24.687690 31469 consensus_peers.cc:597] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.982147 31394 consensus_peers.cc:597] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.986826 31394 consensus_peers.cc:597] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:24.987483 31394 consensus_peers.cc:597] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:25.000820 31394 consensus_peers.cc:597] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:25.020068 31394 consensus_peers.cc:597] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:25.103603 31470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:45167, user_credentials={real_user=slave}} blocked reactor thread for 117134us
W20260709 12:24:25.140612 31469 consensus_peers.cc:597] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:25.141250 31469 consensus_peers.cc:597] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:25.141791 31469 consensus_peers.cc:597] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:25.162175 31469 connection.cc:573] client connection to 127.22.43.66:40387 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:24:25.169003 22701 tablet_server.cc:196] TabletServer@127.22.43.66:0 shutdown complete.
W20260709 12:24:25.170956 31469 consensus_peers.cc:597] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:25.198128 32429 raft_consensus.cc:493] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.199075 32429 raft_consensus.cc:515] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:25.201835 32429 leader_election.cc:290] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:25.212188 31468 leader_election.cc:336] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:25.215612 31469 leader_election.cc:336] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:25.216056 31469 leader_election.cc:304] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:25.216811 32429 raft_consensus.cc:2749] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.252398 32418 raft_consensus.cc:493] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.252993 32418 raft_consensus.cc:515] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:25.255111 32418 leader_election.cc:290] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:25.255786 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbe4a643c4fe59edd20b80397459b" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
W20260709 12:24:25.259156 31393 leader_election.cc:336] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.259570 31393 leader_election.cc:304] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:25.260183 32418 raft_consensus.cc:2749] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.271675 32427 raft_consensus.cc:493] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.272413 32427 raft_consensus.cc:515] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:25.274680 32427 leader_election.cc:290] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:25.276525 22701 tablet_server.cc:179] TabletServer@127.22.43.67:0 shutting down...
W20260709 12:24:25.281054 31468 leader_election.cc:336] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:25.281788 31469 leader_election.cc:336] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:25.282321 31469 leader_election.cc:304] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:25.283202 32427 raft_consensus.cc:2749] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:25.324523 32427 raft_consensus.cc:493] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.324924 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:25.326027 22701 tablet_replica.cc:333] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.327260 22701 raft_consensus.cc:2243] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.325006 32427 raft_consensus.cc:515] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:25.328418 22701 raft_consensus.cc:2272] T 8d9eda698af44e0194bcc4cf3ccc7689 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:25.330333 31470 consensus_peers.cc:597] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:25.330466 32427 leader_election.cc:290] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:25.331981 22701 tablet_replica.cc:333] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.333009 22701 raft_consensus.cc:2243] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.333576 22701 raft_consensus.cc:2272] T 23abbe4a643c4fe59edd20b80397459b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:25.334573 31469 leader_election.cc:336] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:25.335150 31468 leader_election.cc:336] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.335500 31468 leader_election.cc:304] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:25.336099 32427 raft_consensus.cc:2749] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.336367 22701 tablet_replica.cc:333] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.337172 22701 raft_consensus.cc:2243] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.337636 22701 raft_consensus.cc:2272] T e1ac93be0c8e4f939c700b1ac7fa43d6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.339875 22701 tablet_replica.cc:333] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.340503 22701 raft_consensus.cc:2243] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.341013 22701 raft_consensus.cc:2272] T 7323a3bd4ffe4eae8831fceee0397685 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.343655 22701 tablet_replica.cc:333] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.344295 22701 raft_consensus.cc:2243] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.345103 22701 raft_consensus.cc:2272] T 42fcca57e9e24daea0e2dac26aedce05 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.347332 22701 tablet_replica.cc:333] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.347903 22701 raft_consensus.cc:2243] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.348348 22701 raft_consensus.cc:2272] T 4dfa903d81ea4bcca153d01ec079d6d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.350533 22701 tablet_replica.cc:333] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.351152 22701 raft_consensus.cc:2243] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.351639 22701 raft_consensus.cc:2272] T aed7a6253b364f139cce7e085a12c9ad P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.353928 22701 tablet_replica.cc:333] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.354745 22701 raft_consensus.cc:2243] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.355337 22701 raft_consensus.cc:2272] T 2622a99407874e409f4fb5248f2f404b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.357761 22701 tablet_replica.cc:333] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.358282 32427 raft_consensus.cc:493] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.358587 22701 raft_consensus.cc:2243] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.359225 22701 raft_consensus.cc:2272] T 656a43be5139490a9ab0b8bc38750ac6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.358917 32427 raft_consensus.cc:515] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:25.361510 32427 leader_election.cc:290] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:25.362433 22701 tablet_replica.cc:333] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.363047 32427 raft_consensus.cc:493] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.363369 22701 raft_consensus.cc:2243] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.364017 22701 raft_consensus.cc:2272] T 315f791c509f45baa49304f2085a8c2d P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.363636 32427 raft_consensus.cc:515] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:25.366087 32427 leader_election.cc:290] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:25.366972 22701 tablet_replica.cc:333] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.367852 22701 raft_consensus.cc:2243] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:25.365291 31468 leader_election.cc:336] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.368510 22701 raft_consensus.cc:2272] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:25.369154 31470 leader_election.cc:336] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:25.369195 32425 raft_consensus.cc:493] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.370743 32425 raft_consensus.cc:515] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:25.371783 22701 tablet_replica.cc:333] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.372825 22701 raft_consensus.cc:2243] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.373313 32425 leader_election.cc:290] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:25.373520 22701 raft_consensus.cc:2272] T c34c9c84b088402082232ada2f901768 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:25.374508 31468 leader_election.cc:336] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.375075 31468 leader_election.cc:304] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
W20260709 12:24:25.375977 31469 leader_election.cc:336] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:25.376279 32427 raft_consensus.cc:2749] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:25.376490 31469 leader_election.cc:304] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:25.376633 22701 tablet_replica.cc:333] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.377259 32429 raft_consensus.cc:2749] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.377799 22701 raft_consensus.cc:2243] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.378518 22701 raft_consensus.cc:2272] T 033329b2f3e348ccac62b6620f611a8b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:25.381006 31394 leader_election.cc:336] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:25.381642 22701 tablet_replica.cc:333] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
W20260709 12:24:25.382056 31393 leader_election.cc:336] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.382525 31393 leader_election.cc:304] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:25.382629 22701 raft_consensus.cc:2243] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.383317 32425 raft_consensus.cc:2749] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.383872 22701 raft_consensus.cc:2272] T 49b3b16774644d7e85c404e0fd485a60 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.387171 22701 tablet_replica.cc:333] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
W20260709 12:24:25.387493 31470 consensus_peers.cc:597] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:25.387902 22701 raft_consensus.cc:2243] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.388476 22701 raft_consensus.cc:2272] T dc6e89a8a1d04b1e93e58d614c686d42 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.390969 22701 tablet_replica.cc:333] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.391618 22701 raft_consensus.cc:2243] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.392578 22701 raft_consensus.cc:2272] T 7d1cb5c621c6466c9692be5c82cd786f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.395004 22701 tablet_replica.cc:333] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.395543 22701 raft_consensus.cc:2243] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.395991 22701 raft_consensus.cc:2272] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.397687 32425 raft_consensus.cc:493] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.398223 22701 tablet_replica.cc:333] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.398190 32425 raft_consensus.cc:515] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:25.399053 22701 raft_consensus.cc:2243] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.399542 22701 raft_consensus.cc:2272] T 4f26d3890ccd46ddb1160ee1529963a0 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.400177 32425 leader_election.cc:290] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 41649f3a1d8346ada1e2a0e8b6cae5ed (127.22.43.68:34287), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:25.401451 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f931106f8ca4318980f68dfce295cc9" candidate_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" is_pre_election: true
I20260709 12:24:25.402638 22701 tablet_replica.cc:333] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.403650 22701 raft_consensus.cc:2243] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:24:25.404423 31393 leader_election.cc:336] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.404732 22701 raft_consensus.cc:2272] T bffd68df1877438aaa6dfe1ac64c81e4 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.404937 31393 leader_election.cc:304] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 41649f3a1d8346ada1e2a0e8b6cae5ed, 6d8f665ef2fc4df7a59ae96d4086dba9
I20260709 12:24:25.406064 32425 raft_consensus.cc:2749] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:25.415020 22701 tablet_replica.cc:333] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.415920 22701 raft_consensus.cc:2243] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.417037 22701 raft_consensus.cc:2272] T ff653c4c2e914776b9658d2b0d395afe P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.419797 22701 tablet_replica.cc:333] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.420652 22701 raft_consensus.cc:2243] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.421296 22701 raft_consensus.cc:2272] T fc7a9bea17c8409da9f38b8bc322e895 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.424171 22701 tablet_replica.cc:333] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.424775 32302 raft_consensus.cc:493] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.424998 22701 raft_consensus.cc:2243] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.425334 32302 raft_consensus.cc:515] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:25.425742 22701 raft_consensus.cc:2272] T 772880df0e044150b248d02eb59b08ce P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.427408 32302 leader_election.cc:290] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
I20260709 12:24:25.428898 22701 tablet_replica.cc:333] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.429857 22701 raft_consensus.cc:2243] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.430469 22701 raft_consensus.cc:2272] T 8f29029e642247cb91cf3c64c81118a1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:25.431757 31393 leader_election.cc:336] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.433346 22701 tablet_replica.cc:333] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.434274 22701 raft_consensus.cc:2243] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:25.434271 31394 leader_election.cc:336] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:25.435021 22701 raft_consensus.cc:2272] T 585fd08c8ecd43f38d46851ea9eca526 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.434960 31394 leader_election.cc:304] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c9c70e306d465ebdbcd2b8e9849f3b; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:25.435856 32302 raft_consensus.cc:2749] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.437686 22701 tablet_replica.cc:333] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.438395 22701 raft_consensus.cc:2243] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.438901 22701 raft_consensus.cc:2272] T 1db9b56686874345a49f931200fdc7f8 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.440846 22701 tablet_replica.cc:333] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.441427 22701 raft_consensus.cc:2243] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.442304 22701 raft_consensus.cc:2272] T 881b09b571934068b262cdee9a6064ca P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.444300 22701 tablet_replica.cc:333] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.444960 22701 raft_consensus.cc:2243] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.445470 22701 raft_consensus.cc:2272] T a46ed529cd264980bac4a8656242966a P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.448221 22701 tablet_replica.cc:333] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.448856 22701 raft_consensus.cc:2243] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.449311 22701 raft_consensus.cc:2272] T d96465747d074cce91dcec123d153e68 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.451346 22701 tablet_replica.cc:333] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.451920 22701 raft_consensus.cc:2243] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.452399 22701 raft_consensus.cc:2272] T c0b3ab9ea32b4118bdeaef97935b378b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.454370 22701 tablet_replica.cc:333] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.454926 22701 raft_consensus.cc:2243] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.455762 22701 raft_consensus.cc:2272] T e36bf368739149e1a96b5f15cbc86e6c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.457789 22701 tablet_replica.cc:333] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.458443 22701 raft_consensus.cc:2243] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.459448 22701 raft_consensus.cc:2272] T ae28f8ed99514107ba0fc461d1829ce6 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.462126 22701 tablet_replica.cc:333] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.462690 22701 raft_consensus.cc:2243] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.463164 22701 raft_consensus.cc:2272] T 0f931106f8ca4318980f68dfce295cc9 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.465312 22701 tablet_replica.cc:333] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.466059 22701 raft_consensus.cc:2243] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.466647 22701 raft_consensus.cc:2272] T 344ee99261a143ee9924131fc68c1ec3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.469417 22701 tablet_replica.cc:333] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.470216 22701 raft_consensus.cc:2243] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.471101 22701 raft_consensus.cc:2272] T 70bda5ad3f124108b9ac3050da12be43 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.473311 22701 tablet_replica.cc:333] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.473873 22701 raft_consensus.cc:2243] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.474732 22701 raft_consensus.cc:2272] T 5e1c340f374545689f892f6136c5f92b P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.477170 22701 tablet_replica.cc:333] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.477856 22701 raft_consensus.cc:2243] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.478757 22701 raft_consensus.cc:2272] T b007219e2ff443068a7ec936b0d2a6d1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.480984 22701 tablet_replica.cc:333] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.481559 22701 raft_consensus.cc:2243] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.482056 22701 raft_consensus.cc:2272] T 1ff5a82bfbaf425ba4873d0f0e3e776c P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.484122 22701 tablet_replica.cc:333] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.484661 22701 raft_consensus.cc:2243] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.485453 22701 raft_consensus.cc:2272] T b69abb8bd62140f58770bec881e8ec59 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.487686 22701 tablet_replica.cc:333] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.488268 22701 raft_consensus.cc:2243] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.489037 22701 raft_consensus.cc:2272] T ba9231e7b61847e29dac9f04c129f242 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.491324 22701 tablet_replica.cc:333] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.491899 22701 raft_consensus.cc:2243] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.492324 22701 raft_consensus.cc:2272] T c135641325754ecdb94233454a817a7f P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.494617 22701 tablet_replica.cc:333] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.495164 22701 raft_consensus.cc:2243] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.495589 22701 raft_consensus.cc:2272] T 7b274862a58d4893959ebf0c52110287 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.497643 22701 tablet_replica.cc:333] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.498245 22701 raft_consensus.cc:2243] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.498677 22701 raft_consensus.cc:2272] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.501355 22701 tablet_replica.cc:333] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.501947 22701 raft_consensus.cc:2243] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.502513 22701 raft_consensus.cc:2272] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.504772 22701 tablet_replica.cc:333] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b: stopping tablet replica
I20260709 12:24:25.505295 22701 raft_consensus.cc:2243] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:25.506181 22701 raft_consensus.cc:2272] T 2f636bc19da04dd8b83cab524f85dd00 P e3c9c70e306d465ebdbcd2b8e9849f3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:25.562291 31470 consensus_peers.cc:597] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:25.578209 32427 raft_consensus.cc:493] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.578717 32427 raft_consensus.cc:515] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:25.580703 32427 leader_election.cc:290] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:25.584748 31470 leader_election.cc:336] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:25.585371 31468 leader_election.cc:336] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.585714 31468 leader_election.cc:304] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:25.586372 32427 raft_consensus.cc:2749] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:25.597774 32427 raft_consensus.cc:493] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.598321 32427 raft_consensus.cc:515] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:25.600106 32427 leader_election.cc:290] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:25.604117 31470 leader_election.cc:336] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:25.604669 31468 leader_election.cc:336] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.605059 31468 leader_election.cc:304] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:25.605695 32429 raft_consensus.cc:2749] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:25.610603 31470 consensus_peers.cc:597] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:25.615775 32427 raft_consensus.cc:493] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.616284 32427 raft_consensus.cc:515] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:25.618218 32427 leader_election.cc:290] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:25.621925 31470 leader_election.cc:336] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:25.622460 31468 leader_election.cc:336] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.622830 31468 leader_election.cc:304] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:25.623463 32427 raft_consensus.cc:2749] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.633522 32427 raft_consensus.cc:493] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.633967 32427 raft_consensus.cc:515] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:25.635757 32427 leader_election.cc:290] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:25.638978 31468 leader_election.cc:336] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:25.639447 31469 leader_election.cc:336] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:25.639811 31469 leader_election.cc:304] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:25.640329 32427 raft_consensus.cc:2749] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:25.664362 31470 consensus_peers.cc:597] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:25.680743 32427 raft_consensus.cc:493] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:25.681391 32427 raft_consensus.cc:515] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:25.683471 32427 leader_election.cc:290] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:25.686733 31469 leader_election.cc:336] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:25.687443 31470 leader_election.cc:336] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:25.687835 31470 leader_election.cc:304] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:25.688531 32427 raft_consensus.cc:2749] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:25.696502 31470 consensus_peers.cc:597] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:25.739889 32427 raft_consensus.cc:493] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:25.740561 32427 raft_consensus.cc:515] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:25.743317 32427 leader_election.cc:290] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:25.747560 31470 leader_election.cc:336] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:25.748097 31468 leader_election.cc:336] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.748442 31468 leader_election.cc:304] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:25.749010 32427 raft_consensus.cc:2749] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.798301 32427 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:25.798799 32427 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:25.800796 32427 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:25.804684 31469 leader_election.cc:336] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:25.805092 31470 leader_election.cc:336] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:25.805495 31470 leader_election.cc:304] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:25.806126 32440 raft_consensus.cc:2749] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:25.809556 31470 consensus_peers.cc:597] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:25.816340 32440 raft_consensus.cc:493] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:25.816819 32440 raft_consensus.cc:515] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:25.818691 32440 leader_election.cc:290] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:25.822010 31469 leader_election.cc:336] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:25.822607 31470 leader_election.cc:336] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:25.822983 31470 leader_election.cc:304] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:25.823628 32440 raft_consensus.cc:2749] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:25.851227 31470 consensus_peers.cc:597] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:25.895579 32440 raft_consensus.cc:493] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:25.896009 32440 raft_consensus.cc:515] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:25.897612 32440 leader_election.cc:290] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:25.901168 32440 raft_consensus.cc:493] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
W20260709 12:24:25.901263 31469 leader_election.cc:336] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:25.901799 31470 leader_election.cc:336] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:25.901741 32440 raft_consensus.cc:515] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:25.902277 31470 leader_election.cc:304] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:25.902895 32310 raft_consensus.cc:2749] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.903852 32440 leader_election.cc:290] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:25.907770 31468 leader_election.cc:336] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:25.908264 31469 leader_election.cc:336] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:25.908663 31469 leader_election.cc:304] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:25.909271 32440 raft_consensus.cc:2749] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.954277 32440 raft_consensus.cc:493] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:25.954702 32440 raft_consensus.cc:515] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:25.956403 32440 leader_election.cc:290] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:25.961575 31469 leader_election.cc:336] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:25.962081 31468 leader_election.cc:336] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:25.962568 31468 leader_election.cc:304] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:25.963373 32310 raft_consensus.cc:2749] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:26.022837 31452 debug-util.cc:398] Leaking SignalData structure 0x7b08000994c0 after lost signal to thread 22704
W20260709 12:24:26.024039 31452 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3c20 after lost signal to thread 31212
W20260709 12:24:26.026407 31452 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9860 after lost signal to thread 31530
I20260709 12:24:26.101742 32310 raft_consensus.cc:493] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:26.102423 32310 raft_consensus.cc:515] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:26.104419 32310 leader_election.cc:290] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:26.108650 31469 leader_election.cc:336] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:26.110103 31468 leader_election.cc:336] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:26.110584 31468 leader_election.cc:304] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:26.111239 32310 raft_consensus.cc:2749] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:26.451360 31468 consensus_peers.cc:597] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:26.572791 22701 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 31452)
I20260709 12:24:26.645402 32310 raft_consensus.cc:493] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:26.646036 32440 raft_consensus.cc:493] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:26.646186 32310 raft_consensus.cc:515] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:26.646844 32427 raft_consensus.cc:493] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:26.646632 32440 raft_consensus.cc:515] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:26.647408 32427 raft_consensus.cc:515] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:26.648705 32310 leader_election.cc:290] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:26.648937 32440 leader_election.cc:290] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:26.649634 32427 leader_election.cc:290] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:26.650766 32427 raft_consensus.cc:493] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:26.651309 32427 raft_consensus.cc:515] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:26.652806 32310 raft_consensus.cc:493] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:26.652060 32440 raft_consensus.cc:493] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:26.653467 32440 raft_consensus.cc:515] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:26.653977 32427 leader_election.cc:290] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:26.654704 32310 raft_consensus.cc:515] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:26.656067 32440 leader_election.cc:290] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:26.656708 32310 leader_election.cc:290] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
I20260709 12:24:26.658453 32310 raft_consensus.cc:493] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:26.658910 32310 raft_consensus.cc:515] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:26.661037 32310 leader_election.cc:290] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:26.662724 31469 leader_election.cc:336] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:26.663264 31470 leader_election.cc:336] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:26.664101 31470 leader_election.cc:336] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:26.664513 31470 leader_election.cc:304] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
W20260709 12:24:26.665004 31468 leader_election.cc:336] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:26.665421 31470 leader_election.cc:336] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:26.665557 32310 raft_consensus.cc:2749] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:26.665637 31468 leader_election.cc:304] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
W20260709 12:24:26.667732 31468 leader_election.cc:336] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:26.667872 32310 raft_consensus.cc:2749] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:26.668313 31470 leader_election.cc:336] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:26.668354 31468 leader_election.cc:304] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
W20260709 12:24:26.669063 31470 leader_election.cc:336] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:26.669497 32310 raft_consensus.cc:2749] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:26.669548 31470 leader_election.cc:336] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:26.669658 31468 leader_election.cc:336] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:26.670492 31468 leader_election.cc:304] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
W20260709 12:24:26.672593 31468 leader_election.cc:336] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:26.673207 31470 leader_election.cc:336] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:26.673629 32310 raft_consensus.cc:2749] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:26.673082 31468 leader_election.cc:304] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:26.674551 32310 raft_consensus.cc:2749] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:26.674682 31468 leader_election.cc:336] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:26.675208 31468 leader_election.cc:304] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:26.675858 32310 raft_consensus.cc:2749] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:26.678517 31468 consensus_peers.cc:597] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:26.678956 31468 leader_election.cc:336] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:26.679356 31468 leader_election.cc:304] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:26.679955 32440 raft_consensus.cc:2749] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:26.704452 31468 consensus_peers.cc:597] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:26.714293 32310 raft_consensus.cc:493] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:26.714977 32310 raft_consensus.cc:515] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:26.717324 32310 leader_election.cc:290] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:26.721164 31469 leader_election.cc:336] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:26.721724 31470 leader_election.cc:336] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:26.722242 31470 leader_election.cc:304] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:26.723088 32310 raft_consensus.cc:2749] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:26.810140 31468 consensus_peers.cc:597] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:26.813099 32310 raft_consensus.cc:493] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:26.813649 32310 raft_consensus.cc:515] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:26.815809 32310 leader_election.cc:290] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:26.819628 31470 leader_election.cc:336] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:26.820114 31469 leader_election.cc:336] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:26.820533 31469 leader_election.cc:304] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:26.821223 32310 raft_consensus.cc:2749] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:26.876772 31468 consensus_peers.cc:597] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:26.883347 32310 raft_consensus.cc:493] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:26.884022 32310 raft_consensus.cc:515] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:26.886759 32310 leader_election.cc:290] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:26.889354 31468 consensus_peers.cc:597] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:26.889775 31468 leader_election.cc:336] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:26.891337 31470 leader_election.cc:336] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:26.891767 31470 leader_election.cc:304] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:26.892477 32310 raft_consensus.cc:2749] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:26.898422 31468 consensus_peers.cc:597] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:26.905908 31468 consensus_peers.cc:597] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:26.918401 32310 raft_consensus.cc:493] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:26.919086 32310 raft_consensus.cc:515] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:26.920897 32310 leader_election.cc:290] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:26.924261 32310 raft_consensus.cc:493] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:26.924881 32310 raft_consensus.cc:515] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
W20260709 12:24:26.925101 31469 leader_election.cc:336] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:26.925771 31470 leader_election.cc:336] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:26.926190 31470 leader_election.cc:304] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:26.926787 32440 raft_consensus.cc:2749] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:26.926970 32310 leader_election.cc:290] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:26.931349 31469 leader_election.cc:336] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:26.931840 31470 leader_election.cc:336] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:26.932260 31470 leader_election.cc:304] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:26.932936 32310 raft_consensus.cc:2749] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:26.934341 31468 consensus_peers.cc:597] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:26.938973 31469 consensus_peers.cc:597] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:26.958684 32310 raft_consensus.cc:493] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:26.959571 32310 raft_consensus.cc:515] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:26.961855 32310 leader_election.cc:290] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:26.967121 31469 leader_election.cc:336] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:26.967842 31468 leader_election.cc:336] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:26.968276 31468 leader_election.cc:304] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:26.968933 32310 raft_consensus.cc:2749] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:26.985553 31469 consensus_peers.cc:597] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:27.002848 32440 raft_consensus.cc:493] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:27.003443 32440 raft_consensus.cc:515] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:27.005733 32440 leader_election.cc:290] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:27.010234 31470 leader_election.cc:336] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:27.011404 31469 leader_election.cc:336] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:27.011793 31469 leader_election.cc:304] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:27.012393 32440 raft_consensus.cc:2749] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:27.021142 31469 consensus_peers.cc:597] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:27.028187 31468 consensus_peers.cc:597] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:27.065802 31469 consensus_peers.cc:597] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:27.077373 32440 raft_consensus.cc:493] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:27.078109 32440 raft_consensus.cc:515] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:27.080420 32440 leader_election.cc:290] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:27.083940 31468 leader_election.cc:336] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:27.084411 31469 leader_election.cc:336] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:27.084775 31469 leader_election.cc:304] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:27.085358 32440 raft_consensus.cc:2749] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:27.181515 31468 consensus_peers.cc:597] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:27.192571 32440 raft_consensus.cc:493] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:27.193126 32440 raft_consensus.cc:515] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:27.194855 32440 leader_election.cc:290] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:27.198688 31470 leader_election.cc:336] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:27.199106 31468 leader_election.cc:336] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:27.199502 31468 leader_election.cc:304] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:27.200078 32440 raft_consensus.cc:2749] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:27.259482 31469 consensus_peers.cc:597] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:27.297871 31469 consensus_peers.cc:597] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:27.311416 32440 raft_consensus.cc:493] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:27.311875 32440 raft_consensus.cc:515] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:27.314668 32440 leader_election.cc:290] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:27.317830 31468 leader_election.cc:336] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:27.318341 31470 leader_election.cc:336] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:27.318753 31470 leader_election.cc:304] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:27.319319 32310 raft_consensus.cc:2749] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:27.327615 31469 consensus_peers.cc:597] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:27.332340 32310 raft_consensus.cc:493] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:27.332801 32310 raft_consensus.cc:515] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:27.334468 32310 leader_election.cc:290] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:27.338459 31469 leader_election.cc:336] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:27.339011 31470 leader_election.cc:336] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:27.339368 31470 leader_election.cc:304] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:27.339927 32310 raft_consensus.cc:2749] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:27.367035 32310 raft_consensus.cc:493] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:27.367638 32310 raft_consensus.cc:515] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:27.369395 32310 leader_election.cc:290] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:27.371847 31469 consensus_peers.cc:597] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:27.374027 31468 leader_election.cc:336] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:27.374529 31470 leader_election.cc:336] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:27.374969 31470 leader_election.cc:304] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:27.375700 32310 raft_consensus.cc:2749] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:27.413522 32440 raft_consensus.cc:493] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:27.414124 32440 raft_consensus.cc:515] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:27.418049 32440 leader_election.cc:290] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:27.421689 31469 leader_election.cc:336] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:27.449322 31470 leader_election.cc:336] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:27.453318 31470 leader_election.cc:304] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:27.456410 32440 raft_consensus.cc:2749] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:27.461691 32440 raft_consensus.cc:493] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:27.461944 32310 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:27.462988 32310 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:27.464066 32440 raft_consensus.cc:515] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:27.466115 32310 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:27.471412 32440 leader_election.cc:290] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:27.471693 31470 leader_election.cc:336] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:27.473243 31468 leader_election.cc:336] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:27.474447 31469 leader_election.cc:336] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:27.474839 31469 leader_election.cc:304] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:27.475456 32440 raft_consensus.cc:2749] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:27.477180 31469 leader_election.cc:336] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:27.477562 31469 leader_election.cc:304] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:27.478173 32440 raft_consensus.cc:2749] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.494786 32440 raft_consensus.cc:493] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:27.495726 32440 raft_consensus.cc:515] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:27.498665 32440 leader_election.cc:290] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:27.502429 31468 leader_election.cc:336] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:27.502912 31469 leader_election.cc:336] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:27.503415 31469 leader_election.cc:304] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:27.504278 32440 raft_consensus.cc:2749] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.532580 32440 raft_consensus.cc:493] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:27.533727 32440 raft_consensus.cc:515] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:27.537094 32440 leader_election.cc:290] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:27.542991 31468 leader_election.cc:336] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:27.545401 31469 leader_election.cc:336] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:27.546411 31469 leader_election.cc:304] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:27.547369 32440 raft_consensus.cc:2749] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:27.552222 31469 consensus_peers.cc:597] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:27.573592 22701 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 31452)
W20260709 12:24:27.639577 31469 consensus_peers.cc:597] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:27.643247 32310 raft_consensus.cc:493] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:27.644153 32310 raft_consensus.cc:515] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:27.646672 32310 leader_election.cc:290] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:27.650489 31470 leader_election.cc:336] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:27.650970 31469 leader_election.cc:336] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:27.651361 31469 leader_election.cc:304] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:27.651962 32310 raft_consensus.cc:2749] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:27.677157 31469 consensus_peers.cc:597] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:27.756925 31470 consensus_peers.cc:597] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:27.835702 32310 raft_consensus.cc:493] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:27.836427 32310 raft_consensus.cc:515] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:27.838299 32310 leader_election.cc:290] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:27.842095 31468 leader_election.cc:336] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:27.842844 31469 leader_election.cc:336] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:27.843271 31469 leader_election.cc:304] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:27.844134 32440 raft_consensus.cc:2749] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:27.895040 32310 raft_consensus.cc:493] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:27.895831 32310 raft_consensus.cc:515] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:27.897926 32310 leader_election.cc:290] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:27.901903 31470 leader_election.cc:336] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:27.902529 31468 leader_election.cc:336] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:27.902937 31468 leader_election.cc:304] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:27.903631 32310 raft_consensus.cc:2749] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:27.978627 31470 consensus_peers.cc:597] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:28.018321 32310 raft_consensus.cc:493] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:28.019001 32310 raft_consensus.cc:515] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:28.021068 32310 leader_election.cc:290] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:28.025202 31468 leader_election.cc:336] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:28.025769 31469 leader_election.cc:336] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:28.026247 31469 leader_election.cc:304] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:28.026892 32440 raft_consensus.cc:2749] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:28.030437 31470 consensus_peers.cc:597] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:28.112241 31470 consensus_peers.cc:597] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:28.198319 32310 raft_consensus.cc:493] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:28.199081 32310 raft_consensus.cc:515] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:28.200798 32310 leader_election.cc:290] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:28.204861 31468 leader_election.cc:336] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:28.205399 31469 leader_election.cc:336] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:28.205821 31469 leader_election.cc:304] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:28.206528 32310 raft_consensus.cc:2749] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:28.228098 32440 raft_consensus.cc:493] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:28.228924 32440 raft_consensus.cc:515] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:28.231318 32440 leader_election.cc:290] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:28.234496 31470 leader_election.cc:336] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:28.235340 31468 leader_election.cc:336] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:28.235741 31468 leader_election.cc:304] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.236424 32440 raft_consensus.cc:2749] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:28.264263 31470 consensus_peers.cc:597] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:28.283833 32440 raft_consensus.cc:493] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:28.284534 32440 raft_consensus.cc:515] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:28.286610 32440 leader_election.cc:290] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:28.292578 31470 leader_election.cc:336] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:28.293215 31470 consensus_peers.cc:597] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:28.293219 31469 leader_election.cc:336] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:28.293785 31469 leader_election.cc:304] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.294456 32310 raft_consensus.cc:2749] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:28.349413 32310 raft_consensus.cc:493] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:28.350164 32310 raft_consensus.cc:515] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:28.352618 32310 leader_election.cc:290] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:28.359956 31469 leader_election.cc:336] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:28.360955 31470 leader_election.cc:336] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:28.361528 31470 leader_election.cc:304] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.362836 32310 raft_consensus.cc:2749] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:28.368494 32310 raft_consensus.cc:493] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:28.369331 32310 raft_consensus.cc:515] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:28.372306 32310 leader_election.cc:290] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:28.374878 31470 consensus_peers.cc:597] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:28.377233 31468 leader_election.cc:336] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:28.377787 31470 leader_election.cc:336] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:28.378226 31470 leader_election.cc:304] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.378834 32310 raft_consensus.cc:2749] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:28.436625 31470 consensus_peers.cc:597] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:28.499410 32310 raft_consensus.cc:493] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:28.500243 32310 raft_consensus.cc:515] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:28.502490 32310 leader_election.cc:290] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:28.506413 31468 leader_election.cc:336] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:28.506886 31470 leader_election.cc:336] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:28.507334 31470 leader_election.cc:304] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.508059 32310 raft_consensus.cc:2749] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:28.517253 32310 raft_consensus.cc:493] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:28.517939 32310 raft_consensus.cc:515] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:28.520103 32310 leader_election.cc:290] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:28.523483 31470 leader_election.cc:336] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:28.523985 31468 leader_election.cc:336] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:28.524394 31468 leader_election.cc:304] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.525060 32310 raft_consensus.cc:2749] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:28.574232 22701 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 31452)
I20260709 12:24:28.608852 32310 raft_consensus.cc:493] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:28.609728 32310 raft_consensus.cc:515] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:28.612082 32310 leader_election.cc:290] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:28.615470 31469 leader_election.cc:336] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:28.615984 31470 leader_election.cc:336] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:28.616340 31470 leader_election.cc:304] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.616935 32310 raft_consensus.cc:2749] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:28.646384 32310 raft_consensus.cc:493] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:28.647028 32310 raft_consensus.cc:515] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:28.651410 32310 leader_election.cc:290] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:28.653872 31468 leader_election.cc:336] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:28.654573 31470 leader_election.cc:336] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:28.655028 31470 leader_election.cc:304] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.655810 32310 raft_consensus.cc:2749] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:28.784484 32310 raft_consensus.cc:493] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:28.785082 32310 raft_consensus.cc:515] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:28.786734 32310 leader_election.cc:290] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:28.792220 31469 leader_election.cc:336] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:28.794832 31470 leader_election.cc:336] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:28.795640 31470 leader_election.cc:304] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.796432 32310 raft_consensus.cc:2749] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:28.809618 32310 raft_consensus.cc:493] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:28.810308 32310 raft_consensus.cc:515] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:28.812216 32310 leader_election.cc:290] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:28.815683 31469 leader_election.cc:336] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:28.816293 31470 leader_election.cc:336] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:28.816735 31470 leader_election.cc:304] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.817477 32310 raft_consensus.cc:2749] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.832252 32443 raft_consensus.cc:493] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:28.832957 32443 raft_consensus.cc:515] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:28.835117 32443 leader_election.cc:290] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:28.839154 31468 leader_election.cc:336] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:28.839849 31470 leader_election.cc:336] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:28.840276 31470 leader_election.cc:304] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.841446 32443 raft_consensus.cc:2749] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:28.897944 32443 raft_consensus.cc:493] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:28.898629 32443 raft_consensus.cc:515] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:28.900389 32443 leader_election.cc:290] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:28.904233 31468 leader_election.cc:336] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:28.904798 31470 leader_election.cc:336] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:28.905222 31470 leader_election.cc:304] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:28.906073 32443 raft_consensus.cc:2749] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:29.030506 32310 raft_consensus.cc:493] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:29.031153 32310 raft_consensus.cc:515] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:29.032958 32310 leader_election.cc:290] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:29.036953 31470 leader_election.cc:336] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:29.037505 31469 leader_election.cc:336] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:29.037961 31469 leader_election.cc:304] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:29.038712 32310 raft_consensus.cc:2749] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:29.051554 32310 raft_consensus.cc:493] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:29.052229 32310 raft_consensus.cc:515] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:29.054508 32310 leader_election.cc:290] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:29.058861 31470 leader_election.cc:336] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:29.059382 31468 leader_election.cc:336] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:29.059847 31468 leader_election.cc:304] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:29.060721 32310 raft_consensus.cc:2749] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:29.098656 31468 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111) [suppressed 438 similar messages]
W20260709 12:24:29.109614 31468 consensus_peers.cc:597] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.120126 31468 consensus_peers.cc:597] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:29.122013 32310 raft_consensus.cc:493] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:29.122538 32310 raft_consensus.cc:515] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:29.124752 32310 leader_election.cc:290] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:29.128614 31468 leader_election.cc:336] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:29.129194 31469 leader_election.cc:336] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:29.129680 31469 leader_election.cc:304] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:29.130479 32443 raft_consensus.cc:2749] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:29.145644 32443 raft_consensus.cc:493] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:29.146585 32443 raft_consensus.cc:515] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:29.149029 32443 leader_election.cc:290] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:29.153121 31470 leader_election.cc:336] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:29.155097 31468 leader_election.cc:336] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:29.155560 31468 leader_election.cc:304] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:29.156378 32443 raft_consensus.cc:2749] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:29.199915 31468 consensus_peers.cc:597] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:29.218994 32443 raft_consensus.cc:493] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:29.219601 32443 raft_consensus.cc:515] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:29.221709 32443 leader_election.cc:290] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:29.227334 31469 leader_election.cc:336] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:29.227946 31468 leader_election.cc:336] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:29.228322 31468 leader_election.cc:304] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:29.228938 32443 raft_consensus.cc:2749] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:29.262635 32443 raft_consensus.cc:493] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:29.263279 32443 raft_consensus.cc:515] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:29.265478 32443 leader_election.cc:290] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:29.270066 31468 consensus_peers.cc:597] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.270162 31469 leader_election.cc:336] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:29.270781 31468 consensus_peers.cc:597] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.271265 31468 leader_election.cc:336] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:29.271684 31468 leader_election.cc:304] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:29.272392 32443 raft_consensus.cc:2749] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:29.311460 31468 consensus_peers.cc:597] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.383695 31468 consensus_peers.cc:597] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.424002 31468 consensus_peers.cc:597] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.424525 31468 consensus_peers.cc:597] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.467926 31469 consensus_peers.cc:597] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.494015 31469 consensus_peers.cc:597] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.498899 31469 consensus_peers.cc:597] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.522624 31468 consensus_peers.cc:597] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:29.545207 32310 raft_consensus.cc:493] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:29.545680 32310 raft_consensus.cc:515] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:29.547691 32310 leader_election.cc:290] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:29.551148 31469 leader_election.cc:336] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:29.553128 31470 leader_election.cc:336] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:29.553486 31470 leader_election.cc:304] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:29.554098 32310 raft_consensus.cc:2749] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:29.567366 32310 raft_consensus.cc:493] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:29.567812 32310 raft_consensus.cc:515] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:29.569543 32310 leader_election.cc:290] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:29.573110 31468 leader_election.cc:336] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:29.573738 31469 leader_election.cc:336] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:29.574257 31469 leader_election.cc:304] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
W20260709 12:24:29.574749 22701 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 31452)
I20260709 12:24:29.575034 32310 raft_consensus.cc:2749] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:29.675959 31469 consensus_peers.cc:597] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:29.693125 32310 raft_consensus.cc:493] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:29.693635 32310 raft_consensus.cc:515] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:29.695317 32310 leader_election.cc:290] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:29.700847 31468 leader_election.cc:336] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:29.704018 31469 leader_election.cc:336] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:29.704502 31469 leader_election.cc:304] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:29.705215 32310 raft_consensus.cc:2749] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:29.705730 31468 consensus_peers.cc:597] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Couldn't send request to peer 6d8f665ef2fc4df7a59ae96d4086dba9. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.706106 31469 consensus_peers.cc:597] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.737859 31469 consensus_peers.cc:597] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.876932 31469 consensus_peers.cc:597] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.896660 31469 consensus_peers.cc:597] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:29.951292 31469 consensus_peers.cc:597] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:29.967521 32310 raft_consensus.cc:493] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:29.968231 32310 raft_consensus.cc:515] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:29.970410 32310 leader_election.cc:290] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:29.974342 31469 leader_election.cc:336] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:29.974754 31468 leader_election.cc:336] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:29.975155 31468 leader_election.cc:304] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:29.975742 32310 raft_consensus.cc:2749] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:29.995572 31469 consensus_peers.cc:597] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:30.014746 32310 raft_consensus.cc:493] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:30.015296 32310 raft_consensus.cc:515] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:30.017230 32310 leader_election.cc:290] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:30.021127 31469 leader_election.cc:336] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:30.022307 31468 leader_election.cc:336] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:30.022671 31468 leader_election.cc:304] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:30.023233 32310 raft_consensus.cc:2749] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:30.129808 31470 consensus_peers.cc:597] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:30.198220 32310 raft_consensus.cc:493] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:30.198792 32310 raft_consensus.cc:515] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } }
I20260709 12:24:30.201049 32310 leader_election.cc:290] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387)
W20260709 12:24:30.206425 31468 leader_election.cc:336] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:30.207002 31469 leader_election.cc:336] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:30.207418 31469 leader_election.cc:304] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, 998cd06c0be349879a0602496bc33640
I20260709 12:24:30.208024 32310 raft_consensus.cc:2749] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:30.241031 31469 consensus_peers.cc:597] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Couldn't send request to peer 998cd06c0be349879a0602496bc33640. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:30.366029 32310 raft_consensus.cc:493] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:30.366597 32310 raft_consensus.cc:515] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:30.368688 32310 leader_election.cc:290] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:30.372686 31470 leader_election.cc:336] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:30.373374 31468 leader_election.cc:336] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:30.373867 31468 leader_election.cc:304] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.374714 32310 raft_consensus.cc:2749] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:30.380831 32310 raft_consensus.cc:493] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:30.381655 32310 raft_consensus.cc:515] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:30.383878 32310 leader_election.cc:290] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:30.389050 31470 leader_election.cc:336] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:30.389636 31469 leader_election.cc:336] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:30.390108 31469 leader_election.cc:304] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.390859 32310 raft_consensus.cc:2749] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:30.480551 32310 raft_consensus.cc:493] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:30.481057 32310 raft_consensus.cc:515] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } }
I20260709 12:24:30.483192 32310 leader_election.cc:290] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:30.486730 31470 leader_election.cc:336] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:30.488694 31468 leader_election.cc:336] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:30.489137 31468 leader_election.cc:304] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.489818 32310 raft_consensus.cc:2749] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:30.492566 31470 consensus_peers.cc:597] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:30.497932 32310 raft_consensus.cc:493] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:30.498567 32310 raft_consensus.cc:515] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:30.500152 32310 leader_election.cc:290] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
I20260709 12:24:30.503345 32310 raft_consensus.cc:493] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
W20260709 12:24:30.503886 31469 leader_election.cc:336] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:30.504547 31470 leader_election.cc:336] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:30.504146 32310 raft_consensus.cc:515] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:30.504962 31470 leader_election.cc:304] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.505641 32445 raft_consensus.cc:2749] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:30.507536 32310 leader_election.cc:290] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:30.509588 31470 leader_election.cc:336] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:30.510658 31468 leader_election.cc:336] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:30.511145 31468 leader_election.cc:304] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.511937 32310 raft_consensus.cc:2749] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:30.539793 32445 raft_consensus.cc:493] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:30.540359 32445 raft_consensus.cc:515] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:30.542490 32445 leader_election.cc:290] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:30.547989 31468 leader_election.cc:336] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
W20260709 12:24:30.549142 31470 leader_election.cc:336] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:30.549506 31470 leader_election.cc:304] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.550129 32445 raft_consensus.cc:2749] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:30.575232 22701 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 31452)
W20260709 12:24:30.626680 31470 consensus_peers.cc:597] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:30.650309 32445 raft_consensus.cc:493] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:30.650782 32445 raft_consensus.cc:515] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:30.652958 32445 leader_election.cc:290] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:30.656405 31469 leader_election.cc:336] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:30.657248 31470 leader_election.cc:336] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:30.657744 31470 leader_election.cc:304] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.658445 32445 raft_consensus.cc:2749] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:30.671475 32445 raft_consensus.cc:493] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:30.671994 32445 raft_consensus.cc:515] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:30.674650 32445 leader_election.cc:290] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:30.678551 31470 leader_election.cc:336] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:30.679759 31468 leader_election.cc:336] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:30.680377 31468 leader_election.cc:304] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.681447 32445 raft_consensus.cc:2749] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:30.712342 22701 tablet_server.cc:196] TabletServer@127.22.43.67:0 shutdown complete.
W20260709 12:24:30.720273 31470 consensus_peers.cc:597] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:30.731246 32445 raft_consensus.cc:493] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 998cd06c0be349879a0602496bc33640)
I20260709 12:24:30.731926 32445 raft_consensus.cc:515] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:30.733994 32445 leader_election.cc:290] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:30.738605 31470 leader_election.cc:336] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:30.739146 31469 leader_election.cc:336] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:30.739804 31469 leader_election.cc:304] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.740907 32445 raft_consensus.cc:2749] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:30.745792 32445 raft_consensus.cc:493] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:30.746413 32445 raft_consensus.cc:515] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:30.748912 32445 leader_election.cc:290] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:30.753963 31469 leader_election.cc:336] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
W20260709 12:24:30.754654 31470 leader_election.cc:336] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
I20260709 12:24:30.755139 31470 leader_election.cc:304] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.755962 32445 raft_consensus.cc:2749] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:30.764082 31470 consensus_peers.cc:597] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:30.833734 32445 raft_consensus.cc:493] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:30.834520 32445 raft_consensus.cc:515] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:30.837559 32445 leader_election.cc:290] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:30.842227 31470 leader_election.cc:336] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:30.843317 31468 leader_election.cc:336] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:30.843736 31468 leader_election.cc:304] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.844622 32445 raft_consensus.cc:2749] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:30.850459 31470 consensus_peers.cc:597] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed -> Peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Couldn't send request to peer e3c9c70e306d465ebdbcd2b8e9849f3b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:30.859434 22701 tablet_server.cc:179] TabletServer@127.22.43.68:0 shutting down...
I20260709 12:24:30.862468 32447 raft_consensus.cc:493] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d8f665ef2fc4df7a59ae96d4086dba9)
I20260709 12:24:30.863555 32447 raft_consensus.cc:515] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } } peers { permanent_uuid: "6d8f665ef2fc4df7a59ae96d4086dba9" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41673 } }
I20260709 12:24:30.865679 32447 leader_election.cc:290] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167), 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673)
W20260709 12:24:30.869681 31470 leader_election.cc:336] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:30.870836 31468 leader_election.cc:336] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d8f665ef2fc4df7a59ae96d4086dba9 (127.22.43.65:41673): Network error: Client connection negotiation failed: client connection to 127.22.43.65:41673: connect: Connection refused (error 111)
I20260709 12:24:30.872294 31468 leader_election.cc:304] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 6d8f665ef2fc4df7a59ae96d4086dba9, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.873337 32447 raft_consensus.cc:2749] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:30.891733 32445 raft_consensus.cc:493] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3c9c70e306d465ebdbcd2b8e9849f3b)
I20260709 12:24:30.892413 32445 raft_consensus.cc:515] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "998cd06c0be349879a0602496bc33640" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 40387 } } peers { permanent_uuid: "e3c9c70e306d465ebdbcd2b8e9849f3b" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 45167 } } peers { permanent_uuid: "41649f3a1d8346ada1e2a0e8b6cae5ed" member_type: VOTER last_known_addr { host: "127.22.43.68" port: 34287 } }
I20260709 12:24:30.895290 32445 leader_election.cc:290] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387), e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167)
W20260709 12:24:30.900219 31470 leader_election.cc:336] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3c9c70e306d465ebdbcd2b8e9849f3b (127.22.43.67:45167): Network error: Client connection negotiation failed: client connection to 127.22.43.67:45167: connect: Connection refused (error 111)
W20260709 12:24:30.900791 31469 leader_election.cc:336] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 998cd06c0be349879a0602496bc33640 (127.22.43.66:40387): Network error: Client connection negotiation failed: client connection to 127.22.43.66:40387: connect: Connection refused (error 111)
I20260709 12:24:30.901149 31469 leader_election.cc:304] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41649f3a1d8346ada1e2a0e8b6cae5ed; no voters: 998cd06c0be349879a0602496bc33640, e3c9c70e306d465ebdbcd2b8e9849f3b
I20260709 12:24:30.901911 32445 raft_consensus.cc:2749] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:30.910447 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:30.911378 22701 tablet_replica.cc:333] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.912246 22701 raft_consensus.cc:2243] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.912792 22701 raft_consensus.cc:2272] T dc8b707960e641338e58cc2552304bb1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.915297 22701 tablet_replica.cc:333] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.915964 22701 raft_consensus.cc:2243] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.916493 22701 raft_consensus.cc:2272] T 8d9eda698af44e0194bcc4cf3ccc7689 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.918844 22701 tablet_replica.cc:333] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.919476 22701 raft_consensus.cc:2243] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.919936 22701 raft_consensus.cc:2272] T 3f373819fb7049ee9b511c4cad4374fd P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.922243 22701 tablet_replica.cc:333] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.922883 22701 raft_consensus.cc:2243] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.923445 22701 raft_consensus.cc:2272] T 23abbe4a643c4fe59edd20b80397459b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.926496 22701 tablet_replica.cc:333] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.927214 22701 raft_consensus.cc:2243] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.927793 22701 raft_consensus.cc:2272] T 42fcca57e9e24daea0e2dac26aedce05 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.930490 22701 tablet_replica.cc:333] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.931275 22701 raft_consensus.cc:2243] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.931962 22701 raft_consensus.cc:2272] T 4dfa903d81ea4bcca153d01ec079d6d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.935000 22701 tablet_replica.cc:333] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.935669 22701 raft_consensus.cc:2243] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:30.936591 22701 raft_consensus.cc:2272] T e1ac93be0c8e4f939c700b1ac7fa43d6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.938738 22701 tablet_replica.cc:333] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.939239 22701 raft_consensus.cc:2243] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.939635 22701 raft_consensus.cc:2272] T fbfd97beba6040c69589994e8389028e P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.941601 22701 tablet_replica.cc:333] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.942162 22701 raft_consensus.cc:2243] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.942561 22701 raft_consensus.cc:2272] T ff653c4c2e914776b9658d2b0d395afe P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.945182 22701 tablet_replica.cc:333] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.946091 22701 raft_consensus.cc:2243] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:30.947459 22701 raft_consensus.cc:2272] T 772880df0e044150b248d02eb59b08ce P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.950312 22701 tablet_replica.cc:333] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.951100 22701 raft_consensus.cc:2243] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.951686 22701 raft_consensus.cc:2272] T 49b3b16774644d7e85c404e0fd485a60 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.954512 22701 tablet_replica.cc:333] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.955328 22701 raft_consensus.cc:2243] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.955971 22701 raft_consensus.cc:2272] T dc6e89a8a1d04b1e93e58d614c686d42 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.959066 22701 tablet_replica.cc:333] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.959834 22701 raft_consensus.cc:2243] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:30.960994 22701 raft_consensus.cc:2272] T 11bc57e4f3e241e0a32f281992c4d952 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.963551 22701 tablet_replica.cc:333] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.964149 22701 raft_consensus.cc:2243] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:30.965080 22701 raft_consensus.cc:2272] T 455e5a199ea34658a55df3d05a441939 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.967334 22701 tablet_replica.cc:333] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.967931 22701 raft_consensus.cc:2243] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.968436 22701 raft_consensus.cc:2272] T 315f791c509f45baa49304f2085a8c2d P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.970623 22701 tablet_replica.cc:333] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.971184 22701 raft_consensus.cc:2243] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.971735 22701 raft_consensus.cc:2272] T 0f931106f8ca4318980f68dfce295cc9 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.974025 22701 tablet_replica.cc:333] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.974898 22701 raft_consensus.cc:2243] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:30.976055 22701 raft_consensus.cc:2272] T 9ca14ac33e4d47d5959bcf7eb1e84e70 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.978677 22701 tablet_replica.cc:333] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.979240 22701 raft_consensus.cc:2243] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.979700 22701 raft_consensus.cc:2272] T 033329b2f3e348ccac62b6620f611a8b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.981755 22701 tablet_replica.cc:333] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.982360 22701 raft_consensus.cc:2243] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.982805 22701 raft_consensus.cc:2272] T e36bf368739149e1a96b5f15cbc86e6c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.984853 22701 tablet_replica.cc:333] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.985399 22701 raft_consensus.cc:2243] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:30.986321 22701 raft_consensus.cc:2272] T 50603727db744cf8aeb6da31ee6cbf18 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.988291 22701 tablet_replica.cc:333] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.988862 22701 raft_consensus.cc:2243] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.989367 22701 raft_consensus.cc:2272] T 5c9ef281dbc6466ea1c1189cdc3fd144 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.991390 22701 tablet_replica.cc:333] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.991937 22701 raft_consensus.cc:2243] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:30.992779 22701 raft_consensus.cc:2272] T 7cf6f2d6abcf4a32b80ba9e8c4ed0905 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.995108 22701 tablet_replica.cc:333] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.995764 22701 raft_consensus.cc:2243] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.996341 22701 raft_consensus.cc:2272] T 4f26d3890ccd46ddb1160ee1529963a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.999092 22701 tablet_replica.cc:333] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:30.999648 22701 raft_consensus.cc:2243] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.000490 22701 raft_consensus.cc:2272] T 0071e37b60b04beb864d69169365283f P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.002640 22701 tablet_replica.cc:333] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.003177 22701 raft_consensus.cc:2243] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.003993 22701 raft_consensus.cc:2272] T 92f215322251405ebe02666b49f6acd6 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.006579 22701 tablet_replica.cc:333] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.007450 22701 raft_consensus.cc:2243] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.007956 22701 raft_consensus.cc:2272] T bffd68df1877438aaa6dfe1ac64c81e4 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.010156 22701 tablet_replica.cc:333] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.010738 22701 raft_consensus.cc:2243] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.011214 22701 raft_consensus.cc:2272] T 58676338c84446f98d6653d9a31003ef P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.013963 22701 tablet_replica.cc:333] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.014899 22701 raft_consensus.cc:2243] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.016225 22701 raft_consensus.cc:2272] T 585fd08c8ecd43f38d46851ea9eca526 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.019371 22701 tablet_replica.cc:333] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.020092 22701 raft_consensus.cc:2243] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.020700 22701 raft_consensus.cc:2272] T 1db9b56686874345a49f931200fdc7f8 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.023169 22701 tablet_replica.cc:333] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.023881 22701 raft_consensus.cc:2243] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.024389 22701 raft_consensus.cc:2272] T 881b09b571934068b262cdee9a6064ca P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.026849 22701 tablet_replica.cc:333] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.027529 22701 raft_consensus.cc:2243] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.028543 22701 raft_consensus.cc:2272] T a46ed529cd264980bac4a8656242966a P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.030848 22701 tablet_replica.cc:333] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.031455 22701 raft_consensus.cc:2243] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.031972 22701 raft_consensus.cc:2272] T 5e1c340f374545689f892f6136c5f92b P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.034276 22701 tablet_replica.cc:333] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.034859 22701 raft_consensus.cc:2243] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.035770 22701 raft_consensus.cc:2272] T 9caafdbf4faa4bdeb26c29a5454a5f94 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.038388 22701 tablet_replica.cc:333] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.038973 22701 raft_consensus.cc:2243] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.039443 22701 raft_consensus.cc:2272] T b007219e2ff443068a7ec936b0d2a6d1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.041664 22701 tablet_replica.cc:333] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.042271 22701 raft_consensus.cc:2243] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.043135 22701 raft_consensus.cc:2272] T 1ff5a82bfbaf425ba4873d0f0e3e776c P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.045313 22701 tablet_replica.cc:333] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.045994 22701 raft_consensus.cc:2243] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.046480 22701 raft_consensus.cc:2272] T b69abb8bd62140f58770bec881e8ec59 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.048712 22701 tablet_replica.cc:333] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.049329 22701 raft_consensus.cc:2243] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.049846 22701 raft_consensus.cc:2272] T ba9231e7b61847e29dac9f04c129f242 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.052004 22701 tablet_replica.cc:333] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.052559 22701 raft_consensus.cc:2243] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.053424 22701 raft_consensus.cc:2272] T 34cd27f677614e42854b6618e07715a0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.055733 22701 tablet_replica.cc:333] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.056227 22701 raft_consensus.cc:2243] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.056644 22701 raft_consensus.cc:2272] T 7382bfbf93704e3fb4a71d8f048be405 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.058893 22701 tablet_replica.cc:333] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.059351 22701 raft_consensus.cc:2243] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.060345 22701 raft_consensus.cc:2272] T 20e8dd80d0ac4a2e82a042b49b8bc0d3 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.062386 22701 tablet_replica.cc:333] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.062880 22701 raft_consensus.cc:2243] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.063300 22701 raft_consensus.cc:2272] T a32f85ad47fd43e997766faf8e9ae119 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.065428 22701 tablet_replica.cc:333] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.065973 22701 raft_consensus.cc:2243] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.066407 22701 raft_consensus.cc:2272] T d8345833c0f34e96af79e53d5eb8fbc0 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.068627 22701 tablet_replica.cc:333] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.069104 22701 raft_consensus.cc:2243] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.069514 22701 raft_consensus.cc:2272] T 2a807ba2b8d2417a8a13d2bf1bcef8c1 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.071748 22701 tablet_replica.cc:333] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed: stopping tablet replica
I20260709 12:24:31.072324 22701 raft_consensus.cc:2243] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.072889 22701 raft_consensus.cc:2272] T 2f636bc19da04dd8b83cab524f85dd00 P 41649f3a1d8346ada1e2a0e8b6cae5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.152177 22701 tablet_server.cc:196] TabletServer@127.22.43.68:0 shutdown complete.
I20260709 12:24:31.225291 22701 master.cc:562] Master@127.22.43.126:35313 shutting down...
I20260709 12:24:31.257995 22701 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:31.258680 22701 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.259068 22701 tablet_replica.cc:333] T 00000000000000000000000000000000 P e2cf68ea04f64e90a7182eb7eaaf1f91: stopping tablet replica
I20260709 12:24:31.283643 22701 master.cc:584] Master@127.22.43.126:35313 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (38333 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:24:31.373569 22701 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.43.126:35239
I20260709 12:24:31.374796 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:31.382489 32449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:31.382479 32448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:31.383090 32451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:31.383749 22701 server_base.cc:1061] running on GCE node
I20260709 12:24:31.385361 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:31.385610 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:31.385793 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599871385774 us; error 0 us; skew 500 ppm
I20260709 12:24:31.386509 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:31.389170 22701 webserver.cc:533] Webserver started at http://127.22.43.126:34887/ using document root <none> and password file <none>
I20260709 12:24:31.389858 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:31.390157 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:31.390457 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:31.391731 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/master-0-root/instance:
uuid: "c0612c8d1ffb4ae6b551e7d2eb6d073a"
format_stamp: "Formatted at 2026-07-09 12:24:31 on dist-test-slave-0768"
I20260709 12:24:31.396173 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:24:31.399613 32456 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:31.400502 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:24:31.400822 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/master-0-root
uuid: "c0612c8d1ffb4ae6b551e7d2eb6d073a"
format_stamp: "Formatted at 2026-07-09 12:24:31 on dist-test-slave-0768"
I20260709 12:24:31.401113 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:31.409626 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:31.410868 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:31.450273 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.126:35239
I20260709 12:24:31.450407 32508 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.126:35239 every 8 connection(s)
I20260709 12:24:31.454370 32509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:31.465982 32509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a: Bootstrap starting.
I20260709 12:24:31.471041 32509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:31.475520 32509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a: No bootstrap required, opened a new log
I20260709 12:24:31.477830 32509 raft_consensus.cc:359] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0612c8d1ffb4ae6b551e7d2eb6d073a" member_type: VOTER }
I20260709 12:24:31.478338 32509 raft_consensus.cc:385] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:31.478595 32509 raft_consensus.cc:740] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0612c8d1ffb4ae6b551e7d2eb6d073a, State: Initialized, Role: FOLLOWER
I20260709 12:24:31.479223 32509 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0612c8d1ffb4ae6b551e7d2eb6d073a" member_type: VOTER }
I20260709 12:24:31.479722 32509 raft_consensus.cc:399] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:31.479949 32509 raft_consensus.cc:493] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:31.480237 32509 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.485181 32509 raft_consensus.cc:515] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0612c8d1ffb4ae6b551e7d2eb6d073a" member_type: VOTER }
I20260709 12:24:31.485721 32509 leader_election.cc:304] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0612c8d1ffb4ae6b551e7d2eb6d073a; no voters: 
I20260709 12:24:31.486956 32509 leader_election.cc:290] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:31.487543 32512 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:31.489039 32512 raft_consensus.cc:697] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [term 1 LEADER]: Becoming Leader. State: Replica: c0612c8d1ffb4ae6b551e7d2eb6d073a, State: Running, Role: LEADER
I20260709 12:24:31.490015 32509 sys_catalog.cc:565] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:31.489820 32512 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0612c8d1ffb4ae6b551e7d2eb6d073a" member_type: VOTER }
I20260709 12:24:31.496328 32514 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0612c8d1ffb4ae6b551e7d2eb6d073a. Latest consensus state: current_term: 1 leader_uuid: "c0612c8d1ffb4ae6b551e7d2eb6d073a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0612c8d1ffb4ae6b551e7d2eb6d073a" member_type: VOTER } }
I20260709 12:24:31.496546 32513 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0612c8d1ffb4ae6b551e7d2eb6d073a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0612c8d1ffb4ae6b551e7d2eb6d073a" member_type: VOTER } }
I20260709 12:24:31.497248 32514 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:31.497474 32513 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:31.500742 32521 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:31.506178 32521 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:31.507596 22701 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:31.515331 32521 catalog_manager.cc:1383] Generated new cluster ID: 2df0647f216c4751b68f221cc8699563
I20260709 12:24:31.515651 32521 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:31.530846 32521 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:31.532133 32521 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:31.548290 32521 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a: Generated new TSK 0
I20260709 12:24:31.548925 32521 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:31.574748 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:31.581189 32530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:31.582077 32531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:31.584573 32533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:31.584666 22701 server_base.cc:1061] running on GCE node
I20260709 12:24:31.585948 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:31.586205 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:31.586372 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599871586356 us; error 0 us; skew 500 ppm
I20260709 12:24:31.586905 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:31.589277 22701 webserver.cc:533] Webserver started at http://127.22.43.65:34933/ using document root <none> and password file <none>
I20260709 12:24:31.589768 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:31.589999 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:31.590281 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:31.591506 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-0-root/instance:
uuid: "53755e1407fa4f059487bace5d6e8cb4"
format_stamp: "Formatted at 2026-07-09 12:24:31 on dist-test-slave-0768"
I20260709 12:24:31.595948 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:24:31.599236 32538 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:31.600075 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:24:31.600428 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-0-root
uuid: "53755e1407fa4f059487bace5d6e8cb4"
format_stamp: "Formatted at 2026-07-09 12:24:31 on dist-test-slave-0768"
I20260709 12:24:31.600786 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:31.611624 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:31.612983 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:31.614693 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:31.617266 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:31.617511 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:31.617802 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:31.618042 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:24:31.661830 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.65:32887
I20260709 12:24:31.662017 32600 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.65:32887 every 8 connection(s)
I20260709 12:24:31.667702 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:31.675570 32605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:31.678406 32606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:31.681717 32608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:31.682744 32601 heartbeater.cc:344] Connected to a master server at 127.22.43.126:35239
I20260709 12:24:31.682924 22701 server_base.cc:1061] running on GCE node
I20260709 12:24:31.683446 32601 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:31.684607 32601 heartbeater.cc:507] Master 127.22.43.126:35239 requested a full tablet report, sending...
I20260709 12:24:31.684861 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:31.685204 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:31.685424 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599871685406 us; error 0 us; skew 500 ppm
I20260709 12:24:31.686251 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:31.687065 32473 ts_manager.cc:194] Registered new tserver with Master: 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887)
I20260709 12:24:31.689066 22701 webserver.cc:533] Webserver started at http://127.22.43.66:36259/ using document root <none> and password file <none>
I20260709 12:24:31.689306 32473 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42738
I20260709 12:24:31.689746 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:31.690122 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:31.690418 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:31.691972 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-1-root/instance:
uuid: "c72b6a0c70a14ed889f676786ef0e134"
format_stamp: "Formatted at 2026-07-09 12:24:31 on dist-test-slave-0768"
I20260709 12:24:31.696754 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:24:31.700402 32613 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:31.701323 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:24:31.701658 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-1-root
uuid: "c72b6a0c70a14ed889f676786ef0e134"
format_stamp: "Formatted at 2026-07-09 12:24:31 on dist-test-slave-0768"
I20260709 12:24:31.702028 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:31.722286 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:31.723527 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:31.725013 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:31.727233 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:31.727459 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:31.727703 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:31.727876 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:31.767015 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.66:33079
I20260709 12:24:31.767074 32676 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.66:33079 every 8 connection(s)
I20260709 12:24:31.771941 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:31.779893 32680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:31.781386 32681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:31.782068 32683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:31.783141 22701 server_base.cc:1061] running on GCE node
I20260709 12:24:31.784235 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:31.784520 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:31.784740 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599871784722 us; error 0 us; skew 500 ppm
I20260709 12:24:31.785485 32677 heartbeater.cc:344] Connected to a master server at 127.22.43.126:35239
I20260709 12:24:31.785486 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:31.786018 32677 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:31.786871 32677 heartbeater.cc:507] Master 127.22.43.126:35239 requested a full tablet report, sending...
I20260709 12:24:31.788537 22701 webserver.cc:533] Webserver started at http://127.22.43.67:37349/ using document root <none> and password file <none>
I20260709 12:24:31.789012 32473 ts_manager.cc:194] Registered new tserver with Master: c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:31.789116 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:31.789501 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:31.789781 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:31.790639 32473 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42744
I20260709 12:24:31.790992 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-2-root/instance:
uuid: "baa0f002917f4ff7b016742adb282d79"
format_stamp: "Formatted at 2026-07-09 12:24:31 on dist-test-slave-0768"
I20260709 12:24:31.795619 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:24:31.798839 32688 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:31.799600 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:24:31.799909 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-2-root
uuid: "baa0f002917f4ff7b016742adb282d79"
format_stamp: "Formatted at 2026-07-09 12:24:31 on dist-test-slave-0768"
I20260709 12:24:31.800230 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:31.810792 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:31.811978 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:31.813418 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:31.815656 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:31.815883 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:31.816126 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:31.816300 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:31.856487 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.67:46707
I20260709 12:24:31.856606 32750 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.67:46707 every 8 connection(s)
I20260709 12:24:31.870332 32751 heartbeater.cc:344] Connected to a master server at 127.22.43.126:35239
I20260709 12:24:31.870764 32751 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:31.871531 32751 heartbeater.cc:507] Master 127.22.43.126:35239 requested a full tablet report, sending...
I20260709 12:24:31.873375 32473 ts_manager.cc:194] Registered new tserver with Master: baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:31.873482 22701 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013857558s
I20260709 12:24:31.874832 32473 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42752
I20260709 12:24:31.900045 32473 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42756:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:31.903501 32473 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:31.980458 32716 tablet_service.cc:1511] Processing CreateTablet for tablet ee147b0d9961498783fda1e20a5254bf (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:24:31.982033 32716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee147b0d9961498783fda1e20a5254bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:31.981917 32715 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7bc899c94245f18b8da19d76824cc4 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:24:31.982434 32714 tablet_service.cc:1511] Processing CreateTablet for tablet 3898ad57ae3c441caf3d75c5ed15cc39 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:24:31.983606 32715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7bc899c94245f18b8da19d76824cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:31.984849 32713 tablet_service.cc:1511] Processing CreateTablet for tablet 24556c0c1c444490b9fe3e5baa831ada (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:24:31.987145 32712 tablet_service.cc:1511] Processing CreateTablet for tablet a0af227d76f14a6e9c929ffa2e0178d6 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:24:31.988708 32712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0af227d76f14a6e9c929ffa2e0178d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:31.991022 32642 tablet_service.cc:1511] Processing CreateTablet for tablet ee147b0d9961498783fda1e20a5254bf (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:24:31.992448 32642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee147b0d9961498783fda1e20a5254bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:31.995138 32641 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7bc899c94245f18b8da19d76824cc4 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:24:31.996629 32641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7bc899c94245f18b8da19d76824cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:31.999130 32640 tablet_service.cc:1511] Processing CreateTablet for tablet 3898ad57ae3c441caf3d75c5ed15cc39 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:24:32.000655 32640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3898ad57ae3c441caf3d75c5ed15cc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.002146 32639 tablet_service.cc:1511] Processing CreateTablet for tablet 24556c0c1c444490b9fe3e5baa831ada (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:24:32.002847 32710 tablet_service.cc:1511] Processing CreateTablet for tablet 6defb984d3c644798ce8683daf85d896 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:24:32.004343 32710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6defb984d3c644798ce8683daf85d896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.005086 32638 tablet_service.cc:1511] Processing CreateTablet for tablet a0af227d76f14a6e9c929ffa2e0178d6 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:24:32.007778 32637 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5ac5633b794425be2031f182f7cd0e (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:24:32.010344 32711 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5ac5633b794425be2031f182f7cd0e (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:24:32.011909 32711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5ac5633b794425be2031f182f7cd0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.014199 32715 tablet_service.cc:1511] Processing CreateTablet for tablet c1ad632c91f14429895340f24716d0ac (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:24:32.015239 32636 tablet_service.cc:1511] Processing CreateTablet for tablet 6defb984d3c644798ce8683daf85d896 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:24:32.017793 32635 tablet_service.cc:1511] Processing CreateTablet for tablet c1ad632c91f14429895340f24716d0ac (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:24:32.019243 32635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ad632c91f14429895340f24716d0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.022313 32636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6defb984d3c644798ce8683daf85d896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.023272 32639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24556c0c1c444490b9fe3e5baa831ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.024045 32634 tablet_service.cc:1511] Processing CreateTablet for tablet 6baf2f940a9f4c40ba334c03d8ac3ee3 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:24:32.025134 32638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0af227d76f14a6e9c929ffa2e0178d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.025913 32637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5ac5633b794425be2031f182f7cd0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.029690 32709 tablet_service.cc:1511] Processing CreateTablet for tablet 6baf2f940a9f4c40ba334c03d8ac3ee3 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:24:32.030249 32634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6baf2f940a9f4c40ba334c03d8ac3ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.032330 32633 tablet_service.cc:1511] Processing CreateTablet for tablet 0828bc27aab34b81984de2f7d6a156e8 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:24:32.033794 32633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0828bc27aab34b81984de2f7d6a156e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.036007 32708 tablet_service.cc:1511] Processing CreateTablet for tablet 0828bc27aab34b81984de2f7d6a156e8 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:24:32.015694 32715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ad632c91f14429895340f24716d0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.054276 32709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6baf2f940a9f4c40ba334c03d8ac3ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.058216 32713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24556c0c1c444490b9fe3e5baa831ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.060113 32708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0828bc27aab34b81984de2f7d6a156e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.060773 32714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3898ad57ae3c441caf3d75c5ed15cc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.095007 32566 tablet_service.cc:1511] Processing CreateTablet for tablet ee147b0d9961498783fda1e20a5254bf (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:24:32.096459 32566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee147b0d9961498783fda1e20a5254bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.100502 32564 tablet_service.cc:1511] Processing CreateTablet for tablet 3898ad57ae3c441caf3d75c5ed15cc39 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:24:32.101992 32564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3898ad57ae3c441caf3d75c5ed15cc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.105958 32563 tablet_service.cc:1511] Processing CreateTablet for tablet 24556c0c1c444490b9fe3e5baa831ada (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:24:32.107430 32563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24556c0c1c444490b9fe3e5baa831ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.108419 32557 tablet_service.cc:1511] Processing CreateTablet for tablet 0828bc27aab34b81984de2f7d6a156e8 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:24:32.111129 32562 tablet_service.cc:1511] Processing CreateTablet for tablet a0af227d76f14a6e9c929ffa2e0178d6 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:24:32.109786 32557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0828bc27aab34b81984de2f7d6a156e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.113560 32561 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5ac5633b794425be2031f182f7cd0e (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:24:32.115016 32561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5ac5633b794425be2031f182f7cd0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.118207 32560 tablet_service.cc:1511] Processing CreateTablet for tablet 6defb984d3c644798ce8683daf85d896 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:24:32.119616 32560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6defb984d3c644798ce8683daf85d896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.101222 32565 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7bc899c94245f18b8da19d76824cc4 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:24:32.122887 32565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7bc899c94245f18b8da19d76824cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.123225 32559 tablet_service.cc:1511] Processing CreateTablet for tablet c1ad632c91f14429895340f24716d0ac (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:24:32.124697 32559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ad632c91f14429895340f24716d0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.127130 32558 tablet_service.cc:1511] Processing CreateTablet for tablet 6baf2f940a9f4c40ba334c03d8ac3ee3 (DEFAULT_TABLE table=test-workload [id=177b6c7df595479bab889086ad4cf80c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:24:32.128539 32558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6baf2f940a9f4c40ba334c03d8ac3ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.130273 32562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0af227d76f14a6e9c929ffa2e0178d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:32.190840   300 tablet_bootstrap.cc:492] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:32.201211 32766 tablet_bootstrap.cc:492] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79: Bootstrap starting.
I20260709 12:24:32.207068   300 tablet_bootstrap.cc:654] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.214816 32767 tablet_bootstrap.cc:492] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134: Bootstrap starting.
I20260709 12:24:32.245285 32766 tablet_bootstrap.cc:654] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.255789   300 tablet_bootstrap.cc:492] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4: No bootstrap required, opened a new log
I20260709 12:24:32.256412   300 ts_tablet_manager.cc:1403] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.025s
I20260709 12:24:32.259840   300 raft_consensus.cc:359] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.262130   300 raft_consensus.cc:385] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.262158 32767 tablet_bootstrap.cc:654] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.262710   300 raft_consensus.cc:740] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.264104   300 consensus_queue.cc:260] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.268167   300 ts_tablet_manager.cc:1434] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:24:32.268467 32766 tablet_bootstrap.cc:492] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79: No bootstrap required, opened a new log
I20260709 12:24:32.268937 32601 heartbeater.cc:499] Master 127.22.43.126:35239 was elected leader, sending a full tablet report...
I20260709 12:24:32.269313   300 tablet_bootstrap.cc:492] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:32.270357 32766 ts_tablet_manager.cc:1403] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79: Time spent bootstrapping tablet: real 0.071s	user 0.000s	sys 0.034s
I20260709 12:24:32.271502 32767 tablet_bootstrap.cc:492] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134: No bootstrap required, opened a new log
I20260709 12:24:32.272063 32767 ts_tablet_manager.cc:1403] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134: Time spent bootstrapping tablet: real 0.058s	user 0.005s	sys 0.010s
I20260709 12:24:32.273850 32766 raft_consensus.cc:359] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:32.274729 32766 raft_consensus.cc:385] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.275043 32766 raft_consensus.cc:740] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.275911 32766 consensus_queue.cc:260] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:32.276850   300 tablet_bootstrap.cc:654] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.278666 32751 heartbeater.cc:499] Master 127.22.43.126:35239 was elected leader, sending a full tablet report...
I20260709 12:24:32.279273 32766 ts_tablet_manager.cc:1434] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:24:32.280514 32766 tablet_bootstrap.cc:492] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79: Bootstrap starting.
I20260709 12:24:32.287078   300 tablet_bootstrap.cc:492] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4: No bootstrap required, opened a new log
I20260709 12:24:32.287735   300 ts_tablet_manager.cc:1403] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 12:24:32.287981 32766 tablet_bootstrap.cc:654] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.285297 32767 raft_consensus.cc:359] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:32.291031   300 raft_consensus.cc:359] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.291944   300 raft_consensus.cc:385] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.292984   300 raft_consensus.cc:740] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.290284 32767 raft_consensus.cc:385] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.293821   300 consensus_queue.cc:260] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.294178 32767 raft_consensus.cc:740] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.296181   300 ts_tablet_manager.cc:1434] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:24:32.295461 32767 consensus_queue.cc:260] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:32.297328   300 tablet_bootstrap.cc:492] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:32.304472   306 raft_consensus.cc:493] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.305294 32677 heartbeater.cc:499] Master 127.22.43.126:35239 was elected leader, sending a full tablet report...
I20260709 12:24:32.305096   306 raft_consensus.cc:515] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:32.307829   306 leader_election.cc:290] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887)
I20260709 12:24:32.310043   300 tablet_bootstrap.cc:654] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.334867   300 tablet_bootstrap.cc:492] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4: No bootstrap required, opened a new log
I20260709 12:24:32.335456   300 ts_tablet_manager.cc:1403] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.012s
I20260709 12:24:32.338640   300 raft_consensus.cc:359] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.339406   300 raft_consensus.cc:385] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.339710   300 raft_consensus.cc:740] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.340432   300 consensus_queue.cc:260] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.341461 32767 ts_tablet_manager.cc:1434] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134: Time spent starting tablet: real 0.069s	user 0.011s	sys 0.000s
I20260709 12:24:32.345924   309 raft_consensus.cc:493] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.348791   309 raft_consensus.cc:515] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:32.349679 32767 tablet_bootstrap.cc:492] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134: Bootstrap starting.
I20260709 12:24:32.355229   309 leader_election.cc:290] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707), 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887)
I20260709 12:24:32.342994   300 ts_tablet_manager.cc:1434] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:32.357940   300 tablet_bootstrap.cc:492] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:32.358362 32766 tablet_bootstrap.cc:492] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79: No bootstrap required, opened a new log
I20260709 12:24:32.358946 32766 ts_tablet_manager.cc:1403] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79: Time spent bootstrapping tablet: real 0.079s	user 0.028s	sys 0.048s
I20260709 12:24:32.362514 32766 raft_consensus.cc:359] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.363337 32766 raft_consensus.cc:385] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.363663 32766 raft_consensus.cc:740] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Initialized, Role: FOLLOWER
W20260709 12:24:32.364483 32752 tablet.cc:2406] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:24:32.364542 32766 consensus_queue.cc:260] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.371251 32766 ts_tablet_manager.cc:1434] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:24:32.371714 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
I20260709 12:24:32.372457 32766 tablet_bootstrap.cc:492] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79: Bootstrap starting.
I20260709 12:24:32.373521 32767 tablet_bootstrap.cc:654] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:32.374086 32689 leader_election.cc:343] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.383275   300 tablet_bootstrap.cc:654] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.393754 32766 tablet_bootstrap.cc:654] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.397816   300 tablet_bootstrap.cc:492] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4: No bootstrap required, opened a new log
I20260709 12:24:32.398561   300 ts_tablet_manager.cc:1403] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.007s
I20260709 12:24:32.402067   300 raft_consensus.cc:359] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.402841   300 raft_consensus.cc:385] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.402835 32726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:32.403483   300 raft_consensus.cc:740] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.403759 32726 raft_consensus.cc:2468] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 0.
I20260709 12:24:32.403906 32652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:32.404429   300 consensus_queue.cc:260] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.404901 32652 raft_consensus.cc:2468] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 0.
I20260709 12:24:32.405426 32614 leader_election.cc:304] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:32.406312   309 raft_consensus.cc:2804] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:32.406682   309 raft_consensus.cc:493] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.407009   309 raft_consensus.cc:3060] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.412722   306 raft_consensus.cc:493] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.413110   300 ts_tablet_manager.cc:1434] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:24:32.413286   306 raft_consensus.cc:515] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.414912   300 tablet_bootstrap.cc:492] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:32.413739 32767 tablet_bootstrap.cc:492] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134: No bootstrap required, opened a new log
I20260709 12:24:32.415588   306 leader_election.cc:290] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:32.416364 32767 ts_tablet_manager.cc:1403] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134: Time spent bootstrapping tablet: real 0.067s	user 0.028s	sys 0.018s
I20260709 12:24:32.416889 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7bc899c94245f18b8da19d76824cc4" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
W20260709 12:24:32.418443 32689 leader_election.cc:343] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.418741   309 raft_consensus.cc:515] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:32.420894   309 leader_election.cc:290] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Requested vote from peers baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707), 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887)
I20260709 12:24:32.421604 32767 raft_consensus.cc:359] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.422125   300 tablet_bootstrap.cc:654] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.421816 32689 leader_election.cc:304] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134; no voters: 53755e1407fa4f059487bace5d6e8cb4
I20260709 12:24:32.422453 32767 raft_consensus.cc:385] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.422823 32767 raft_consensus.cc:740] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.423242   306 raft_consensus.cc:2804] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:32.423659   306 raft_consensus.cc:493] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.423799 32652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7bc899c94245f18b8da19d76824cc4" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:32.424084   306 raft_consensus.cc:3060] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.423753 32767 consensus_queue.cc:260] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.425298 32575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:32.425961 32766 tablet_bootstrap.cc:492] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79: No bootstrap required, opened a new log
I20260709 12:24:32.426479   303 raft_consensus.cc:493] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.426723 32726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:32.427029 32767 ts_tablet_manager.cc:1434] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:24:32.427038   303 raft_consensus.cc:515] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
W20260709 12:24:32.429111 32689 leader_election.cc:343] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.429592 32689 leader_election.cc:304] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa0f002917f4ff7b016742adb282d79; no voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:32.431268 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
I20260709 12:24:32.432809   306 raft_consensus.cc:515] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
W20260709 12:24:32.433959 32614 leader_election.cc:343] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.434660   303 leader_election.cc:290] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.426481 32766 ts_tablet_manager.cc:1403] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.000s
I20260709 12:24:32.437958 32726 raft_consensus.cc:2393] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c72b6a0c70a14ed889f676786ef0e134 in current term 1: Already voted for candidate baa0f002917f4ff7b016742adb282d79 in this term.
I20260709 12:24:32.439462 32767 tablet_bootstrap.cc:492] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134: Bootstrap starting.
W20260709 12:24:32.441283 32614 leader_election.cc:343] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.443606 32614 leader_election.cc:304] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c72b6a0c70a14ed889f676786ef0e134; no voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79
I20260709 12:24:32.444500   306 leader_election.cc:290] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Requested vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887)
I20260709 12:24:32.445158   306 raft_consensus.cc:2749] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.446182   309 raft_consensus.cc:2749] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.446846 32767 tablet_bootstrap.cc:654] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.451016   300 tablet_bootstrap.cc:492] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4: No bootstrap required, opened a new log
I20260709 12:24:32.451547   300 ts_tablet_manager.cc:1403] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.005s
I20260709 12:24:32.452188   303 raft_consensus.cc:493] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.452783   303 raft_consensus.cc:515] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.453322 32766 raft_consensus.cc:359] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.454953 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:32.454809   300 raft_consensus.cc:359] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.455302   303 leader_election.cc:290] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.456871   300 raft_consensus.cc:385] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:24:32.457052 32689 leader_election.cc:343] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.457409   300 raft_consensus.cc:740] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.458645   300 consensus_queue.cc:260] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.464247   303 raft_consensus.cc:493] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.459959 32766 raft_consensus.cc:385] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.461892 32652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:32.464782   303 raft_consensus.cc:515] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.465247 32652 raft_consensus.cc:2393] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate baa0f002917f4ff7b016742adb282d79 in current term 1: Already voted for candidate c72b6a0c70a14ed889f676786ef0e134 in this term.
I20260709 12:24:32.466370 32766 raft_consensus.cc:740] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.466988   303 leader_election.cc:290] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.467942 32689 leader_election.cc:304] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa0f002917f4ff7b016742adb282d79; no voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:32.468827   318 raft_consensus.cc:2749] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.468181 32766 consensus_queue.cc:260] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.472546 32726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3898ad57ae3c441caf3d75c5ed15cc39" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:32.464466   300 ts_tablet_manager.cc:1434] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:24:32.474059 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:32.475482 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:32.476291   300 tablet_bootstrap.cc:492] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:32.475615 32766 ts_tablet_manager.cc:1434] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
W20260709 12:24:32.477949 32539 leader_election.cc:343] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:32.478736 32539 leader_election.cc:343] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.479236 32766 tablet_bootstrap.cc:492] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79: Bootstrap starting.
W20260709 12:24:32.479380 32539 leader_election.cc:343] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.480805 32652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3898ad57ae3c441caf3d75c5ed15cc39" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:32.481442 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
W20260709 12:24:32.482303 32539 leader_election.cc:343] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.482761 32539 leader_election.cc:304] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4; no voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:32.482908 32650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:32.483609   303 raft_consensus.cc:2749] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:32.484803 32539 leader_election.cc:343] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.485258 32539 leader_election.cc:304] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4; no voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:32.486022   303 raft_consensus.cc:2749] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.487274   300 tablet_bootstrap.cc:654] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.489336 32767 tablet_bootstrap.cc:492] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134: No bootstrap required, opened a new log
I20260709 12:24:32.489929 32767 ts_tablet_manager.cc:1403] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.018s
W20260709 12:24:32.487241 32539 leader_election.cc:343] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.491626 32539 leader_election.cc:304] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4; no voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:32.492029 32766 tablet_bootstrap.cc:654] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.492441   303 raft_consensus.cc:2749] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.494056   300 tablet_bootstrap.cc:492] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4: No bootstrap required, opened a new log
I20260709 12:24:32.494477   300 ts_tablet_manager.cc:1403] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 12:24:32.494154 32767 raft_consensus.cc:359] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.495237 32767 raft_consensus.cc:385] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.495554 32767 raft_consensus.cc:740] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.496330 32767 consensus_queue.cc:260] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.497421 32766 tablet_bootstrap.cc:492] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79: No bootstrap required, opened a new log
I20260709 12:24:32.498585 32767 ts_tablet_manager.cc:1434] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:24:32.499166 32766 ts_tablet_manager.cc:1403] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 12:24:32.498121   300 raft_consensus.cc:359] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:32.499796   300 raft_consensus.cc:385] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.500111   300 raft_consensus.cc:740] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.500384 32767 tablet_bootstrap.cc:492] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134: Bootstrap starting.
I20260709 12:24:32.501035   300 consensus_queue.cc:260] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
W20260709 12:24:32.502527 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:32.504215   300 ts_tablet_manager.cc:1434] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:24:32.504797 32766 raft_consensus.cc:359] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.505424   300 tablet_bootstrap.cc:492] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:32.505544 32766 raft_consensus.cc:385] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.506011 32766 raft_consensus.cc:740] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.506886 32766 consensus_queue.cc:260] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.508845 32767 tablet_bootstrap.cc:654] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.509479 32766 ts_tablet_manager.cc:1434] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 12:24:32.510499 32766 tablet_bootstrap.cc:492] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79: Bootstrap starting.
I20260709 12:24:32.513048   303 raft_consensus.cc:493] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.513729   303 raft_consensus.cc:515] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.517091 32766 tablet_bootstrap.cc:654] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.517537 32650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
W20260709 12:24:32.519550 32539 leader_election.cc:343] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.520946   303 leader_election.cc:290] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.523207 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
W20260709 12:24:32.525317 32539 leader_election.cc:343] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.525966 32539 leader_election.cc:304] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4; no voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:32.527550   303 raft_consensus.cc:2749] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.531292   300 tablet_bootstrap.cc:654] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.538355 32767 tablet_bootstrap.cc:492] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134: No bootstrap required, opened a new log
I20260709 12:24:32.538885 32766 tablet_bootstrap.cc:492] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79: No bootstrap required, opened a new log
I20260709 12:24:32.538964 32767 ts_tablet_manager.cc:1403] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.019s
I20260709 12:24:32.539541 32766 ts_tablet_manager.cc:1403] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.013s
I20260709 12:24:32.540664   300 tablet_bootstrap.cc:492] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4: No bootstrap required, opened a new log
I20260709 12:24:32.541236   300 ts_tablet_manager.cc:1403] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.004s
I20260709 12:24:32.542837 32766 raft_consensus.cc:359] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.543603 32766 raft_consensus.cc:385] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.543921 32766 raft_consensus.cc:740] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.543859 32767 raft_consensus.cc:359] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.544807 32767 raft_consensus.cc:385] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.544524   300 raft_consensus.cc:359] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.545140 32767 raft_consensus.cc:740] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.545472   300 raft_consensus.cc:385] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.545079 32766 consensus_queue.cc:260] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.545853   300 raft_consensus.cc:740] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.546212 32767 consensus_queue.cc:260] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.547679 32766 ts_tablet_manager.cc:1434] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:24:32.548511 32767 ts_tablet_manager.cc:1434] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:24:32.548748 32766 tablet_bootstrap.cc:492] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79: Bootstrap starting.
I20260709 12:24:32.549616 32767 tablet_bootstrap.cc:492] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134: Bootstrap starting.
I20260709 12:24:32.546856   300 consensus_queue.cc:260] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.551885   300 ts_tablet_manager.cc:1434] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:24:32.552978   300 tablet_bootstrap.cc:492] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:32.556037 32766 tablet_bootstrap.cc:654] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.556804 32767 tablet_bootstrap.cc:654] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.559495   300 tablet_bootstrap.cc:654] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.569515   300 tablet_bootstrap.cc:492] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4: No bootstrap required, opened a new log
I20260709 12:24:32.570091   300 ts_tablet_manager.cc:1403] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:24:32.572036   300 raft_consensus.cc:359] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.572582   300 raft_consensus.cc:385] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.572808   300 raft_consensus.cc:740] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.573405   300 consensus_queue.cc:260] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.574648   321 raft_consensus.cc:493] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.575240   321 raft_consensus.cc:515] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.576366 32767 tablet_bootstrap.cc:492] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134: No bootstrap required, opened a new log
I20260709 12:24:32.576963 32767 ts_tablet_manager.cc:1403] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.004s
I20260709 12:24:32.579334 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defb984d3c644798ce8683daf85d896" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
I20260709 12:24:32.579373 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defb984d3c644798ce8683daf85d896" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:32.580111 32767 raft_consensus.cc:359] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.580637 32724 raft_consensus.cc:2468] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 0.
I20260709 12:24:32.580988 32767 raft_consensus.cc:385] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.581351 32767 raft_consensus.cc:740] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Initialized, Role: FOLLOWER
W20260709 12:24:32.581476 32614 leader_election.cc:343] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.582319 32614 leader_election.cc:304] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134; no voters: 53755e1407fa4f059487bace5d6e8cb4
I20260709 12:24:32.582310 32767 consensus_queue.cc:260] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.577435   321 leader_election.cc:290] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.583289   309 raft_consensus.cc:2804] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:32.583923   309 raft_consensus.cc:493] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.584419   309 raft_consensus.cc:3060] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.598835   309 raft_consensus.cc:515] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.600657   303 raft_consensus.cc:493] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.604187   303 raft_consensus.cc:515] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.610471 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:32.611570 32724 raft_consensus.cc:2468] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53755e1407fa4f059487bace5d6e8cb4 in term 0.
I20260709 12:24:32.610601 32650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:32.614073 32650 raft_consensus.cc:2468] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53755e1407fa4f059487bace5d6e8cb4 in term 0.
I20260709 12:24:32.615942 32539 leader_election.cc:304] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:32.617584   303 leader_election.cc:290] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.618507   303 raft_consensus.cc:493] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.619269   318 raft_consensus.cc:493] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.619192   303 raft_consensus.cc:515] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.620050   318 raft_consensus.cc:515] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.621378   332 raft_consensus.cc:2804] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:32.621814   332 raft_consensus.cc:493] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.622452   318 leader_election.cc:290] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:32.603415   300 ts_tablet_manager.cc:1434] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:24:32.624091   303 leader_election.cc:290] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.625422 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ad632c91f14429895340f24716d0ac" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
I20260709 12:24:32.625655 32767 ts_tablet_manager.cc:1434] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134: Time spent starting tablet: real 0.048s	user 0.024s	sys 0.024s
I20260709 12:24:32.625662 32650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ad632c91f14429895340f24716d0ac" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:32.626119   300 tablet_bootstrap.cc:492] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:32.628553 32767 tablet_bootstrap.cc:492] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134: Bootstrap starting.
I20260709 12:24:32.622493   332 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.626158 32576 raft_consensus.cc:2468] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 0.
I20260709 12:24:32.628878 32766 tablet_bootstrap.cc:492] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79: No bootstrap required, opened a new log
I20260709 12:24:32.626482 32650 raft_consensus.cc:2468] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 0.
I20260709 12:24:32.629454 32766 ts_tablet_manager.cc:1403] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79: Time spent bootstrapping tablet: real 0.081s	user 0.037s	sys 0.033s
I20260709 12:24:32.630234 32689 leader_election.cc:304] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:32.631366   318 raft_consensus.cc:2804] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:32.631743   318 raft_consensus.cc:493] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.632057   318 raft_consensus.cc:3060] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.632869 32766 raft_consensus.cc:359] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.633618 32766 raft_consensus.cc:385] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.633980 32766 raft_consensus.cc:740] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.634260 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defb984d3c644798ce8683daf85d896" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:32.634910 32724 raft_consensus.cc:3060] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.634838 32766 consensus_queue.cc:260] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.635896 32767 tablet_bootstrap.cc:654] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.637434 32766 ts_tablet_manager.cc:1434] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:24:32.638536 32766 tablet_bootstrap.cc:492] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79: Bootstrap starting.
I20260709 12:24:32.643579   300 tablet_bootstrap.cc:654] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.644917 32766 tablet_bootstrap.cc:654] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.662034   309 leader_election.cc:290] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.662213 32767 tablet_bootstrap.cc:492] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134: No bootstrap required, opened a new log
I20260709 12:24:32.663133 32767 ts_tablet_manager.cc:1403] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.006s
W20260709 12:24:32.663682 32539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33079, user_credentials={real_user=slave}} blocked reactor thread for 47871.5us
I20260709 12:24:32.666788 32724 raft_consensus.cc:2468] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 1.
I20260709 12:24:32.667147 32767 raft_consensus.cc:359] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.668469 32614 leader_election.cc:304] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:32.669611   309 raft_consensus.cc:2804] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:32.667955 32650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:32.670328   309 raft_consensus.cc:697] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:32.671430   309 consensus_queue.cc:237] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.678218 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:32.681121 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defb984d3c644798ce8683daf85d896" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:32.682194   300 tablet_bootstrap.cc:492] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4: No bootstrap required, opened a new log
W20260709 12:24:32.682674 32614 leader_election.cc:343] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.682730   300 ts_tablet_manager.cc:1403] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.012s
I20260709 12:24:32.684022   332 raft_consensus.cc:515] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.676421   318 raft_consensus.cc:515] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.687016   300 raft_consensus.cc:359] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.687743   300 raft_consensus.cc:385] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.688035   300 raft_consensus.cc:740] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.688755   300 consensus_queue.cc:260] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
W20260709 12:24:32.682762 32539 leader_election.cc:343] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.689754   332 leader_election.cc:290] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 election: Requested vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.690270 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ad632c91f14429895340f24716d0ac" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
W20260709 12:24:32.690373 32539 leader_election.cc:343] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.691061 32576 raft_consensus.cc:3060] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.692144   300 ts_tablet_manager.cc:1434] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:32.693230   300 tablet_bootstrap.cc:492] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:32.667976 32767 raft_consensus.cc:385] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.693814 32767 raft_consensus.cc:740] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.694808 32767 consensus_queue.cc:260] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.697400 32767 ts_tablet_manager.cc:1434] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:24:32.691056 32539 leader_election.cc:304] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4; no voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:32.698506 32767 tablet_bootstrap.cc:492] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134: Bootstrap starting.
I20260709 12:24:32.700043 32650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:32.700193   333 raft_consensus.cc:2749] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.700613   300 tablet_bootstrap.cc:654] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.700712 32650 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.705299 32766 tablet_bootstrap.cc:492] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79: No bootstrap required, opened a new log
I20260709 12:24:32.704006 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:32.705858 32766 ts_tablet_manager.cc:1403] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79: Time spent bootstrapping tablet: real 0.068s	user 0.024s	sys 0.021s
I20260709 12:24:32.707327 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ad632c91f14429895340f24716d0ac" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:32.707927 32651 raft_consensus.cc:3060] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.710055 32766 raft_consensus.cc:359] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.710826 32766 raft_consensus.cc:385] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.711117 32766 raft_consensus.cc:740] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.711254   309 raft_consensus.cc:493] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.711817   309 raft_consensus.cc:515] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.712576 32576 raft_consensus.cc:2468] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 1.
I20260709 12:24:32.714036   309 leader_election.cc:290] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.714155 32689 leader_election.cc:304] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:32.714653 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
I20260709 12:24:32.715287 32576 raft_consensus.cc:2468] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 0.
I20260709 12:24:32.715085 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:32.716979 32614 leader_election.cc:304] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
W20260709 12:24:32.717995 32614 leader_election.cc:343] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.713680 32766 consensus_queue.cc:260] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.715181   306 raft_consensus.cc:2804] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:32.720688 32767 tablet_bootstrap.cc:654] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.709584 32650 raft_consensus.cc:2468] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53755e1407fa4f059487bace5d6e8cb4 in term 1.
I20260709 12:24:32.706434 32724 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.723266   331 raft_consensus.cc:2804] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:32.723748   331 raft_consensus.cc:493] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.724045 32539 leader_election.cc:304] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:32.724390   309 raft_consensus.cc:493] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.725203   333 raft_consensus.cc:2804] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:32.724982   309 raft_consensus.cc:515] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.725832   333 raft_consensus.cc:697] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 LEADER]: Becoming Leader. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Running, Role: LEADER
I20260709 12:24:32.726845   333 consensus_queue.cc:237] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.725050 32472 catalog_manager.cc:5697] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 0 to 1, leader changed from <none> to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.729183 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:32.724081   331 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.728401   309 leader_election.cc:290] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.706802   318 leader_election.cc:290] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
W20260709 12:24:32.734143 32614 leader_election.cc:343] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.728096 32651 raft_consensus.cc:2468] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 1.
I20260709 12:24:32.737811 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
I20260709 12:24:32.738564 32576 raft_consensus.cc:2468] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 0.
I20260709 12:24:32.740803   331 raft_consensus.cc:515] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.743319 32614 leader_election.cc:304] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: baa0f002917f4ff7b016742adb282d79
I20260709 12:24:32.745697   309 raft_consensus.cc:2804] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:32.746131   309 raft_consensus.cc:493] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.747211 32766 ts_tablet_manager.cc:1434] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.007s
I20260709 12:24:32.746484 32767 tablet_bootstrap.cc:492] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134: No bootstrap required, opened a new log
I20260709 12:24:32.748342 32767 ts_tablet_manager.cc:1403] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.003s
I20260709 12:24:32.748769 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:32.746500   309 raft_consensus.cc:3060] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.749277   306 raft_consensus.cc:697] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:32.755846 32576 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.758193   331 leader_election.cc:290] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.759429 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:32.760452 32766 tablet_bootstrap.cc:492] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79: Bootstrap starting.
W20260709 12:24:32.761204 32614 leader_election.cc:343] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.770442 32767 raft_consensus.cc:359] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.771263 32767 raft_consensus.cc:385] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.771538 32767 raft_consensus.cc:740] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.772316 32767 consensus_queue.cc:260] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.773236   309 raft_consensus.cc:515] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.775344 32724 raft_consensus.cc:2468] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53755e1407fa4f059487bace5d6e8cb4 in term 1.
I20260709 12:24:32.776399 32575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:32.777072 32575 raft_consensus.cc:3060] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.786886 32767 ts_tablet_manager.cc:1434] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:24:32.788132 32767 tablet_bootstrap.cc:492] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134: Bootstrap starting.
I20260709 12:24:32.788437 32473 catalog_manager.cc:5697] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "53755e1407fa4f059487bace5d6e8cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.780591   309 leader_election.cc:290] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:32.791471 32575 raft_consensus.cc:2468] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 1.
I20260709 12:24:32.792903 32614 leader_election.cc:304] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:32.793824   309 raft_consensus.cc:2804] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:32.794709   309 raft_consensus.cc:697] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:32.795327 32767 tablet_bootstrap.cc:654] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.796165   300 tablet_bootstrap.cc:492] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4: No bootstrap required, opened a new log
I20260709 12:24:32.791208   306 consensus_queue.cc:237] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.796826   300 ts_tablet_manager.cc:1403] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.104s	user 0.019s	sys 0.020s
I20260709 12:24:32.795665   309 consensus_queue.cc:237] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.766263 32576 raft_consensus.cc:2468] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 1.
I20260709 12:24:32.798822 32766 tablet_bootstrap.cc:654] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.799443 32614 leader_election.cc:304] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: baa0f002917f4ff7b016742adb282d79
I20260709 12:24:32.801206   331 raft_consensus.cc:2804] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:32.801872   331 raft_consensus.cc:697] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:32.803077   331 consensus_queue.cc:237] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.803965   300 raft_consensus.cc:359] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.804867   300 raft_consensus.cc:385] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.805197   300 raft_consensus.cc:740] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.806126   300 consensus_queue.cc:260] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.808784   300 ts_tablet_manager.cc:1434] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:24:32.783466 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79"
W20260709 12:24:32.811705 32614 leader_election.cc:343] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.819670   339 raft_consensus.cc:493] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.820461   339 raft_consensus.cc:515] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.825330   339 leader_election.cc:290] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:32.826856 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
W20260709 12:24:32.828673 32689 leader_election.cc:343] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.826853 32575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
I20260709 12:24:32.837831 32575 raft_consensus.cc:2468] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 0.
I20260709 12:24:32.839576 32689 leader_election.cc:304] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:32.841189   339 raft_consensus.cc:2804] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:32.841701   339 raft_consensus.cc:493] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.842160   339 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.861634   339 raft_consensus.cc:515] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.871783 32470 catalog_manager.cc:5697] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:32.876209   306 raft_consensus.cc:493] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.877007   306 raft_consensus.cc:515] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.880982 32575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3898ad57ae3c441caf3d75c5ed15cc39" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
I20260709 12:24:32.881917 32575 raft_consensus.cc:2468] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 0.
I20260709 12:24:32.883466 32689 leader_election.cc:304] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:32.884877   338 raft_consensus.cc:2804] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:32.885421   338 raft_consensus.cc:493] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.885829   338 raft_consensus.cc:3060] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.900143   338 raft_consensus.cc:515] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.904994 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3898ad57ae3c441caf3d75c5ed15cc39" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:32.906078 32651 raft_consensus.cc:2468] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 0.
I20260709 12:24:32.908006   306 leader_election.cc:290] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:32.912204 32575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3898ad57ae3c441caf3d75c5ed15cc39" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:32.912560 32767 tablet_bootstrap.cc:492] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134: No bootstrap required, opened a new log
I20260709 12:24:32.912803 32575 raft_consensus.cc:3060] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.913094 32767 ts_tablet_manager.cc:1403] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134: Time spent bootstrapping tablet: real 0.125s	user 0.059s	sys 0.061s
I20260709 12:24:32.916049 32767 raft_consensus.cc:359] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.916762 32767 raft_consensus.cc:385] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.917021 32767 raft_consensus.cc:740] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.917744 32767 consensus_queue.cc:260] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.920020 32767 ts_tablet_manager.cc:1434] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:32.921029 32767 tablet_bootstrap.cc:492] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134: Bootstrap starting.
I20260709 12:24:32.921303 32575 raft_consensus.cc:2468] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 1.
I20260709 12:24:32.919713 32472 catalog_manager.cc:5697] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 0 to 1, leader changed from <none> to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.922547 32689 leader_election.cc:304] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:32.923398   306 raft_consensus.cc:2804] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:32.923938   306 raft_consensus.cc:697] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:32.924814   306 consensus_queue.cc:237] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.926515 32767 tablet_bootstrap.cc:654] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.928093   338 leader_election.cc:290] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:32.929565 32472 catalog_manager.cc:5697] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 0 to 1, leader changed from <none> to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.934971 32766 tablet_bootstrap.cc:492] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79: No bootstrap required, opened a new log
I20260709 12:24:32.935498 32766 ts_tablet_manager.cc:1403] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79: Time spent bootstrapping tablet: real 0.179s	user 0.054s	sys 0.073s
I20260709 12:24:32.938269 32766 raft_consensus.cc:359] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.938956 32766 raft_consensus.cc:385] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.939203 32766 raft_consensus.cc:740] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.939838 32766 consensus_queue.cc:260] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.940639 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3898ad57ae3c441caf3d75c5ed15cc39" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:32.941486 32651 raft_consensus.cc:3060] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.941845 32766 ts_tablet_manager.cc:1434] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:24:32.942265   333 raft_consensus.cc:493] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.943883   333 raft_consensus.cc:515] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:32.944424 32766 tablet_bootstrap.cc:492] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79: Bootstrap starting.
I20260709 12:24:32.945436 32767 tablet_bootstrap.cc:492] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134: No bootstrap required, opened a new log
I20260709 12:24:32.946009 32767 ts_tablet_manager.cc:1403] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.007s
I20260709 12:24:32.942291 32650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:32.943074 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:32.947712 32576 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.949101 32767 raft_consensus.cc:359] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.949793 32767 raft_consensus.cc:385] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.950099 32767 raft_consensus.cc:740] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.932628   339 leader_election.cc:290] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:32.952358 32766 tablet_bootstrap.cc:654] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:32.954589 32689 leader_election.cc:343] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.955139 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:32.955931 32724 raft_consensus.cc:2393] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53755e1407fa4f059487bace5d6e8cb4 in current term 1: Already voted for candidate baa0f002917f4ff7b016742adb282d79 in this term.
I20260709 12:24:32.950052   333 leader_election.cc:290] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:32.962767 32651 raft_consensus.cc:2468] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 1.
I20260709 12:24:32.963162 32576 raft_consensus.cc:2468] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 1.
I20260709 12:24:32.965440 32767 consensus_queue.cc:260] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.967516 32689 leader_election.cc:304] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:32.968946 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:32.969489 32767 ts_tablet_manager.cc:1434] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:24:32.969871 32651 raft_consensus.cc:2393] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53755e1407fa4f059487bace5d6e8cb4 in current term 1: Already voted for candidate c72b6a0c70a14ed889f676786ef0e134 in this term.
I20260709 12:24:32.970551 32767 tablet_bootstrap.cc:492] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134: Bootstrap starting.
I20260709 12:24:32.971148 32539 leader_election.cc:304] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4; no voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:32.972151   339 raft_consensus.cc:2804] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:32.973515   339 raft_consensus.cc:697] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:32.976081   333 raft_consensus.cc:3060] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.974730   339 consensus_queue.cc:237] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:32.996999 32767 tablet_bootstrap.cc:654] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.998802 32766 tablet_bootstrap.cc:492] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79: No bootstrap required, opened a new log
I20260709 12:24:32.999264   333 raft_consensus.cc:2749] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.999534 32766 ts_tablet_manager.cc:1403] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.024s
I20260709 12:24:33.002990 32766 raft_consensus.cc:359] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.003845 32766 raft_consensus.cc:385] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:33.004192 32766 raft_consensus.cc:740] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Initialized, Role: FOLLOWER
I20260709 12:24:33.004907 32766 consensus_queue.cc:260] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.005339 32767 tablet_bootstrap.cc:492] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134: No bootstrap required, opened a new log
I20260709 12:24:33.005921 32767 ts_tablet_manager.cc:1403] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.008s
I20260709 12:24:33.006934 32766 ts_tablet_manager.cc:1434] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:24:33.007225 32472 catalog_manager.cc:5697] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:33.007951 32766 tablet_bootstrap.cc:492] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79: Bootstrap starting.
I20260709 12:24:33.008599 32767 raft_consensus.cc:359] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.009325 32767 raft_consensus.cc:385] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:33.008735 32472 catalog_manager.cc:5697] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:33.009613 32767 raft_consensus.cc:740] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Initialized, Role: FOLLOWER
I20260709 12:24:33.010437 32767 consensus_queue.cc:260] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.012562 32767 ts_tablet_manager.cc:1434] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:33.014369 32766 tablet_bootstrap.cc:654] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:33.018393 32766 tablet_bootstrap.cc:492] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79: No bootstrap required, opened a new log
I20260709 12:24:33.018857 32766 ts_tablet_manager.cc:1403] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:24:33.021590 32766 raft_consensus.cc:359] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.022243 32766 raft_consensus.cc:385] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:33.022506 32766 raft_consensus.cc:740] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Initialized, Role: FOLLOWER
I20260709 12:24:33.023162 32766 consensus_queue.cc:260] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.025202 32766 ts_tablet_manager.cc:1434] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:33.104825   333 raft_consensus.cc:493] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.105415   333 raft_consensus.cc:515] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.107194   333 leader_election.cc:290] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:33.108282 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defb984d3c644798ce8683daf85d896" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:33.108498 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defb984d3c644798ce8683daf85d896" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:33.109396 32724 raft_consensus.cc:2393] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53755e1407fa4f059487bace5d6e8cb4 in current term 1: Already voted for candidate c72b6a0c70a14ed889f676786ef0e134 in this term.
I20260709 12:24:33.110371 32539 leader_election.cc:304] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4; no voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:33.111052   333 raft_consensus.cc:3060] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.116344   333 raft_consensus.cc:2749] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:33.117630   339 raft_consensus.cc:493] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.118180   339 raft_consensus.cc:515] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.119895   331 consensus_queue.cc:1048] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:33.120326   339 leader_election.cc:290] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:33.121001 32575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
I20260709 12:24:33.121340 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:33.121724 32575 raft_consensus.cc:2468] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 0.
I20260709 12:24:33.122104 32651 raft_consensus.cc:2468] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 0.
I20260709 12:24:33.122859 32689 leader_election.cc:304] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:33.123697   339 raft_consensus.cc:2804] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:33.124122   339 raft_consensus.cc:493] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.124553   339 raft_consensus.cc:3060] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.127966   331 raft_consensus.cc:493] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.128517   331 raft_consensus.cc:515] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.130614   331 leader_election.cc:290] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:33.131932 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:33.132423 32575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
I20260709 12:24:33.133271 32575 raft_consensus.cc:2393] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c72b6a0c70a14ed889f676786ef0e134 in current term 1: Already voted for candidate baa0f002917f4ff7b016742adb282d79 in this term.
I20260709 12:24:33.135927   339 raft_consensus.cc:515] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.138550 32614 leader_election.cc:304] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c72b6a0c70a14ed889f676786ef0e134; no voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79
I20260709 12:24:33.138970   339 leader_election.cc:290] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:33.139760   321 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.139624   309 consensus_queue.cc:1048] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:33.141124 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:33.141770 32576 raft_consensus.cc:3060] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.143181 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:33.143818 32651 raft_consensus.cc:3060] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.146750   321 raft_consensus.cc:2749] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:33.149523 32576 raft_consensus.cc:2468] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 1.
I20260709 12:24:33.151122 32689 leader_election.cc:304] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:33.151845 32651 raft_consensus.cc:2468] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 1.
I20260709 12:24:33.152469   339 raft_consensus.cc:2804] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:33.154649   339 raft_consensus.cc:697] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:33.155339   339 consensus_queue.cc:237] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.164357 32473 catalog_manager.cc:5697] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:33.173604   333 raft_consensus.cc:493] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.174219   333 raft_consensus.cc:515] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.175980   333 leader_election.cc:290] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:33.176796 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7bc899c94245f18b8da19d76824cc4" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:33.177006 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7bc899c94245f18b8da19d76824cc4" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:33.177443 32651 raft_consensus.cc:2468] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53755e1407fa4f059487bace5d6e8cb4 in term 0.
I20260709 12:24:33.177666 32724 raft_consensus.cc:2468] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53755e1407fa4f059487bace5d6e8cb4 in term 0.
I20260709 12:24:33.178452 32539 leader_election.cc:304] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:33.179087   333 raft_consensus.cc:2804] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:33.179432   333 raft_consensus.cc:493] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.179719   333 raft_consensus.cc:3060] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.185176   333 raft_consensus.cc:515] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.186779   333 leader_election.cc:290] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 election: Requested vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:33.187587 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7bc899c94245f18b8da19d76824cc4" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:33.187853 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7bc899c94245f18b8da19d76824cc4" candidate_uuid: "53755e1407fa4f059487bace5d6e8cb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:33.188170 32651 raft_consensus.cc:3060] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.188539 32724 raft_consensus.cc:3060] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.193786 32651 raft_consensus.cc:2468] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53755e1407fa4f059487bace5d6e8cb4 in term 1.
I20260709 12:24:33.193787 32724 raft_consensus.cc:2468] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53755e1407fa4f059487bace5d6e8cb4 in term 1.
I20260709 12:24:33.195026 32539 leader_election.cc:304] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:33.195689   333 raft_consensus.cc:2804] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:33.196159   333 raft_consensus.cc:697] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 LEADER]: Becoming Leader. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Running, Role: LEADER
I20260709 12:24:33.196977   333 consensus_queue.cc:237] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:33.203769   321 consensus_queue.cc:1048] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.204722 32473 catalog_manager.cc:5697] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "53755e1407fa4f059487bace5d6e8cb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:33.213493   339 consensus_queue.cc:1048] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.213153 32724 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.223668   333 consensus_queue.cc:1048] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.229477   309 consensus_queue.cc:1048] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.233111   339 consensus_queue.cc:1048] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.248558   332 consensus_queue.cc:1048] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.306303 32724 raft_consensus.cc:3060] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.312577   309 consensus_queue.cc:1048] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.323464   309 consensus_queue.cc:1048] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.392597   339 consensus_queue.cc:1048] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.404253   339 consensus_queue.cc:1048] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:24:33.504424 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:33.583571   338 consensus_queue.cc:1048] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.591276   318 consensus_queue.cc:1048] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.650411   338 consensus_queue.cc:1048] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.651139   318 consensus_queue.cc:1048] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.667393   332 consensus_queue.cc:1048] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.683449   332 consensus_queue.cc:1048] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:24:34.506145 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:34.621196   318 raft_consensus.cc:493] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.621727   318 raft_consensus.cc:515] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:34.623358   318 leader_election.cc:290] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887)
I20260709 12:24:34.624192 32650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:34.624424 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4" is_pre_election: true
I20260709 12:24:34.624816 32650 raft_consensus.cc:2468] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 1.
I20260709 12:24:34.625111 32576 raft_consensus.cc:2468] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 1.
I20260709 12:24:34.626070 32689 leader_election.cc:304] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:34.626788   318 raft_consensus.cc:2804] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.627179   318 raft_consensus.cc:493] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.627480   318 raft_consensus.cc:3060] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.632596   318 raft_consensus.cc:515] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:34.634382   318 leader_election.cc:290] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 election: Requested vote from peers c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079), 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887)
I20260709 12:24:34.635318 32650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:34.635545 32576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee147b0d9961498783fda1e20a5254bf" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:34.635910 32650 raft_consensus.cc:3060] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.636157 32576 raft_consensus.cc:3060] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.641494 32576 raft_consensus.cc:2468] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 2.
I20260709 12:24:34.641932 32650 raft_consensus.cc:2468] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 2.
I20260709 12:24:34.642593 32689 leader_election.cc:304] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:34.643311   318 raft_consensus.cc:2804] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:34.643733   318 raft_consensus.cc:697] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:34.644366   318 consensus_queue.cc:237] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:34.651353 32472 catalog_manager.cc:5697] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 0 to 2, leader changed from <none> to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.109229 32650 raft_consensus.cc:1275] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:35.110730   318 consensus_queue.cc:1048] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:35.121861 32576 raft_consensus.cc:1275] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:35.124032   390 consensus_queue.cc:1048] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:35.268339 22701 ts_manager.cc:295] Set tserver state for 53755e1407fa4f059487bace5d6e8cb4 to MAINTENANCE_MODE
I20260709 12:24:35.269152 22701 tablet_server.cc:179] TabletServer@127.22.43.65:0 shutting down...
I20260709 12:24:35.293926 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:35.294627 22701 tablet_replica.cc:333] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4: stopping tablet replica
I20260709 12:24:35.295224 22701 raft_consensus.cc:2243] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:35.296041 22701 raft_consensus.cc:2272] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:35.298228 22701 tablet_replica.cc:333] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4: stopping tablet replica
I20260709 12:24:35.298803 22701 raft_consensus.cc:2243] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:35.299204 22701 raft_consensus.cc:2272] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:35.301156 22701 tablet_replica.cc:333] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4: stopping tablet replica
I20260709 12:24:35.301762 22701 raft_consensus.cc:2243] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:35.302299 22701 raft_consensus.cc:2272] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:35.304924 22701 tablet_replica.cc:333] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4: stopping tablet replica
I20260709 12:24:35.305475 22701 raft_consensus.cc:2243] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:35.306315 22701 raft_consensus.cc:2272] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:35.308178 22701 tablet_replica.cc:333] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4: stopping tablet replica
I20260709 12:24:35.308667 22701 raft_consensus.cc:2243] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:35.309036 22701 raft_consensus.cc:2272] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:35.311029 22701 tablet_replica.cc:333] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4: stopping tablet replica
I20260709 12:24:35.311609 22701 raft_consensus.cc:2243] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:35.312042 22701 raft_consensus.cc:2272] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:35.313868 22701 tablet_replica.cc:333] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4: stopping tablet replica
I20260709 12:24:35.314476 22701 raft_consensus.cc:2243] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:35.314913 22701 raft_consensus.cc:2272] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:35.316768 22701 tablet_replica.cc:333] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4: stopping tablet replica
I20260709 12:24:35.317313 22701 raft_consensus.cc:2243] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:35.317744 22701 raft_consensus.cc:2272] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:35.319610 22701 tablet_replica.cc:333] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4: stopping tablet replica
I20260709 12:24:35.320139 22701 raft_consensus.cc:2243] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:35.320576 22701 raft_consensus.cc:2272] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:35.322463 22701 tablet_replica.cc:333] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4: stopping tablet replica
I20260709 12:24:35.322958 22701 raft_consensus.cc:2243] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:35.323395 22701 raft_consensus.cc:2272] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:35.352169 22701 tablet_server.cc:196] TabletServer@127.22.43.65:0 shutdown complete.
W20260709 12:24:35.507186 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:24:35.516875 32614 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111) [suppressed 164 similar messages]
W20260709 12:24:35.520735 32614 consensus_peers.cc:597] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:35.548436 32689 consensus_peers.cc:597] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:35.557250 32689 consensus_peers.cc:597] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:35.581257 32614 consensus_peers.cc:597] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:35.602767 32689 consensus_peers.cc:597] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:35.664577 32689 consensus_peers.cc:597] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:35.710224 32614 consensus_peers.cc:597] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:35.742715 32689 consensus_peers.cc:597] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:36.493863   405 raft_consensus.cc:493] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 53755e1407fa4f059487bace5d6e8cb4)
I20260709 12:24:36.494448   405 raft_consensus.cc:515] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:36.496275   405 leader_election.cc:290] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:36.498126 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7bc899c94245f18b8da19d76824cc4" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
W20260709 12:24:36.500121 32614 leader_election.cc:336] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111)
I20260709 12:24:36.500581 32614 leader_election.cc:304] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c72b6a0c70a14ed889f676786ef0e134; no voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79
I20260709 12:24:36.501375   405 raft_consensus.cc:2749] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:36.508198 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:24:36.660212   403 raft_consensus.cc:493] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 53755e1407fa4f059487bace5d6e8cb4)
I20260709 12:24:36.660964   403 raft_consensus.cc:515] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:36.663084   403 leader_election.cc:290] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:36.665112 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7bc899c94245f18b8da19d76824cc4" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
I20260709 12:24:36.665967 32651 raft_consensus.cc:2468] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 1.
I20260709 12:24:36.667037 32689 leader_election.cc:304] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:36.667734   403 raft_consensus.cc:2804] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:36.667769 32689 leader_election.cc:336] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111)
I20260709 12:24:36.668063   403 raft_consensus.cc:493] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 53755e1407fa4f059487bace5d6e8cb4)
I20260709 12:24:36.668509   403 raft_consensus.cc:3060] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.673583   403 raft_consensus.cc:515] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:36.675191   403 leader_election.cc:290] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:36.676822 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7bc899c94245f18b8da19d76824cc4" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:36.677556 32651 raft_consensus.cc:3060] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:36.678992 32689 leader_election.cc:336] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111)
I20260709 12:24:36.682940 32651 raft_consensus.cc:2468] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 2.
I20260709 12:24:36.683938 32689 leader_election.cc:304] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134; no voters: 53755e1407fa4f059487bace5d6e8cb4
I20260709 12:24:36.684672   403 raft_consensus.cc:2804] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:36.685127   403 raft_consensus.cc:697] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:36.685817   403 consensus_queue.cc:237] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:36.694877 32470 catalog_manager.cc:5697] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 1 to 2, leader changed from 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65) to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:36.703972   403 raft_consensus.cc:493] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 53755e1407fa4f059487bace5d6e8cb4)
I20260709 12:24:36.704690   403 raft_consensus.cc:515] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:36.706916   403 leader_election.cc:290] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:36.708639 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c72b6a0c70a14ed889f676786ef0e134" is_pre_election: true
W20260709 12:24:36.710949 32689 leader_election.cc:336] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111)
I20260709 12:24:36.711391 32689 leader_election.cc:304] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa0f002917f4ff7b016742adb282d79; no voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:36.712087   403 raft_consensus.cc:2749] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.782501   331 raft_consensus.cc:493] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 53755e1407fa4f059487bace5d6e8cb4)
I20260709 12:24:36.783139   331 raft_consensus.cc:515] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:36.785159   331 leader_election.cc:290] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:36.786993 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79" is_pre_election: true
I20260709 12:24:36.787729 32724 raft_consensus.cc:2468] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 1.
I20260709 12:24:36.788755 32614 leader_election.cc:304] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:36.789484   331 raft_consensus.cc:2804] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:36.789479 32614 leader_election.cc:336] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111)
I20260709 12:24:36.789933   331 raft_consensus.cc:493] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 53755e1407fa4f059487bace5d6e8cb4)
I20260709 12:24:36.790416   331 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.796100   331 raft_consensus.cc:515] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:36.797849   331 leader_election.cc:290] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:36.799660 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:36.800365 32724 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:36.802102 32614 leader_election.cc:336] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111)
I20260709 12:24:36.807437 32724 raft_consensus.cc:2468] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 2.
I20260709 12:24:36.808509 32614 leader_election.cc:304] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134; no voters: 53755e1407fa4f059487bace5d6e8cb4
I20260709 12:24:36.809204   331 raft_consensus.cc:2804] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:36.809576   331 raft_consensus.cc:697] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:36.810334   331 consensus_queue.cc:237] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:36.821538 32470 catalog_manager.cc:5697] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 1 to 2, leader changed from 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65) to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.145498 32651 raft_consensus.cc:1275] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:37.147074   338 consensus_queue.cc:1048] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:37.149780 32689 consensus_peers.cc:597] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:37.217190 32614 consensus_peers.cc:597] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:37.344245 32724 raft_consensus.cc:1275] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:37.345675   331 consensus_queue.cc:1048] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:37.510294 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:24:38.017956 32689 consensus_peers.cc:597] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:38.110561 32614 consensus_peers.cc:597] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:38.139636 32689 consensus_peers.cc:597] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:38.223585 32614 consensus_peers.cc:597] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:38.252964 32689 consensus_peers.cc:597] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:38.256814 32614 consensus_peers.cc:597] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:38.281672 32689 consensus_peers.cc:597] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:38.374878 32689 consensus_peers.cc:597] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:38.511566 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:24:39.512671 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:24:39.568691 32614 consensus_peers.cc:597] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:39.605170 32689 consensus_peers.cc:597] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:40.372097 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:40.380556   424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:40.384806   425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:40.390031 22701 server_base.cc:1061] running on GCE node
W20260709 12:24:40.390863   427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:40.392351 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:40.392606 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:40.392797 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599880392782 us; error 0 us; skew 500 ppm
I20260709 12:24:40.393514 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:40.396559 22701 webserver.cc:533] Webserver started at http://127.22.43.65:34933/ using document root <none> and password file <none>
I20260709 12:24:40.397241 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:40.397466 22701 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:24:40.402099 22701 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:24:40.406884   432 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:40.407712 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.003s
I20260709 12:24:40.408071 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-0-root
uuid: "53755e1407fa4f059487bace5d6e8cb4"
format_stamp: "Formatted at 2026-07-09 12:24:31 on dist-test-slave-0768"
I20260709 12:24:40.408509 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599526815862-22701-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:40.435611 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:40.436928 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:40.438570 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:40.442644   440 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:24:40.495751 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:24:40.496024 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.055s	user 0.000s	sys 0.003s
I20260709 12:24:40.496269 22701 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:24:40.502156   440 tablet_bootstrap.cc:492] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
W20260709 12:24:40.513581 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:24:40.519738   440 tablet_bootstrap.cc:492] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.520787   440 tablet_bootstrap.cc:492] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap complete.
I20260709 12:24:40.521473   440 ts_tablet_manager.cc:1403] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 12:24:40.524612   440 raft_consensus.cc:359] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.525643   440 raft_consensus.cc:740] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.526453   440 consensus_queue.cc:260] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.529378   440 ts_tablet_manager.cc:1434] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.002s
I20260709 12:24:40.530238   440 tablet_bootstrap.cc:492] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:40.545128   440 tablet_bootstrap.cc:492] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.545946   440 tablet_bootstrap.cc:492] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap complete.
I20260709 12:24:40.546499   440 ts_tablet_manager.cc:1403] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:24:40.548542   440 raft_consensus.cc:359] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.549067   440 raft_consensus.cc:740] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.549640   440 consensus_queue.cc:260] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.551215   440 ts_tablet_manager.cc:1434] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:24:40.551884   440 tablet_bootstrap.cc:492] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:40.552251 22701 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:24:40.552590 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.056s	user 0.042s	sys 0.012s
I20260709 12:24:40.565491   440 tablet_bootstrap.cc:492] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.566447   440 tablet_bootstrap.cc:492] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap complete.
I20260709 12:24:40.567209   440 ts_tablet_manager.cc:1403] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:24:40.569494   440 raft_consensus.cc:359] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.570124   440 raft_consensus.cc:740] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.570811   440 consensus_queue.cc:260] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.572944   440 ts_tablet_manager.cc:1434] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:24:40.573746   440 tablet_bootstrap.cc:492] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
W20260709 12:24:40.574331 32689 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111) [suppressed 100 similar messages]
W20260709 12:24:40.577665 32689 consensus_peers.cc:597] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:40.587885   440 tablet_bootstrap.cc:492] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.588742   440 tablet_bootstrap.cc:492] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap complete.
I20260709 12:24:40.589452   440 ts_tablet_manager.cc:1403] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:24:40.591862   440 raft_consensus.cc:359] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:40.592530   440 raft_consensus.cc:740] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.593194   440 consensus_queue.cc:260] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } }
I20260709 12:24:40.594762   440 ts_tablet_manager.cc:1434] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:24:40.595439   440 tablet_bootstrap.cc:492] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:40.611416   440 tablet_bootstrap.cc:492] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.612535   440 tablet_bootstrap.cc:492] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap complete.
I20260709 12:24:40.613346   440 ts_tablet_manager.cc:1403] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 12:24:40.614037 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.65:32887
I20260709 12:24:40.614172   502 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.65:32887 every 8 connection(s)
I20260709 12:24:40.616276   440 raft_consensus.cc:359] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.617048   440 raft_consensus.cc:740] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.617903   440 consensus_queue.cc:260] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.619828   440 ts_tablet_manager.cc:1434] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.004s
I20260709 12:24:40.620031 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:40.620771   440 tablet_bootstrap.cc:492] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:40.640280   503 heartbeater.cc:344] Connected to a master server at 127.22.43.126:35239
I20260709 12:24:40.640985   503 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:40.642272   503 heartbeater.cc:507] Master 127.22.43.126:35239 requested a full tablet report, sending...
I20260709 12:24:40.652427 32470 ts_manager.cc:194] Re-registered known tserver with Master: 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887)
I20260709 12:24:40.660847   440 tablet_bootstrap.cc:492] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.661969   440 tablet_bootstrap.cc:492] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap complete.
I20260709 12:24:40.662688   440 ts_tablet_manager.cc:1403] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.016s
I20260709 12:24:40.666440 32470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48982
I20260709 12:24:40.666683   440 raft_consensus.cc:359] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.667516   440 raft_consensus.cc:740] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.667737 32724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
mode: GRACEFUL
new_leader_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:54010
I20260709 12:24:40.668737 32724 raft_consensus.cc:606] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Received request to transfer leadership to TS c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:40.668408   440 consensus_queue.cc:260] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.670684   440 ts_tablet_manager.cc:1434] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:40.670997   503 heartbeater.cc:499] Master 127.22.43.126:35239 was elected leader, sending a full tablet report...
I20260709 12:24:40.671598   440 tablet_bootstrap.cc:492] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:40.688068 32651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
mode: GRACEFUL
new_leader_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:50622
I20260709 12:24:40.688730 32651 raft_consensus.cc:606] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Received request to transfer leadership to TS baa0f002917f4ff7b016742adb282d79
I20260709 12:24:40.693269 32724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1ad632c91f14429895340f24716d0ac"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
mode: GRACEFUL
new_leader_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:54010
I20260709 12:24:40.694460 32724 raft_consensus.cc:606] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Received request to transfer leadership to TS c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:40.697597 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:40.698377 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:40.699231 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:40.713928   440 tablet_bootstrap.cc:492] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:24:40.714691 32689 consensus_peers.cc:597] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:40.715023   440 tablet_bootstrap.cc:492] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap complete.
W20260709 12:24:40.715560 32689 consensus_peers.cc:597] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:40.717861   440 ts_tablet_manager.cc:1403] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.046s	user 0.037s	sys 0.004s
I20260709 12:24:40.720566   440 raft_consensus.cc:359] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.721246   440 raft_consensus.cc:740] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.721992   440 consensus_queue.cc:260] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
W20260709 12:24:40.724040 32614 consensus_peers.cc:597] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:40.724099   440 ts_tablet_manager.cc:1434] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:40.724967   440 tablet_bootstrap.cc:492] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:40.730388   476 raft_consensus.cc:3060] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.740957   440 tablet_bootstrap.cc:492] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.742245   440 tablet_bootstrap.cc:492] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap complete.
I20260709 12:24:40.743049   440 ts_tablet_manager.cc:1403] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:24:40.745460   440 raft_consensus.cc:359] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.746003   440 raft_consensus.cc:740] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.746634   440 consensus_queue.cc:260] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.748648   440 ts_tablet_manager.cc:1434] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:24:40.749429   440 tablet_bootstrap.cc:492] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:40.763492   440 tablet_bootstrap.cc:492] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.764189   440 tablet_bootstrap.cc:492] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap complete.
I20260709 12:24:40.764652   440 ts_tablet_manager.cc:1403] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:24:40.766424   440 raft_consensus.cc:359] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.766870   440 raft_consensus.cc:740] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.767438   440 consensus_queue.cc:260] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.769220   440 ts_tablet_manager.cc:1434] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:24:40.770152   440 tablet_bootstrap.cc:492] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap starting.
I20260709 12:24:40.783453   440 tablet_bootstrap.cc:492] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.784379   440 tablet_bootstrap.cc:492] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4: Bootstrap complete.
I20260709 12:24:40.785033   440 ts_tablet_manager.cc:1403] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:24:40.787320   440 raft_consensus.cc:359] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.787799   440 raft_consensus.cc:740] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53755e1407fa4f059487bace5d6e8cb4, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.788288   440 consensus_queue.cc:260] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.789839   440 ts_tablet_manager.cc:1434] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:40.794482   421 raft_consensus.cc:993] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79: : Instructing follower c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:40.795125   437 raft_consensus.cc:1081] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Signalling peer c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:40.796845 32651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1ad632c91f14429895340f24716d0ac"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:52700
I20260709 12:24:40.797416 32651 raft_consensus.cc:493] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:40.797768 32651 raft_consensus.cc:3060] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.804921 32651 raft_consensus.cc:515] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.806703 32651 leader_election.cc:290] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:40.807704   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ad632c91f14429895340f24716d0ac" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:40.807713 32724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ad632c91f14429895340f24716d0ac" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:40.808696   476 raft_consensus.cc:3060] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.808768 32724 raft_consensus.cc:3055] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:40.809227 32724 raft_consensus.cc:740] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:40.810345 32724 consensus_queue.cc:260] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.811765   421 raft_consensus.cc:993] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79: : Instructing follower c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:40.811918 32724 raft_consensus.cc:3060] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.812340   437 raft_consensus.cc:1081] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Signalling peer c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:40.813910 32651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:52700
I20260709 12:24:40.814492 32651 raft_consensus.cc:493] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:40.814920 32651 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.819623   476 raft_consensus.cc:2468] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 2.
I20260709 12:24:40.820911 32614 leader_election.cc:304] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:40.821858   423 raft_consensus.cc:2804] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:40.823330   423 raft_consensus.cc:697] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:40.824457   423 consensus_queue.cc:237] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.825135 32651 raft_consensus.cc:515] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.827149 32651 leader_election.cc:290] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:40.828370 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:40.828939 32725 raft_consensus.cc:3055] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:40.829193 32725 raft_consensus.cc:740] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:40.821445 32724 raft_consensus.cc:2468] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 2.
I20260709 12:24:40.829955 32725 consensus_queue.cc:260] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.827914   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:40.831430 32725 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.831712   476 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.839676 32725 raft_consensus.cc:2468] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 2.
I20260709 12:24:40.841029 32614 leader_election.cc:304] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baa0f002917f4ff7b016742adb282d79, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:40.841974   423 raft_consensus.cc:2804] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:40.841846   476 raft_consensus.cc:2468] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 2.
I20260709 12:24:40.842648   423 raft_consensus.cc:697] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:40.843679   423 consensus_queue.cc:237] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.844094 32470 catalog_manager.cc:5697] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 1 to 2, leader changed from baa0f002917f4ff7b016742adb282d79 (127.22.43.67) to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.860589 32470 catalog_manager.cc:5697] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 1 to 2, leader changed from baa0f002917f4ff7b016742adb282d79 (127.22.43.67) to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.867421   476 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.950348   520 raft_consensus.cc:993] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134: : Instructing follower baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:40.950920   520 raft_consensus.cc:1081] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Signalling peer baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:40.952612 32725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:60034
I20260709 12:24:40.953161 32725 raft_consensus.cc:493] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:40.953511 32725 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.958709 32725 raft_consensus.cc:515] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.960312 32725 leader_election.cc:290] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:40.961362   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:40.961380 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:40.962040   475 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.962149 32651 raft_consensus.cc:3055] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:40.962570 32651 raft_consensus.cc:740] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:40.963363 32651 consensus_queue.cc:260] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.964386 32651 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.968048   475 raft_consensus.cc:2468] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 2.
I20260709 12:24:40.969169 32689 leader_election.cc:304] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:40.969846   437 raft_consensus.cc:2804] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:40.970059 32651 raft_consensus.cc:2468] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 2.
I20260709 12:24:40.970439   437 raft_consensus.cc:697] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:40.971935   437 consensus_queue.cc:237] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:40.978865 32470 catalog_manager.cc:5697] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 1 to 2, leader changed from c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66) to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:41.347941   475 raft_consensus.cc:1275] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:41.349423   520 consensus_queue.cc:1048] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:41.363227 32725 raft_consensus.cc:1275] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:41.364606   520 consensus_queue.cc:1048] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:41.376094 32725 raft_consensus.cc:1275] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:41.377489   520 consensus_queue.cc:1048] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:41.387576   475 raft_consensus.cc:1275] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:41.389065   520 consensus_queue.cc:1048] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:41.514642 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:24:41.558955 32651 raft_consensus.cc:1275] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:41.560326   529 consensus_queue.cc:1048] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:41.569705   475 raft_consensus.cc:1275] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:41.571703   421 consensus_queue.cc:1048] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:41.711457 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:41.718649 32651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
mode: GRACEFUL
new_leader_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:50622
I20260709 12:24:41.719326 32651 raft_consensus.cc:606] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Received request to transfer leadership to TS baa0f002917f4ff7b016742adb282d79
I20260709 12:24:41.722033 32651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
mode: GRACEFUL
new_leader_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:50622
I20260709 12:24:41.722492 32651 raft_consensus.cc:606] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Received request to transfer leadership to TS baa0f002917f4ff7b016742adb282d79
I20260709 12:24:41.724763 32725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
mode: GRACEFUL
new_leader_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:54010
I20260709 12:24:41.725298 32725 raft_consensus.cc:606] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Received request to transfer leadership to TS c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:41.726425 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:41.727070 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:41.727677 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:41.860668   423 raft_consensus.cc:993] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134: : Instructing follower baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:41.861259   520 raft_consensus.cc:1081] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Signalling peer baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:41.863126 32725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:60034
I20260709 12:24:41.863811 32725 raft_consensus.cc:493] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:41.864269 32725 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.871204 32725 raft_consensus.cc:515] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:41.873086 32725 leader_election.cc:290] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 3 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:41.873778   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:41.874202 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:41.874493   475 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.874801 32651 raft_consensus.cc:3055] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:41.875098 32651 raft_consensus.cc:740] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:41.875918 32651 consensus_queue.cc:260] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:41.877200 32651 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.882038   475 raft_consensus.cc:2468] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 3.
I20260709 12:24:41.883301 32689 leader_election.cc:304] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:41.884125   529 raft_consensus.cc:2804] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:41.884625   529 raft_consensus.cc:697] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:41.884706 32651 raft_consensus.cc:2468] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 3.
I20260709 12:24:41.885779   529 consensus_queue.cc:237] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:41.892823 32472 catalog_manager.cc:5697] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 2 to 3, leader changed from c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66) to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 3 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:42.004617   532 raft_consensus.cc:993] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134: : Instructing follower baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:42.005067   520 raft_consensus.cc:1081] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Signalling peer baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:42.006531 32725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:60034
I20260709 12:24:42.007083 32725 raft_consensus.cc:493] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.007449 32725 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.013164 32725 raft_consensus.cc:515] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.014827 32725 leader_election.cc:290] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 3 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:42.015580   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:42.015913 32650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:42.016253   475 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.016513 32650 raft_consensus.cc:3055] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:42.016875 32650 raft_consensus.cc:740] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:42.017537 32650 consensus_queue.cc:260] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.018641 32650 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.021601   475 raft_consensus.cc:2468] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 3.
I20260709 12:24:42.022797 32689 leader_election.cc:304] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:42.023556   529 raft_consensus.cc:2804] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:42.023976   529 raft_consensus.cc:697] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:42.024783   529 consensus_queue.cc:237] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.025189 32650 raft_consensus.cc:2468] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 3.
I20260709 12:24:42.031087 32472 catalog_manager.cc:5697] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 2 to 3, leader changed from c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66) to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 3 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:42.195523   421 raft_consensus.cc:993] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79: : Instructing follower c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:42.196015   529 raft_consensus.cc:1081] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Signalling peer c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:42.197449 32650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:52700
I20260709 12:24:42.197907 32650 raft_consensus.cc:493] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.198199 32650 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.204238 32650 raft_consensus.cc:515] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.206198 32650 leader_election.cc:290] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 3 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:42.206979   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:42.207260 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:42.207659   475 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.207826 32725 raft_consensus.cc:3055] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:42.208226 32725 raft_consensus.cc:740] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:42.209038 32725 consensus_queue.cc:260] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.210352 32725 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.215075   475 raft_consensus.cc:2468] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 3.
I20260709 12:24:42.216207 32614 leader_election.cc:304] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:42.216938   520 raft_consensus.cc:2804] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:42.217384   520 raft_consensus.cc:697] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 3 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:42.217536 32725 raft_consensus.cc:2468] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 3.
I20260709 12:24:42.218250   520 consensus_queue.cc:237] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.225101 32472 catalog_manager.cc:5697] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 2 to 3, leader changed from baa0f002917f4ff7b016742adb282d79 (127.22.43.67) to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.400846   475 raft_consensus.cc:1275] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:42.403606   421 consensus_queue.cc:1048] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:42.418515 32650 raft_consensus.cc:1275] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:42.420298   529 consensus_queue.cc:1048] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:42.430809 32651 raft_consensus.cc:1275] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:42.432173   529 consensus_queue.cc:1048] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:42.442116   476 raft_consensus.cc:1275] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:42.443838   421 consensus_queue.cc:1048] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:42.515661 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:24:42.701331 32725 raft_consensus.cc:1275] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:42.702899   520 consensus_queue.cc:1048] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:42.712245   475 raft_consensus.cc:1275] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:42.713706   520 consensus_queue.cc:1048] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:42.735953 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:42.743036 32651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
mode: GRACEFUL
new_leader_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:50622
I20260709 12:24:42.743533 32651 raft_consensus.cc:606] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Received request to transfer leadership to TS baa0f002917f4ff7b016742adb282d79
I20260709 12:24:42.745823 32725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
mode: GRACEFUL
new_leader_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:54010
I20260709 12:24:42.746430 32725 raft_consensus.cc:606] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Received request to transfer leadership to TS c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:42.748754 32725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
mode: GRACEFUL
new_leader_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:54010
I20260709 12:24:42.749321 32725 raft_consensus.cc:606] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Received request to transfer leadership to TS c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:42.750458 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:42.750946 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:42.751495 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:42.930477   437 raft_consensus.cc:993] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79: : Instructing follower c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:42.930992   529 raft_consensus.cc:1081] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Signalling peer c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:42.932627 32651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:52700
I20260709 12:24:42.933233 32651 raft_consensus.cc:493] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.933615 32651 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.938804 32651 raft_consensus.cc:515] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.940361 32651 leader_election.cc:290] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 4 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:42.941248   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:42.941824   475 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.941553 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baf2f940a9f4c40ba334c03d8ac3ee3" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:42.942396 32725 raft_consensus.cc:3055] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:42.942657 32725 raft_consensus.cc:740] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:42.943480 32725 consensus_queue.cc:260] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.945152 32725 raft_consensus.cc:3060] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.949923   475 raft_consensus.cc:2468] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 4.
I20260709 12:24:42.951390 32614 leader_election.cc:304] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:42.952128   520 raft_consensus.cc:2804] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:42.952610   520 raft_consensus.cc:697] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 4 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:42.953411   520 consensus_queue.cc:237] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.955327 32725 raft_consensus.cc:2468] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 4.
I20260709 12:24:42.955772   554 raft_consensus.cc:993] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134: : Instructing follower baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:42.956334   532 raft_consensus.cc:1081] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Signalling peer baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:42.958179 32725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:60034
I20260709 12:24:42.958732 32725 raft_consensus.cc:493] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.959170 32725 raft_consensus.cc:3060] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.960604 32472 catalog_manager.cc:5697] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 3 to 4, leader changed from baa0f002917f4ff7b016742adb282d79 (127.22.43.67) to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 4 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.965627 32725 raft_consensus.cc:515] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.967763 32725 leader_election.cc:290] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:42.968645   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:42.968813 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:42.969483   475 raft_consensus.cc:3060] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.969581 32651 raft_consensus.cc:3055] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:42.970055 32651 raft_consensus.cc:740] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:42.970947 32651 consensus_queue.cc:260] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.972396 32651 raft_consensus.cc:3060] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.975663   475 raft_consensus.cc:2468] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 2.
I20260709 12:24:42.976902 32689 leader_election.cc:304] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:42.977669   529 raft_consensus.cc:2804] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:42.978214   529 raft_consensus.cc:697] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:42.978590 32651 raft_consensus.cc:2468] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 2.
I20260709 12:24:42.979106   529 consensus_queue.cc:237] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:42.986850 32472 catalog_manager.cc:5697] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 1 to 2, leader changed from c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66) to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:43.089583   437 raft_consensus.cc:993] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79: : Instructing follower c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:43.090132   529 raft_consensus.cc:1081] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Signalling peer c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:43.091488 32651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:52700
I20260709 12:24:43.092008 32651 raft_consensus.cc:493] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:43.092239 32651 raft_consensus.cc:3060] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:43.097095 32651 raft_consensus.cc:515] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:43.098519 32651 leader_election.cc:290] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:43.099267   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:43.099939   475 raft_consensus.cc:3060] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:43.099906 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:43.100749 32725 raft_consensus.cc:3055] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:43.101082 32725 raft_consensus.cc:740] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:43.102072 32725 consensus_queue.cc:260] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:43.103442 32725 raft_consensus.cc:3060] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:43.107880   475 raft_consensus.cc:2468] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 2.
I20260709 12:24:43.109244 32614 leader_election.cc:304] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:43.110163   520 raft_consensus.cc:2804] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:43.110589   520 raft_consensus.cc:697] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:43.110940 32725 raft_consensus.cc:2468] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 2.
I20260709 12:24:43.111491   520 consensus_queue.cc:237] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:43.119227 32472 catalog_manager.cc:5697] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 1 to 2, leader changed from baa0f002917f4ff7b016742adb282d79 (127.22.43.67) to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.372187   475 raft_consensus.cc:1275] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:43.373502   520 consensus_queue.cc:1048] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:43.383082 32725 raft_consensus.cc:1275] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 4 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:43.385425   520 consensus_queue.cc:1048] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:43.498363 32651 raft_consensus.cc:1275] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:43.499606   529 consensus_queue.cc:1048] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:43.511931   475 raft_consensus.cc:1275] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:43.513780   567 consensus_queue.cc:1048] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:43.516736 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:24:43.541028   475 raft_consensus.cc:1275] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:43.542410   520 consensus_queue.cc:1048] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:43.552969 32725 raft_consensus.cc:1275] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:43.554901   532 consensus_queue.cc:1048] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:43.757735 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:43.766232 32725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
mode: GRACEFUL
new_leader_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:54010
I20260709 12:24:43.766821 32725 raft_consensus.cc:606] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Received request to transfer leadership to TS c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:43.769549 32651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6defb984d3c644798ce8683daf85d896"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
mode: GRACEFUL
new_leader_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:50622
I20260709 12:24:43.770048 32651 raft_consensus.cc:606] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Received request to transfer leadership to TS baa0f002917f4ff7b016742adb282d79
I20260709 12:24:43.772408 32651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
mode: GRACEFUL
new_leader_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:50622
I20260709 12:24:43.772836 32651 raft_consensus.cc:606] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Received request to transfer leadership to TS baa0f002917f4ff7b016742adb282d79
I20260709 12:24:43.773809 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:43.774384 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:43.774973 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:43.975320   566 raft_consensus.cc:993] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79: : Instructing follower c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:43.975778   567 raft_consensus.cc:1081] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Signalling peer c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:43.977180 32651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:52700
I20260709 12:24:43.977720 32651 raft_consensus.cc:493] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:43.978021 32651 raft_consensus.cc:3060] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:43.982730 32651 raft_consensus.cc:515] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:43.984299 32651 leader_election.cc:290] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 3 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:43.985217   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:43.985240 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24556c0c1c444490b9fe3e5baa831ada" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:43.986133   475 raft_consensus.cc:3060] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:43.986239 32725 raft_consensus.cc:3055] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:43.986686 32725 raft_consensus.cc:740] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:43.987392 32725 consensus_queue.cc:260] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:43.988361 32725 raft_consensus.cc:3060] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:43.991575   475 raft_consensus.cc:2468] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 3.
I20260709 12:24:43.992672 32614 leader_election.cc:304] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:43.993330   520 raft_consensus.cc:2804] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:43.993613 32725 raft_consensus.cc:2468] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 3.
I20260709 12:24:43.993854   520 raft_consensus.cc:697] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 3 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:43.994845   520 consensus_queue.cc:237] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:44.001649 32470 catalog_manager.cc:5697] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 2 to 3, leader changed from baa0f002917f4ff7b016742adb282d79 (127.22.43.67) to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:44.010784   532 raft_consensus.cc:993] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134: : Instructing follower baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:44.011314   520 raft_consensus.cc:1081] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Signalling peer baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:44.012950 32725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6defb984d3c644798ce8683daf85d896"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:60034
I20260709 12:24:44.013525 32725 raft_consensus.cc:493] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:44.013953 32725 raft_consensus.cc:3060] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:44.019539 32725 raft_consensus.cc:515] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:44.021436 32725 leader_election.cc:290] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:44.022199   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defb984d3c644798ce8683daf85d896" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:44.022464 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defb984d3c644798ce8683daf85d896" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:44.023000   475 raft_consensus.cc:3060] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:44.023039 32651 raft_consensus.cc:3055] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:44.023527 32651 raft_consensus.cc:740] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:44.024164 32651 consensus_queue.cc:260] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:44.025098 32651 raft_consensus.cc:3060] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:44.028340   475 raft_consensus.cc:2468] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 2.
I20260709 12:24:44.029364 32689 leader_election.cc:304] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:44.029873 32651 raft_consensus.cc:2468] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 2.
I20260709 12:24:44.030200   567 raft_consensus.cc:2804] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:44.030799   567 raft_consensus.cc:697] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:44.031677   567 consensus_queue.cc:237] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:44.039047 32470 catalog_manager.cc:5697] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 1 to 2, leader changed from c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66) to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:44.184043   554 raft_consensus.cc:993] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134: : Instructing follower baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:44.184631   554 raft_consensus.cc:1081] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Signalling peer baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:44.186498 32725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:60034
I20260709 12:24:44.187053 32725 raft_consensus.cc:493] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:44.187388 32725 raft_consensus.cc:3060] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.192245 32725 raft_consensus.cc:515] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:44.193781 32725 leader_election.cc:290] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 3 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:44.194661   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:44.194782 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ac5633b794425be2031f182f7cd0e" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:44.195340   475 raft_consensus.cc:3060] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.195427 32651 raft_consensus.cc:3055] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:44.195832 32651 raft_consensus.cc:740] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:44.196426 32651 consensus_queue.cc:260] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:44.197330 32651 raft_consensus.cc:3060] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.200671   475 raft_consensus.cc:2468] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 3.
I20260709 12:24:44.202136 32651 raft_consensus.cc:2468] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 3.
I20260709 12:24:44.202109 32689 leader_election.cc:304] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:44.203369   567 raft_consensus.cc:2804] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:44.203853   567 raft_consensus.cc:697] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:44.204697   567 consensus_queue.cc:237] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:44.210559 32470 catalog_manager.cc:5697] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 2 to 3, leader changed from c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66) to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 3 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:44.465979   476 raft_consensus.cc:1275] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:44.467324   567 consensus_queue.cc:1048] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:44.479476 32651 raft_consensus.cc:1275] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:44.483088   566 consensus_queue.cc:1048] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:44.488008 32725 raft_consensus.cc:1275] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:44.489435   520 consensus_queue.cc:1048] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:44.500252   476 raft_consensus.cc:1275] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:44.503170   520 consensus_queue.cc:1048] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:44.517788 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:24:44.711367   476 raft_consensus.cc:1275] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:44.712651   567 consensus_queue.cc:1048] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:44.723508 32651 raft_consensus.cc:1275] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:44.724886   579 consensus_queue.cc:1048] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:44.781599 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:44.789166 32725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
mode: GRACEFUL
new_leader_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:54010
I20260709 12:24:44.789664 32725 raft_consensus.cc:606] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Received request to transfer leadership to TS c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:44.792336 32725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6defb984d3c644798ce8683daf85d896"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
mode: GRACEFUL
new_leader_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:54010
I20260709 12:24:44.792770 32725 raft_consensus.cc:606] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Received request to transfer leadership to TS c72b6a0c70a14ed889f676786ef0e134
I20260709 12:24:44.795086 32651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
mode: GRACEFUL
new_leader_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:50622
I20260709 12:24:44.795591 32651 raft_consensus.cc:606] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 3 LEADER]: Received request to transfer leadership to TS baa0f002917f4ff7b016742adb282d79
I20260709 12:24:44.796733 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:44.797283 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:44.797919 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:44.870795   566 raft_consensus.cc:993] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79: : Instructing follower c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:44.871345   579 raft_consensus.cc:1081] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Signalling peer c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:44.872789 32651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:52700
I20260709 12:24:44.873270 32651 raft_consensus.cc:493] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:44.873564 32651 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.878202 32651 raft_consensus.cc:515] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:44.879544 32651 leader_election.cc:290] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 4 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:44.880501   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:44.880681 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0828bc27aab34b81984de2f7d6a156e8" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:44.881197   476 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.881214 32725 raft_consensus.cc:3055] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:44.881769 32725 raft_consensus.cc:740] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:44.882596 32725 consensus_queue.cc:260] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:44.883844 32725 raft_consensus.cc:3060] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.888782   476 raft_consensus.cc:2468] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 4.
I20260709 12:24:44.890053 32614 leader_election.cc:304] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:44.890589 32725 raft_consensus.cc:2468] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 4.
I20260709 12:24:44.890758   520 raft_consensus.cc:2804] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:44.891259   520 raft_consensus.cc:697] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 4 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:44.892083   520 consensus_queue.cc:237] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:44.899493 32472 catalog_manager.cc:5697] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 3 to 4, leader changed from baa0f002917f4ff7b016742adb282d79 (127.22.43.67) to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 4 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.058912   579 raft_consensus.cc:993] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79: : Instructing follower c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:45.059466   567 raft_consensus.cc:1081] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Signalling peer c72b6a0c70a14ed889f676786ef0e134 to start an election
I20260709 12:24:45.060894 32651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6defb984d3c644798ce8683daf85d896"
dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
 from {username='slave'} at 127.0.0.1:52700
I20260709 12:24:45.061379 32651 raft_consensus.cc:493] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:45.061645 32651 raft_consensus.cc:3060] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.066321 32651 raft_consensus.cc:515] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:45.067718 32651 leader_election.cc:290] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 3 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), baa0f002917f4ff7b016742adb282d79 (127.22.43.67:46707)
I20260709 12:24:45.068600   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defb984d3c644798ce8683daf85d896" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:45.068691 32725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6defb984d3c644798ce8683daf85d896" candidate_uuid: "c72b6a0c70a14ed889f676786ef0e134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baa0f002917f4ff7b016742adb282d79"
I20260709 12:24:45.069387   476 raft_consensus.cc:3060] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.069483 32725 raft_consensus.cc:3055] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:45.069875 32725 raft_consensus.cc:740] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:45.070509 32725 consensus_queue.cc:260] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:45.071389 32725 raft_consensus.cc:3060] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.074883   476 raft_consensus.cc:2468] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 3.
I20260709 12:24:45.075969 32725 raft_consensus.cc:2468] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b6a0c70a14ed889f676786ef0e134 in term 3.
I20260709 12:24:45.075989 32614 leader_election.cc:304] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, c72b6a0c70a14ed889f676786ef0e134; no voters: 
I20260709 12:24:45.077026   532 raft_consensus.cc:2804] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:45.077510   532 raft_consensus.cc:697] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 3 LEADER]: Becoming Leader. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:45.078238   532 consensus_queue.cc:237] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:45.084131 32472 catalog_manager.cc:5697] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 reported cstate change: term changed from 2 to 3, leader changed from baa0f002917f4ff7b016742adb282d79 (127.22.43.67) to c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66). New cstate: current_term: 3 leader_uuid: "c72b6a0c70a14ed889f676786ef0e134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.237099   589 raft_consensus.cc:993] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134: : Instructing follower baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:45.237641   532 raft_consensus.cc:1081] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 3 LEADER]: Signalling peer baa0f002917f4ff7b016742adb282d79 to start an election
I20260709 12:24:45.239042 32725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6"
dest_uuid: "baa0f002917f4ff7b016742adb282d79"
 from {username='slave'} at 127.0.0.1:60034
I20260709 12:24:45.239466 32725 raft_consensus.cc:493] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:45.239691 32725 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.244201 32725 raft_consensus.cc:515] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:45.245501 32725 leader_election.cc:290] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 4 election: Requested vote from peers 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887), c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079)
I20260709 12:24:45.246398   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "53755e1407fa4f059487bace5d6e8cb4"
I20260709 12:24:45.246587 32651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0af227d76f14a6e9c929ffa2e0178d6" candidate_uuid: "baa0f002917f4ff7b016742adb282d79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c72b6a0c70a14ed889f676786ef0e134"
I20260709 12:24:45.247094   476 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.247162 32651 raft_consensus.cc:3055] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:45.247570 32651 raft_consensus.cc:740] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c72b6a0c70a14ed889f676786ef0e134, State: Running, Role: LEADER
I20260709 12:24:45.248148 32651 consensus_queue.cc:260] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:45.249017 32651 raft_consensus.cc:3060] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.252631   476 raft_consensus.cc:2468] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 4.
I20260709 12:24:45.253623 32651 raft_consensus.cc:2468] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa0f002917f4ff7b016742adb282d79 in term 4.
I20260709 12:24:45.253966 32689 leader_election.cc:304] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53755e1407fa4f059487bace5d6e8cb4, baa0f002917f4ff7b016742adb282d79; no voters: 
I20260709 12:24:45.254751   567 raft_consensus.cc:2804] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:45.255232   567 raft_consensus.cc:697] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 4 LEADER]: Becoming Leader. State: Replica: baa0f002917f4ff7b016742adb282d79, State: Running, Role: LEADER
I20260709 12:24:45.256018   567 consensus_queue.cc:237] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } }
I20260709 12:24:45.262522 32472 catalog_manager.cc:5697] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 reported cstate change: term changed from 3 to 4, leader changed from c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66) to baa0f002917f4ff7b016742adb282d79 (127.22.43.67). New cstate: current_term: 4 leader_uuid: "baa0f002917f4ff7b016742adb282d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.373155 32725 raft_consensus.cc:1275] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 4 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:45.374491   532 consensus_queue.cc:1048] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:45.384025   476 raft_consensus.cc:1275] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:45.385754   532 consensus_queue.cc:1048] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:24:45.518848 32522 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:24:45.533720   476 raft_consensus.cc:1275] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:45.535212   532 consensus_queue.cc:1048] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:45.546134 32725 raft_consensus.cc:1275] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Refusing update from remote peer c72b6a0c70a14ed889f676786ef0e134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:45.547715   598 consensus_queue.cc:1048] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa0f002917f4ff7b016742adb282d79" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:45.718664 32651 raft_consensus.cc:1275] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 4 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:45.719830   567 consensus_queue.cc:1048] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b6a0c70a14ed889f676786ef0e134" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:45.729031   476 raft_consensus.cc:1275] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Refusing update from remote peer baa0f002917f4ff7b016742adb282d79: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:45.730576   567 consensus_queue.cc:1048] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53755e1407fa4f059487bace5d6e8cb4" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:45.805157 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:45.835358 22701 tablet_server.cc:179] TabletServer@127.22.43.65:32887 shutting down...
I20260709 12:24:45.856426 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:45.857395 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:45.858407 22701 raft_consensus.cc:2243] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.859136 22701 raft_consensus.cc:2272] T 0828bc27aab34b81984de2f7d6a156e8 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.861871 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:45.862681 22701 raft_consensus.cc:2243] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.863071 22701 raft_consensus.cc:2272] T 3898ad57ae3c441caf3d75c5ed15cc39 P 53755e1407fa4f059487bace5d6e8cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.865136 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:45.865705 22701 raft_consensus.cc:2243] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.866225 22701 raft_consensus.cc:2272] T 24556c0c1c444490b9fe3e5baa831ada P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.868240 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:45.868784 22701 raft_consensus.cc:2243] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.869194 22701 raft_consensus.cc:2272] T 9e5ac5633b794425be2031f182f7cd0e P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.871234 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:45.871773 22701 raft_consensus.cc:2243] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.872151 22701 raft_consensus.cc:2272] T 5d7bc899c94245f18b8da19d76824cc4 P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.874168 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:45.874742 22701 raft_consensus.cc:2243] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.875196 22701 raft_consensus.cc:2272] T 6defb984d3c644798ce8683daf85d896 P 53755e1407fa4f059487bace5d6e8cb4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.877586 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:45.878257 22701 raft_consensus.cc:2243] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.878641 22701 raft_consensus.cc:2272] T ee147b0d9961498783fda1e20a5254bf P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.880498 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:45.880945 22701 raft_consensus.cc:2243] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.881289 22701 raft_consensus.cc:2272] T c1ad632c91f14429895340f24716d0ac P 53755e1407fa4f059487bace5d6e8cb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.883428 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:45.884047 22701 raft_consensus.cc:2243] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.884567 22701 raft_consensus.cc:2272] T a0af227d76f14a6e9c929ffa2e0178d6 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.887251 22701 tablet_replica.cc:333] stopping tablet replica
I20260709 12:24:45.887780 22701 raft_consensus.cc:2243] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.888240 22701 raft_consensus.cc:2272] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P 53755e1407fa4f059487bace5d6e8cb4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.917507 22701 tablet_server.cc:196] TabletServer@127.22.43.65:32887 shutdown complete.
W20260709 12:24:45.931524 32614 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111)
W20260709 12:24:45.935222 32614 consensus_peers.cc:597] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.941190 22701 tablet_server.cc:179] TabletServer@127.22.43.66:0 shutting down...
I20260709 12:24:45.968618 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:45.969504 22701 tablet_replica.cc:333] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134: stopping tablet replica
I20260709 12:24:45.970472 22701 raft_consensus.cc:2243] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:24:45.970855 32689 consensus_peers.cc:597] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 -> Peer c72b6a0c70a14ed889f676786ef0e134 (127.22.43.66:33079): Couldn't send request to peer c72b6a0c70a14ed889f676786ef0e134. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.971681 22701 raft_consensus.cc:2272] T 0828bc27aab34b81984de2f7d6a156e8 P c72b6a0c70a14ed889f676786ef0e134 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.974788 22701 tablet_replica.cc:333] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134: stopping tablet replica
I20260709 12:24:45.975459 22701 raft_consensus.cc:2243] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.976011 22701 raft_consensus.cc:2272] T 3898ad57ae3c441caf3d75c5ed15cc39 P c72b6a0c70a14ed889f676786ef0e134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.978655 22701 tablet_replica.cc:333] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134: stopping tablet replica
I20260709 12:24:45.979346 22701 raft_consensus.cc:2243] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.979838 22701 raft_consensus.cc:2272] T 9e5ac5633b794425be2031f182f7cd0e P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.982455 22701 tablet_replica.cc:333] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134: stopping tablet replica
I20260709 12:24:45.983183 22701 raft_consensus.cc:2243] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.984056 22701 raft_consensus.cc:2272] T 5d7bc899c94245f18b8da19d76824cc4 P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.988170 22701 tablet_replica.cc:333] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134: stopping tablet replica
I20260709 12:24:45.989169 22701 raft_consensus.cc:2243] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:24:45.989652 32689 consensus_peers.cc:597] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.989663 32614 consensus_peers.cc:597] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.990234 22701 raft_consensus.cc:2272] T 24556c0c1c444490b9fe3e5baa831ada P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.992924 22701 tablet_replica.cc:333] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134: stopping tablet replica
I20260709 12:24:45.993532 22701 raft_consensus.cc:2243] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:24:45.994441 22701 raft_consensus.cc:2272] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P c72b6a0c70a14ed889f676786ef0e134 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.996721 22701 tablet_replica.cc:333] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134: stopping tablet replica
I20260709 12:24:45.997318 22701 raft_consensus.cc:2243] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:45.998189 22701 raft_consensus.cc:2272] T c1ad632c91f14429895340f24716d0ac P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.000454 22701 tablet_replica.cc:333] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134: stopping tablet replica
I20260709 12:24:46.001078 22701 raft_consensus.cc:2243] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.001621 22701 raft_consensus.cc:2272] T a0af227d76f14a6e9c929ffa2e0178d6 P c72b6a0c70a14ed889f676786ef0e134 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.004724 22701 tablet_replica.cc:333] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134: stopping tablet replica
I20260709 12:24:46.005288 22701 raft_consensus.cc:2243] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.006273 22701 raft_consensus.cc:2272] T 6defb984d3c644798ce8683daf85d896 P c72b6a0c70a14ed889f676786ef0e134 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.008951 22701 tablet_replica.cc:333] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134: stopping tablet replica
I20260709 12:24:46.009545 22701 raft_consensus.cc:2243] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.010072 22701 raft_consensus.cc:2272] T ee147b0d9961498783fda1e20a5254bf P c72b6a0c70a14ed889f676786ef0e134 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:46.023520 32689 consensus_peers.cc:597] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:46.037246 22701 tablet_server.cc:196] TabletServer@127.22.43.66:0 shutdown complete.
I20260709 12:24:46.065677 22701 tablet_server.cc:179] TabletServer@127.22.43.67:0 shutting down...
I20260709 12:24:46.090726 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:46.091454 22701 tablet_replica.cc:333] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79: stopping tablet replica
I20260709 12:24:46.092306 22701 raft_consensus.cc:2243] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.093184 22701 raft_consensus.cc:2272] T a0af227d76f14a6e9c929ffa2e0178d6 P baa0f002917f4ff7b016742adb282d79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.095566 22701 tablet_replica.cc:333] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79: stopping tablet replica
I20260709 12:24:46.096171 22701 raft_consensus.cc:2243] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.096596 22701 raft_consensus.cc:2272] T 0828bc27aab34b81984de2f7d6a156e8 P baa0f002917f4ff7b016742adb282d79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.099056 22701 tablet_replica.cc:333] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79: stopping tablet replica
I20260709 12:24:46.099619 22701 raft_consensus.cc:2243] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.100481 22701 raft_consensus.cc:2272] T 3898ad57ae3c441caf3d75c5ed15cc39 P baa0f002917f4ff7b016742adb282d79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.102955 22701 tablet_replica.cc:333] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79: stopping tablet replica
I20260709 12:24:46.103514 22701 raft_consensus.cc:2243] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.103929 22701 raft_consensus.cc:2272] T 6baf2f940a9f4c40ba334c03d8ac3ee3 P baa0f002917f4ff7b016742adb282d79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.106003 22701 tablet_replica.cc:333] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79: stopping tablet replica
I20260709 12:24:46.106556 22701 raft_consensus.cc:2243] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.106966 22701 raft_consensus.cc:2272] T c1ad632c91f14429895340f24716d0ac P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.108986 22701 tablet_replica.cc:333] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79: stopping tablet replica
I20260709 12:24:46.109524 22701 raft_consensus.cc:2243] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.110317 22701 raft_consensus.cc:2272] T 9e5ac5633b794425be2031f182f7cd0e P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.112995 22701 tablet_replica.cc:333] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79: stopping tablet replica
I20260709 12:24:46.113698 22701 raft_consensus.cc:2243] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.114257 22701 raft_consensus.cc:2272] T 24556c0c1c444490b9fe3e5baa831ada P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:46.115348 32689 consensus_peers.cc:597] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 -> Peer 53755e1407fa4f059487bace5d6e8cb4 (127.22.43.65:32887): Couldn't send request to peer 53755e1407fa4f059487bace5d6e8cb4. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:46.116683 22701 tablet_replica.cc:333] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79: stopping tablet replica
I20260709 12:24:46.117218 22701 raft_consensus.cc:2243] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.118010 22701 raft_consensus.cc:2272] T 5d7bc899c94245f18b8da19d76824cc4 P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.120009 22701 tablet_replica.cc:333] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79: stopping tablet replica
I20260709 12:24:46.120466 22701 raft_consensus.cc:2243] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.120815 22701 raft_consensus.cc:2272] T 6defb984d3c644798ce8683daf85d896 P baa0f002917f4ff7b016742adb282d79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.123143 22701 tablet_replica.cc:333] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79: stopping tablet replica
I20260709 12:24:46.123553 22701 raft_consensus.cc:2243] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.124302 22701 raft_consensus.cc:2272] T ee147b0d9961498783fda1e20a5254bf P baa0f002917f4ff7b016742adb282d79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.154588 22701 tablet_server.cc:196] TabletServer@127.22.43.67:0 shutdown complete.
I20260709 12:24:46.182341 22701 master.cc:562] Master@127.22.43.126:35239 shutting down...
I20260709 12:24:46.209118 22701 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.209764 22701 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.210233 22701 tablet_replica.cc:333] T 00000000000000000000000000000000 P c0612c8d1ffb4ae6b551e7d2eb6d073a: stopping tablet replica
I20260709 12:24:46.231802 22701 master.cc:584] Master@127.22.43.126:35239 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14901 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:24:46.274966 22701 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.43.126:33533
I20260709 12:24:46.276122 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:46.281700   609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:46.281745   610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:46.282429   612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:46.286329 22701 server_base.cc:1061] running on GCE node
I20260709 12:24:46.287266 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:46.287441 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:46.287557 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599886287546 us; error 0 us; skew 500 ppm
I20260709 12:24:46.288028 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:46.290413 22701 webserver.cc:533] Webserver started at http://127.22.43.126:42929/ using document root <none> and password file <none>
I20260709 12:24:46.290864 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:46.291013 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:46.291236 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:46.292282 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/master-0-root/instance:
uuid: "0ccdc883a07844e18eb8d74d55bddb95"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-0768"
I20260709 12:24:46.296933 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:24:46.300345   617 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.301137 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:24:46.301465 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/master-0-root
uuid: "0ccdc883a07844e18eb8d74d55bddb95"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-0768"
I20260709 12:24:46.301753 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:46.325050 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:46.326287 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:46.365772 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.126:33533
I20260709 12:24:46.366099   669 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.126:33533 every 8 connection(s)
I20260709 12:24:46.369782   670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.381341   670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95: Bootstrap starting.
I20260709 12:24:46.386444   670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.390847   670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95: No bootstrap required, opened a new log
I20260709 12:24:46.393121   670 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccdc883a07844e18eb8d74d55bddb95" member_type: VOTER }
I20260709 12:24:46.393507   670 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.393687   670 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ccdc883a07844e18eb8d74d55bddb95, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.394289   670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccdc883a07844e18eb8d74d55bddb95" member_type: VOTER }
I20260709 12:24:46.394694   670 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:46.394883   670 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:46.395093   670 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.400075   670 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccdc883a07844e18eb8d74d55bddb95" member_type: VOTER }
I20260709 12:24:46.400543   670 leader_election.cc:304] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ccdc883a07844e18eb8d74d55bddb95; no voters: 
I20260709 12:24:46.401703   670 leader_election.cc:290] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:46.402070   673 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:46.403564   673 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [term 1 LEADER]: Becoming Leader. State: Replica: 0ccdc883a07844e18eb8d74d55bddb95, State: Running, Role: LEADER
I20260709 12:24:46.404247   673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccdc883a07844e18eb8d74d55bddb95" member_type: VOTER }
I20260709 12:24:46.404781   670 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:46.410957   674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ccdc883a07844e18eb8d74d55bddb95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccdc883a07844e18eb8d74d55bddb95" member_type: VOTER } }
I20260709 12:24:46.411350   675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ccdc883a07844e18eb8d74d55bddb95. Latest consensus state: current_term: 1 leader_uuid: "0ccdc883a07844e18eb8d74d55bddb95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ccdc883a07844e18eb8d74d55bddb95" member_type: VOTER } }
I20260709 12:24:46.411831   674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:46.412194   675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:46.415287   681 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:46.420748   681 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:46.423151 22701 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:46.430233   681 catalog_manager.cc:1383] Generated new cluster ID: d956d01d37aa48c4bbede396b35e8ebe
I20260709 12:24:46.430562   681 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:46.458384   681 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:46.459744   681 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:46.474617   681 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95: Generated new TSK 0
I20260709 12:24:46.475273   681 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:46.490048 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:46.496347   691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:46.497530   692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:46.500504   694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:46.501456 22701 server_base.cc:1061] running on GCE node
I20260709 12:24:46.502571 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:46.502774 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:46.502997 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599886502959 us; error 0 us; skew 500 ppm
I20260709 12:24:46.503621 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:46.506246 22701 webserver.cc:533] Webserver started at http://127.22.43.65:46227/ using document root <none> and password file <none>
I20260709 12:24:46.506794 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:46.506978 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:46.507201 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:46.508289 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-0-root/instance:
uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-0768"
I20260709 12:24:46.513409 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:24:46.516872   699 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.517865 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:24:46.518290 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-0-root
uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-0768"
I20260709 12:24:46.518646 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:46.533480 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:46.534859 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:46.536484 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:46.539016 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:46.539283 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.539552 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:46.539749 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.582583 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.65:41317
I20260709 12:24:46.582700   762 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.65:41317 every 8 connection(s)
I20260709 12:24:46.587931 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:46.595018   767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:46.595371   768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:46.598290 22701 server_base.cc:1061] running on GCE node
W20260709 12:24:46.599390   771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:46.600270   763 heartbeater.cc:344] Connected to a master server at 127.22.43.126:33533
I20260709 12:24:46.600448 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:24:46.600653   763 heartbeater.cc:461] Registering TS with master...
W20260709 12:24:46.600767 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:46.601082 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599886601062 us; error 0 us; skew 500 ppm
I20260709 12:24:46.601581   763 heartbeater.cc:507] Master 127.22.43.126:33533 requested a full tablet report, sending...
I20260709 12:24:46.601696 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:46.604496 22701 webserver.cc:533] Webserver started at http://127.22.43.66:41681/ using document root <none> and password file <none>
I20260709 12:24:46.604532   634 ts_manager.cc:194] Registered new tserver with Master: 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65:41317)
I20260709 12:24:46.605232 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:46.605508 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:46.605830 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:46.607209   634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49830
I20260709 12:24:46.607321 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-1-root/instance:
uuid: "2da225e91b9b4774bf0cfc4a06304ef5"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-0768"
I20260709 12:24:46.612423 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:24:46.616969   775 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.617936 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:24:46.618345 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-1-root
uuid: "2da225e91b9b4774bf0cfc4a06304ef5"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-0768"
I20260709 12:24:46.618664 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:46.657837 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:46.659144 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:46.660607 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:46.662791 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:46.663017 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.663267 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:46.663439 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.703085 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.66:34473
I20260709 12:24:46.703218   837 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.66:34473 every 8 connection(s)
I20260709 12:24:46.707939 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:46.715605   841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:46.717620   842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:46.719357   844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:46.720340 22701 server_base.cc:1061] running on GCE node
I20260709 12:24:46.721467 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:46.721735 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:46.721975 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599886721955 us; error 0 us; skew 500 ppm
I20260709 12:24:46.722569 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:46.722600   838 heartbeater.cc:344] Connected to a master server at 127.22.43.126:33533
I20260709 12:24:46.723124   838 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:46.724148   838 heartbeater.cc:507] Master 127.22.43.126:33533 requested a full tablet report, sending...
I20260709 12:24:46.725590 22701 webserver.cc:533] Webserver started at http://127.22.43.67:39271/ using document root <none> and password file <none>
I20260709 12:24:46.726276 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:46.726472 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:46.726531   634 ts_manager.cc:194] Registered new tserver with Master: 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66:34473)
I20260709 12:24:46.726753 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:46.728065 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-2-root/instance:
uuid: "fadb86bd71864c3191194e36a0c49f02"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-0768"
I20260709 12:24:46.728065   634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49844
I20260709 12:24:46.732802 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:24:46.736436   850 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.737205 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:24:46.737504 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-2-root
uuid: "fadb86bd71864c3191194e36a0c49f02"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-0768"
I20260709 12:24:46.737782 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599526815862-22701-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:46.749115 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:46.750344 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:46.751780 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:46.753997 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:46.754235 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.754479 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:46.754655 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.795818 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.67:46369
I20260709 12:24:46.795944   912 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.67:46369 every 8 connection(s)
I20260709 12:24:46.809965   913 heartbeater.cc:344] Connected to a master server at 127.22.43.126:33533
I20260709 12:24:46.810451   913 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:46.811240   913 heartbeater.cc:507] Master 127.22.43.126:33533 requested a full tablet report, sending...
I20260709 12:24:46.813267   634 ts_manager.cc:194] Registered new tserver with Master: fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369)
I20260709 12:24:46.813743 22701 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014564353s
I20260709 12:24:46.814697   634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49858
I20260709 12:24:46.839331   634 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49862:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:46.841518   634 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:46.898245   803 tablet_service.cc:1511] Processing CreateTablet for tablet c6b3a7a543fd41d1bfeac7fe4cc0edba (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=026a8749440549408a030cd97e2741e9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:24:46.899726   803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b3a7a543fd41d1bfeac7fe4cc0edba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.899567   728 tablet_service.cc:1511] Processing CreateTablet for tablet c6b3a7a543fd41d1bfeac7fe4cc0edba (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=026a8749440549408a030cd97e2741e9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:24:46.900097   726 tablet_service.cc:1511] Processing CreateTablet for tablet dd63a442787c4e92afd21edb2eb52d8b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=026a8749440549408a030cd97e2741e9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:24:46.901021   728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b3a7a543fd41d1bfeac7fe4cc0edba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.901655   726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd63a442787c4e92afd21edb2eb52d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.902742   878 tablet_service.cc:1511] Processing CreateTablet for tablet c6b3a7a543fd41d1bfeac7fe4cc0edba (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=026a8749440549408a030cd97e2741e9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:24:46.903084   802 tablet_service.cc:1511] Processing CreateTablet for tablet dd63a442787c4e92afd21edb2eb52d8b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=026a8749440549408a030cd97e2741e9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:24:46.904228   878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b3a7a543fd41d1bfeac7fe4cc0edba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.904495   802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd63a442787c4e92afd21edb2eb52d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.907124   877 tablet_service.cc:1511] Processing CreateTablet for tablet dd63a442787c4e92afd21edb2eb52d8b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=026a8749440549408a030cd97e2741e9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:24:46.908501   877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd63a442787c4e92afd21edb2eb52d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.932123   929 tablet_bootstrap.cc:492] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5: Bootstrap starting.
I20260709 12:24:46.937636   930 tablet_bootstrap.cc:492] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02: Bootstrap starting.
I20260709 12:24:46.942239   929 tablet_bootstrap.cc:654] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.939038   928 tablet_bootstrap.cc:492] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8: Bootstrap starting.
I20260709 12:24:46.947614   930 tablet_bootstrap.cc:654] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.955513   930 tablet_bootstrap.cc:492] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02: No bootstrap required, opened a new log
I20260709 12:24:46.956130   930 ts_tablet_manager.cc:1403] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:24:46.956146   928 tablet_bootstrap.cc:654] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.959677   930 raft_consensus.cc:359] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:46.960711   930 raft_consensus.cc:385] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.961084   930 raft_consensus.cc:740] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fadb86bd71864c3191194e36a0c49f02, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.961277   928 tablet_bootstrap.cc:492] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8: No bootstrap required, opened a new log
I20260709 12:24:46.961939   928 ts_tablet_manager.cc:1403] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8: Time spent bootstrapping tablet: real 0.023s	user 0.000s	sys 0.012s
I20260709 12:24:46.962209   930 consensus_queue.cc:260] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:46.964466   928 raft_consensus.cc:359] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:46.967554   928 raft_consensus.cc:385] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.968227   928 raft_consensus.cc:740] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d39a2bcb16746cbbc3ee0223b283ec8, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.966432   930 ts_tablet_manager.cc:1434] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:24:46.965864   913 heartbeater.cc:499] Master 127.22.43.126:33533 was elected leader, sending a full tablet report...
I20260709 12:24:46.969002   929 tablet_bootstrap.cc:492] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5: No bootstrap required, opened a new log
I20260709 12:24:46.969455   930 tablet_bootstrap.cc:492] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02: Bootstrap starting.
I20260709 12:24:46.969517   929 ts_tablet_manager.cc:1403] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.009s
I20260709 12:24:46.970153   928 consensus_queue.cc:260] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:46.973003   929 raft_consensus.cc:359] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:46.973909   929 raft_consensus.cc:385] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.974280   929 raft_consensus.cc:740] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da225e91b9b4774bf0cfc4a06304ef5, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.975317   929 consensus_queue.cc:260] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:46.976351   930 tablet_bootstrap.cc:654] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.981945   838 heartbeater.cc:499] Master 127.22.43.126:33533 was elected leader, sending a full tablet report...
I20260709 12:24:46.983261   929 ts_tablet_manager.cc:1434] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:24:46.984779   929 tablet_bootstrap.cc:492] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5: Bootstrap starting.
I20260709 12:24:46.990021   928 ts_tablet_manager.cc:1434] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.010s
I20260709 12:24:46.991335   928 tablet_bootstrap.cc:492] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8: Bootstrap starting.
I20260709 12:24:46.994041   763 heartbeater.cc:499] Master 127.22.43.126:33533 was elected leader, sending a full tablet report...
I20260709 12:24:46.996201   929 tablet_bootstrap.cc:654] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.998136   928 tablet_bootstrap.cc:654] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.999305   930 tablet_bootstrap.cc:492] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02: No bootstrap required, opened a new log
I20260709 12:24:46.999902   930 ts_tablet_manager.cc:1403] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.019s
I20260709 12:24:47.003787   930 raft_consensus.cc:359] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:47.004835   930 raft_consensus.cc:385] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.005281   930 raft_consensus.cc:740] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fadb86bd71864c3191194e36a0c49f02, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.006474   930 consensus_queue.cc:260] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:47.009606   930 ts_tablet_manager.cc:1434] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:24:47.010408   936 raft_consensus.cc:493] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.010921   936 raft_consensus.cc:515] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:47.012257   929 tablet_bootstrap.cc:492] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5: No bootstrap required, opened a new log
I20260709 12:24:47.012967   929 ts_tablet_manager.cc:1403] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.003s
I20260709 12:24:47.013118   936 leader_election.cc:290] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65:41317), fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369)
I20260709 12:24:47.027758   929 raft_consensus.cc:359] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.028388   929 raft_consensus.cc:385] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.028750   929 raft_consensus.cc:740] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da225e91b9b4774bf0cfc4a06304ef5, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.029537   929 consensus_queue.cc:260] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.031140   928 tablet_bootstrap.cc:492] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8: No bootstrap required, opened a new log
I20260709 12:24:47.031754   928 ts_tablet_manager.cc:1403] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.006s
I20260709 12:24:47.031870   929 ts_tablet_manager.cc:1434] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:24:47.034853   928 raft_consensus.cc:359] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:47.035552   928 raft_consensus.cc:385] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.035820   928 raft_consensus.cc:740] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d39a2bcb16746cbbc3ee0223b283ec8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.036821   928 consensus_queue.cc:260] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:47.039434   928 ts_tablet_manager.cc:1434] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:47.040215   738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b3a7a543fd41d1bfeac7fe4cc0edba" candidate_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" is_pre_election: true
I20260709 12:24:47.041013   738 raft_consensus.cc:2468] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da225e91b9b4774bf0cfc4a06304ef5 in term 0.
I20260709 12:24:47.042363   779 leader_election.cc:304] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da225e91b9b4774bf0cfc4a06304ef5, 4d39a2bcb16746cbbc3ee0223b283ec8; no voters: 
I20260709 12:24:47.043287   936 raft_consensus.cc:2804] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.043642   936 raft_consensus.cc:493] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.043994   936 raft_consensus.cc:3060] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.045753   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b3a7a543fd41d1bfeac7fe4cc0edba" candidate_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fadb86bd71864c3191194e36a0c49f02" is_pre_election: true
I20260709 12:24:47.046520   888 raft_consensus.cc:2468] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da225e91b9b4774bf0cfc4a06304ef5 in term 0.
I20260709 12:24:47.050871   936 raft_consensus.cc:515] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:47.052773   936 leader_election.cc:290] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [CANDIDATE]: Term 1 election: Requested vote from peers 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65:41317), fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369)
I20260709 12:24:47.053491   738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b3a7a543fd41d1bfeac7fe4cc0edba" candidate_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
I20260709 12:24:47.053782   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b3a7a543fd41d1bfeac7fe4cc0edba" candidate_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fadb86bd71864c3191194e36a0c49f02"
I20260709 12:24:47.054286   738 raft_consensus.cc:3060] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.054368   888 raft_consensus.cc:3060] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.062129   888 raft_consensus.cc:2468] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da225e91b9b4774bf0cfc4a06304ef5 in term 1.
I20260709 12:24:47.062130   738 raft_consensus.cc:2468] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da225e91b9b4774bf0cfc4a06304ef5 in term 1.
I20260709 12:24:47.063565   779 leader_election.cc:304] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2da225e91b9b4774bf0cfc4a06304ef5, 4d39a2bcb16746cbbc3ee0223b283ec8, fadb86bd71864c3191194e36a0c49f02; no voters: 
I20260709 12:24:47.064364   936 raft_consensus.cc:2804] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.065265   936 raft_consensus.cc:697] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 LEADER]: Becoming Leader. State: Replica: 2da225e91b9b4774bf0cfc4a06304ef5, State: Running, Role: LEADER
I20260709 12:24:47.066159   936 consensus_queue.cc:237] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:47.072963   631 catalog_manager.cc:5697] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.243369   935 raft_consensus.cc:493] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.243984   935 raft_consensus.cc:515] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.246062   935 leader_election.cc:290] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66:34473), fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369)
I20260709 12:24:47.257412   813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd63a442787c4e92afd21edb2eb52d8b" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" is_pre_election: true
I20260709 12:24:47.258090   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd63a442787c4e92afd21edb2eb52d8b" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fadb86bd71864c3191194e36a0c49f02" is_pre_election: true
I20260709 12:24:47.258291   813 raft_consensus.cc:2468] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 0.
I20260709 12:24:47.258778   888 raft_consensus.cc:2468] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 0.
I20260709 12:24:47.259699   702 leader_election.cc:304] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da225e91b9b4774bf0cfc4a06304ef5, 4d39a2bcb16746cbbc3ee0223b283ec8; no voters: 
I20260709 12:24:47.260839   935 raft_consensus.cc:2804] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.261250   935 raft_consensus.cc:493] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.261541   935 raft_consensus.cc:3060] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.267575   935 raft_consensus.cc:515] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.269338   935 leader_election.cc:290] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 1 election: Requested vote from peers 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66:34473), fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369)
I20260709 12:24:47.270339   813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd63a442787c4e92afd21edb2eb52d8b" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da225e91b9b4774bf0cfc4a06304ef5"
I20260709 12:24:47.270510   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd63a442787c4e92afd21edb2eb52d8b" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fadb86bd71864c3191194e36a0c49f02"
I20260709 12:24:47.270916   813 raft_consensus.cc:3060] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.271229   888 raft_consensus.cc:3060] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.276508   813 raft_consensus.cc:2468] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 1.
I20260709 12:24:47.276647   888 raft_consensus.cc:2468] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 1.
I20260709 12:24:47.277797   702 leader_election.cc:304] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da225e91b9b4774bf0cfc4a06304ef5, 4d39a2bcb16746cbbc3ee0223b283ec8; no voters: 
I20260709 12:24:47.278616   935 raft_consensus.cc:2804] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.279651   935 raft_consensus.cc:697] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 4d39a2bcb16746cbbc3ee0223b283ec8, State: Running, Role: LEADER
I20260709 12:24:47.280591   935 consensus_queue.cc:237] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.288210   631 catalog_manager.cc:5697] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.349597   631 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49876:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:47.351869   631 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:47.376495   728 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4bde34a28e417a9184541e9baac84a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=02fb9af07bc4404a9485399f8a38a5d0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:24:47.377970   728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4bde34a28e417a9184541e9baac84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:47.377782   802 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4bde34a28e417a9184541e9baac84a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=02fb9af07bc4404a9485399f8a38a5d0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:24:47.379313   802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4bde34a28e417a9184541e9baac84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:47.379729   878 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4bde34a28e417a9184541e9baac84a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=02fb9af07bc4404a9485399f8a38a5d0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:24:47.381151   878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4bde34a28e417a9184541e9baac84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:47.380808   726 tablet_service.cc:1511] Processing CreateTablet for tablet b7151b242a824c578fc38fd73456a71c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=02fb9af07bc4404a9485399f8a38a5d0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:24:47.382176   726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7151b242a824c578fc38fd73456a71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:47.386343   803 tablet_service.cc:1511] Processing CreateTablet for tablet b7151b242a824c578fc38fd73456a71c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=02fb9af07bc4404a9485399f8a38a5d0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:24:47.387746   803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7151b242a824c578fc38fd73456a71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:47.401458   928 tablet_bootstrap.cc:492] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8: Bootstrap starting.
I20260709 12:24:47.402096   877 tablet_service.cc:1511] Processing CreateTablet for tablet b7151b242a824c578fc38fd73456a71c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=02fb9af07bc4404a9485399f8a38a5d0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:24:47.403563   877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7151b242a824c578fc38fd73456a71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:47.408834   928 tablet_bootstrap.cc:654] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.415244   929 tablet_bootstrap.cc:492] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5: Bootstrap starting.
W20260709 12:24:47.418162   683 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:47.418187   928 tablet_bootstrap.cc:492] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8: No bootstrap required, opened a new log
I20260709 12:24:47.419102   928 ts_tablet_manager.cc:1403] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.002s
I20260709 12:24:47.421396   930 tablet_bootstrap.cc:492] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02: Bootstrap starting.
I20260709 12:24:47.422554   928 raft_consensus.cc:359] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.423377   928 raft_consensus.cc:385] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.423725   928 raft_consensus.cc:740] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d39a2bcb16746cbbc3ee0223b283ec8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.424536   928 consensus_queue.cc:260] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.427009   928 ts_tablet_manager.cc:1434] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:24:47.428272   929 tablet_bootstrap.cc:654] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.428288   928 tablet_bootstrap.cc:492] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8: Bootstrap starting.
I20260709 12:24:47.432319   930 tablet_bootstrap.cc:654] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.438532   928 tablet_bootstrap.cc:654] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.446619   930 tablet_bootstrap.cc:492] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02: No bootstrap required, opened a new log
I20260709 12:24:47.447261   930 ts_tablet_manager.cc:1403] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.015s
I20260709 12:24:47.448877   929 tablet_bootstrap.cc:492] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5: No bootstrap required, opened a new log
I20260709 12:24:47.449061   928 tablet_bootstrap.cc:492] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8: No bootstrap required, opened a new log
I20260709 12:24:47.449560   929 ts_tablet_manager.cc:1403] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.013s
I20260709 12:24:47.449699   928 ts_tablet_manager.cc:1403] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.001s
I20260709 12:24:47.450730   930 raft_consensus.cc:359] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.451607   930 raft_consensus.cc:385] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.451931   930 raft_consensus.cc:740] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fadb86bd71864c3191194e36a0c49f02, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.452665   928 raft_consensus.cc:359] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.453027   929 raft_consensus.cc:359] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.453689   928 raft_consensus.cc:385] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.452981   930 consensus_queue.cc:260] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.454197   929 raft_consensus.cc:385] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.454284   928 raft_consensus.cc:740] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d39a2bcb16746cbbc3ee0223b283ec8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.454742   929 raft_consensus.cc:740] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da225e91b9b4774bf0cfc4a06304ef5, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.455394   928 consensus_queue.cc:260] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.455669   929 consensus_queue.cc:260] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.457873   928 ts_tablet_manager.cc:1434] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:24:47.458232   929 ts_tablet_manager.cc:1434] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:24:47.459482   929 tablet_bootstrap.cc:492] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5: Bootstrap starting.
I20260709 12:24:47.461975   930 ts_tablet_manager.cc:1434] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:24:47.463255   930 tablet_bootstrap.cc:492] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02: Bootstrap starting.
I20260709 12:24:47.467262   929 tablet_bootstrap.cc:654] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.469795   930 tablet_bootstrap.cc:654] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.476917   929 tablet_bootstrap.cc:492] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5: No bootstrap required, opened a new log
I20260709 12:24:47.476706   930 tablet_bootstrap.cc:492] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02: No bootstrap required, opened a new log
I20260709 12:24:47.477669   929 ts_tablet_manager.cc:1403] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.011s
I20260709 12:24:47.477830   930 ts_tablet_manager.cc:1403] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 12:24:47.481235   929 raft_consensus.cc:359] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.482172   929 raft_consensus.cc:385] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.481716   930 raft_consensus.cc:359] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.482390   936 consensus_queue.cc:1048] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.482824   930 raft_consensus.cc:385] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.483341   930 raft_consensus.cc:740] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fadb86bd71864c3191194e36a0c49f02, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.482620   929 raft_consensus.cc:740] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da225e91b9b4774bf0cfc4a06304ef5, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.484505   930 consensus_queue.cc:260] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.484715   929 consensus_queue.cc:260] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.487759   929 ts_tablet_manager.cc:1434] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:24:47.490393   930 ts_tablet_manager.cc:1434] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:24:47.507577   963 consensus_queue.cc:1048] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.555593   935 raft_consensus.cc:493] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.557308   935 raft_consensus.cc:515] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.564059   813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4bde34a28e417a9184541e9baac84a" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" is_pre_election: true
I20260709 12:24:47.565366   813 raft_consensus.cc:2468] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 0.
I20260709 12:24:47.567886   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4bde34a28e417a9184541e9baac84a" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fadb86bd71864c3191194e36a0c49f02" is_pre_election: true
I20260709 12:24:47.568260   702 leader_election.cc:304] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da225e91b9b4774bf0cfc4a06304ef5, 4d39a2bcb16746cbbc3ee0223b283ec8; no voters: 
I20260709 12:24:47.569193   888 raft_consensus.cc:2468] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 0.
I20260709 12:24:47.569669   935 leader_election.cc:290] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66:34473), fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369)
I20260709 12:24:47.570362   935 raft_consensus.cc:2804] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.570760   935 raft_consensus.cc:493] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.571149   935 raft_consensus.cc:3060] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.579970   963 raft_consensus.cc:493] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.580947   963 raft_consensus.cc:515] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.584259   935 raft_consensus.cc:515] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.584734   963 leader_election.cc:290] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65:41317), fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369)
I20260709 12:24:47.585605   738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7151b242a824c578fc38fd73456a71c" candidate_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" is_pre_election: true
I20260709 12:24:47.586448   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7151b242a824c578fc38fd73456a71c" candidate_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fadb86bd71864c3191194e36a0c49f02" is_pre_election: true
I20260709 12:24:47.586659   738 raft_consensus.cc:2468] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da225e91b9b4774bf0cfc4a06304ef5 in term 0.
I20260709 12:24:47.587391   888 raft_consensus.cc:2468] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da225e91b9b4774bf0cfc4a06304ef5 in term 0.
I20260709 12:24:47.587541   935 leader_election.cc:290] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 1 election: Requested vote from peers 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66:34473), fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369)
I20260709 12:24:47.588408   779 leader_election.cc:304] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da225e91b9b4774bf0cfc4a06304ef5, 4d39a2bcb16746cbbc3ee0223b283ec8; no voters: 
I20260709 12:24:47.589460   963 raft_consensus.cc:2804] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.589902   813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4bde34a28e417a9184541e9baac84a" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da225e91b9b4774bf0cfc4a06304ef5"
I20260709 12:24:47.590333   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4bde34a28e417a9184541e9baac84a" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fadb86bd71864c3191194e36a0c49f02"
I20260709 12:24:47.590565   963 raft_consensus.cc:493] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.590756   813 raft_consensus.cc:3060] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.591322   888 raft_consensus.cc:3060] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.591393   963 raft_consensus.cc:3060] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.599972   888 raft_consensus.cc:2468] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 1.
I20260709 12:24:47.601204   701 leader_election.cc:304] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d39a2bcb16746cbbc3ee0223b283ec8, fadb86bd71864c3191194e36a0c49f02; no voters: 
I20260709 12:24:47.601985   935 raft_consensus.cc:2804] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.602273   813 raft_consensus.cc:2468] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 1.
I20260709 12:24:47.602370   963 raft_consensus.cc:515] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.602463   935 raft_consensus.cc:697] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 4d39a2bcb16746cbbc3ee0223b283ec8, State: Running, Role: LEADER
I20260709 12:24:47.604962   963 leader_election.cc:290] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [CANDIDATE]: Term 1 election: Requested vote from peers 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65:41317), fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369)
I20260709 12:24:47.604650   935 consensus_queue.cc:237] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.605955   738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7151b242a824c578fc38fd73456a71c" candidate_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
I20260709 12:24:47.606220   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7151b242a824c578fc38fd73456a71c" candidate_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fadb86bd71864c3191194e36a0c49f02"
I20260709 12:24:47.606647   738 raft_consensus.cc:3060] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.606781   888 raft_consensus.cc:3060] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.613235   888 raft_consensus.cc:2468] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da225e91b9b4774bf0cfc4a06304ef5 in term 1.
I20260709 12:24:47.614570   777 leader_election.cc:304] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da225e91b9b4774bf0cfc4a06304ef5, fadb86bd71864c3191194e36a0c49f02; no voters: 
I20260709 12:24:47.615613   963 raft_consensus.cc:2804] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.616170   963 raft_consensus.cc:697] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 LEADER]: Becoming Leader. State: Replica: 2da225e91b9b4774bf0cfc4a06304ef5, State: Running, Role: LEADER
I20260709 12:24:47.617452   963 consensus_queue.cc:237] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.617864   738 raft_consensus.cc:2468] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da225e91b9b4774bf0cfc4a06304ef5 in term 1.
I20260709 12:24:47.622965   630 catalog_manager.cc:5697] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65). New cstate: current_term: 1 leader_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.627488   631 catalog_manager.cc:5697] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.657723   813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6b3a7a543fd41d1bfeac7fe4cc0edba"
dest_uuid: "2da225e91b9b4774bf0cfc4a06304ef5"
mode: GRACEFUL
new_leader_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
 from {username='slave'} at 127.0.0.1:39906
I20260709 12:24:47.658511   813 raft_consensus.cc:606] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 LEADER]: Received request to transfer leadership to TS 4d39a2bcb16746cbbc3ee0223b283ec8
I20260709 12:24:47.672894   738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd63a442787c4e92afd21edb2eb52d8b"
dest_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
mode: GRACEFUL
new_leader_uuid: "2da225e91b9b4774bf0cfc4a06304ef5"
 from {username='slave'} at 127.0.0.1:54298
I20260709 12:24:47.673542   738 raft_consensus.cc:606] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 LEADER]: Received request to transfer leadership to TS 2da225e91b9b4774bf0cfc4a06304ef5
I20260709 12:24:47.682597   813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7151b242a824c578fc38fd73456a71c"
dest_uuid: "2da225e91b9b4774bf0cfc4a06304ef5"
mode: GRACEFUL
new_leader_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
 from {username='slave'} at 127.0.0.1:39906
I20260709 12:24:47.683140   813 raft_consensus.cc:606] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 LEADER]: Received request to transfer leadership to TS 4d39a2bcb16746cbbc3ee0223b283ec8
I20260709 12:24:47.814124   935 consensus_queue.cc:1048] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:47.828086   945 consensus_queue.cc:1048] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.837538   945 raft_consensus.cc:993] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8: : Instructing follower 2da225e91b9b4774bf0cfc4a06304ef5 to start an election
I20260709 12:24:47.838099   935 raft_consensus.cc:1081] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 LEADER]: Signalling peer 2da225e91b9b4774bf0cfc4a06304ef5 to start an election
I20260709 12:24:47.839847   813 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd63a442787c4e92afd21edb2eb52d8b"
dest_uuid: "2da225e91b9b4774bf0cfc4a06304ef5"
 from {username='slave'} at 127.0.0.1:39892
I20260709 12:24:47.840503   813 raft_consensus.cc:493] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:47.840883   813 raft_consensus.cc:3060] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:47.847955   813 raft_consensus.cc:515] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.849787   813 leader_election.cc:290] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [CANDIDATE]: Term 2 election: Requested vote from peers 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65:41317), fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369)
I20260709 12:24:47.850688   738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd63a442787c4e92afd21edb2eb52d8b" candidate_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
I20260709 12:24:47.851354   738 raft_consensus.cc:3055] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:47.851388   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd63a442787c4e92afd21edb2eb52d8b" candidate_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fadb86bd71864c3191194e36a0c49f02"
I20260709 12:24:47.851794   738 raft_consensus.cc:740] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d39a2bcb16746cbbc3ee0223b283ec8, State: Running, Role: LEADER
I20260709 12:24:47.852061   888 raft_consensus.cc:3060] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:47.852841   738 consensus_queue.cc:260] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.854318   738 raft_consensus.cc:3060] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:47.859702   888 raft_consensus.cc:2468] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da225e91b9b4774bf0cfc4a06304ef5 in term 2.
I20260709 12:24:47.860989   777 leader_election.cc:304] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da225e91b9b4774bf0cfc4a06304ef5, fadb86bd71864c3191194e36a0c49f02; no voters: 
I20260709 12:24:47.861418   738 raft_consensus.cc:2468] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da225e91b9b4774bf0cfc4a06304ef5 in term 2.
I20260709 12:24:47.861785   963 raft_consensus.cc:2804] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:47.862488   963 raft_consensus.cc:697] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 LEADER]: Becoming Leader. State: Replica: 2da225e91b9b4774bf0cfc4a06304ef5, State: Running, Role: LEADER
I20260709 12:24:47.863544   963 consensus_queue.cc:237] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:47.870404   629 catalog_manager.cc:5697] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 reported cstate change: term changed from 1 to 2, leader changed from 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65) to 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.025975   963 consensus_queue.cc:1048] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.037007   975 consensus_queue.cc:1048] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:48.048503   976 raft_consensus.cc:993] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5: : Instructing follower 4d39a2bcb16746cbbc3ee0223b283ec8 to start an election
I20260709 12:24:48.049127   941 raft_consensus.cc:1081] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 LEADER]: Signalling peer 4d39a2bcb16746cbbc3ee0223b283ec8 to start an election
I20260709 12:24:48.050844   738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7151b242a824c578fc38fd73456a71c"
dest_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
 from {username='slave'} at 127.0.0.1:54296
I20260709 12:24:48.051357   738 raft_consensus.cc:493] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.051676   738 raft_consensus.cc:3060] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.057358   738 raft_consensus.cc:515] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:48.059850   738 leader_election.cc:290] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 2 election: Requested vote from peers 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66:34473), fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369)
I20260709 12:24:48.060238   813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7151b242a824c578fc38fd73456a71c" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da225e91b9b4774bf0cfc4a06304ef5"
I20260709 12:24:48.060467   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7151b242a824c578fc38fd73456a71c" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fadb86bd71864c3191194e36a0c49f02"
I20260709 12:24:48.060922   813 raft_consensus.cc:3055] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.061146   888 raft_consensus.cc:3060] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.061300   813 raft_consensus.cc:740] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da225e91b9b4774bf0cfc4a06304ef5, State: Running, Role: LEADER
I20260709 12:24:48.062300   813 consensus_queue.cc:260] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:48.063314   813 raft_consensus.cc:3060] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.068014   888 raft_consensus.cc:2468] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 2.
I20260709 12:24:48.069108   813 raft_consensus.cc:2468] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 2.
I20260709 12:24:48.069378   701 leader_election.cc:304] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d39a2bcb16746cbbc3ee0223b283ec8, fadb86bd71864c3191194e36a0c49f02; no voters: 
I20260709 12:24:48.070379   935 raft_consensus.cc:2804] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.070798   935 raft_consensus.cc:697] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 LEADER]: Becoming Leader. State: Replica: 4d39a2bcb16746cbbc3ee0223b283ec8, State: Running, Role: LEADER
I20260709 12:24:48.071593   935 consensus_queue.cc:237] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:48.077570   631 catalog_manager.cc:5697] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 reported cstate change: term changed from 1 to 2, leader changed from 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66) to 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.100342   975 raft_consensus.cc:993] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5: : Instructing follower 4d39a2bcb16746cbbc3ee0223b283ec8 to start an election
I20260709 12:24:48.100840   941 raft_consensus.cc:1081] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 LEADER]: Signalling peer 4d39a2bcb16746cbbc3ee0223b283ec8 to start an election
I20260709 12:24:48.102538   738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6b3a7a543fd41d1bfeac7fe4cc0edba"
dest_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
 from {username='slave'} at 127.0.0.1:54296
I20260709 12:24:48.103120   738 raft_consensus.cc:493] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.103463   738 raft_consensus.cc:3060] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.108942   738 raft_consensus.cc:515] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:48.110563   738 leader_election.cc:290] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 2 election: Requested vote from peers fadb86bd71864c3191194e36a0c49f02 (127.22.43.67:46369), 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66:34473)
I20260709 12:24:48.111462   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b3a7a543fd41d1bfeac7fe4cc0edba" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fadb86bd71864c3191194e36a0c49f02"
I20260709 12:24:48.111733   813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6b3a7a543fd41d1bfeac7fe4cc0edba" candidate_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da225e91b9b4774bf0cfc4a06304ef5"
I20260709 12:24:48.112099   888 raft_consensus.cc:3060] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.112355   813 raft_consensus.cc:3055] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.112746   813 raft_consensus.cc:740] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da225e91b9b4774bf0cfc4a06304ef5, State: Running, Role: LEADER
I20260709 12:24:48.113692   813 consensus_queue.cc:260] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:48.115103   813 raft_consensus.cc:3060] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.119139   888 raft_consensus.cc:2468] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 2.
I20260709 12:24:48.120265   701 leader_election.cc:304] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d39a2bcb16746cbbc3ee0223b283ec8, fadb86bd71864c3191194e36a0c49f02; no voters: 
I20260709 12:24:48.121155   935 raft_consensus.cc:2804] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.121629   935 raft_consensus.cc:697] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 LEADER]: Becoming Leader. State: Replica: 4d39a2bcb16746cbbc3ee0223b283ec8, State: Running, Role: LEADER
I20260709 12:24:48.122191   813 raft_consensus.cc:2468] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d39a2bcb16746cbbc3ee0223b283ec8 in term 2.
I20260709 12:24:48.122706   935 consensus_queue.cc:237] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } }
I20260709 12:24:48.130110   629 catalog_manager.cc:5697] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 reported cstate change: term changed from 1 to 2, leader changed from 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66) to 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65). New cstate: current_term: 2 leader_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.175736   935 consensus_queue.cc:1048] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.186731   979 consensus_queue.cc:1048] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:48.365311   738 raft_consensus.cc:1275] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Refusing update from remote peer 2da225e91b9b4774bf0cfc4a06304ef5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.366655   941 consensus_queue.cc:1048] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:48.374954   888 raft_consensus.cc:1275] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Refusing update from remote peer 2da225e91b9b4774bf0cfc4a06304ef5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.376734   976 consensus_queue.cc:1048] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:48.410454 22701 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:24:48.412444 22701 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:24:48.413079 22701 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:24:48.427707   738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c4bde34a28e417a9184541e9baac84a"
dest_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
mode: GRACEFUL
new_leader_uuid: "fadb86bd71864c3191194e36a0c49f02"
 from {username='slave'} at 127.0.0.1:54304
I20260709 12:24:48.428365   738 raft_consensus.cc:606] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 LEADER]: Received request to transfer leadership to TS fadb86bd71864c3191194e36a0c49f02
I20260709 12:24:48.429638 22701 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:24:48.515012   888 raft_consensus.cc:1275] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Refusing update from remote peer 4d39a2bcb16746cbbc3ee0223b283ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.516595   935 consensus_queue.cc:1048] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:48.527808   813 raft_consensus.cc:1275] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Refusing update from remote peer 4d39a2bcb16746cbbc3ee0223b283ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.531032   935 consensus_queue.cc:1048] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:48.577515   813 raft_consensus.cc:1275] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Refusing update from remote peer 4d39a2bcb16746cbbc3ee0223b283ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.578729   935 consensus_queue.cc:1048] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:48.586550   888 raft_consensus.cc:1275] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Refusing update from remote peer 4d39a2bcb16746cbbc3ee0223b283ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.588201   945 consensus_queue.cc:1048] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:48.693619   979 raft_consensus.cc:993] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8: : Instructing follower fadb86bd71864c3191194e36a0c49f02 to start an election
I20260709 12:24:48.694221   945 raft_consensus.cc:1081] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 LEADER]: Signalling peer fadb86bd71864c3191194e36a0c49f02 to start an election
I20260709 12:24:48.695904   888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c4bde34a28e417a9184541e9baac84a"
dest_uuid: "fadb86bd71864c3191194e36a0c49f02"
 from {username='slave'} at 127.0.0.1:52450
I20260709 12:24:48.696491   888 raft_consensus.cc:493] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.696820   888 raft_consensus.cc:3060] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.702361   888 raft_consensus.cc:515] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:48.704695   888 leader_election.cc:290] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [CANDIDATE]: Term 2 election: Requested vote from peers 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65:41317), 2da225e91b9b4774bf0cfc4a06304ef5 (127.22.43.66:34473)
I20260709 12:24:48.717448   738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4bde34a28e417a9184541e9baac84a" candidate_uuid: "fadb86bd71864c3191194e36a0c49f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8"
I20260709 12:24:48.718158   738 raft_consensus.cc:3055] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.718562   738 raft_consensus.cc:740] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d39a2bcb16746cbbc3ee0223b283ec8, State: Running, Role: LEADER
I20260709 12:24:48.719102   813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4bde34a28e417a9184541e9baac84a" candidate_uuid: "fadb86bd71864c3191194e36a0c49f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da225e91b9b4774bf0cfc4a06304ef5"
I20260709 12:24:48.719805   813 raft_consensus.cc:3060] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.719449   738 consensus_queue.cc:260] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:48.720922   738 raft_consensus.cc:3060] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.725294   813 raft_consensus.cc:2468] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fadb86bd71864c3191194e36a0c49f02 in term 2.
I20260709 12:24:48.726437   738 raft_consensus.cc:2468] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fadb86bd71864c3191194e36a0c49f02 in term 2.
I20260709 12:24:48.726857   853 leader_election.cc:304] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da225e91b9b4774bf0cfc4a06304ef5, fadb86bd71864c3191194e36a0c49f02; no voters: 
I20260709 12:24:48.727849   959 raft_consensus.cc:2804] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.728924   959 raft_consensus.cc:697] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 2 LEADER]: Becoming Leader. State: Replica: fadb86bd71864c3191194e36a0c49f02, State: Running, Role: LEADER
I20260709 12:24:48.729975   959 consensus_queue.cc:237] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } }
I20260709 12:24:48.736503   629 catalog_manager.cc:5697] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 reported cstate change: term changed from 1 to 2, leader changed from 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65) to fadb86bd71864c3191194e36a0c49f02 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "fadb86bd71864c3191194e36a0c49f02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d39a2bcb16746cbbc3ee0223b283ec8" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 41317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da225e91b9b4774bf0cfc4a06304ef5" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 34473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fadb86bd71864c3191194e36a0c49f02" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46369 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:48.791391 22701 tablet_server.cc:179] TabletServer@127.22.43.65:0 shutting down...
I20260709 12:24:48.817965 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:48.818707 22701 tablet_replica.cc:333] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8: stopping tablet replica
I20260709 12:24:48.819391 22701 raft_consensus.cc:2243] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.819818 22701 raft_consensus.cc:2272] T 0c4bde34a28e417a9184541e9baac84a P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.822754 22701 tablet_replica.cc:333] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8: stopping tablet replica
I20260709 12:24:48.823352 22701 raft_consensus.cc:2243] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:48.824229 22701 raft_consensus.cc:2272] T b7151b242a824c578fc38fd73456a71c P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.827316 22701 tablet_replica.cc:333] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8: stopping tablet replica
I20260709 12:24:48.828037 22701 raft_consensus.cc:2243] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:48.828852 22701 raft_consensus.cc:2272] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.831599 22701 tablet_replica.cc:333] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8: stopping tablet replica
I20260709 12:24:48.832100 22701 raft_consensus.cc:2243] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.832532 22701 raft_consensus.cc:2272] T dd63a442787c4e92afd21edb2eb52d8b P 4d39a2bcb16746cbbc3ee0223b283ec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.860301 22701 tablet_server.cc:196] TabletServer@127.22.43.65:0 shutdown complete.
W20260709 12:24:48.862370   779 consensus_peers.cc:597] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 -> Peer 4d39a2bcb16746cbbc3ee0223b283ec8 (127.22.43.65:41317): Couldn't send request to peer 4d39a2bcb16746cbbc3ee0223b283ec8. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:41317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.879360 22701 tablet_server.cc:179] TabletServer@127.22.43.66:0 shutting down...
I20260709 12:24:48.908247 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:48.909109 22701 tablet_replica.cc:333] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5: stopping tablet replica
I20260709 12:24:48.909833 22701 raft_consensus.cc:2243] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.910392 22701 raft_consensus.cc:2272] T b7151b242a824c578fc38fd73456a71c P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.913815 22701 tablet_replica.cc:333] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5: stopping tablet replica
I20260709 12:24:48.914790 22701 raft_consensus.cc:2243] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.915591 22701 raft_consensus.cc:2272] T 0c4bde34a28e417a9184541e9baac84a P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.919422 22701 tablet_replica.cc:333] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5: stopping tablet replica
I20260709 12:24:48.920009 22701 raft_consensus.cc:2243] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:48.921039 22701 raft_consensus.cc:2272] T dd63a442787c4e92afd21edb2eb52d8b P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.924373 22701 tablet_replica.cc:333] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5: stopping tablet replica
I20260709 12:24:48.924978 22701 raft_consensus.cc:2243] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.925448 22701 raft_consensus.cc:2272] T c6b3a7a543fd41d1bfeac7fe4cc0edba P 2da225e91b9b4774bf0cfc4a06304ef5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.952643 22701 tablet_server.cc:196] TabletServer@127.22.43.66:0 shutdown complete.
I20260709 12:24:48.970046 22701 tablet_server.cc:179] TabletServer@127.22.43.67:0 shutting down...
I20260709 12:24:48.991726 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:48.992466 22701 tablet_replica.cc:333] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02: stopping tablet replica
I20260709 12:24:48.993108 22701 raft_consensus.cc:2243] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.993597 22701 raft_consensus.cc:2272] T b7151b242a824c578fc38fd73456a71c P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.996528 22701 tablet_replica.cc:333] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02: stopping tablet replica
I20260709 12:24:48.997134 22701 raft_consensus.cc:2243] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:48.997776 22701 pending_rounds.cc:70] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02: Trying to abort 1 pending ops.
I20260709 12:24:48.998006 22701 pending_rounds.cc:77] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625144246108160 op_type: NO_OP noop_request { }
I20260709 12:24:48.998313 22701 raft_consensus.cc:2889] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:24:48.998605 22701 raft_consensus.cc:2272] T 0c4bde34a28e417a9184541e9baac84a P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.001366 22701 tablet_replica.cc:333] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02: stopping tablet replica
I20260709 12:24:49.001993 22701 raft_consensus.cc:2243] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.002439 22701 raft_consensus.cc:2272] T c6b3a7a543fd41d1bfeac7fe4cc0edba P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.005394 22701 tablet_replica.cc:333] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02: stopping tablet replica
I20260709 12:24:49.006049 22701 raft_consensus.cc:2243] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.006552 22701 raft_consensus.cc:2272] T dd63a442787c4e92afd21edb2eb52d8b P fadb86bd71864c3191194e36a0c49f02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.032399 22701 tablet_server.cc:196] TabletServer@127.22.43.67:0 shutdown complete.
I20260709 12:24:49.048857 22701 master.cc:562] Master@127.22.43.126:33533 shutting down...
I20260709 12:24:49.071357 22701 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:49.071954 22701 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.072280 22701 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0ccdc883a07844e18eb8d74d55bddb95: stopping tablet replica
I20260709 12:24:49.093628 22701 master.cc:584] Master@127.22.43.126:33533 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2858 ms)
[----------] 6 tests from LeaderRebalancerTest (362144 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:24:49.133411 22701 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.43.126:39765
I20260709 12:24:49.134605 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:49.140043   996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:49.140297   997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:49.140981   999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:49.143164 22701 server_base.cc:1061] running on GCE node
I20260709 12:24:49.143981 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:49.144238 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:49.144362 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599889144350 us; error 0 us; skew 500 ppm
I20260709 12:24:49.144838 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:49.147202 22701 webserver.cc:533] Webserver started at http://127.22.43.126:37201/ using document root <none> and password file <none>
I20260709 12:24:49.147639 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:49.147801 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:49.148007 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:49.149093 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/master-0-root/instance:
uuid: "fef148db4ec843ebbe3f34537620d4ad"
format_stamp: "Formatted at 2026-07-09 12:24:49 on dist-test-slave-0768"
I20260709 12:24:49.153560 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:24:49.157609  1004 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:49.158579 22701 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:24:49.158916 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/master-0-root
uuid: "fef148db4ec843ebbe3f34537620d4ad"
format_stamp: "Formatted at 2026-07-09 12:24:49 on dist-test-slave-0768"
I20260709 12:24:49.159231 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:49.175781 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:49.177150 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:49.219834 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.126:39765
I20260709 12:24:49.219937  1056 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.126:39765 every 8 connection(s)
I20260709 12:24:49.223982  1057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.235405  1057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad: Bootstrap starting.
I20260709 12:24:49.240298  1057 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:49.244467  1057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad: No bootstrap required, opened a new log
I20260709 12:24:49.246702  1057 raft_consensus.cc:359] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef148db4ec843ebbe3f34537620d4ad" member_type: VOTER }
I20260709 12:24:49.247072  1057 raft_consensus.cc:385] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:49.247255  1057 raft_consensus.cc:740] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef148db4ec843ebbe3f34537620d4ad, State: Initialized, Role: FOLLOWER
I20260709 12:24:49.247748  1057 consensus_queue.cc:260] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef148db4ec843ebbe3f34537620d4ad" member_type: VOTER }
I20260709 12:24:49.248149  1057 raft_consensus.cc:399] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:49.248333  1057 raft_consensus.cc:493] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:49.248538  1057 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:49.253279  1057 raft_consensus.cc:515] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef148db4ec843ebbe3f34537620d4ad" member_type: VOTER }
I20260709 12:24:49.253734  1057 leader_election.cc:304] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fef148db4ec843ebbe3f34537620d4ad; no voters: 
I20260709 12:24:49.254871  1057 leader_election.cc:290] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:49.255260  1060 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:49.256768  1060 raft_consensus.cc:697] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [term 1 LEADER]: Becoming Leader. State: Replica: fef148db4ec843ebbe3f34537620d4ad, State: Running, Role: LEADER
I20260709 12:24:49.257510  1060 consensus_queue.cc:237] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef148db4ec843ebbe3f34537620d4ad" member_type: VOTER }
I20260709 12:24:49.257848  1057 sys_catalog.cc:565] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:49.260607  1061 sys_catalog.cc:455] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fef148db4ec843ebbe3f34537620d4ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef148db4ec843ebbe3f34537620d4ad" member_type: VOTER } }
I20260709 12:24:49.260629  1062 sys_catalog.cc:455] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader fef148db4ec843ebbe3f34537620d4ad. Latest consensus state: current_term: 1 leader_uuid: "fef148db4ec843ebbe3f34537620d4ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef148db4ec843ebbe3f34537620d4ad" member_type: VOTER } }
I20260709 12:24:49.261480  1062 sys_catalog.cc:458] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:49.261456  1061 sys_catalog.cc:458] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:49.268082  1066 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:49.274734  1066 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:49.275731 22701 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:49.284423  1066 catalog_manager.cc:1383] Generated new cluster ID: 28fccaeebb854203a2cde764b6b55180
I20260709 12:24:49.284754  1066 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:49.311902  1066 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:49.313271  1066 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:49.332732  1066 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad: Generated new TSK 0
I20260709 12:24:49.333384  1066 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:49.342943 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:49.349352  1078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:49.350075  1079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:49.351082  1081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:49.351969 22701 server_base.cc:1061] running on GCE node
I20260709 12:24:49.352805 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:49.352985 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:49.353118 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599889353107 us; error 0 us; skew 500 ppm
I20260709 12:24:49.353600 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:49.355868 22701 webserver.cc:533] Webserver started at http://127.22.43.65:44681/ using document root <none> and password file <none>
I20260709 12:24:49.356318 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:49.356472 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:49.356691 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:49.357726 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-0-root/instance:
uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
format_stamp: "Formatted at 2026-07-09 12:24:49 on dist-test-slave-0768"
I20260709 12:24:49.362490 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:24:49.365826  1086 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:49.366674 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:24:49.366966 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-0-root
uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
format_stamp: "Formatted at 2026-07-09 12:24:49 on dist-test-slave-0768"
I20260709 12:24:49.367265 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:49.376418 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:49.377635 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:49.379166 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:49.381484 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:49.381706 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:49.382001 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:49.382191 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:49.423009 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.65:38885
I20260709 12:24:49.423116  1148 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.65:38885 every 8 connection(s)
I20260709 12:24:49.428470 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:49.435341  1153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:49.441155  1154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:49.444387 22701 server_base.cc:1061] running on GCE node
W20260709 12:24:49.444581  1156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:49.444792  1149 heartbeater.cc:344] Connected to a master server at 127.22.43.126:39765
I20260709 12:24:49.445297  1149 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:49.446422  1149 heartbeater.cc:507] Master 127.22.43.126:39765 requested a full tablet report, sending...
I20260709 12:24:49.446655 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:49.446954 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:49.447153 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599889447133 us; error 0 us; skew 500 ppm
I20260709 12:24:49.447924 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:49.448800  1022 ts_manager.cc:194] Registered new tserver with Master: 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885)
I20260709 12:24:49.450618 22701 webserver.cc:533] Webserver started at http://127.22.43.66:34917/ using document root <none> and password file <none>
I20260709 12:24:49.451159 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:49.451100  1022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34320
I20260709 12:24:49.451529 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:49.451887 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:49.453529 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-1-root/instance:
uuid: "cb26883861e84d4d9cddb3349fcf7d34"
format_stamp: "Formatted at 2026-07-09 12:24:49 on dist-test-slave-0768"
I20260709 12:24:49.458920 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:49.462499  1162 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:49.463274 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:24:49.463585 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-1-root
uuid: "cb26883861e84d4d9cddb3349fcf7d34"
format_stamp: "Formatted at 2026-07-09 12:24:49 on dist-test-slave-0768"
I20260709 12:24:49.463900 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:49.483505 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:49.484722 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:49.486276 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:49.488543 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:49.488778 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:49.489018 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:49.489192 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:49.530377 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.66:33951
I20260709 12:24:49.530476  1224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.66:33951 every 8 connection(s)
I20260709 12:24:49.535327 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:49.542941  1228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:49.544062  1229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:49.546869  1225 heartbeater.cc:344] Connected to a master server at 127.22.43.126:39765
I20260709 12:24:49.547416  1225 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:49.548031 22701 server_base.cc:1061] running on GCE node
W20260709 12:24:49.548265  1231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:49.548496  1225 heartbeater.cc:507] Master 127.22.43.126:39765 requested a full tablet report, sending...
I20260709 12:24:49.549304 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:49.549568 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:49.549810 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599889549788 us; error 0 us; skew 500 ppm
I20260709 12:24:49.550488 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:49.550812  1022 ts_manager.cc:194] Registered new tserver with Master: cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:49.552387  1022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34322
I20260709 12:24:49.552932 22701 webserver.cc:533] Webserver started at http://127.22.43.67:40637/ using document root <none> and password file <none>
I20260709 12:24:49.553593 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:49.553814 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:49.554153 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:49.555341 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-2-root/instance:
uuid: "787cff824e6646138b52e01a3a203597"
format_stamp: "Formatted at 2026-07-09 12:24:49 on dist-test-slave-0768"
I20260709 12:24:49.559810 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:24:49.563236  1236 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:49.564014 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:24:49.564332 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-2-root
uuid: "787cff824e6646138b52e01a3a203597"
format_stamp: "Formatted at 2026-07-09 12:24:49 on dist-test-slave-0768"
I20260709 12:24:49.564636 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599526815862-22701-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:49.580103 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:49.581308 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:49.582818 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:49.585215 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:49.585458 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:49.585706 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:49.585879 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:49.625633 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.67:33923
I20260709 12:24:49.625732  1298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.67:33923 every 8 connection(s)
I20260709 12:24:49.640228  1299 heartbeater.cc:344] Connected to a master server at 127.22.43.126:39765
I20260709 12:24:49.640617  1299 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:49.641387  1299 heartbeater.cc:507] Master 127.22.43.126:39765 requested a full tablet report, sending...
I20260709 12:24:49.643368  1022 ts_manager.cc:194] Registered new tserver with Master: 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:49.643895 22701 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014721402s
I20260709 12:24:49.644869  1022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34332
I20260709 12:24:49.669433  1022 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34346:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:49.672247  1022 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:49.739616  1114 tablet_service.cc:1511] Processing CreateTablet for tablet 640ad567937c4867ace7c1927c63be92 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:49.741125  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640ad567937c4867ace7c1927c63be92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.742969  1113 tablet_service.cc:1511] Processing CreateTablet for tablet df8a73b264c24f7293a10162ef2c5a79 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:49.744499  1113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8a73b264c24f7293a10162ef2c5a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.744936  1190 tablet_service.cc:1511] Processing CreateTablet for tablet 640ad567937c4867ace7c1927c63be92 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:49.746587  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640ad567937c4867ace7c1927c63be92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.747013  1185 tablet_service.cc:1511] Processing CreateTablet for tablet f857dba63c984a3fbfdbb1b27799e38b (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:49.748174  1111 tablet_service.cc:1511] Processing CreateTablet for tablet 26cdc8855ada47f7a65e9f1befef6ee1 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:49.748606  1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f857dba63c984a3fbfdbb1b27799e38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.749573  1111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26cdc8855ada47f7a65e9f1befef6ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.749224  1189 tablet_service.cc:1511] Processing CreateTablet for tablet df8a73b264c24f7293a10162ef2c5a79 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:49.758781  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8a73b264c24f7293a10162ef2c5a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.751155  1188 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa072525af2477389a5e6c6fd3b94ba (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:49.752784  1109 tablet_service.cc:1511] Processing CreateTablet for tablet f857dba63c984a3fbfdbb1b27799e38b (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:49.753183  1187 tablet_service.cc:1511] Processing CreateTablet for tablet 26cdc8855ada47f7a65e9f1befef6ee1 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:49.747066  1112 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa072525af2477389a5e6c6fd3b94ba (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:49.764199  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa072525af2477389a5e6c6fd3b94ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.764833  1112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa072525af2477389a5e6c6fd3b94ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.755285  1186 tablet_service.cc:1511] Processing CreateTablet for tablet 440a9e5626d64a9fbba9c7b6135232ea (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:49.751058  1110 tablet_service.cc:1511] Processing CreateTablet for tablet 440a9e5626d64a9fbba9c7b6135232ea (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:49.764884  1187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26cdc8855ada47f7a65e9f1befef6ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.766798  1110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440a9e5626d64a9fbba9c7b6135232ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.768587  1186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440a9e5626d64a9fbba9c7b6135232ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.769248  1109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f857dba63c984a3fbfdbb1b27799e38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.793080  1108 tablet_service.cc:1511] Processing CreateTablet for tablet 4a584d9db72c4c9daba1e998de3dc937 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:49.795337  1108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a584d9db72c4c9daba1e998de3dc937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.800525  1184 tablet_service.cc:1511] Processing CreateTablet for tablet 4a584d9db72c4c9daba1e998de3dc937 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:49.802495  1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a584d9db72c4c9daba1e998de3dc937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.812671  1114 tablet_service.cc:1511] Processing CreateTablet for tablet 2aa9d703663449caa4946ee295c4fe51 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:49.814576  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aa9d703663449caa4946ee295c4fe51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.824493  1183 tablet_service.cc:1511] Processing CreateTablet for tablet 2aa9d703663449caa4946ee295c4fe51 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:49.828492  1107 tablet_service.cc:1511] Processing CreateTablet for tablet 0b33be2a6a0540eca49d02011b933bd9 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:49.830263  1107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b33be2a6a0540eca49d02011b933bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.834810  1183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aa9d703663449caa4946ee295c4fe51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.855854  1185 tablet_service.cc:1511] Processing CreateTablet for tablet 0b33be2a6a0540eca49d02011b933bd9 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:49.859696  1313 tablet_bootstrap.cc:492] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:49.860018  1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b33be2a6a0540eca49d02011b933bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.874706  1314 tablet_bootstrap.cc:492] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:49.886032  1313 tablet_bootstrap.cc:654] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:49.906261  1264 tablet_service.cc:1511] Processing CreateTablet for tablet 640ad567937c4867ace7c1927c63be92 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:49.907712  1264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640ad567937c4867ace7c1927c63be92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.911368  1263 tablet_service.cc:1511] Processing CreateTablet for tablet df8a73b264c24f7293a10162ef2c5a79 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:49.913182  1263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8a73b264c24f7293a10162ef2c5a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.913612  1314 tablet_bootstrap.cc:654] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:49.916785  1261 tablet_service.cc:1511] Processing CreateTablet for tablet 26cdc8855ada47f7a65e9f1befef6ee1 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:49.918236  1261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26cdc8855ada47f7a65e9f1befef6ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.919073  1260 tablet_service.cc:1511] Processing CreateTablet for tablet 440a9e5626d64a9fbba9c7b6135232ea (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:49.920400  1260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440a9e5626d64a9fbba9c7b6135232ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.915066  1262 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa072525af2477389a5e6c6fd3b94ba (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:49.922735  1262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa072525af2477389a5e6c6fd3b94ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.917551  1259 tablet_service.cc:1511] Processing CreateTablet for tablet f857dba63c984a3fbfdbb1b27799e38b (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:49.925693  1259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f857dba63c984a3fbfdbb1b27799e38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.916213  1313 tablet_bootstrap.cc:492] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:49.929493  1313 ts_tablet_manager.cc:1403] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.011s
I20260709 12:24:49.933640  1313 raft_consensus.cc:359] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:49.934688  1313 raft_consensus.cc:385] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:49.934998  1258 tablet_service.cc:1511] Processing CreateTablet for tablet 4a584d9db72c4c9daba1e998de3dc937 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:49.936518  1258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a584d9db72c4c9daba1e998de3dc937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.937870  1314 tablet_bootstrap.cc:492] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:49.938494  1314 ts_tablet_manager.cc:1403] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.015s
I20260709 12:24:49.939167  1257 tablet_service.cc:1511] Processing CreateTablet for tablet 2aa9d703663449caa4946ee295c4fe51 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:49.940554  1257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aa9d703663449caa4946ee295c4fe51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.941682  1314 raft_consensus.cc:359] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:49.942509  1314 raft_consensus.cc:385] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:49.942844  1314 raft_consensus.cc:740] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:49.944147  1314 consensus_queue.cc:260] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:49.945281  1256 tablet_service.cc:1511] Processing CreateTablet for tablet 0b33be2a6a0540eca49d02011b933bd9 (DEFAULT_TABLE table=test-workload [id=bec1c031090340d4ab67f992789595df]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:49.946728  1256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b33be2a6a0540eca49d02011b933bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:49.953038  1314 ts_tablet_manager.cc:1434] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:24:49.953272  1149 heartbeater.cc:499] Master 127.22.43.126:39765 was elected leader, sending a full tablet report...
I20260709 12:24:49.954360  1314 tablet_bootstrap.cc:492] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:49.961016  1314 tablet_bootstrap.cc:654] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:49.935067  1313 raft_consensus.cc:740] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:49.979975  1313 consensus_queue.cc:260] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:49.981940  1320 raft_consensus.cc:493] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.997008  1320 raft_consensus.cc:515] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.003633  1320 leader_election.cc:290] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:49.988337  1318 tablet_bootstrap.cc:492] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:50.010872  1318 tablet_bootstrap.cc:654] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.018009  1314 tablet_bootstrap.cc:492] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:50.018630  1314 ts_tablet_manager.cc:1403] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.065s	user 0.025s	sys 0.022s
I20260709 12:24:50.021693  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cdc8855ada47f7a65e9f1befef6ee1" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
W20260709 12:24:50.024191  1090 leader_election.cc:343] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.021766  1314 raft_consensus.cc:359] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.026160  1314 raft_consensus.cc:385] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.026614  1314 raft_consensus.cc:740] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.027737  1314 consensus_queue.cc:260] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.030378  1314 ts_tablet_manager.cc:1434] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:24:50.030953  1225 heartbeater.cc:499] Master 127.22.43.126:39765 was elected leader, sending a full tablet report...
I20260709 12:24:50.031450  1314 tablet_bootstrap.cc:492] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:50.033913  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cdc8855ada47f7a65e9f1befef6ee1" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
W20260709 12:24:50.036788  1090 leader_election.cc:343] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.037271  1090 leader_election.cc:304] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:50.026887  1313 ts_tablet_manager.cc:1434] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.004s
I20260709 12:24:50.039286  1320 raft_consensus.cc:2749] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.039710  1313 tablet_bootstrap.cc:492] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:50.040380  1314 tablet_bootstrap.cc:654] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.047519  1318 tablet_bootstrap.cc:492] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:50.048246  1318 ts_tablet_manager.cc:1403] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.017s
I20260709 12:24:50.048278  1313 tablet_bootstrap.cc:654] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.052443  1318 raft_consensus.cc:359] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.053320  1318 raft_consensus.cc:385] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.053663  1318 raft_consensus.cc:740] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.054500  1318 consensus_queue.cc:260] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.055377  1314 tablet_bootstrap.cc:492] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:50.056092  1314 ts_tablet_manager.cc:1403] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.015s
I20260709 12:24:50.063851  1318 ts_tablet_manager.cc:1434] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 12:24:50.064040  1313 tablet_bootstrap.cc:492] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:50.064778  1313 ts_tablet_manager.cc:1403] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.012s
I20260709 12:24:50.064975  1299 heartbeater.cc:499] Master 127.22.43.126:39765 was elected leader, sending a full tablet report...
I20260709 12:24:50.065205  1318 tablet_bootstrap.cc:492] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:50.068776  1313 raft_consensus.cc:359] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.069733  1313 raft_consensus.cc:385] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.070191  1313 raft_consensus.cc:740] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.060472  1314 raft_consensus.cc:359] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.070945  1314 raft_consensus.cc:385] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.071349  1314 raft_consensus.cc:740] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.071439  1313 consensus_queue.cc:260] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.072464  1318 tablet_bootstrap.cc:654] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.072471  1314 consensus_queue.cc:260] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.075367  1314 ts_tablet_manager.cc:1434] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:24:50.076496  1314 tablet_bootstrap.cc:492] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:50.081156  1313 ts_tablet_manager.cc:1434] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 12:24:50.082561  1313 tablet_bootstrap.cc:492] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:50.084080  1314 tablet_bootstrap.cc:654] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.091066  1313 tablet_bootstrap.cc:654] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.097236  1314 tablet_bootstrap.cc:492] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:50.098171  1314 ts_tablet_manager.cc:1403] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 12:24:50.101763  1314 raft_consensus.cc:359] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.102798  1314 raft_consensus.cc:385] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.103227  1314 raft_consensus.cc:740] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.104282  1314 consensus_queue.cc:260] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.107396  1314 ts_tablet_manager.cc:1434] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:24:50.108660  1314 tablet_bootstrap.cc:492] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:50.114419  1318 tablet_bootstrap.cc:492] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:50.115068  1318 ts_tablet_manager.cc:1403] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.027s
I20260709 12:24:50.115566  1313 tablet_bootstrap.cc:492] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:50.116219  1313 ts_tablet_manager.cc:1403] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.007s
I20260709 12:24:50.116254  1314 tablet_bootstrap.cc:654] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.118347  1318 raft_consensus.cc:359] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.119263  1318 raft_consensus.cc:385] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.119669  1318 raft_consensus.cc:740] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.119936  1313 raft_consensus.cc:359] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.120893  1313 raft_consensus.cc:385] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.120653  1318 consensus_queue.cc:260] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.121258  1313 raft_consensus.cc:740] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.122387  1314 tablet_bootstrap.cc:492] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:50.122295  1313 consensus_queue.cc:260] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.122967  1318 ts_tablet_manager.cc:1434] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:50.122987  1314 ts_tablet_manager.cc:1403] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:24:50.124378  1318 tablet_bootstrap.cc:492] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:50.126510  1314 raft_consensus.cc:359] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.127259  1314 raft_consensus.cc:385] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.127569  1314 raft_consensus.cc:740] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.128480  1314 consensus_queue.cc:260] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.132413  1313 ts_tablet_manager.cc:1434] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 12:24:50.132871  1314 ts_tablet_manager.cc:1434] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:24:50.132916  1318 tablet_bootstrap.cc:654] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.134240  1314 tablet_bootstrap.cc:492] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:50.143354  1314 tablet_bootstrap.cc:654] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.144685  1313 tablet_bootstrap.cc:492] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:50.151396  1313 tablet_bootstrap.cc:654] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.154770  1318 tablet_bootstrap.cc:492] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:50.155370  1318 ts_tablet_manager.cc:1403] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.009s
I20260709 12:24:50.155712  1314 tablet_bootstrap.cc:492] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:50.156322  1314 ts_tablet_manager.cc:1403] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 12:24:50.157308  1313 tablet_bootstrap.cc:492] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:50.157812  1313 ts_tablet_manager.cc:1403] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 12:24:50.158463  1318 raft_consensus.cc:359] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.159271  1318 raft_consensus.cc:385] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.159608  1323 raft_consensus.cc:493] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.159937  1318 raft_consensus.cc:740] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.159310  1314 raft_consensus.cc:359] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.160471  1314 raft_consensus.cc:385] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.160405  1323 raft_consensus.cc:515] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.160945  1314 raft_consensus.cc:740] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.161005  1313 raft_consensus.cc:359] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.160986  1318 consensus_queue.cc:260] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.162403  1313 raft_consensus.cc:385] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.162797  1313 raft_consensus.cc:740] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.163818  1313 consensus_queue.cc:260] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.164448  1318 ts_tablet_manager.cc:1434] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:24:50.165576  1318 tablet_bootstrap.cc:492] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:50.167135  1323 leader_election.cc:290] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.172811  1318 tablet_bootstrap.cc:654] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.176447  1327 raft_consensus.cc:493] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.176221  1314 consensus_queue.cc:260] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.177011  1323 raft_consensus.cc:493] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.176931  1327 raft_consensus.cc:515] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.180298  1323 raft_consensus.cc:515] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.182423  1327 leader_election.cc:290] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:50.182737  1323 leader_election.cc:290] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.185093  1314 ts_tablet_manager.cc:1434] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:24:50.186681  1313 ts_tablet_manager.cc:1434] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.006s
I20260709 12:24:50.188139  1314 tablet_bootstrap.cc:492] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:50.192284  1313 tablet_bootstrap.cc:492] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:50.200719  1313 tablet_bootstrap.cc:654] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.206676  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ad567937c4867ace7c1927c63be92" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:50.207859  1124 raft_consensus.cc:2468] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 0.
I20260709 12:24:50.210549  1166 leader_election.cc:304] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:50.211638  1336 raft_consensus.cc:2804] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.208112  1318 tablet_bootstrap.cc:492] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:50.212090  1336 raft_consensus.cc:493] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.212054  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b33be2a6a0540eca49d02011b933bd9" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:50.212772  1336 raft_consensus.cc:3060] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.212882  1318 ts_tablet_manager.cc:1403] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.009s
W20260709 12:24:50.213959  1166 leader_election.cc:343] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.215422  1314 tablet_bootstrap.cc:654] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.215801  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ad567937c4867ace7c1927c63be92" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:50.216462  1318 raft_consensus.cc:359] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.217308  1318 raft_consensus.cc:385] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.218452  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b33be2a6a0540eca49d02011b933bd9" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
W20260709 12:24:50.219597  1166 leader_election.cc:343] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.226605  1313 tablet_bootstrap.cc:492] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:50.227365  1313 ts_tablet_manager.cc:1403] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.007s
I20260709 12:24:50.217631  1318 raft_consensus.cc:740] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.231050  1320 raft_consensus.cc:493] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.231668  1320 raft_consensus.cc:515] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.232472  1314 tablet_bootstrap.cc:492] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:50.231906  1336 raft_consensus.cc:515] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.233034  1314 ts_tablet_manager.cc:1403] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.009s
I20260709 12:24:50.233966  1320 leader_election.cc:290] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.234581  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:50.235777  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ad567937c4867ace7c1927c63be92" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:50.237664  1336 leader_election.cc:290] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.236539  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440a9e5626d64a9fbba9c7b6135232ea" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:50.231354  1313 raft_consensus.cc:359] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.237107  1327 raft_consensus.cc:493] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.239110  1272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ad567937c4867ace7c1927c63be92" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:50.239585  1273 raft_consensus.cc:2468] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 0.
I20260709 12:24:50.239789  1327 raft_consensus.cc:515] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.236534  1314 raft_consensus.cc:359] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.235988  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440a9e5626d64a9fbba9c7b6135232ea" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:50.238796  1124 raft_consensus.cc:2468] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 0.
W20260709 12:24:50.241408  1166 leader_election.cc:343] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.241663  1090 leader_election.cc:304] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:50.247668  1320 raft_consensus.cc:2804] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:24:50.248009  1090 leader_election.cc:343] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.231612  1318 consensus_queue.cc:260] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.242419  1327 leader_election.cc:290] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:50.248840  1317 raft_consensus.cc:493] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.249044  1240 leader_election.cc:304] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:50.249274  1274 raft_consensus.cc:2468] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 0.
I20260709 12:24:50.249974  1327 raft_consensus.cc:2804] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.249506  1317 raft_consensus.cc:515] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.244266  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa072525af2477389a5e6c6fd3b94ba" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:50.248172  1320 raft_consensus.cc:493] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.250860  1320 raft_consensus.cc:3060] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.250991  1122 raft_consensus.cc:2468] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 0.
I20260709 12:24:50.252777  1317 leader_election.cc:290] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.247862  1314 raft_consensus.cc:385] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.253468  1314 raft_consensus.cc:740] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.254171  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa072525af2477389a5e6c6fd3b94ba" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:50.254398  1314 consensus_queue.cc:260] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.254783  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f857dba63c984a3fbfdbb1b27799e38b" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:50.255038  1199 raft_consensus.cc:2468] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 0.
I20260709 12:24:50.238160  1123 raft_consensus.cc:3060] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:50.256335  1090 leader_election.cc:343] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.254096  1166 leader_election.cc:304] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34; no voters: 9e2deb8701624db5b7da4b2dd7b0e76a
I20260709 12:24:50.257254  1314 ts_tablet_manager.cc:1434] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:24:50.258564  1314 tablet_bootstrap.cc:492] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:50.258428  1240 leader_election.cc:304] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:50.259227  1336 raft_consensus.cc:2804] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.259790  1336 raft_consensus.cc:493] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.260133  1336 raft_consensus.cc:3060] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.260998  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f857dba63c984a3fbfdbb1b27799e38b" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:50.261677  1199 raft_consensus.cc:2468] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 0.
I20260709 12:24:50.250336  1327 raft_consensus.cc:493] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.262428  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:50.263135  1327 raft_consensus.cc:3060] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.266698  1314 tablet_bootstrap.cc:654] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.243633  1313 raft_consensus.cc:385] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.267942  1313 raft_consensus.cc:740] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
W20260709 12:24:50.269245  1070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:50.263782  1090 leader_election.cc:304] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597
I20260709 12:24:50.269824  1313 consensus_queue.cc:260] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.270862  1317 raft_consensus.cc:2804] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.271301  1317 raft_consensus.cc:493] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.271685  1317 raft_consensus.cc:3060] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.272246  1123 raft_consensus.cc:2468] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:50.274371  1345 raft_consensus.cc:2804] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.278656  1345 raft_consensus.cc:493] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.279083  1345 raft_consensus.cc:3060] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.279384  1166 leader_election.cc:304] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597
I20260709 12:24:50.280851  1323 raft_consensus.cc:2804] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.278002  1313 ts_tablet_manager.cc:1434] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.003s
I20260709 12:24:50.272284  1336 raft_consensus.cc:515] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.284330  1336 leader_election.cc:290] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.285974  1313 tablet_bootstrap.cc:492] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:50.286435  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b33be2a6a0540eca49d02011b933bd9" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:50.287420  1274 raft_consensus.cc:3060] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.291174  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b33be2a6a0540eca49d02011b933bd9" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:50.292150  1122 raft_consensus.cc:3060] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.296273  1320 raft_consensus.cc:515] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.298547  1314 tablet_bootstrap.cc:492] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:50.299115  1314 ts_tablet_manager.cc:1403] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.010s
I20260709 12:24:50.301513  1327 raft_consensus.cc:515] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.302953  1314 raft_consensus.cc:359] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.303673  1314 raft_consensus.cc:385] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.303262  1122 raft_consensus.cc:2468] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:50.303974  1327 leader_election.cc:290] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:50.305234  1166 leader_election.cc:304] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:50.307564  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440a9e5626d64a9fbba9c7b6135232ea" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:50.308336  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440a9e5626d64a9fbba9c7b6135232ea" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:50.308970  1273 raft_consensus.cc:3060] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:50.309494  1090 leader_election.cc:343] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.309418  1317 raft_consensus.cc:515] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.311760  1317 leader_election.cc:290] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.312302  1320 leader_election.cc:290] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.312594  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f857dba63c984a3fbfdbb1b27799e38b" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:50.313381  1200 raft_consensus.cc:3060] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:50.313572  1240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:33951, user_credentials={real_user=slave}} blocked reactor thread for 55231.4us
I20260709 12:24:50.304006  1314 raft_consensus.cc:740] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.314780  1314 consensus_queue.cc:260] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
W20260709 12:24:50.316305  1240 leader_election.cc:343] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.307132  1345 raft_consensus.cc:515] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.317250  1272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f857dba63c984a3fbfdbb1b27799e38b" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:50.318660  1336 raft_consensus.cc:2804] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.318758  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:50.319275  1314 ts_tablet_manager.cc:1434] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:24:50.320379  1314 tablet_bootstrap.cc:492] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:50.320842  1318 ts_tablet_manager.cc:1434] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.107s	user 0.004s	sys 0.004s
I20260709 12:24:50.323932  1318 tablet_bootstrap.cc:492] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
W20260709 12:24:50.321717  1090 leader_election.cc:343] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.319362  1336 raft_consensus.cc:697] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:50.317584  1273 raft_consensus.cc:2468] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 1.
I20260709 12:24:50.307674  1274 raft_consensus.cc:2468] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:50.326524  1314 tablet_bootstrap.cc:654] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.326939  1323 raft_consensus.cc:697] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:50.330209  1090 leader_election.cc:304] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: cb26883861e84d4d9cddb3349fcf7d34
W20260709 12:24:50.330018  1240 leader_election.cc:343] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.312397  1313 tablet_bootstrap.cc:654] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.329859  1323 consensus_queue.cc:237] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.328228  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:50.332173  1122 raft_consensus.cc:3060] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.335183  1345 leader_election.cc:290] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:50.331489  1320 raft_consensus.cc:2804] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.339354  1320 raft_consensus.cc:697] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:50.339402  1200 raft_consensus.cc:2468] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 1.
I20260709 12:24:50.340374  1320 consensus_queue.cc:237] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.340973  1090 leader_election.cc:304] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597
I20260709 12:24:50.337389  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa072525af2477389a5e6c6fd3b94ba" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:50.338261  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa072525af2477389a5e6c6fd3b94ba" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:50.342222  1199 raft_consensus.cc:3060] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.342265  1123 raft_consensus.cc:3060] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.344020  1317 raft_consensus.cc:2804] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.344524  1317 raft_consensus.cc:697] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:50.345337  1317 consensus_queue.cc:237] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.350530  1123 raft_consensus.cc:2468] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 1.
I20260709 12:24:50.341758  1313 tablet_bootstrap.cc:492] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:50.351588  1313 ts_tablet_manager.cc:1403] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.006s
I20260709 12:24:50.352893  1318 tablet_bootstrap.cc:654] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.356575  1240 leader_election.cc:304] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:50.357661  1345 raft_consensus.cc:2804] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.358248  1345 raft_consensus.cc:697] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Becoming Leader. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:50.353113  1122 raft_consensus.cc:2468] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 1.
I20260709 12:24:50.359079  1345 consensus_queue.cc:237] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.361750  1240 leader_election.cc:304] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:50.328343  1336 consensus_queue.cc:237] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.354930  1313 raft_consensus.cc:359] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.364444  1313 raft_consensus.cc:385] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.365159  1313 raft_consensus.cc:740] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.367100  1344 raft_consensus.cc:2804] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.367713  1344 raft_consensus.cc:697] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Becoming Leader. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:50.368590  1344 consensus_queue.cc:237] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.366336  1313 consensus_queue.cc:260] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.379498  1021 catalog_manager.cc:5697] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.381002  1199 raft_consensus.cc:2468] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 1.
I20260709 12:24:50.385023  1314 tablet_bootstrap.cc:492] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:50.386072  1314 ts_tablet_manager.cc:1403] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.009s
I20260709 12:24:50.388159  1323 raft_consensus.cc:493] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.388849  1323 raft_consensus.cc:515] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.392165  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:50.393383  1123 raft_consensus.cc:2393] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb26883861e84d4d9cddb3349fcf7d34 in current term 1: Already voted for candidate 787cff824e6646138b52e01a3a203597 in this term.
I20260709 12:24:50.396493  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:50.398540  1313 ts_tablet_manager.cc:1434] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 12:24:50.401602  1323 leader_election.cc:290] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.403581  1166 leader_election.cc:304] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a
I20260709 12:24:50.404332  1313 tablet_bootstrap.cc:492] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:50.404870  1336 raft_consensus.cc:3060] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.407141  1022 catalog_manager.cc:5697] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 reported cstate change: term changed from 0 to 1, leader changed from <none> to 787cff824e6646138b52e01a3a203597 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "787cff824e6646138b52e01a3a203597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:50.412884  1314 raft_consensus.cc:359] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.413781  1314 raft_consensus.cc:385] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.414065  1314 raft_consensus.cc:740] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.414670  1313 tablet_bootstrap.cc:654] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.414954  1314 consensus_queue.cc:260] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.417668  1314 ts_tablet_manager.cc:1434] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:24:50.417775  1318 tablet_bootstrap.cc:492] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:50.418442  1318 ts_tablet_manager.cc:1403] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.007s
I20260709 12:24:50.422430  1318 raft_consensus.cc:359] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.423507  1318 raft_consensus.cc:385] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.424005  1318 raft_consensus.cc:740] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.423025  1019 catalog_manager.cc:5697] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 1 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.425122  1318 consensus_queue.cc:260] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.428316  1318 ts_tablet_manager.cc:1434] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:24:50.429690  1318 tablet_bootstrap.cc:492] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:50.423516  1336 raft_consensus.cc:2749] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.441619  1318 tablet_bootstrap.cc:654] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.441831  1313 tablet_bootstrap.cc:492] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:50.442525  1313 ts_tablet_manager.cc:1403] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.021s
I20260709 12:24:50.446465  1313 raft_consensus.cc:359] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.447633  1313 raft_consensus.cc:385] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.448118  1313 raft_consensus.cc:740] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.449532  1313 consensus_queue.cc:260] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.453454  1320 raft_consensus.cc:493] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.454258  1320 raft_consensus.cc:515] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.457237  1320 leader_election.cc:290] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.452894  1313 ts_tablet_manager.cc:1434] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:24:50.458014  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a584d9db72c4c9daba1e998de3dc937" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:50.458832  1199 raft_consensus.cc:2468] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 0.
I20260709 12:24:50.460372  1090 leader_election.cc:304] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:50.461252  1320 raft_consensus.cc:2804] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.462004  1320 raft_consensus.cc:493] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.462208  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a584d9db72c4c9daba1e998de3dc937" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
W20260709 12:24:50.463616  1090 leader_election.cc:343] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.465531  1320 raft_consensus.cc:3060] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.467128  1313 tablet_bootstrap.cc:492] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:50.470018  1022 catalog_manager.cc:5697] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.474354  1320 raft_consensus.cc:515] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.474915  1313 tablet_bootstrap.cc:654] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.477566  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a584d9db72c4c9daba1e998de3dc937" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:50.478243  1199 raft_consensus.cc:3060] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.469126  1318 tablet_bootstrap.cc:492] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:50.479003  1318 ts_tablet_manager.cc:1403] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.017s
I20260709 12:24:50.481148  1320 leader_election.cc:290] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.481830  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a584d9db72c4c9daba1e998de3dc937" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:50.482167  1019 catalog_manager.cc:5697] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 1 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:50.483536  1090 leader_election.cc:343] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.486941  1313 tablet_bootstrap.cc:492] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:50.487534  1313 ts_tablet_manager.cc:1403] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 12:24:50.489149  1199 raft_consensus.cc:2468] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 1.
I20260709 12:24:50.482394  1318 raft_consensus.cc:359] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.490144  1318 raft_consensus.cc:385] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.489706  1313 raft_consensus.cc:359] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.490511  1318 raft_consensus.cc:740] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.490736  1313 raft_consensus.cc:385] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.491080  1313 raft_consensus.cc:740] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.491730  1313 consensus_queue.cc:260] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.492601  1090 leader_election.cc:304] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597
I20260709 12:24:50.494191  1313 ts_tablet_manager.cc:1434] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:24:50.494418  1320 raft_consensus.cc:2804] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.494990  1320 raft_consensus.cc:697] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:50.496212  1313 tablet_bootstrap.cc:492] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:50.495447  1021 catalog_manager.cc:5697] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 reported cstate change: term changed from 0 to 1, leader changed from <none> to 787cff824e6646138b52e01a3a203597 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "787cff824e6646138b52e01a3a203597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:50.495865  1320 consensus_queue.cc:237] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.504417  1313 tablet_bootstrap.cc:654] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.491500  1318 consensus_queue.cc:260] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.508039  1317 raft_consensus.cc:493] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.508759  1317 raft_consensus.cc:515] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.511036  1317 leader_election.cc:290] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.512997  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:50.513226  1318 ts_tablet_manager.cc:1434] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:24:50.513047  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:50.513793  1274 raft_consensus.cc:2468] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 0.
I20260709 12:24:50.514540  1318 tablet_bootstrap.cc:492] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
W20260709 12:24:50.514716  1090 leader_election.cc:343] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.515623  1090 leader_election.cc:304] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:50.516532  1317 raft_consensus.cc:2804] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.516920  1317 raft_consensus.cc:493] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.517285  1317 raft_consensus.cc:3060] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.523160  1022 catalog_manager.cc:5697] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 1 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.524497  1313 tablet_bootstrap.cc:492] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:50.524951  1313 ts_tablet_manager.cc:1403] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.011s
I20260709 12:24:50.526922  1313 raft_consensus.cc:359] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.527380  1313 raft_consensus.cc:385] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.527544  1313 raft_consensus.cc:740] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.528179  1313 consensus_queue.cc:260] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.528667  1317 raft_consensus.cc:515] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.531576  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:50.531816  1313 ts_tablet_manager.cc:1434] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:24:50.532181  1199 raft_consensus.cc:3060] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.538559  1317 leader_election.cc:290] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.539378  1199 raft_consensus.cc:2468] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 1.
I20260709 12:24:50.539729  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:50.540392  1274 raft_consensus.cc:3060] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.540944  1090 leader_election.cc:304] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:50.541867  1317 raft_consensus.cc:2804] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.542385  1317 raft_consensus.cc:697] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:50.542258  1318 tablet_bootstrap.cc:654] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.543349  1317 consensus_queue.cc:237] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.548990  1274 raft_consensus.cc:2468] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 1.
I20260709 12:24:50.555538  1318 tablet_bootstrap.cc:492] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:50.556170  1318 ts_tablet_manager.cc:1403] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.000s
I20260709 12:24:50.557749  1019 catalog_manager.cc:5697] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 1 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.558825  1318 raft_consensus.cc:359] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.559594  1318 raft_consensus.cc:385] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.559866  1318 raft_consensus.cc:740] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.560549  1318 consensus_queue.cc:260] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.562990  1318 ts_tablet_manager.cc:1434] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:50.564096  1318 tablet_bootstrap.cc:492] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:50.571012  1318 tablet_bootstrap.cc:654] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.575512  1318 tablet_bootstrap.cc:492] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:50.575938  1318 ts_tablet_manager.cc:1403] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:24:50.577852  1318 raft_consensus.cc:359] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.578433  1318 raft_consensus.cc:385] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.578645  1318 raft_consensus.cc:740] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.579245  1318 consensus_queue.cc:260] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.580926  1318 ts_tablet_manager.cc:1434] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:24:50.581930  1318 tablet_bootstrap.cc:492] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:50.586386  1318 tablet_bootstrap.cc:654] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.590651  1318 tablet_bootstrap.cc:492] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:50.591063  1318 ts_tablet_manager.cc:1403] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:24:50.593151  1318 raft_consensus.cc:359] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.593715  1318 raft_consensus.cc:385] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.594107  1318 raft_consensus.cc:740] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.594726  1318 consensus_queue.cc:260] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.596402  1318 ts_tablet_manager.cc:1434] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:50.615926  1345 raft_consensus.cc:493] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.616357  1345 raft_consensus.cc:515] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.618206  1345 leader_election.cc:290] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:50.618993  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a584d9db72c4c9daba1e998de3dc937" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:50.619272  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a584d9db72c4c9daba1e998de3dc937" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:50.620178  1199 raft_consensus.cc:2393] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 787cff824e6646138b52e01a3a203597 in current term 1: Already voted for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in this term.
I20260709 12:24:50.621161  1240 leader_election.cc:304] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 787cff824e6646138b52e01a3a203597; no voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:50.621836  1345 raft_consensus.cc:3060] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.626832  1345 raft_consensus.cc:2749] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.660432  1336 raft_consensus.cc:493] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.661114  1336 raft_consensus.cc:515] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.663035  1336 leader_election.cc:290] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.663923  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cdc8855ada47f7a65e9f1befef6ee1" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:50.664129  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cdc8855ada47f7a65e9f1befef6ee1" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:50.664649  1123 raft_consensus.cc:2468] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 0.
I20260709 12:24:50.664798  1274 raft_consensus.cc:2468] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 0.
I20260709 12:24:50.665817  1166 leader_election.cc:304] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:50.666517  1336 raft_consensus.cc:2804] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.666839  1336 raft_consensus.cc:493] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.667109  1336 raft_consensus.cc:3060] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.672555  1336 raft_consensus.cc:515] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.674360  1336 leader_election.cc:290] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.675084  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cdc8855ada47f7a65e9f1befef6ee1" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:50.675369  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cdc8855ada47f7a65e9f1befef6ee1" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:50.675690  1123 raft_consensus.cc:3060] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.675989  1274 raft_consensus.cc:3060] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.680718  1123 raft_consensus.cc:2468] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:50.680855  1274 raft_consensus.cc:2468] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:50.681926  1166 leader_election.cc:304] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:50.682585  1336 raft_consensus.cc:2804] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.682976  1336 raft_consensus.cc:697] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:50.683594  1336 consensus_queue.cc:237] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.690362  1022 catalog_manager.cc:5697] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.705235  1345 raft_consensus.cc:493] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.705789  1345 raft_consensus.cc:515] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.707863  1345 leader_election.cc:290] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:50.708657  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f857dba63c984a3fbfdbb1b27799e38b" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:50.708940  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f857dba63c984a3fbfdbb1b27799e38b" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:50.709682  1199 raft_consensus.cc:2393] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 787cff824e6646138b52e01a3a203597 in current term 1: Already voted for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in this term.
I20260709 12:24:50.710615  1240 leader_election.cc:304] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 787cff824e6646138b52e01a3a203597; no voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:50.711226  1345 raft_consensus.cc:3060] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.716403  1345 raft_consensus.cc:2749] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.741580  1345 consensus_queue.cc:1048] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:50.754508  1345 consensus_queue.cc:1048] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:50.757970  1274 raft_consensus.cc:3060] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.766902  1336 consensus_queue.cc:1048] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:50.777863  1347 consensus_queue.cc:1048] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:50.826833  1199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "640ad567937c4867ace7c1927c63be92"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
mode: GRACEFUL
new_leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:50274
I20260709 12:24:50.827421  1199 raft_consensus.cc:606] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Received request to transfer leadership to TS 9e2deb8701624db5b7da4b2dd7b0e76a
I20260709 12:24:50.835021  1317 consensus_queue.cc:1048] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:50.845361  1347 consensus_queue.cc:1048] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:50.848017  1273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79"
dest_uuid: "787cff824e6646138b52e01a3a203597"
mode: GRACEFUL
new_leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:44116
I20260709 12:24:50.848744  1273 raft_consensus.cc:606] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Received request to transfer leadership to TS 9e2deb8701624db5b7da4b2dd7b0e76a
I20260709 12:24:50.853412  1350 consensus_queue.cc:1048] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:50.855960  1274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fa072525af2477389a5e6c6fd3b94ba"
dest_uuid: "787cff824e6646138b52e01a3a203597"
mode: GRACEFUL
new_leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:44116
I20260709 12:24:50.856665  1274 raft_consensus.cc:606] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Received request to transfer leadership to TS 9e2deb8701624db5b7da4b2dd7b0e76a
I20260709 12:24:50.863583  1199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26cdc8855ada47f7a65e9f1befef6ee1"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
mode: GRACEFUL
new_leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:50274
I20260709 12:24:50.864668  1199 raft_consensus.cc:606] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Received request to transfer leadership to TS 9e2deb8701624db5b7da4b2dd7b0e76a
I20260709 12:24:50.871933  1350 consensus_queue.cc:1048] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:24:50.874881  1347 consensus_queue.cc:1048] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:50.884227  1345 consensus_queue.cc:1048] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:50.887516  1123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "440a9e5626d64a9fbba9c7b6135232ea"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
mode: GRACEFUL
new_leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
 from {username='slave'} at 127.0.0.1:48036
I20260709 12:24:50.888139  1123 raft_consensus.cc:606] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Received request to transfer leadership to TS cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:50.896839  1123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f857dba63c984a3fbfdbb1b27799e38b"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
mode: GRACEFUL
new_leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
 from {username='slave'} at 127.0.0.1:48036
I20260709 12:24:50.897464  1123 raft_consensus.cc:606] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Received request to transfer leadership to TS cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:50.900038  1200 raft_consensus.cc:3060] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.908224  1345 consensus_queue.cc:1048] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:50.912138  1122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a584d9db72c4c9daba1e998de3dc937"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
mode: GRACEFUL
new_leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
 from {username='slave'} at 127.0.0.1:48036
I20260709 12:24:50.912689  1122 raft_consensus.cc:606] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Received request to transfer leadership to TS cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:50.921295  1350 consensus_queue.cc:1048] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:50.928661  1122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
mode: GRACEFUL
new_leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
 from {username='slave'} at 127.0.0.1:48036
I20260709 12:24:50.929222  1122 raft_consensus.cc:606] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Received request to transfer leadership to TS cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:50.935587  1345 raft_consensus.cc:993] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597: : Instructing follower 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:50.937933  1344 raft_consensus.cc:1081] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Signalling peer 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:50.940668  1122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:48026
I20260709 12:24:50.941277  1122 raft_consensus.cc:493] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:50.943049  1122 raft_consensus.cc:3060] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.952034  1350 raft_consensus.cc:993] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a: : Instructing follower cb26883861e84d4d9cddb3349fcf7d34 to start an election
I20260709 12:24:50.952662  1350 raft_consensus.cc:1081] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Signalling peer cb26883861e84d4d9cddb3349fcf7d34 to start an election
I20260709 12:24:50.952715  1200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b33be2a6a0540eca49d02011b933bd9"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
mode: GRACEFUL
new_leader_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:50274
I20260709 12:24:50.953482  1200 raft_consensus.cc:606] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Received request to transfer leadership to TS 787cff824e6646138b52e01a3a203597
I20260709 12:24:50.954186  1122 raft_consensus.cc:515] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.954996  1198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "440a9e5626d64a9fbba9c7b6135232ea"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
 from {username='slave'} at 127.0.0.1:50266
I20260709 12:24:50.955680  1198 raft_consensus.cc:493] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:50.956096  1198 raft_consensus.cc:3060] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.959558  1272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:50.960254  1122 leader_election.cc:290] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.960404  1272 raft_consensus.cc:3055] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:50.960805  1272 raft_consensus.cc:740] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:50.959674  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:50.962033  1200 raft_consensus.cc:3060] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.961753  1272 consensus_queue.cc:260] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.963208  1272 raft_consensus.cc:3060] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.965349  1198 raft_consensus.cc:515] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.968286  1198 leader_election.cc:290] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 2 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:50.970638  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440a9e5626d64a9fbba9c7b6135232ea" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:50.971004  1272 raft_consensus.cc:2468] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:50.971271  1122 raft_consensus.cc:3055] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:50.971892  1122 raft_consensus.cc:740] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:50.972144  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440a9e5626d64a9fbba9c7b6135232ea" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:50.972690  1273 raft_consensus.cc:3060] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.972937  1122 consensus_queue.cc:260] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.971213  1317 consensus_queue.cc:1048] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:50.974537  1122 raft_consensus.cc:3060] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.975765  1090 leader_election.cc:304] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:50.977151  1317 raft_consensus.cc:2804] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:50.977646  1317 raft_consensus.cc:697] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:50.978497  1317 consensus_queue.cc:237] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.980947  1273 raft_consensus.cc:2468] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 2.
I20260709 12:24:50.982298  1166 leader_election.cc:304] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:50.983201  1347 raft_consensus.cc:2804] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:50.983681  1347 raft_consensus.cc:697] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:50.984530  1347 consensus_queue.cc:237] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:50.986203  1122 raft_consensus.cc:2468] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 2.
I20260709 12:24:50.987705  1019 catalog_manager.cc:5697] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 1 to 2, leader changed from 787cff824e6646138b52e01a3a203597 (127.22.43.67) to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 2 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.989409  1200 raft_consensus.cc:2468] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:50.992709  1317 consensus_queue.cc:1048] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:50.997004  1020 catalog_manager.cc:5697] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 1 to 2, leader changed from 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65) to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.012161  1350 raft_consensus.cc:993] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a: : Instructing follower cb26883861e84d4d9cddb3349fcf7d34 to start an election
I20260709 12:24:51.012671  1320 raft_consensus.cc:1081] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Signalling peer cb26883861e84d4d9cddb3349fcf7d34 to start an election
I20260709 12:24:51.015076  1199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a584d9db72c4c9daba1e998de3dc937"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
 from {username='slave'} at 127.0.0.1:50266
I20260709 12:24:51.015751  1199 raft_consensus.cc:493] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.016222  1199 raft_consensus.cc:3060] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.015906  1317 consensus_queue.cc:1048] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:51.029101  1199 raft_consensus.cc:515] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.031543  1200 raft_consensus.cc:1240] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Rejecting Update request from peer 9e2deb8701624db5b7da4b2dd7b0e76a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:51.031904  1394 consensus_queue.cc:1048] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:51.032723  1199 leader_election.cc:290] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 2 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:51.035625  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a584d9db72c4c9daba1e998de3dc937" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:51.035856  1272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a584d9db72c4c9daba1e998de3dc937" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:51.036305  1122 raft_consensus.cc:3055] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.036723  1122 raft_consensus.cc:740] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:51.037635  1122 consensus_queue.cc:260] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.040635  1122 raft_consensus.cc:3060] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.042575  1317 raft_consensus.cc:993] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a: : Instructing follower cb26883861e84d4d9cddb3349fcf7d34 to start an election
I20260709 12:24:51.043145  1394 raft_consensus.cc:1081] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Signalling peer cb26883861e84d4d9cddb3349fcf7d34 to start an election
I20260709 12:24:51.045321  1200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
 from {username='slave'} at 127.0.0.1:50266
I20260709 12:24:51.045959  1200 raft_consensus.cc:493] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.046384  1200 raft_consensus.cc:3060] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.057201  1122 raft_consensus.cc:2468] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 2.
I20260709 12:24:51.057296  1200 raft_consensus.cc:515] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.058707  1166 leader_election.cc:304] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597
I20260709 12:24:51.059744  1200 leader_election.cc:290] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 2 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:51.059871  1347 raft_consensus.cc:2804] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.060528  1347 raft_consensus.cc:697] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:51.061271  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:51.061272  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:51.062134  1123 raft_consensus.cc:3055] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.062143  1273 raft_consensus.cc:3060] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.062677  1123 raft_consensus.cc:740] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:51.061494  1347 consensus_queue.cc:237] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.063499  1123 consensus_queue.cc:260] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.064862  1123 raft_consensus.cc:3060] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.071254  1273 raft_consensus.cc:2468] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 2.
I20260709 12:24:51.072501  1123 raft_consensus.cc:2468] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 2.
I20260709 12:24:51.072621  1166 leader_election.cc:304] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:51.073643  1347 raft_consensus.cc:2804] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.073050  1019 catalog_manager.cc:5697] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 1 to 2, leader changed from 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65) to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.074265  1347 raft_consensus.cc:697] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:51.075685  1347 consensus_queue.cc:237] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.086509  1019 catalog_manager.cc:5697] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 1 to 2, leader changed from 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65) to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.129448  1347 consensus_queue.cc:1048] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:51.141323  1347 consensus_queue.cc:1048] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:51.149014  1336 raft_consensus.cc:993] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34: : Instructing follower 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:51.149595  1347 raft_consensus.cc:1081] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Signalling peer 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:51.151175  1123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26cdc8855ada47f7a65e9f1befef6ee1"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:48020
I20260709 12:24:51.151777  1123 raft_consensus.cc:493] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.152145  1123 raft_consensus.cc:3060] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.158353  1123 raft_consensus.cc:515] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.160470  1123 leader_election.cc:290] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:51.161170  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cdc8855ada47f7a65e9f1befef6ee1" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:51.161531  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cdc8855ada47f7a65e9f1befef6ee1" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:51.161912  1200 raft_consensus.cc:3055] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.162174  1273 raft_consensus.cc:3060] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.162269  1200 raft_consensus.cc:740] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:51.163213  1200 consensus_queue.cc:260] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.164319  1200 raft_consensus.cc:3060] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.169857  1273 raft_consensus.cc:2468] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:51.171144  1090 leader_election.cc:304] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:51.171839  1200 raft_consensus.cc:2468] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:51.171974  1394 raft_consensus.cc:2804] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.172632  1394 raft_consensus.cc:697] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:51.173389  1394 consensus_queue.cc:237] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.179687  1021 catalog_manager.cc:5697] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 1 to 2, leader changed from cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66) to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 2 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.184607  1345 raft_consensus.cc:993] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597: : Instructing follower 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:51.185127  1344 raft_consensus.cc:1081] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Signalling peer 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:51.186679  1123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fa072525af2477389a5e6c6fd3b94ba"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:48026
I20260709 12:24:51.187258  1123 raft_consensus.cc:493] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.187561  1123 raft_consensus.cc:3060] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.194092  1123 raft_consensus.cc:515] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.195930  1123 leader_election.cc:290] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:51.196768  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa072525af2477389a5e6c6fd3b94ba" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:51.197096  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa072525af2477389a5e6c6fd3b94ba" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:51.197479  1200 raft_consensus.cc:3060] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.197769  1273 raft_consensus.cc:3055] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.198179  1273 raft_consensus.cc:740] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:51.198920  1273 consensus_queue.cc:260] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.200073  1273 raft_consensus.cc:3060] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.202944  1200 raft_consensus.cc:2468] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:51.204102  1090 leader_election.cc:304] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:51.204813  1394 raft_consensus.cc:2804] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.205204  1394 raft_consensus.cc:697] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:51.205794  1273 raft_consensus.cc:2468] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:51.205991  1394 consensus_queue.cc:237] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.212190  1021 catalog_manager.cc:5697] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 1 to 2, leader changed from 787cff824e6646138b52e01a3a203597 (127.22.43.67) to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 2 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.314672  1336 raft_consensus.cc:993] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34: : Instructing follower 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:51.315164  1347 raft_consensus.cc:1081] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Signalling peer 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:51.317000  1123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "640ad567937c4867ace7c1927c63be92"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:48020
I20260709 12:24:51.317592  1123 raft_consensus.cc:493] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.318007  1123 raft_consensus.cc:3060] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.319346  1347 raft_consensus.cc:993] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34: : Instructing follower 787cff824e6646138b52e01a3a203597 to start an election
I20260709 12:24:51.319896  1336 raft_consensus.cc:1081] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Signalling peer 787cff824e6646138b52e01a3a203597 to start an election
I20260709 12:24:51.321626  1273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b33be2a6a0540eca49d02011b933bd9"
dest_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:44104
I20260709 12:24:51.322245  1273 raft_consensus.cc:493] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.322613  1273 raft_consensus.cc:3060] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.326020  1123 raft_consensus.cc:515] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.328495  1123 leader_election.cc:290] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:51.330080  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ad567937c4867ace7c1927c63be92" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:51.329931  1272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640ad567937c4867ace7c1927c63be92" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:51.336084  1200 raft_consensus.cc:3055] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.336200  1272 raft_consensus.cc:3060] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.336522  1200 raft_consensus.cc:740] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:51.337080  1273 raft_consensus.cc:515] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.337527  1200 consensus_queue.cc:260] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.338938  1200 raft_consensus.cc:3060] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.340099  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b33be2a6a0540eca49d02011b933bd9" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:51.340797  1123 raft_consensus.cc:3060] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.340914  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b33be2a6a0540eca49d02011b933bd9" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:51.341626  1198 raft_consensus.cc:3055] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.341980  1198 raft_consensus.cc:740] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:51.342790  1198 consensus_queue.cc:260] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.343430  1272 raft_consensus.cc:2468] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:51.343947  1198 raft_consensus.cc:3060] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.344904  1090 leader_election.cc:304] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:51.345896  1394 raft_consensus.cc:2804] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.346378  1394 raft_consensus.cc:697] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:51.346401  1200 raft_consensus.cc:2468] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:51.347397  1394 consensus_queue.cc:237] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.348819  1123 raft_consensus.cc:2468] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 2.
I20260709 12:24:51.350194  1240 leader_election.cc:304] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:51.351023  1344 raft_consensus.cc:2804] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.351190  1198 raft_consensus.cc:2468] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 2.
I20260709 12:24:51.351562  1344 raft_consensus.cc:697] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 2 LEADER]: Becoming Leader. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:51.352705  1273 leader_election.cc:290] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 2 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:51.352456  1344 consensus_queue.cc:237] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.355528  1021 catalog_manager.cc:5697] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 1 to 2, leader changed from cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66) to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 2 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.359884  1019 catalog_manager.cc:5697] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 reported cstate change: term changed from 1 to 2, leader changed from cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66) to 787cff824e6646138b52e01a3a203597 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "787cff824e6646138b52e01a3a203597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.460664  1317 raft_consensus.cc:993] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a: : Instructing follower cb26883861e84d4d9cddb3349fcf7d34 to start an election
I20260709 12:24:51.461144  1317 raft_consensus.cc:1081] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Signalling peer cb26883861e84d4d9cddb3349fcf7d34 to start an election
I20260709 12:24:51.462984  1198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f857dba63c984a3fbfdbb1b27799e38b"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
 from {username='slave'} at 127.0.0.1:50266
I20260709 12:24:51.463678  1198 raft_consensus.cc:493] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.464041  1198 raft_consensus.cc:3060] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.467159  1273 raft_consensus.cc:1275] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer cb26883861e84d4d9cddb3349fcf7d34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.468699  1336 consensus_queue.cc:1048] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.471179  1198 raft_consensus.cc:515] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.473256  1198 leader_election.cc:290] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 2 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:51.474320  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f857dba63c984a3fbfdbb1b27799e38b" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:51.474959  1273 raft_consensus.cc:3060] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.478488  1122 raft_consensus.cc:1275] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Refusing update from remote peer cb26883861e84d4d9cddb3349fcf7d34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.479795  1323 consensus_queue.cc:1048] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.480580  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f857dba63c984a3fbfdbb1b27799e38b" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:51.481223  1123 raft_consensus.cc:3055] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.483872  1272 raft_consensus.cc:1275] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer cb26883861e84d4d9cddb3349fcf7d34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.485507  1323 consensus_queue.cc:1048] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.481596  1123 raft_consensus.cc:740] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:51.487272  1123 consensus_queue.cc:260] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.488656  1123 raft_consensus.cc:3060] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.491848  1273 raft_consensus.cc:2468] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 2.
I20260709 12:24:51.493973  1166 leader_election.cc:304] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:51.494994  1122 raft_consensus.cc:1275] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Refusing update from remote peer cb26883861e84d4d9cddb3349fcf7d34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.496481  1347 raft_consensus.cc:2804] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.496997  1347 raft_consensus.cc:697] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:51.497942  1347 consensus_queue.cc:237] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:51.500016  1123 raft_consensus.cc:2468] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 2.
I20260709 12:24:51.496997  1336 consensus_queue.cc:1048] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:24:51.509588  1020 catalog_manager.cc:5697] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 1 to 2, leader changed from 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65) to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.518693  1273 raft_consensus.cc:3060] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.526743  1273 raft_consensus.cc:1275] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer cb26883861e84d4d9cddb3349fcf7d34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.527069  1272 raft_consensus.cc:1275] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.528313  1336 consensus_queue.cc:1048] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.528513  1317 consensus_queue.cc:1048] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.536252  1198 raft_consensus.cc:1275] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.537710  1394 consensus_queue.cc:1048] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.540127  1123 raft_consensus.cc:1275] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Refusing update from remote peer cb26883861e84d4d9cddb3349fcf7d34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.541945  1336 consensus_queue.cc:1048] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.653439  1273 raft_consensus.cc:1275] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.654830  1394 consensus_queue.cc:1048] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.666095  1198 raft_consensus.cc:1275] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.668032  1350 consensus_queue.cc:1048] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:51.714547  1198 raft_consensus.cc:1275] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.715889  1399 consensus_queue.cc:1048] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.724660  1273 raft_consensus.cc:1275] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.726289  1317 consensus_queue.cc:1048] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.734521  1198 raft_consensus.cc:1275] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.736076  1344 consensus_queue.cc:1048] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.741770  1123 raft_consensus.cc:1275] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.743568  1344 consensus_queue.cc:1048] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.807152  1273 raft_consensus.cc:1275] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.808727  1317 consensus_queue.cc:1048] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.817659  1198 raft_consensus.cc:1275] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.819581  1317 consensus_queue.cc:1048] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.967199  1273 raft_consensus.cc:1275] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer cb26883861e84d4d9cddb3349fcf7d34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.968626  1336 consensus_queue.cc:1048] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.978410  1123 raft_consensus.cc:1275] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Refusing update from remote peer cb26883861e84d4d9cddb3349fcf7d34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.981200  1323 consensus_queue.cc:1048] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.983758  1021 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34358:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:53.986085  1021 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:54.039112  1114 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4a2a3c52004b1cb6372ee44053abc8 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:54.040421  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4a2a3c52004b1cb6372ee44053abc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.040838  1183 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4a2a3c52004b1cb6372ee44053abc8 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:54.043694  1258 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4a2a3c52004b1cb6372ee44053abc8 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:54.044445  1183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4a2a3c52004b1cb6372ee44053abc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.044989  1258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4a2a3c52004b1cb6372ee44053abc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.046872  1186 tablet_service.cc:1511] Processing CreateTablet for tablet 8766846e73d349fabdfe01afc5311ebd (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:54.048106  1186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8766846e73d349fabdfe01afc5311ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.051355  1108 tablet_service.cc:1511] Processing CreateTablet for tablet 8766846e73d349fabdfe01afc5311ebd (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:54.051776  1107 tablet_service.cc:1511] Processing CreateTablet for tablet 95d59e9ad17b4eec804272c0af331b3b (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:54.052718  1108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8766846e73d349fabdfe01afc5311ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.053849  1184 tablet_service.cc:1511] Processing CreateTablet for tablet 95d59e9ad17b4eec804272c0af331b3b (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:54.055126  1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d59e9ad17b4eec804272c0af331b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.058940  1189 tablet_service.cc:1511] Processing CreateTablet for tablet a9cf542f2066458ea7a2f2d888c93e83 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:54.060271  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9cf542f2066458ea7a2f2d888c93e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.064339  1257 tablet_service.cc:1511] Processing CreateTablet for tablet a9cf542f2066458ea7a2f2d888c93e83 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:54.065330  1264 tablet_service.cc:1511] Processing CreateTablet for tablet 95d59e9ad17b4eec804272c0af331b3b (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:54.064343  1261 tablet_service.cc:1511] Processing CreateTablet for tablet 8766846e73d349fabdfe01afc5311ebd (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:54.068141  1109 tablet_service.cc:1511] Processing CreateTablet for tablet a9cf542f2066458ea7a2f2d888c93e83 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:54.069511  1109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9cf542f2066458ea7a2f2d888c93e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.070739  1190 tablet_service.cc:1511] Processing CreateTablet for tablet 726f6d6ea59e433487a10ca6d225cb10 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:54.071602  1111 tablet_service.cc:1511] Processing CreateTablet for tablet 726f6d6ea59e433487a10ca6d225cb10 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:54.072090  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726f6d6ea59e433487a10ca6d225cb10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.074076  1259 tablet_service.cc:1511] Processing CreateTablet for tablet 726f6d6ea59e433487a10ca6d225cb10 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:54.074702  1110 tablet_service.cc:1511] Processing CreateTablet for tablet 0411e8023f324310b510f35e9d7416b6 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:54.077567  1110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0411e8023f324310b510f35e9d7416b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.082937  1187 tablet_service.cc:1511] Processing CreateTablet for tablet 0411e8023f324310b510f35e9d7416b6 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:54.084304  1187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0411e8023f324310b510f35e9d7416b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.084942  1256 tablet_service.cc:1511] Processing CreateTablet for tablet 0411e8023f324310b510f35e9d7416b6 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:54.086275  1107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d59e9ad17b4eec804272c0af331b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.090282  1111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726f6d6ea59e433487a10ca6d225cb10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.091312  1185 tablet_service.cc:1511] Processing CreateTablet for tablet 711f9564e1284330a23664342394fb4f (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:54.092664  1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711f9564e1284330a23664342394fb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.097139  1263 tablet_service.cc:1511] Processing CreateTablet for tablet 711f9564e1284330a23664342394fb4f (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:54.101769  1113 tablet_service.cc:1511] Processing CreateTablet for tablet 711f9564e1284330a23664342394fb4f (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:54.105014  1113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711f9564e1284330a23664342394fb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.106979  1420 tablet_bootstrap.cc:492] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:54.065770  1257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9cf542f2066458ea7a2f2d888c93e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.109210  1112 tablet_service.cc:1511] Processing CreateTablet for tablet c795217fcd6c49619900c50103171297 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:54.110306  1188 tablet_service.cc:1511] Processing CreateTablet for tablet c795217fcd6c49619900c50103171297 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:54.111646  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c795217fcd6c49619900c50103171297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.114115  1262 tablet_service.cc:1511] Processing CreateTablet for tablet c795217fcd6c49619900c50103171297 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:54.120790  1260 tablet_service.cc:1511] Processing CreateTablet for tablet 69c61dde938040cea666ca0bd54c85b4 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:54.124366  1106 tablet_service.cc:1511] Processing CreateTablet for tablet 69c61dde938040cea666ca0bd54c85b4 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:54.131057  1185 tablet_service.cc:1511] Processing CreateTablet for tablet 69c61dde938040cea666ca0bd54c85b4 (DEFAULT_TABLE table=soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:54.132457  1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c61dde938040cea666ca0bd54c85b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.139209  1421 tablet_bootstrap.cc:492] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:54.146152  1421 tablet_bootstrap.cc:654] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.160383  1112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c795217fcd6c49619900c50103171297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.168426  1106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c61dde938040cea666ca0bd54c85b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.168686  1420 tablet_bootstrap.cc:654] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.109689  1261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8766846e73d349fabdfe01afc5311ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.226441  1259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726f6d6ea59e433487a10ca6d225cb10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.227396  1260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c61dde938040cea666ca0bd54c85b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.230314  1256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0411e8023f324310b510f35e9d7416b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.233363  1264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d59e9ad17b4eec804272c0af331b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.235670  1262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c795217fcd6c49619900c50103171297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:54.238818  1263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711f9564e1284330a23664342394fb4f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:54.306097  1090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.66:33951, user_credentials={real_user=slave}} blocked reactor thread for 66352.6us
W20260709 12:24:54.308749  1070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:54.415750  1420 tablet_bootstrap.cc:492] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:54.416451  1420 ts_tablet_manager.cc:1403] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.310s	user 0.073s	sys 0.151s
I20260709 12:24:54.420908  1420 raft_consensus.cc:359] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.421768  1420 raft_consensus.cc:385] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.422192  1420 raft_consensus.cc:740] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.423209  1420 consensus_queue.cc:260] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.426127  1420 ts_tablet_manager.cc:1434] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:24:54.427268  1420 tablet_bootstrap.cc:492] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:54.460688  1420 tablet_bootstrap.cc:654] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.474442  1425 tablet_bootstrap.cc:492] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:54.475749  1421 tablet_bootstrap.cc:492] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:54.476375  1421 ts_tablet_manager.cc:1403] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.337s	user 0.063s	sys 0.104s
I20260709 12:24:54.481503  1425 tablet_bootstrap.cc:654] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.481639  1421 raft_consensus.cc:359] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.486640  1421 raft_consensus.cc:385] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.486984  1421 raft_consensus.cc:740] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.489010  1420 tablet_bootstrap.cc:492] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:54.489566  1420 ts_tablet_manager.cc:1403] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.063s	user 0.001s	sys 0.019s
I20260709 12:24:54.492604  1420 raft_consensus.cc:359] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.493347  1420 raft_consensus.cc:385] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.493639  1420 raft_consensus.cc:740] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.487993  1421 consensus_queue.cc:260] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.494570  1420 consensus_queue.cc:260] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.496932  1421 ts_tablet_manager.cc:1434] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 12:24:54.498719  1420 ts_tablet_manager.cc:1434] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:24:54.498884  1421 tablet_bootstrap.cc:492] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:54.499866  1420 tablet_bootstrap.cc:492] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:54.507599  1420 tablet_bootstrap.cc:654] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.508917  1421 tablet_bootstrap.cc:654] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.513213  1425 tablet_bootstrap.cc:492] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:54.513844  1425 ts_tablet_manager.cc:1403] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.015s
I20260709 12:24:54.515861  1420 tablet_bootstrap.cc:492] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:54.516492  1420 ts_tablet_manager.cc:1403] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:24:54.518138  1425 raft_consensus.cc:359] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.519017  1425 raft_consensus.cc:385] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.519316  1425 raft_consensus.cc:740] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.520270  1421 tablet_bootstrap.cc:492] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:54.520083  1425 consensus_queue.cc:260] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.520107  1420 raft_consensus.cc:359] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.521492  1420 raft_consensus.cc:385] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.521929  1420 raft_consensus.cc:740] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.522624  1425 ts_tablet_manager.cc:1434] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:24:54.522712  1420 consensus_queue.cc:260] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.523957  1425 tablet_bootstrap.cc:492] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:54.521070  1421 ts_tablet_manager.cc:1403] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 12:24:54.525662  1420 ts_tablet_manager.cc:1434] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:24:54.526896  1420 tablet_bootstrap.cc:492] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:54.527828  1421 raft_consensus.cc:359] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.528637  1421 raft_consensus.cc:385] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.528940  1421 raft_consensus.cc:740] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.529946  1421 consensus_queue.cc:260] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.531375  1425 tablet_bootstrap.cc:654] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.532300  1421 ts_tablet_manager.cc:1434] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 12:24:54.533372  1421 tablet_bootstrap.cc:492] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:54.538383  1420 tablet_bootstrap.cc:654] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.549983  1421 tablet_bootstrap.cc:654] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.603780  1420 tablet_bootstrap.cc:492] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:54.604306  1421 tablet_bootstrap.cc:492] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:54.604357  1420 ts_tablet_manager.cc:1403] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.078s	user 0.035s	sys 0.035s
I20260709 12:24:54.604573  1425 tablet_bootstrap.cc:492] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:54.604887  1421 ts_tablet_manager.cc:1403] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.045s
I20260709 12:24:54.605208  1425 ts_tablet_manager.cc:1403] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.081s	user 0.042s	sys 0.033s
I20260709 12:24:54.607560  1421 raft_consensus.cc:359] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.608219  1421 raft_consensus.cc:385] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.608106  1420 raft_consensus.cc:359] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.608655  1421 raft_consensus.cc:740] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.608398  1425 raft_consensus.cc:359] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.609020  1420 raft_consensus.cc:385] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.609201  1425 raft_consensus.cc:385] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.609383  1420 raft_consensus.cc:740] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.609532  1425 raft_consensus.cc:740] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.609583  1421 consensus_queue.cc:260] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.610221  1420 consensus_queue.cc:260] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.610430  1425 consensus_queue.cc:260] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.612270  1421 ts_tablet_manager.cc:1434] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:54.612697  1420 ts_tablet_manager.cc:1434] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:24:54.613358  1425 ts_tablet_manager.cc:1434] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:24:54.614017  1420 tablet_bootstrap.cc:492] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:54.614365  1425 tablet_bootstrap.cc:492] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:54.621222  1420 tablet_bootstrap.cc:654] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.621222  1425 tablet_bootstrap.cc:654] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.628298  1421 tablet_bootstrap.cc:492] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:54.633644  1425 tablet_bootstrap.cc:492] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:54.634224  1425 ts_tablet_manager.cc:1403] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.020s	user 0.002s	sys 0.017s
I20260709 12:24:54.636652  1425 raft_consensus.cc:359] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.637413  1425 raft_consensus.cc:385] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.637799  1421 tablet_bootstrap.cc:654] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.638003  1425 raft_consensus.cc:740] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.639361  1420 tablet_bootstrap.cc:492] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:54.638947  1425 consensus_queue.cc:260] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.640023  1420 ts_tablet_manager.cc:1403] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 12:24:54.643512  1425 ts_tablet_manager.cc:1434] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:24:54.643671  1421 tablet_bootstrap.cc:492] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:54.644227  1421 ts_tablet_manager.cc:1403] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 12:24:54.643769  1420 raft_consensus.cc:359] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.644764  1420 raft_consensus.cc:385] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.644901  1425 tablet_bootstrap.cc:492] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:54.645141  1420 raft_consensus.cc:740] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.646095  1420 consensus_queue.cc:260] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.648617  1420 ts_tablet_manager.cc:1434] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:54.649739  1420 tablet_bootstrap.cc:492] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:54.650504  1421 raft_consensus.cc:359] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.651311  1421 raft_consensus.cc:385] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.651602  1421 raft_consensus.cc:740] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.652328  1425 tablet_bootstrap.cc:654] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.652487  1421 consensus_queue.cc:260] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.655481  1421 ts_tablet_manager.cc:1434] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:24:54.656862  1421 tablet_bootstrap.cc:492] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:54.660238  1420 tablet_bootstrap.cc:654] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.666288  1421 tablet_bootstrap.cc:654] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.672539  1420 tablet_bootstrap.cc:492] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:54.673146  1420 ts_tablet_manager.cc:1403] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 12:24:54.676203  1420 raft_consensus.cc:359] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.677095  1420 raft_consensus.cc:385] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.677440  1420 raft_consensus.cc:740] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.678195  1420 consensus_queue.cc:260] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.680485  1420 ts_tablet_manager.cc:1434] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:24:54.680619  1421 tablet_bootstrap.cc:492] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:54.681422  1421 ts_tablet_manager.cc:1403] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 12:24:54.681551  1420 tablet_bootstrap.cc:492] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:54.685429  1421 raft_consensus.cc:359] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.686431  1421 raft_consensus.cc:385] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.686789  1421 raft_consensus.cc:740] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.687729  1421 consensus_queue.cc:260] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.688992  1420 tablet_bootstrap.cc:654] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.690449  1421 ts_tablet_manager.cc:1434] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 12:24:54.698525  1421 tablet_bootstrap.cc:492] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:54.700986  1420 tablet_bootstrap.cc:492] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:54.701596  1420 ts_tablet_manager.cc:1403] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 12:24:54.704850  1420 raft_consensus.cc:359] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.705610  1420 raft_consensus.cc:385] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.705933  1420 raft_consensus.cc:740] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.706697  1420 consensus_queue.cc:260] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.708122  1421 tablet_bootstrap.cc:654] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.709514  1409 raft_consensus.cc:493] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.710064  1409 raft_consensus.cc:515] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.712244  1409 leader_election.cc:290] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:54.714572  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:54.715214  1123 raft_consensus.cc:2468] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 0.
I20260709 12:24:54.716534  1240 leader_election.cc:304] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:54.717634  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
W20260709 12:24:54.719218  1240 leader_election.cc:343] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:54.720207  1409 raft_consensus.cc:2804] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:54.720657  1409 raft_consensus.cc:493] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.721001  1409 raft_consensus.cc:3060] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.721963  1424 raft_consensus.cc:493] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.722487  1424 raft_consensus.cc:515] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.723193  1421 tablet_bootstrap.cc:492] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:54.724112  1421 ts_tablet_manager.cc:1403] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.008s
I20260709 12:24:54.724948  1424 leader_election.cc:290] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:54.727502  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:54.728304  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:54.728983  1421 raft_consensus.cc:359] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.730075  1408 raft_consensus.cc:493] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.730295  1421 raft_consensus.cc:385] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.730679  1408 raft_consensus.cc:515] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.730959  1421 raft_consensus.cc:740] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.731536  1420 ts_tablet_manager.cc:1434] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.001s
I20260709 12:24:54.731055  1409 raft_consensus.cc:515] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.733079  1408 leader_election.cc:290] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
W20260709 12:24:54.734223  1090 leader_election.cc:343] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:54.735046  1090 leader_election.cc:343] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:54.735551  1090 leader_election.cc:304] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:54.735607  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711f9564e1284330a23664342394fb4f" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:54.736402  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
W20260709 12:24:54.741138  1166 leader_election.cc:343] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:54.737111  1409 leader_election.cc:290] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
W20260709 12:24:54.742448  1240 leader_election.cc:343] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:54.736348  1421 consensus_queue.cc:260] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.743182  1408 raft_consensus.cc:493] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.743786  1408 raft_consensus.cc:515] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.746758  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795217fcd6c49619900c50103171297" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:54.747406  1124 raft_consensus.cc:2468] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 0.
I20260709 12:24:54.737671  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:54.738147  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711f9564e1284330a23664342394fb4f" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:54.749241  1123 raft_consensus.cc:3060] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.749523  1122 raft_consensus.cc:2468] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 0.
I20260709 12:24:54.738824  1420 tablet_bootstrap.cc:492] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:54.748792  1166 leader_election.cc:304] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:54.757133  1123 raft_consensus.cc:2468] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 1.
I20260709 12:24:54.758739  1240 leader_election.cc:304] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:54.759982  1420 tablet_bootstrap.cc:654] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.760449  1425 tablet_bootstrap.cc:492] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:54.760895  1424 raft_consensus.cc:2749] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:54.760529  1409 raft_consensus.cc:2804] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:54.761219  1425 ts_tablet_manager.cc:1403] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.117s	user 0.051s	sys 0.040s
I20260709 12:24:54.765581  1425 raft_consensus.cc:359] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.766630  1425 raft_consensus.cc:385] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.776985  1425 raft_consensus.cc:740] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.776000  1420 tablet_bootstrap.cc:492] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:54.765867  1408 leader_election.cc:290] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:54.777973  1425 consensus_queue.cc:260] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.778090  1420 ts_tablet_manager.cc:1403] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.005s
I20260709 12:24:54.779898  1446 raft_consensus.cc:2804] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:54.780337  1446 raft_consensus.cc:493] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.780766  1446 raft_consensus.cc:3060] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.783030  1424 raft_consensus.cc:493] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.783946  1424 raft_consensus.cc:515] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.787583  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c61dde938040cea666ca0bd54c85b4" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:54.788430  1198 raft_consensus.cc:2468] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 0.
I20260709 12:24:54.788636  1424 leader_election.cc:290] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:54.788760  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c61dde938040cea666ca0bd54c85b4" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:54.782802  1420 raft_consensus.cc:359] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.790660  1420 raft_consensus.cc:385] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.791020  1420 raft_consensus.cc:740] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.789604  1090 leader_election.cc:304] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
W20260709 12:24:54.792220  1090 leader_election.cc:343] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:54.793161  1350 raft_consensus.cc:2804] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:54.793715  1350 raft_consensus.cc:493] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.794127  1350 raft_consensus.cc:3060] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.791858  1420 consensus_queue.cc:260] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.797571  1446 raft_consensus.cc:515] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.799808  1446 leader_election.cc:290] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:54.800324  1446 raft_consensus.cc:493] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.800735  1446 raft_consensus.cc:515] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
W20260709 12:24:54.811888  1166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.65:38885, user_credentials={real_user=slave}} blocked reactor thread for 63181us
I20260709 12:24:54.815083  1409 raft_consensus.cc:697] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Becoming Leader. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:54.838419  1166 leader_election.cc:304] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597
I20260709 12:24:54.839408  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795217fcd6c49619900c50103171297" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:54.838788  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795217fcd6c49619900c50103171297" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:54.839915  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795217fcd6c49619900c50103171297" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:54.840299  1123 raft_consensus.cc:3060] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.843501  1350 raft_consensus.cc:515] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.846728  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c61dde938040cea666ca0bd54c85b4" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:54.847394  1198 raft_consensus.cc:3060] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.847591  1350 leader_election.cc:290] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:54.850736  1271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c61dde938040cea666ca0bd54c85b4" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:54.851846  1123 raft_consensus.cc:2468] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:54.852241  1444 raft_consensus.cc:2804] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:54.852824  1444 raft_consensus.cc:493] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:54.852929  1090 leader_election.cc:343] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:54.853322  1444 raft_consensus.cc:3060] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.858739  1198 raft_consensus.cc:2468] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 1.
I20260709 12:24:54.862041  1442 raft_consensus.cc:493] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.862700  1420 ts_tablet_manager.cc:1434] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.083s	user 0.019s	sys 0.005s
I20260709 12:24:54.862597  1442 raft_consensus.cc:515] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.863984  1271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a2a3c52004b1cb6372ee44053abc8" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:54.864754  1442 leader_election.cc:290] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:54.864625  1090 leader_election.cc:304] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597
I20260709 12:24:54.861057  1425 ts_tablet_manager.cc:1434] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.099s	user 0.013s	sys 0.012s
I20260709 12:24:54.866086  1449 raft_consensus.cc:2804] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:54.866591  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a2a3c52004b1cb6372ee44053abc8" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:54.866653  1449 raft_consensus.cc:697] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:54.867281  1122 raft_consensus.cc:2468] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 0.
I20260709 12:24:54.868201  1420 tablet_bootstrap.cc:492] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a: Bootstrap starting.
I20260709 12:24:54.867813  1449 consensus_queue.cc:237] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.860939  1409 consensus_queue.cc:237] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.861521  1446 leader_election.cc:290] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
W20260709 12:24:54.873039  1166 leader_election.cc:343] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:54.872895  1444 raft_consensus.cc:515] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.866894  1425 tablet_bootstrap.cc:492] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:54.875742  1421 ts_tablet_manager.cc:1434] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.151s	user 0.012s	sys 0.039s
I20260709 12:24:54.876950  1421 tablet_bootstrap.cc:492] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:54.878069  1420 tablet_bootstrap.cc:654] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.875736  1444 leader_election.cc:290] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:54.884492  1421 tablet_bootstrap.cc:654] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:54.881753  1425 tablet_bootstrap.cc:654] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:54.887566  1166 leader_election.cc:343] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:54.888942  1166 leader_election.cc:343] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:54.889716  1166 leader_election.cc:304] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597
I20260709 12:24:54.890653  1442 raft_consensus.cc:2804] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:54.891016  1166 leader_election.cc:304] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597
I20260709 12:24:54.892509  1444 raft_consensus.cc:2804] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:54.893021  1444 raft_consensus.cc:493] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.893458  1444 raft_consensus.cc:3060] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.893620  1271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726f6d6ea59e433487a10ca6d225cb10" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:54.894526  1271 raft_consensus.cc:2468] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 0.
I20260709 12:24:54.896227  1271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711f9564e1284330a23664342394fb4f" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:54.896348  1166 leader_election.cc:304] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:54.897814  1441 raft_consensus.cc:2804] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:54.898238  1441 raft_consensus.cc:493] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.898602  1441 raft_consensus.cc:3060] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.898506  1020 catalog_manager.cc:5697] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 reported cstate change: term changed from 0 to 1, leader changed from <none> to 787cff824e6646138b52e01a3a203597 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "787cff824e6646138b52e01a3a203597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:54.900251  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726f6d6ea59e433487a10ca6d225cb10" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:54.906431  1121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711f9564e1284330a23664342394fb4f" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:54.907235  1121 raft_consensus.cc:3060] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.915122  1442 raft_consensus.cc:697] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:54.906911  1022 catalog_manager.cc:5697] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 1 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:54.917528  1442 consensus_queue.cc:237] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.917840  1121 raft_consensus.cc:2468] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:54.920698  1441 raft_consensus.cc:515] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.926463  1441 leader_election.cc:290] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:54.918581  1420 tablet_bootstrap.cc:492] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a: No bootstrap required, opened a new log
I20260709 12:24:54.921835  1409 raft_consensus.cc:493] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.928085  1420 ts_tablet_manager.cc:1403] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.002s
I20260709 12:24:54.928023  1409 raft_consensus.cc:515] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.932440  1409 leader_election.cc:290] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
W20260709 12:24:54.921234  1166 leader_election.cc:343] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:54.932839  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d59e9ad17b4eec804272c0af331b3b" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:54.934005  1200 raft_consensus.cc:2468] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 0.
I20260709 12:24:54.935672  1240 leader_election.cc:304] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:54.936125  1420 raft_consensus.cc:359] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.936851  1409 raft_consensus.cc:2804] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:54.937214  1420 raft_consensus.cc:385] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.937492  1409 raft_consensus.cc:493] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.936100  1166 leader_election.cc:304] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:54.938306  1409 raft_consensus.cc:3060] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.937654  1420 raft_consensus.cc:740] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.940707  1425 tablet_bootstrap.cc:492] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:54.940661  1420 consensus_queue.cc:260] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.941532  1446 raft_consensus.cc:2804] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:54.947734  1446 raft_consensus.cc:697] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:54.947799  1425 ts_tablet_manager.cc:1403] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.030s
I20260709 12:24:54.948827  1446 consensus_queue.cc:237] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.951468  1425 raft_consensus.cc:359] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.958709  1425 raft_consensus.cc:385] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.946506  1444 raft_consensus.cc:515] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.955603  1420 ts_tablet_manager.cc:1434] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
W20260709 12:24:54.943543  1166 leader_election.cc:343] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:54.960944  1444 leader_election.cc:290] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:54.961539  1425 raft_consensus.cc:740] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.961768  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726f6d6ea59e433487a10ca6d225cb10" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:54.962517  1271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726f6d6ea59e433487a10ca6d225cb10" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:54.962652  1425 consensus_queue.cc:260] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.965351  1425 ts_tablet_manager.cc:1434] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:24:54.957847  1409 raft_consensus.cc:515] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.944380  1121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d59e9ad17b4eec804272c0af331b3b" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:54.956545  1421 tablet_bootstrap.cc:492] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:54.966830  1121 raft_consensus.cc:2468] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 0.
I20260709 12:24:54.967140  1421 ts_tablet_manager.cc:1403] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.007s
I20260709 12:24:54.967332  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a2a3c52004b1cb6372ee44053abc8" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:54.968117  1124 raft_consensus.cc:3060] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.962558  1122 raft_consensus.cc:3060] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.970830  1121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d59e9ad17b4eec804272c0af331b3b" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:54.971494  1121 raft_consensus.cc:3060] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.971113  1421 raft_consensus.cc:359] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.972055  1421 raft_consensus.cc:385] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:54.972429  1421 raft_consensus.cc:740] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:54.973335  1421 consensus_queue.cc:260] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.963304  1271 raft_consensus.cc:3060] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.974961  1425 tablet_bootstrap.cc:492] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:54.978623  1122 raft_consensus.cc:2468] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:54.979803  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d59e9ad17b4eec804272c0af331b3b" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:54.980451  1200 raft_consensus.cc:3060] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.983477  1421 ts_tablet_manager.cc:1434] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:24:54.986493  1166 leader_election.cc:304] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:54.977937  1124 raft_consensus.cc:2468] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:54.983613  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a2a3c52004b1cb6372ee44053abc8" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:54.984501  1271 raft_consensus.cc:2468] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:54.986927  1421 tablet_bootstrap.cc:492] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:54.985821  1121 raft_consensus.cc:2468] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 1.
I20260709 12:24:54.989979  1446 raft_consensus.cc:2804] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:54.990631  1446 raft_consensus.cc:697] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:54.990931  1200 raft_consensus.cc:2468] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 1.
I20260709 12:24:54.991397  1240 leader_election.cc:304] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:54.991608  1446 consensus_queue.cc:237] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.992501  1448 raft_consensus.cc:2804] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:54.993031  1448 raft_consensus.cc:697] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Becoming Leader. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:54.993981  1448 consensus_queue.cc:237] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.995375  1449 raft_consensus.cc:493] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.995939  1449 raft_consensus.cc:515] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:54.992071  1409 leader_election.cc:290] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
W20260709 12:24:54.997645  1166 leader_election.cc:343] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:54.998772  1421 tablet_bootstrap.cc:654] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:55.000813  1166 leader_election.cc:304] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597
I20260709 12:24:55.001961  1271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9cf542f2066458ea7a2f2d888c93e83" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:55.002715  1271 raft_consensus.cc:2468] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 0.
I20260709 12:24:55.005949  1444 raft_consensus.cc:2804] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:55.006762  1444 raft_consensus.cc:697] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:55.007203  1021 catalog_manager.cc:5697] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.007697  1444 consensus_queue.cc:237] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.008225  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9cf542f2066458ea7a2f2d888c93e83" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
W20260709 12:24:55.009922  1090 leader_election.cc:343] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:55.010718  1090 leader_election.cc:304] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:55.011780  1350 raft_consensus.cc:2804] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:55.012274  1350 raft_consensus.cc:493] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.012678  1350 raft_consensus.cc:3060] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:54.998405  1449 leader_election.cc:290] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:55.031903  1425 tablet_bootstrap.cc:654] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:55.039932  1421 tablet_bootstrap.cc:492] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:55.041973  1425 tablet_bootstrap.cc:492] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:55.042356  1421 ts_tablet_manager.cc:1403] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.035s
I20260709 12:24:55.042532  1425 ts_tablet_manager.cc:1403] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.005s
I20260709 12:24:55.041399  1350 raft_consensus.cc:515] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.045694  1425 raft_consensus.cc:359] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.046474  1350 leader_election.cc:290] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:55.046506  1425 raft_consensus.cc:385] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:55.047168  1425 raft_consensus.cc:740] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:55.047957  1425 consensus_queue.cc:260] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.048269  1421 raft_consensus.cc:359] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.048938  1421 raft_consensus.cc:385] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:55.049199  1421 raft_consensus.cc:740] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:55.049916  1421 consensus_queue.cc:260] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.050273  1271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9cf542f2066458ea7a2f2d888c93e83" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:55.050701  1425 ts_tablet_manager.cc:1434] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:24:55.050967  1271 raft_consensus.cc:3060] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.051075  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9cf542f2066458ea7a2f2d888c93e83" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:55.051803  1425 tablet_bootstrap.cc:492] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:55.052111  1421 ts_tablet_manager.cc:1434] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:24:55.053088  1421 tablet_bootstrap.cc:492] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34: Bootstrap starting.
I20260709 12:24:55.051785  1200 raft_consensus.cc:3060] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.059012  1421 tablet_bootstrap.cc:654] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:55.059036  1425 tablet_bootstrap.cc:654] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:55.059880  1271 raft_consensus.cc:2468] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 1.
I20260709 12:24:55.061515  1090 leader_election.cc:304] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:55.062485  1350 raft_consensus.cc:2804] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:55.063129  1350 raft_consensus.cc:697] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:55.064261  1350 consensus_queue.cc:237] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.067342  1020 catalog_manager.cc:5697] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 reported cstate change: term changed from 0 to 1, leader changed from <none> to 787cff824e6646138b52e01a3a203597 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "787cff824e6646138b52e01a3a203597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.071664  1425 tablet_bootstrap.cc:492] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:55.072578  1425 ts_tablet_manager.cc:1403] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:24:55.076015  1421 tablet_bootstrap.cc:492] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34: No bootstrap required, opened a new log
I20260709 12:24:55.075408  1021 catalog_manager.cc:5697] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 1 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.075433  1425 raft_consensus.cc:359] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.076512  1421 ts_tablet_manager.cc:1403] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:24:55.076795  1425 raft_consensus.cc:385] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:55.077136  1425 raft_consensus.cc:740] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:55.077920  1425 consensus_queue.cc:260] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.079370  1421 raft_consensus.cc:359] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.080111  1421 raft_consensus.cc:385] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:55.080405  1421 raft_consensus.cc:740] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Initialized, Role: FOLLOWER
I20260709 12:24:55.080539  1425 ts_tablet_manager.cc:1434] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:55.081097  1421 consensus_queue.cc:260] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.081600  1425 tablet_bootstrap.cc:492] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:55.079861  1200 raft_consensus.cc:2468] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 1.
I20260709 12:24:55.083524  1421 ts_tablet_manager.cc:1434] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:55.088021  1425 tablet_bootstrap.cc:654] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:55.093271  1425 tablet_bootstrap.cc:492] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:55.093734  1425 ts_tablet_manager.cc:1403] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:24:55.096436  1425 raft_consensus.cc:359] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.097085  1425 raft_consensus.cc:385] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:55.097472  1425 raft_consensus.cc:740] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:55.096935  1022 catalog_manager.cc:5697] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.098191  1425 consensus_queue.cc:260] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.098995  1022 catalog_manager.cc:5697] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.100556  1425 ts_tablet_manager.cc:1434] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:24:55.101570  1425 tablet_bootstrap.cc:492] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597: Bootstrap starting.
I20260709 12:24:55.100889  1022 catalog_manager.cc:5697] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.103063  1448 raft_consensus.cc:493] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.103658  1448 raft_consensus.cc:515] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.105656  1448 leader_election.cc:290] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:55.106902  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a2a3c52004b1cb6372ee44053abc8" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:55.107447  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a2a3c52004b1cb6372ee44053abc8" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:55.108387  1122 raft_consensus.cc:2393] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 787cff824e6646138b52e01a3a203597 in current term 1: Already voted for candidate cb26883861e84d4d9cddb3349fcf7d34 in this term.
I20260709 12:24:55.109591  1240 leader_election.cc:304] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 787cff824e6646138b52e01a3a203597; no voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:55.110581  1448 raft_consensus.cc:3060] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.110707  1425 tablet_bootstrap.cc:654] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:55.116871  1425 tablet_bootstrap.cc:492] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597: No bootstrap required, opened a new log
I20260709 12:24:55.117403  1425 ts_tablet_manager.cc:1403] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:24:55.117741  1448 raft_consensus.cc:2749] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:55.120060  1425 raft_consensus.cc:359] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.120743  1425 raft_consensus.cc:385] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:55.120913  1425 raft_consensus.cc:740] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Initialized, Role: FOLLOWER
I20260709 12:24:55.121428  1425 consensus_queue.cc:260] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.123008  1425 ts_tablet_manager.cc:1434] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:55.180653  1448 raft_consensus.cc:493] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.181183  1448 raft_consensus.cc:515] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.183030  1448 leader_election.cc:290] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:55.183904  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c61dde938040cea666ca0bd54c85b4" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:55.184093  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c61dde938040cea666ca0bd54c85b4" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:55.184940  1200 raft_consensus.cc:2393] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 787cff824e6646138b52e01a3a203597 in current term 1: Already voted for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in this term.
I20260709 12:24:55.185794  1240 leader_election.cc:304] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 787cff824e6646138b52e01a3a203597; no voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:55.186527  1448 raft_consensus.cc:3060] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.191445  1448 raft_consensus.cc:2749] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:55.201975  1444 raft_consensus.cc:493] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.202549  1444 raft_consensus.cc:515] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.204432  1444 leader_election.cc:290] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:55.205315  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:55.205454  1271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:55.206089  1122 raft_consensus.cc:2393] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb26883861e84d4d9cddb3349fcf7d34 in current term 1: Already voted for candidate 787cff824e6646138b52e01a3a203597 in this term.
I20260709 12:24:55.207010  1166 leader_election.cc:304] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a
I20260709 12:24:55.207604  1444 raft_consensus.cc:3060] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.215716  1444 raft_consensus.cc:2749] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:55.248617  1448 raft_consensus.cc:493] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.249231  1448 raft_consensus.cc:515] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.251204  1448 leader_election.cc:290] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:55.252015  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711f9564e1284330a23664342394fb4f" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:55.252224  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711f9564e1284330a23664342394fb4f" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:55.252806  1122 raft_consensus.cc:2393] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 787cff824e6646138b52e01a3a203597 in current term 1: Already voted for candidate cb26883861e84d4d9cddb3349fcf7d34 in this term.
I20260709 12:24:55.253965  1240 leader_election.cc:304] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 787cff824e6646138b52e01a3a203597; no voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:55.254667  1448 raft_consensus.cc:3060] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.260181  1448 raft_consensus.cc:2749] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:55.264514  1350 consensus_queue.cc:1048] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.267350  1448 raft_consensus.cc:493] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.267969  1448 raft_consensus.cc:515] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.270381  1448 leader_election.cc:290] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:55.271031  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795217fcd6c49619900c50103171297" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:55.271926  1122 raft_consensus.cc:2393] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 787cff824e6646138b52e01a3a203597 in current term 1: Already voted for candidate cb26883861e84d4d9cddb3349fcf7d34 in this term.
I20260709 12:24:55.272176  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795217fcd6c49619900c50103171297" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34" is_pre_election: true
I20260709 12:24:55.274400  1240 leader_election.cc:304] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 787cff824e6646138b52e01a3a203597; no voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:55.275686  1448 raft_consensus.cc:3060] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.283341  1424 consensus_queue.cc:1048] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:55.283758  1448 raft_consensus.cc:2749] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:55.302690  1448 consensus_queue.cc:1048] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:24:55.312341  1070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:55.314113  1445 consensus_queue.cc:1048] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:55.327265  1444 consensus_queue.cc:1048] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.340225  1444 consensus_queue.cc:1048] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.399765  1445 consensus_queue.cc:1048] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.410935  1409 consensus_queue.cc:1048] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.414881  1446 raft_consensus.cc:493] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.415468  1446 raft_consensus.cc:515] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.418095  1446 leader_election.cc:290] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:55.421448  1271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597" is_pre_election: true
I20260709 12:24:55.422238  1271 raft_consensus.cc:2468] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 0.
I20260709 12:24:55.421444  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" is_pre_election: true
I20260709 12:24:55.423396  1166 leader_election.cc:304] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:55.423758  1122 raft_consensus.cc:2468] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 0.
I20260709 12:24:55.424288  1444 raft_consensus.cc:2804] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:55.425218  1444 raft_consensus.cc:493] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.425595  1444 raft_consensus.cc:3060] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.432088  1444 raft_consensus.cc:515] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.434731  1121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:55.434131  1444 leader_election.cc:290] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:55.435079  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:55.435431  1121 raft_consensus.cc:3060] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.435848  1274 raft_consensus.cc:3060] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.440645  1121 raft_consensus.cc:2468] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:55.440845  1274 raft_consensus.cc:2468] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 1.
I20260709 12:24:55.441854  1166 leader_election.cc:304] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:55.442561  1441 raft_consensus.cc:2804] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:55.442991  1441 raft_consensus.cc:697] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:55.443610  1441 consensus_queue.cc:237] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.450510  1020 catalog_manager.cc:5697] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 1 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.503806  1441 consensus_queue.cc:1048] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.516713  1198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e4a2a3c52004b1cb6372ee44053abc8"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
mode: GRACEFUL
new_leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:50274
I20260709 12:24:55.517273  1198 raft_consensus.cc:606] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Received request to transfer leadership to TS 9e2deb8701624db5b7da4b2dd7b0e76a
I20260709 12:24:55.521602  1446 consensus_queue.cc:1048] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.527604  1444 consensus_queue.cc:1048] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:55.531847  1198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
mode: GRACEFUL
new_leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:50274
I20260709 12:24:55.532531  1198 raft_consensus.cc:606] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Received request to transfer leadership to TS 9e2deb8701624db5b7da4b2dd7b0e76a
I20260709 12:24:55.540115  1271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95d59e9ad17b4eec804272c0af331b3b"
dest_uuid: "787cff824e6646138b52e01a3a203597"
mode: GRACEFUL
new_leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:44116
I20260709 12:24:55.540884  1271 raft_consensus.cc:606] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Received request to transfer leadership to TS 9e2deb8701624db5b7da4b2dd7b0e76a
I20260709 12:24:55.540982  1444 raft_consensus.cc:993] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34: : Instructing follower 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:55.541574  1444 raft_consensus.cc:1081] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Signalling peer 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:55.547562  1441 consensus_queue.cc:1048] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:55.556054  1122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e4a2a3c52004b1cb6372ee44053abc8"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:48020
I20260709 12:24:55.557600  1122 raft_consensus.cc:493] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.558166  1122 raft_consensus.cc:3060] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.568790  1271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6"
dest_uuid: "787cff824e6646138b52e01a3a203597"
mode: GRACEFUL
new_leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
 from {username='slave'} at 127.0.0.1:44116
I20260709 12:24:55.568702  1122 raft_consensus.cc:515] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.569593  1271 raft_consensus.cc:606] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Received request to transfer leadership to TS cb26883861e84d4d9cddb3349fcf7d34
I20260709 12:24:55.571216  1122 leader_election.cc:290] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:55.572656  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a2a3c52004b1cb6372ee44053abc8" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:55.573359  1198 raft_consensus.cc:3055] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:55.573674  1198 raft_consensus.cc:740] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:55.574095  1271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4a2a3c52004b1cb6372ee44053abc8" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:55.574883  1271 raft_consensus.cc:3060] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.574507  1198 consensus_queue.cc:260] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.576416  1198 raft_consensus.cc:3060] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.583576  1198 raft_consensus.cc:2468] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:55.587924  1090 leader_election.cc:304] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:55.591465  1122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69c61dde938040cea666ca0bd54c85b4"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
mode: GRACEFUL
new_leader_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:48036
I20260709 12:24:55.592159  1122 raft_consensus.cc:606] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Received request to transfer leadership to TS 787cff824e6646138b52e01a3a203597
I20260709 12:24:55.589627  1271 raft_consensus.cc:2468] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:55.592384  1350 raft_consensus.cc:2804] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:55.592990  1274 raft_consensus.cc:1240] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Rejecting Update request from peer cb26883861e84d4d9cddb3349fcf7d34 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:55.593065  1350 raft_consensus.cc:697] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:55.593343  1449 consensus_queue.cc:1048] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.594142  1350 consensus_queue.cc:237] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.606336  1486 consensus_queue.cc:1048] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:55.608754  1020 catalog_manager.cc:5697] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 1 to 2, leader changed from cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66) to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 2 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.617921  1424 consensus_queue.cc:1048] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.832136  1486 consensus_queue.cc:1048] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.832832  1448 raft_consensus.cc:993] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597: : Instructing follower 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:55.833422  1448 raft_consensus.cc:1081] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Signalling peer 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:55.835139  1122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95d59e9ad17b4eec804272c0af331b3b"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:48026
I20260709 12:24:55.835731  1122 raft_consensus.cc:493] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.836078  1122 raft_consensus.cc:3060] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.839951  1446 raft_consensus.cc:993] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34: : Instructing follower 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:55.840499  1446 raft_consensus.cc:1081] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Signalling peer 9e2deb8701624db5b7da4b2dd7b0e76a to start an election
I20260709 12:24:55.842186  1409 raft_consensus.cc:993] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597: : Instructing follower cb26883861e84d4d9cddb3349fcf7d34 to start an election
I20260709 12:24:55.842525  1123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
 from {username='slave'} at 127.0.0.1:48020
I20260709 12:24:55.842724  1448 raft_consensus.cc:1081] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Signalling peer cb26883861e84d4d9cddb3349fcf7d34 to start an election
I20260709 12:24:55.843107  1123 raft_consensus.cc:493] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.843506  1123 raft_consensus.cc:3060] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.844713  1200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
 from {username='slave'} at 127.0.0.1:50270
I20260709 12:24:55.844775  1122 raft_consensus.cc:515] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.845420  1200 raft_consensus.cc:493] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.845842  1200 raft_consensus.cc:3060] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.847882  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d59e9ad17b4eec804272c0af331b3b" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:55.848531  1198 raft_consensus.cc:3060] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.849836  1486 consensus_queue.cc:1048] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.850617  1123 raft_consensus.cc:515] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.852653  1123 leader_election.cc:290] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:55.853574  1121 raft_consensus.cc:1240] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Rejecting Update request from peer cb26883861e84d4d9cddb3349fcf7d34 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:55.853785  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:55.854363  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:55.854499  1199 raft_consensus.cc:3055] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:55.854950  1199 raft_consensus.cc:740] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:55.855775  1199 consensus_queue.cc:260] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.856750  1199 raft_consensus.cc:3060] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.858198  1198 raft_consensus.cc:2468] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:55.859496  1122 leader_election.cc:290] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Requested vote from peers cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:55.860304  1090 leader_election.cc:304] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:55.861533  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d59e9ad17b4eec804272c0af331b3b" candidate_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:55.862129  1273 raft_consensus.cc:3055] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:55.862471  1273 raft_consensus.cc:740] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:55.863350  1273 consensus_queue.cc:260] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.863951  1424 raft_consensus.cc:2804] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:55.864566  1273 raft_consensus.cc:3060] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.864567  1424 raft_consensus.cc:697] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:55.866140  1424 consensus_queue.cc:237] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.867007  1199 raft_consensus.cc:2468] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:55.868729  1090 leader_election.cc:304] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 787cff824e6646138b52e01a3a203597
I20260709 12:24:55.869761  1490 raft_consensus.cc:2804] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:55.870247  1490 raft_consensus.cc:697] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Becoming Leader. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:55.871111  1490 consensus_queue.cc:237] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.863356  1200 raft_consensus.cc:515] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.873636  1200 leader_election.cc:290] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 2 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923)
I20260709 12:24:55.874126  1273 raft_consensus.cc:2468] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2deb8701624db5b7da4b2dd7b0e76a in term 2.
I20260709 12:24:55.876888  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:55.877487  1122 raft_consensus.cc:3060] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.882192  1273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6" candidate_uuid: "cb26883861e84d4d9cddb3349fcf7d34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "787cff824e6646138b52e01a3a203597"
I20260709 12:24:55.882939  1273 raft_consensus.cc:3055] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:55.883190  1273 raft_consensus.cc:740] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:55.884042  1273 consensus_queue.cc:260] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.885274  1273 raft_consensus.cc:3060] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.889430  1122 raft_consensus.cc:2468] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 2.
I20260709 12:24:55.890887  1166 leader_election.cc:304] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2deb8701624db5b7da4b2dd7b0e76a, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:55.891636  1486 raft_consensus.cc:2804] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:55.892002  1273 raft_consensus.cc:2468] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb26883861e84d4d9cddb3349fcf7d34 in term 2.
I20260709 12:24:55.892091  1486 raft_consensus.cc:697] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Becoming Leader. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:55.891047  1022 catalog_manager.cc:5697] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 1 to 2, leader changed from cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66) to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 2 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.893189  1486 consensus_queue.cc:237] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.893500  1022 catalog_manager.cc:5697] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a reported cstate change: term changed from 1 to 2, leader changed from 787cff824e6646138b52e01a3a203597 (127.22.43.67) to 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65). New cstate: current_term: 2 leader_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.901090  1020 catalog_manager.cc:5697] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 reported cstate change: term changed from 1 to 2, leader changed from 787cff824e6646138b52e01a3a203597 (127.22.43.67) to cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66). New cstate: current_term: 2 leader_uuid: "cb26883861e84d4d9cddb3349fcf7d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.914074  1449 raft_consensus.cc:993] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a: : Instructing follower 787cff824e6646138b52e01a3a203597 to start an election
I20260709 12:24:55.914574  1424 raft_consensus.cc:1081] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Signalling peer 787cff824e6646138b52e01a3a203597 to start an election
I20260709 12:24:55.916105  1273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69c61dde938040cea666ca0bd54c85b4"
dest_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:44094
I20260709 12:24:55.916496  1273 raft_consensus.cc:493] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.916725  1273 raft_consensus.cc:3060] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.921056  1273 raft_consensus.cc:515] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.922442  1273 leader_election.cc:290] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 2 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:55.923295  1122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c61dde938040cea666ca0bd54c85b4" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:55.923640  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c61dde938040cea666ca0bd54c85b4" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:55.924017  1122 raft_consensus.cc:3055] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:55.924285  1200 raft_consensus.cc:3060] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.924381  1122 raft_consensus.cc:740] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:55.925293  1122 consensus_queue.cc:260] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.926630  1122 raft_consensus.cc:3060] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.932044  1200 raft_consensus.cc:2468] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 2.
I20260709 12:24:55.933585  1240 leader_election.cc:304] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:55.933869  1122 raft_consensus.cc:2468] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 2.
I20260709 12:24:55.934453  1409 raft_consensus.cc:2804] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:55.934944  1409 raft_consensus.cc:697] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 2 LEADER]: Becoming Leader. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:55.935729  1409 consensus_queue.cc:237] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:55.942034  1020 catalog_manager.cc:5697] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 reported cstate change: term changed from 1 to 2, leader changed from 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65) to 787cff824e6646138b52e01a3a203597 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "787cff824e6646138b52e01a3a203597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.102105  1200 raft_consensus.cc:1275] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.103340  1424 consensus_queue.cc:1048] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.111140  1273 raft_consensus.cc:1275] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.112830  1424 consensus_queue.cc:1048] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:56.251044  1273 raft_consensus.cc:1275] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.252326  1490 consensus_queue.cc:1048] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.259883  1200 raft_consensus.cc:1275] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.262162  1490 consensus_queue.cc:1048] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.301544  1200 raft_consensus.cc:1275] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.302881  1490 consensus_queue.cc:1048] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.306635  1273 raft_consensus.cc:3060] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.313966  1273 raft_consensus.cc:1275] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer 9e2deb8701624db5b7da4b2dd7b0e76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.315918  1449 consensus_queue.cc:1048] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.352327  1122 raft_consensus.cc:1275] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.353572  1409 consensus_queue.cc:1048] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.363296  1200 raft_consensus.cc:1275] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.365664  1409 consensus_queue.cc:1048] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.414939  1273 raft_consensus.cc:1275] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Refusing update from remote peer cb26883861e84d4d9cddb3349fcf7d34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.416186  1486 consensus_queue.cc:1048] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.424805  1122 raft_consensus.cc:1275] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Refusing update from remote peer cb26883861e84d4d9cddb3349fcf7d34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.427115  1442 consensus_queue.cc:1048] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.598376  1021 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34358:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:24:58.624405  1021 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34358:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:24:58.649900 22701 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:24:58.969722  1537 log.cc:927] Time spent T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597: Append to log took a long time: real 0.109s	user 0.004s	sys 0.000s
I20260709 12:24:58.969941  1543 tablet.cc:1724] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:58.950011  1549 tablet.cc:1724] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:58.983019  1226 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:726f6d6ea59e433487a10ca6d225cb10)
I20260709 12:24:58.982091  1555 tablet.cc:1724] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.015225  1561 tablet.cc:1724] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:59.031443  1550 log.cc:927] Time spent T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:24:59.041319  1554 tablet.cc:1724] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:59.033247  1166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:33923, user_credentials={real_user=slave}} blocked reactor thread for 85130.8us
I20260709 12:24:59.079731  1568 tablet.cc:1724] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.096956  1574 tablet.cc:1724] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.085254  1197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
mode: GRACEFUL
new_leader_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:58582
I20260709 12:24:59.123288  1575 tablet.cc:1724] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.113430  1197 raft_consensus.cc:606] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Received request to transfer leadership to TS 787cff824e6646138b52e01a3a203597
I20260709 12:24:59.137485  1549 tablet.cc:1724] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.099676  1573 tablet.cc:1724] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:59.169255  1166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.67:33923, user_credentials={real_user=slave}} blocked reactor thread for 74106.5us
I20260709 12:24:59.174069  1571 tablet.cc:1724] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.182683  1554 tablet.cc:1724] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.196650  1561 tablet.cc:1724] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.217182  1576 tablet.cc:1724] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.219578  1578 tablet.cc:1724] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.222308  1543 tablet.cc:1724] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.227015  1527 raft_consensus.cc:993] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34: : Instructing follower 787cff824e6646138b52e01a3a203597 to start an election
I20260709 12:24:59.227619  1527 raft_consensus.cc:1081] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Signalling peer 787cff824e6646138b52e01a3a203597 to start an election
W20260709 12:24:59.231086  1150 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:2e4a2a3c52004b1cb6372ee44053abc8)
W20260709 12:24:59.237103  1150 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:2e4a2a3c52004b1cb6372ee44053abc8)
I20260709 12:24:59.241158  1268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6"
dest_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:44104
I20260709 12:24:59.241909  1268 raft_consensus.cc:493] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:59.248828  1268 raft_consensus.cc:3060] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.259179  1575 tablet.cc:1724] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.261901  1268 raft_consensus.cc:515] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.270682  1571 tablet.cc:1724] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.269254  1578 tablet.cc:1724] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.272567  1568 tablet.cc:1724] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.198094  1555 tablet.cc:1724] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.282209  1549 tablet.cc:1724] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.306716  1268 leader_election.cc:290] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 3 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:59.307690  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:59.308462  1123 raft_consensus.cc:3060] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.311462  1561 tablet.cc:1724] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.209535  1574 tablet.cc:1724] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.286149  1578 tablet.cc:1724] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.319614  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411e8023f324310b510f35e9d7416b6" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:59.320267  1198 raft_consensus.cc:3055] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:59.320549  1198 raft_consensus.cc:740] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:59.323940  1123 raft_consensus.cc:2468] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 3.
I20260709 12:24:59.325353  1240 leader_election.cc:304] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:59.321362  1198 consensus_queue.cc:260] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.326889  1567 raft_consensus.cc:2804] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:59.327209  1198 raft_consensus.cc:3060] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.327383  1567 raft_consensus.cc:697] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 3 LEADER]: Becoming Leader. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:59.328437  1567 consensus_queue.cc:237] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.337565  1198 raft_consensus.cc:2468] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 3.
I20260709 12:24:59.347419  1574 tablet.cc:1724] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.347841  1573 tablet.cc:1724] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:59.350652  1021 catalog_manager.cc:5697] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 reported cstate change: term changed from 2 to 3, leader changed from cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66) to 787cff824e6646138b52e01a3a203597 (127.22.43.67). New cstate: current_term: 3 leader_uuid: "787cff824e6646138b52e01a3a203597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:59.362316  1021 catalog_manager.cc:5789] TS 787cff824e6646138b52e01a3a203597 (127.22.43.67:33923) does not have the latest schema for tablet 0411e8023f324310b510f35e9d7416b6 (table soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d]). Expected version 1 got 0
I20260709 12:24:59.367143  1123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
mode: GRACEFUL
new_leader_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:53362
I20260709 12:24:59.367753  1123 raft_consensus.cc:606] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Received request to transfer leadership to TS 787cff824e6646138b52e01a3a203597
I20260709 12:24:59.369290 22701 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:24:59.369872 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:59.380697  1198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51"
dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
mode: GRACEFUL
new_leader_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:58582
I20260709 12:24:59.381383  1198 raft_consensus.cc:606] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Received request to transfer leadership to TS 787cff824e6646138b52e01a3a203597
I20260709 12:24:59.385255  1123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79"
dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
mode: GRACEFUL
new_leader_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:53362
I20260709 12:24:59.385905  1123 raft_consensus.cc:606] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Received request to transfer leadership to TS 787cff824e6646138b52e01a3a203597
I20260709 12:24:59.387445 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:59.387943 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:59.392433  1020 catalog_manager.cc:6242] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad: soft_deleted_table [id=ba50f0b7e9754608b7c66b0a6d060f7d] alter complete (version 1)
I20260709 12:24:59.433280  1534 raft_consensus.cc:993] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a: : Instructing follower 787cff824e6646138b52e01a3a203597 to start an election
I20260709 12:24:59.433907  1535 raft_consensus.cc:1081] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Signalling peer 787cff824e6646138b52e01a3a203597 to start an election
I20260709 12:24:59.435607  1268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79"
dest_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:44094
I20260709 12:24:59.436084  1268 raft_consensus.cc:493] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:59.436379  1268 raft_consensus.cc:3060] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.442770  1268 raft_consensus.cc:515] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.444319  1268 leader_election.cc:290] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 3 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:59.445313  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:59.445570  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8a73b264c24f7293a10162ef2c5a79" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:59.446043  1123 raft_consensus.cc:3055] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:59.446199  1198 raft_consensus.cc:3060] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.446455  1123 raft_consensus.cc:740] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:59.447326  1123 consensus_queue.cc:260] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.448552  1123 raft_consensus.cc:3060] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.449667  1534 raft_consensus.cc:993] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a: : Instructing follower 787cff824e6646138b52e01a3a203597 to start an election
I20260709 12:24:59.450249  1535 raft_consensus.cc:1081] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Signalling peer 787cff824e6646138b52e01a3a203597 to start an election
I20260709 12:24:59.451864  1268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd"
dest_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:44094
I20260709 12:24:59.452399  1268 raft_consensus.cc:493] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:59.452754  1268 raft_consensus.cc:3060] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.453104  1198 raft_consensus.cc:2468] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 3.
I20260709 12:24:59.454388  1240 leader_election.cc:304] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:59.455121  1567 raft_consensus.cc:2804] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:59.455436  1123 raft_consensus.cc:2468] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 3.
I20260709 12:24:59.455559  1567 raft_consensus.cc:697] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 3 LEADER]: Becoming Leader. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:59.456604  1567 consensus_queue.cc:237] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.459743  1268 raft_consensus.cc:515] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.462227  1268 leader_election.cc:290] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 3 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:59.463605  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:59.464157  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8766846e73d349fabdfe01afc5311ebd" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:59.464277  1123 raft_consensus.cc:3055] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:59.464756  1123 raft_consensus.cc:740] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e2deb8701624db5b7da4b2dd7b0e76a, State: Running, Role: LEADER
I20260709 12:24:59.464771  1198 raft_consensus.cc:3060] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.465626  1123 consensus_queue.cc:260] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.467031  1123 raft_consensus.cc:3060] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.466910  1021 catalog_manager.cc:5697] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 reported cstate change: term changed from 2 to 3, leader changed from 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65) to 787cff824e6646138b52e01a3a203597 (127.22.43.67). New cstate: current_term: 3 leader_uuid: "787cff824e6646138b52e01a3a203597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:59.470958  1198 raft_consensus.cc:2468] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 3.
I20260709 12:24:59.472046  1240 leader_election.cc:304] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, cb26883861e84d4d9cddb3349fcf7d34; no voters: 
I20260709 12:24:59.472877  1567 raft_consensus.cc:2804] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:59.473363  1567 raft_consensus.cc:697] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 3 LEADER]: Becoming Leader. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:59.474211  1567 consensus_queue.cc:237] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.475255  1123 raft_consensus.cc:2468] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 3.
I20260709 12:24:59.482857  1021 catalog_manager.cc:5697] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 reported cstate change: term changed from 2 to 3, leader changed from 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65) to 787cff824e6646138b52e01a3a203597 (127.22.43.67). New cstate: current_term: 3 leader_uuid: "787cff824e6646138b52e01a3a203597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:59.719177  1579 raft_consensus.cc:993] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34: : Instructing follower 787cff824e6646138b52e01a3a203597 to start an election
I20260709 12:24:59.719882  1581 raft_consensus.cc:1081] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Signalling peer 787cff824e6646138b52e01a3a203597 to start an election
I20260709 12:24:59.721544  1268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51"
dest_uuid: "787cff824e6646138b52e01a3a203597"
 from {username='slave'} at 127.0.0.1:44104
I20260709 12:24:59.722093  1268 raft_consensus.cc:493] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:59.722402  1268 raft_consensus.cc:3060] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.727839  1268 raft_consensus.cc:515] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.729777  1268 leader_election.cc:290] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 3 election: Requested vote from peers 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885), cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951)
I20260709 12:24:59.730664  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a"
I20260709 12:24:59.730940  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aa9d703663449caa4946ee295c4fe51" candidate_uuid: "787cff824e6646138b52e01a3a203597" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb26883861e84d4d9cddb3349fcf7d34"
I20260709 12:24:59.731334  1123 raft_consensus.cc:3060] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.731545  1198 raft_consensus.cc:3055] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:59.731936  1198 raft_consensus.cc:740] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb26883861e84d4d9cddb3349fcf7d34, State: Running, Role: LEADER
I20260709 12:24:59.733098  1198 consensus_queue.cc:260] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.734476  1198 raft_consensus.cc:3060] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.738646  1123 raft_consensus.cc:2468] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 3.
I20260709 12:24:59.739964  1240 leader_election.cc:304] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 787cff824e6646138b52e01a3a203597, 9e2deb8701624db5b7da4b2dd7b0e76a; no voters: 
I20260709 12:24:59.740770  1567 raft_consensus.cc:2804] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:59.741263  1567 raft_consensus.cc:697] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 3 LEADER]: Becoming Leader. State: Replica: 787cff824e6646138b52e01a3a203597, State: Running, Role: LEADER
I20260709 12:24:59.742161  1567 consensus_queue.cc:237] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } }
I20260709 12:24:59.741289  1198 raft_consensus.cc:2468] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 787cff824e6646138b52e01a3a203597 in term 3.
I20260709 12:24:59.754081  1021 catalog_manager.cc:5697] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 reported cstate change: term changed from 2 to 3, leader changed from cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66) to 787cff824e6646138b52e01a3a203597 (127.22.43.67). New cstate: current_term: 3 leader_uuid: "787cff824e6646138b52e01a3a203597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "787cff824e6646138b52e01a3a203597" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 33923 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:59.826124  1123 raft_consensus.cc:1275] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:59.827498  1567 consensus_queue.cc:1048] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:59.836942  1198 raft_consensus.cc:1275] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:59.840128  1567 consensus_queue.cc:1048] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:59.889430  1198 raft_consensus.cc:1275] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:59.890772  1567 consensus_queue.cc:1048] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:59.893224  1198 raft_consensus.cc:1275] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:59.895462  1591 consensus_queue.cc:1048] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:59.897195  1123 raft_consensus.cc:1275] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:59.899055  1591 consensus_queue.cc:1048] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:59.911561  1123 raft_consensus.cc:1275] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:59.915859  1567 consensus_queue.cc:1048] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:00.163700  1197 raft_consensus.cc:1275] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:00.165490  1591 consensus_queue.cc:1048] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb26883861e84d4d9cddb3349fcf7d34" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:00.166266  1122 raft_consensus.cc:1275] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Refusing update from remote peer 787cff824e6646138b52e01a3a203597: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:00.167970  1591 consensus_queue.cc:1048] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2deb8701624db5b7da4b2dd7b0e76a" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:00.389115 22701 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:00.395464 22701 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:00.395979 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:00.401162 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:00.401664 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:01.402684 22701 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:01.407933 22701 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:01.408403 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:01.413159 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:01.413614 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:02.414747 22701 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:02.420943 22701 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:02.421350 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:02.427119 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:02.427505 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:03.428467 22701 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:03.434557 22701 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:03.434928 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:03.441119 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:03.441582 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:04.442678 22701 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:04.447893 22701 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:04.448380 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:04.453698 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:04.454195 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:05.455314 22701 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:05.462185 22701 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:05.462630 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:05.467820 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:05.468247 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:06.469215 22701 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:06.474309 22701 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:06.474730 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:06.479285 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:06.479681 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:07.480770 22701 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:07.486613 22701 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:07.487115 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:07.493149 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:07.493681 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:08.495085 22701 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:08.505154 22701 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:08.505828 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:08.512300 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:08.512794 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:09.577222 22701 tablet_server.cc:179] TabletServer@127.22.43.65:0 shutting down...
W20260709 12:25:09.591528  1240 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 12:25:09.601593  1240 consensus_peers.cc:597] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 -> Peer 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885): Couldn't send request to peer 9e2deb8701624db5b7da4b2dd7b0e76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.631351 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:09.632434 22701 tablet_replica.cc:333] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.634011 22701 raft_consensus.cc:2243] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.634908 22701 raft_consensus.cc:2272] T 726f6d6ea59e433487a10ca6d225cb10 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.637936 22701 tablet_replica.cc:333] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.638652 22701 raft_consensus.cc:2243] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.639694 22701 raft_consensus.cc:2272] T a9cf542f2066458ea7a2f2d888c93e83 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.643565 22701 tablet_replica.cc:333] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.644593 22701 raft_consensus.cc:2243] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.645805 22701 raft_consensus.cc:2272] T 2e4a2a3c52004b1cb6372ee44053abc8 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.648453 22701 tablet_replica.cc:333] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.649215 22701 raft_consensus.cc:2243] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.650074 22701 raft_consensus.cc:2272] T 69c61dde938040cea666ca0bd54c85b4 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.654417 22701 tablet_replica.cc:333] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.655237 22701 raft_consensus.cc:2243] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:09.655560  1166 consensus_peers.cc:597] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 -> Peer 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885): Couldn't send request to peer 9e2deb8701624db5b7da4b2dd7b0e76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.656263 22701 raft_consensus.cc:2272] T 0411e8023f324310b510f35e9d7416b6 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.659118 22701 tablet_replica.cc:333] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.659878 22701 raft_consensus.cc:2243] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.660581 22701 raft_consensus.cc:2272] T 711f9564e1284330a23664342394fb4f P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.663314 22701 tablet_replica.cc:333] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.664016 22701 raft_consensus.cc:2243] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.664582 22701 raft_consensus.cc:2272] T 2aa9d703663449caa4946ee295c4fe51 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.667380 22701 tablet_replica.cc:333] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.668009 22701 raft_consensus.cc:2243] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.668534 22701 raft_consensus.cc:2272] T 8766846e73d349fabdfe01afc5311ebd P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.671217 22701 tablet_replica.cc:333] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.671844 22701 raft_consensus.cc:2243] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.672847 22701 raft_consensus.cc:2272] T 95d59e9ad17b4eec804272c0af331b3b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.675688 22701 tablet_replica.cc:333] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.676301 22701 raft_consensus.cc:2243] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.677745 22701 raft_consensus.cc:2272] T 9fa072525af2477389a5e6c6fd3b94ba P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.678510  1240 consensus_peers.cc:597] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 -> Peer 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885): Couldn't send request to peer 9e2deb8701624db5b7da4b2dd7b0e76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.681262 22701 tablet_replica.cc:333] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.682019 22701 raft_consensus.cc:2243] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.682578 22701 raft_consensus.cc:2272] T 0b33be2a6a0540eca49d02011b933bd9 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.685097 22701 tablet_replica.cc:333] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.685714 22701 raft_consensus.cc:2243] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.686254 22701 raft_consensus.cc:2272] T f857dba63c984a3fbfdbb1b27799e38b P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.688743 22701 tablet_replica.cc:333] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.689355 22701 raft_consensus.cc:2243] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.689903 22701 raft_consensus.cc:2272] T 4a584d9db72c4c9daba1e998de3dc937 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.692451 22701 tablet_replica.cc:333] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.693007 22701 raft_consensus.cc:2243] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.693516 22701 raft_consensus.cc:2272] T df8a73b264c24f7293a10162ef2c5a79 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.695932 22701 tablet_replica.cc:333] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.696549 22701 raft_consensus.cc:2243] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.697419 22701 raft_consensus.cc:2272] T 640ad567937c4867ace7c1927c63be92 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.700021 22701 tablet_replica.cc:333] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.700578 22701 raft_consensus.cc:2243] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.701126 22701 raft_consensus.cc:2272] T c795217fcd6c49619900c50103171297 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.703550 22701 tablet_replica.cc:333] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.704156 22701 raft_consensus.cc:2243] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.704706 22701 raft_consensus.cc:2272] T 440a9e5626d64a9fbba9c7b6135232ea P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.707271 22701 tablet_replica.cc:333] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a: stopping tablet replica
I20260709 12:25:09.707919 22701 raft_consensus.cc:2243] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.709199 22701 raft_consensus.cc:2272] T 26cdc8855ada47f7a65e9f1befef6ee1 P 9e2deb8701624db5b7da4b2dd7b0e76a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.711181  1240 consensus_peers.cc:597] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 -> Peer 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885): Couldn't send request to peer 9e2deb8701624db5b7da4b2dd7b0e76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.759097 22701 tablet_server.cc:196] TabletServer@127.22.43.65:0 shutdown complete.
W20260709 12:25:09.789535  1166 consensus_peers.cc:597] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 -> Peer 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885): Couldn't send request to peer 9e2deb8701624db5b7da4b2dd7b0e76a. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:38885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:09.803939  1240 consensus_peers.cc:597] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 -> Peer 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885): Couldn't send request to peer 9e2deb8701624db5b7da4b2dd7b0e76a. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:38885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.818984 22701 tablet_server.cc:179] TabletServer@127.22.43.66:0 shutting down...
I20260709 12:25:09.853824 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:09.854656 22701 tablet_replica.cc:333] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.855598 22701 raft_consensus.cc:2243] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.856364 22701 raft_consensus.cc:2272] T a9cf542f2066458ea7a2f2d888c93e83 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.859097 22701 tablet_replica.cc:333] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.859943 22701 raft_consensus.cc:2243] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.860533 22701 raft_consensus.cc:2272] T 69c61dde938040cea666ca0bd54c85b4 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.863178 22701 tablet_replica.cc:333] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.863852 22701 raft_consensus.cc:2243] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.864459 22701 raft_consensus.cc:2272] T 0411e8023f324310b510f35e9d7416b6 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.867221 22701 tablet_replica.cc:333] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.867810 22701 raft_consensus.cc:2243] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.868816 22701 raft_consensus.cc:2272] T 711f9564e1284330a23664342394fb4f P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.871181 22701 tablet_replica.cc:333] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.871802 22701 raft_consensus.cc:2243] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.872713 22701 raft_consensus.cc:2272] T 726f6d6ea59e433487a10ca6d225cb10 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.874905 22701 tablet_replica.cc:333] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.875717 22701 raft_consensus.cc:2243] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.876425 22701 raft_consensus.cc:2272] T 8766846e73d349fabdfe01afc5311ebd P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.879133  1240 consensus_peers.cc:597] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 -> Peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Couldn't send request to peer cb26883861e84d4d9cddb3349fcf7d34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.879716 22701 tablet_replica.cc:333] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.880398 22701 raft_consensus.cc:2243] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.880885 22701 raft_consensus.cc:2272] T 2aa9d703663449caa4946ee295c4fe51 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.883479 22701 tablet_replica.cc:333] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.884111 22701 raft_consensus.cc:2243] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.885018 22701 raft_consensus.cc:2272] T c795217fcd6c49619900c50103171297 P cb26883861e84d4d9cddb3349fcf7d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.887455 22701 tablet_replica.cc:333] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.888047 22701 raft_consensus.cc:2243] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.889000 22701 raft_consensus.cc:2272] T 440a9e5626d64a9fbba9c7b6135232ea P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.891283 22701 tablet_replica.cc:333] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.891860 22701 raft_consensus.cc:2243] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.892732 22701 raft_consensus.cc:2272] T 4a584d9db72c4c9daba1e998de3dc937 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.895042 22701 tablet_replica.cc:333] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.895603 22701 raft_consensus.cc:2243] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.896150 22701 raft_consensus.cc:2272] T df8a73b264c24f7293a10162ef2c5a79 P cb26883861e84d4d9cddb3349fcf7d34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.898279 22701 tablet_replica.cc:333] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.898921 22701 raft_consensus.cc:2243] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.899520 22701 raft_consensus.cc:2272] T 26cdc8855ada47f7a65e9f1befef6ee1 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.902848 22701 tablet_replica.cc:333] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.903777 22701 raft_consensus.cc:2243] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:09.904219  1240 consensus_peers.cc:597] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 -> Peer 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885): Couldn't send request to peer 9e2deb8701624db5b7da4b2dd7b0e76a. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:38885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.904558 22701 raft_consensus.cc:2272] T 95d59e9ad17b4eec804272c0af331b3b P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.907195 22701 tablet_replica.cc:333] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.907783 22701 raft_consensus.cc:2243] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.908257 22701 raft_consensus.cc:2272] T 0b33be2a6a0540eca49d02011b933bd9 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.910851 22701 tablet_replica.cc:333] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.911434 22701 raft_consensus.cc:2243] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.912112 22701 raft_consensus.cc:2272] T 9fa072525af2477389a5e6c6fd3b94ba P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.915401 22701 tablet_replica.cc:333] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
W20260709 12:25:09.916007  1240 consensus_peers.cc:597] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 -> Peer 9e2deb8701624db5b7da4b2dd7b0e76a (127.22.43.65:38885): Couldn't send request to peer 9e2deb8701624db5b7da4b2dd7b0e76a. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:38885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.916142 22701 raft_consensus.cc:2243] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.917037 22701 raft_consensus.cc:2272] T 2e4a2a3c52004b1cb6372ee44053abc8 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.917763  1240 consensus_peers.cc:597] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 -> Peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Couldn't send request to peer cb26883861e84d4d9cddb3349fcf7d34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.919731 22701 tablet_replica.cc:333] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.920315 22701 raft_consensus.cc:2243] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.920789 22701 raft_consensus.cc:2272] T 640ad567937c4867ace7c1927c63be92 P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.923213 22701 tablet_replica.cc:333] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34: stopping tablet replica
I20260709 12:25:09.923734 22701 raft_consensus.cc:2243] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.924643 22701 raft_consensus.cc:2272] T f857dba63c984a3fbfdbb1b27799e38b P cb26883861e84d4d9cddb3349fcf7d34 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.945135  1240 consensus_peers.cc:597] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 -> Peer cb26883861e84d4d9cddb3349fcf7d34 (127.22.43.66:33951): Couldn't send request to peer cb26883861e84d4d9cddb3349fcf7d34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.970507 22701 tablet_server.cc:196] TabletServer@127.22.43.66:0 shutdown complete.
I20260709 12:25:10.010880 22701 tablet_server.cc:179] TabletServer@127.22.43.67:0 shutting down...
I20260709 12:25:10.046768 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:10.047681 22701 tablet_replica.cc:333] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.048739 22701 raft_consensus.cc:2243] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.049844 22701 raft_consensus.cc:2272] T 69c61dde938040cea666ca0bd54c85b4 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.052475 22701 tablet_replica.cc:333] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.053136 22701 raft_consensus.cc:2243] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.053699 22701 raft_consensus.cc:2272] T 2e4a2a3c52004b1cb6372ee44053abc8 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.056213 22701 tablet_replica.cc:333] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.056877 22701 raft_consensus.cc:2243] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.057411 22701 raft_consensus.cc:2272] T a9cf542f2066458ea7a2f2d888c93e83 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.059891 22701 tablet_replica.cc:333] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.060653 22701 raft_consensus.cc:2243] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.061405 22701 raft_consensus.cc:2272] T 726f6d6ea59e433487a10ca6d225cb10 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.064845 22701 tablet_replica.cc:333] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.065610 22701 raft_consensus.cc:2243] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.066565 22701 raft_consensus.cc:2272] T 711f9564e1284330a23664342394fb4f P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.069322 22701 tablet_replica.cc:333] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.069989 22701 raft_consensus.cc:2243] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.070906 22701 raft_consensus.cc:2272] T 0411e8023f324310b510f35e9d7416b6 P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.073395 22701 tablet_replica.cc:333] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.074066 22701 raft_consensus.cc:2243] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.074649 22701 raft_consensus.cc:2272] T 26cdc8855ada47f7a65e9f1befef6ee1 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.077136 22701 tablet_replica.cc:333] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.077728 22701 raft_consensus.cc:2243] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.078276 22701 raft_consensus.cc:2272] T 640ad567937c4867ace7c1927c63be92 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.080495 22701 tablet_replica.cc:333] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.081081 22701 raft_consensus.cc:2243] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.082046 22701 raft_consensus.cc:2272] T 8766846e73d349fabdfe01afc5311ebd P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.084438 22701 tablet_replica.cc:333] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.085041 22701 raft_consensus.cc:2243] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.086107 22701 raft_consensus.cc:2272] T 2aa9d703663449caa4946ee295c4fe51 P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.088480 22701 tablet_replica.cc:333] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.089080 22701 raft_consensus.cc:2243] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.089634 22701 raft_consensus.cc:2272] T f857dba63c984a3fbfdbb1b27799e38b P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.092036 22701 tablet_replica.cc:333] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.092621 22701 raft_consensus.cc:2243] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.093168 22701 raft_consensus.cc:2272] T 4a584d9db72c4c9daba1e998de3dc937 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.095497 22701 tablet_replica.cc:333] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.096071 22701 raft_consensus.cc:2243] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.097008 22701 raft_consensus.cc:2272] T df8a73b264c24f7293a10162ef2c5a79 P 787cff824e6646138b52e01a3a203597 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.099382 22701 tablet_replica.cc:333] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.099967 22701 raft_consensus.cc:2243] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.100517 22701 raft_consensus.cc:2272] T 95d59e9ad17b4eec804272c0af331b3b P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.102847 22701 tablet_replica.cc:333] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.103413 22701 raft_consensus.cc:2243] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.103924 22701 raft_consensus.cc:2272] T 9fa072525af2477389a5e6c6fd3b94ba P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.106452 22701 tablet_replica.cc:333] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.107046 22701 raft_consensus.cc:2243] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.107961 22701 raft_consensus.cc:2272] T 0b33be2a6a0540eca49d02011b933bd9 P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.110270 22701 tablet_replica.cc:333] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.110819 22701 raft_consensus.cc:2243] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.111380 22701 raft_consensus.cc:2272] T c795217fcd6c49619900c50103171297 P 787cff824e6646138b52e01a3a203597 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.113727 22701 tablet_replica.cc:333] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597: stopping tablet replica
I20260709 12:25:10.114336 22701 raft_consensus.cc:2243] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.114848 22701 raft_consensus.cc:2272] T 440a9e5626d64a9fbba9c7b6135232ea P 787cff824e6646138b52e01a3a203597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.160019 22701 tablet_server.cc:196] TabletServer@127.22.43.67:0 shutdown complete.
I20260709 12:25:10.198361 22701 master.cc:562] Master@127.22.43.126:39765 shutting down...
I20260709 12:25:10.223480 22701 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.224119 22701 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.224483 22701 tablet_replica.cc:333] T 00000000000000000000000000000000 P fef148db4ec843ebbe3f34537620d4ad: stopping tablet replica
I20260709 12:25:10.246265 22701 master.cc:584] Master@127.22.43.126:39765 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21169 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:25:10.303326 22701 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.43.126:38069
I20260709 12:25:10.304520 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:10.311000  1621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:10.311080  1624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:10.311048  1622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:10.312744 22701 server_base.cc:1061] running on GCE node
I20260709 12:25:10.313647 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:10.313822 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:10.314036 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599910314001 us; error 0 us; skew 500 ppm
I20260709 12:25:10.314554 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:10.316999 22701 webserver.cc:533] Webserver started at http://127.22.43.126:45439/ using document root <none> and password file <none>
I20260709 12:25:10.317490 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:10.317668 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:10.318094 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:10.319268 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/master-0-root/instance:
uuid: "b70ee03760624d1fbf44651d00f95072"
format_stamp: "Formatted at 2026-07-09 12:25:10 on dist-test-slave-0768"
I20260709 12:25:10.323783 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:25:10.327157  1629 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:10.327906 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:25:10.328182 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/master-0-root
uuid: "b70ee03760624d1fbf44651d00f95072"
format_stamp: "Formatted at 2026-07-09 12:25:10 on dist-test-slave-0768"
I20260709 12:25:10.328460 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:10.366267 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:10.367506 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:10.405551 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.126:38069
I20260709 12:25:10.405743  1680 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.126:38069 every 8 connection(s)
I20260709 12:25:10.409781  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.422785  1681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072: Bootstrap starting.
I20260709 12:25:10.428409  1681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.433140  1681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072: No bootstrap required, opened a new log
I20260709 12:25:10.435600  1681 raft_consensus.cc:359] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70ee03760624d1fbf44651d00f95072" member_type: VOTER }
I20260709 12:25:10.436065  1681 raft_consensus.cc:385] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.436265  1681 raft_consensus.cc:740] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b70ee03760624d1fbf44651d00f95072, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.436820  1681 consensus_queue.cc:260] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70ee03760624d1fbf44651d00f95072" member_type: VOTER }
I20260709 12:25:10.437283  1681 raft_consensus.cc:399] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:10.437492  1681 raft_consensus.cc:493] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:10.437757  1681 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.443181  1681 raft_consensus.cc:515] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70ee03760624d1fbf44651d00f95072" member_type: VOTER }
I20260709 12:25:10.443746  1681 leader_election.cc:304] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b70ee03760624d1fbf44651d00f95072; no voters: 
I20260709 12:25:10.444905  1681 leader_election.cc:290] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:10.445281  1684 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.446723  1684 raft_consensus.cc:697] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [term 1 LEADER]: Becoming Leader. State: Replica: b70ee03760624d1fbf44651d00f95072, State: Running, Role: LEADER
I20260709 12:25:10.447479  1684 consensus_queue.cc:237] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70ee03760624d1fbf44651d00f95072" member_type: VOTER }
I20260709 12:25:10.448341  1681 sys_catalog.cc:565] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:10.452530  1685 sys_catalog.cc:455] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b70ee03760624d1fbf44651d00f95072" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70ee03760624d1fbf44651d00f95072" member_type: VOTER } }
I20260709 12:25:10.452734  1686 sys_catalog.cc:455] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b70ee03760624d1fbf44651d00f95072. Latest consensus state: current_term: 1 leader_uuid: "b70ee03760624d1fbf44651d00f95072" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70ee03760624d1fbf44651d00f95072" member_type: VOTER } }
I20260709 12:25:10.453497  1685 sys_catalog.cc:458] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:10.453926  1686 sys_catalog.cc:458] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:10.457542  1690 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:10.465840  1690 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:10.466894 22701 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:10.475513  1690 catalog_manager.cc:1383] Generated new cluster ID: 22284c5f4a0241ebafd3c9c01b704821
I20260709 12:25:10.475864  1690 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:10.496812  1690 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:10.498485  1690 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:10.513324  1690 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072: Generated new TSK 0
I20260709 12:25:10.513991  1690 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:10.533639 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:10.540441  1702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:10.542528  1703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:10.543964  1705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:10.545166 22701 server_base.cc:1061] running on GCE node
I20260709 12:25:10.546123 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:10.546301 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:10.546422 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599910546411 us; error 0 us; skew 500 ppm
I20260709 12:25:10.546868 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:10.549278 22701 webserver.cc:533] Webserver started at http://127.22.43.65:40303/ using document root <none> and password file <none>
I20260709 12:25:10.549799 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:10.550020 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:10.550302 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:10.551441 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-0-root/instance:
uuid: "22dd3f8ff6c4462082e1aac34f75757b"
format_stamp: "Formatted at 2026-07-09 12:25:10 on dist-test-slave-0768"
I20260709 12:25:10.556006 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:25:10.559759  1710 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:10.560820 22701 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:25:10.561126 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-0-root
uuid: "22dd3f8ff6c4462082e1aac34f75757b"
format_stamp: "Formatted at 2026-07-09 12:25:10 on dist-test-slave-0768"
I20260709 12:25:10.561420 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:10.580617 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:10.581928 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:10.583426 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:10.585640 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:10.585875 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:10.586154 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:10.586351 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:10.627699 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.65:34691
I20260709 12:25:10.627825  1772 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.65:34691 every 8 connection(s)
I20260709 12:25:10.633041 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:10.641830  1777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:10.642473  1778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:10.646050 22701 server_base.cc:1061] running on GCE node
W20260709 12:25:10.646423  1781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:10.647603 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:10.647816 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:10.648072 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599910648039 us; error 0 us; skew 500 ppm
I20260709 12:25:10.648680 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:10.651887 22701 webserver.cc:533] Webserver started at http://127.22.43.66:42745/ using document root <none> and password file <none>
I20260709 12:25:10.652565  1773 heartbeater.cc:344] Connected to a master server at 127.22.43.126:38069
I20260709 12:25:10.652616 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:10.653097 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:10.653097  1773 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:10.653477 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:10.654151  1773 heartbeater.cc:507] Master 127.22.43.126:38069 requested a full tablet report, sending...
I20260709 12:25:10.655004 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-1-root/instance:
uuid: "3023eed9ad8a425397f8fe0fe260691e"
format_stamp: "Formatted at 2026-07-09 12:25:10 on dist-test-slave-0768"
I20260709 12:25:10.656635  1646 ts_manager.cc:194] Registered new tserver with Master: 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691)
I20260709 12:25:10.659526  1646 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32966
I20260709 12:25:10.661661 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:25:10.665512  1785 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:10.666428 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:10.666751 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-1-root
uuid: "3023eed9ad8a425397f8fe0fe260691e"
format_stamp: "Formatted at 2026-07-09 12:25:10 on dist-test-slave-0768"
I20260709 12:25:10.667052 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:10.685103 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:10.686394 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:10.687919 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:10.690179 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:10.690412 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:10.690655 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:10.690828 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:10.731451 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.66:41879
I20260709 12:25:10.731582  1847 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.66:41879 every 8 connection(s)
I20260709 12:25:10.736389 22701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:10.744776  1851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:10.745194  1852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:10.748924  1854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:10.749207  1848 heartbeater.cc:344] Connected to a master server at 127.22.43.126:38069
I20260709 12:25:10.749774  1848 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:10.750201 22701 server_base.cc:1061] running on GCE node
I20260709 12:25:10.750779  1848 heartbeater.cc:507] Master 127.22.43.126:38069 requested a full tablet report, sending...
I20260709 12:25:10.751307 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:10.751577 22701 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:10.751792 22701 hybrid_clock.cc:648] HybridClock initialized: now 1783599910751774 us; error 0 us; skew 500 ppm
I20260709 12:25:10.752580 22701 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:10.753158  1646 ts_manager.cc:194] Registered new tserver with Master: 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:10.755275  1646 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32980
I20260709 12:25:10.755509 22701 webserver.cc:533] Webserver started at http://127.22.43.67:38855/ using document root <none> and password file <none>
I20260709 12:25:10.756217 22701 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:10.756462 22701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:10.756780 22701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:10.758041 22701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-2-root/instance:
uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
format_stamp: "Formatted at 2026-07-09 12:25:10 on dist-test-slave-0768"
I20260709 12:25:10.762599 22701 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:25:10.766093  1859 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:10.766888 22701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:25:10.767139 22701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-2-root
uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
format_stamp: "Formatted at 2026-07-09 12:25:10 on dist-test-slave-0768"
I20260709 12:25:10.767397 22701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWotm1J/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599526815862-22701-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:10.800099 22701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:10.801299 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:10.802772 22701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:10.805006 22701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:10.805208 22701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:10.805465 22701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:10.805625 22701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:10.848699 22701 rpc_server.cc:307] RPC server started. Bound to: 127.22.43.67:46461
I20260709 12:25:10.848884  1921 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.43.67:46461 every 8 connection(s)
I20260709 12:25:10.863775  1922 heartbeater.cc:344] Connected to a master server at 127.22.43.126:38069
I20260709 12:25:10.864332  1922 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:10.865159  1922 heartbeater.cc:507] Master 127.22.43.126:38069 requested a full tablet report, sending...
I20260709 12:25:10.867221  1646 ts_manager.cc:194] Registered new tserver with Master: 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:10.867676 22701 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015081799s
I20260709 12:25:10.868747  1646 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32982
I20260709 12:25:10.894340  1646 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32988:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:10.897277  1646 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:10.989967  1813 tablet_service.cc:1511] Processing CreateTablet for tablet 9d585333425c4b5ab82e429569429dbc (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:10.991482  1813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d585333425c4b5ab82e429569429dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.995687  1811 tablet_service.cc:1511] Processing CreateTablet for tablet 506762ba3842492ab6e7f9f128f98088 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:10.997396  1811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506762ba3842492ab6e7f9f128f98088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.999186  1806 tablet_service.cc:1511] Processing CreateTablet for tablet dfee7ba822194cd39954dc5330db93ce (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:11.000764  1806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee7ba822194cd39954dc5330db93ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.000525  1738 tablet_service.cc:1511] Processing CreateTablet for tablet 9d585333425c4b5ab82e429569429dbc (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:11.003142  1807 tablet_service.cc:1511] Processing CreateTablet for tablet ecfdee33f5a34a64bcd8be53c7111305 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:11.003558  1731 tablet_service.cc:1511] Processing CreateTablet for tablet dfee7ba822194cd39954dc5330db93ce (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:11.004500  1807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecfdee33f5a34a64bcd8be53c7111305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.005448  1735 tablet_service.cc:1511] Processing CreateTablet for tablet 70f21bc04ed3443fa62544bd8b7015da (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:11.006615  1730 tablet_service.cc:1511] Processing CreateTablet for tablet 1f284b2b727e463d8212164d8ba764e6 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:11.007059  1808 tablet_service.cc:1511] Processing CreateTablet for tablet 349960d984674a8fae2ad4a7af1b8504 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:11.007877  1734 tablet_service.cc:1511] Processing CreateTablet for tablet 5243a9642f8f48beaf4d071e7ebd624f (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:11.008435  1808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 349960d984674a8fae2ad4a7af1b8504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.010458  1733 tablet_service.cc:1511] Processing CreateTablet for tablet 349960d984674a8fae2ad4a7af1b8504 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:11.011613  1809 tablet_service.cc:1511] Processing CreateTablet for tablet 5243a9642f8f48beaf4d071e7ebd624f (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:10.993710  1812 tablet_service.cc:1511] Processing CreateTablet for tablet 77d4939daabb40dfbc51a37b80bcc27d (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:11.012991  1732 tablet_service.cc:1511] Processing CreateTablet for tablet ecfdee33f5a34a64bcd8be53c7111305 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:11.015635  1805 tablet_service.cc:1511] Processing CreateTablet for tablet 1f284b2b727e463d8212164d8ba764e6 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:11.017171  1805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f284b2b727e463d8212164d8ba764e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.018229  1809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5243a9642f8f48beaf4d071e7ebd624f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.019850  1812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d4939daabb40dfbc51a37b80bcc27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.019598  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 77d4939daabb40dfbc51a37b80bcc27d (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:10.999212  1810 tablet_service.cc:1511] Processing CreateTablet for tablet 70f21bc04ed3443fa62544bd8b7015da (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:11.022691  1810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f21bc04ed3443fa62544bd8b7015da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.003360  1736 tablet_service.cc:1511] Processing CreateTablet for tablet 506762ba3842492ab6e7f9f128f98088 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:11.025344  1738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d585333425c4b5ab82e429569429dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.026734  1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5243a9642f8f48beaf4d071e7ebd624f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.027402  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506762ba3842492ab6e7f9f128f98088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.030200  1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 349960d984674a8fae2ad4a7af1b8504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.030877  1732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecfdee33f5a34a64bcd8be53c7111305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.033464  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d4939daabb40dfbc51a37b80bcc27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.039099  1730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f284b2b727e463d8212164d8ba764e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.044975  1887 tablet_service.cc:1511] Processing CreateTablet for tablet 9d585333425c4b5ab82e429569429dbc (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:11.046108  1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee7ba822194cd39954dc5330db93ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.046553  1887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d585333425c4b5ab82e429569429dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.051959  1886 tablet_service.cc:1511] Processing CreateTablet for tablet 77d4939daabb40dfbc51a37b80bcc27d (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:11.053511  1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77d4939daabb40dfbc51a37b80bcc27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.060787  1885 tablet_service.cc:1511] Processing CreateTablet for tablet 506762ba3842492ab6e7f9f128f98088 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:11.063606  1884 tablet_service.cc:1511] Processing CreateTablet for tablet 70f21bc04ed3443fa62544bd8b7015da (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:11.065078  1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506762ba3842492ab6e7f9f128f98088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.067101  1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f21bc04ed3443fa62544bd8b7015da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.078297  1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f21bc04ed3443fa62544bd8b7015da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.104149  1883 tablet_service.cc:1511] Processing CreateTablet for tablet 5243a9642f8f48beaf4d071e7ebd624f (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:11.104698  1882 tablet_service.cc:1511] Processing CreateTablet for tablet 349960d984674a8fae2ad4a7af1b8504 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:11.105681  1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5243a9642f8f48beaf4d071e7ebd624f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.106448  1882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 349960d984674a8fae2ad4a7af1b8504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.114681  1881 tablet_service.cc:1511] Processing CreateTablet for tablet ecfdee33f5a34a64bcd8be53c7111305 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:11.116163  1881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecfdee33f5a34a64bcd8be53c7111305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.131822  1880 tablet_service.cc:1511] Processing CreateTablet for tablet dfee7ba822194cd39954dc5330db93ce (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:11.133354  1880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee7ba822194cd39954dc5330db93ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:11.138437  1879 tablet_service.cc:1511] Processing CreateTablet for tablet 1f284b2b727e463d8212164d8ba764e6 (DEFAULT_TABLE table=test-workload [id=5e9bc3e1ca484c11a9d1121023b30c74]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:11.139918  1879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f284b2b727e463d8212164d8ba764e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:11.206152  1632 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.43.65:34691, user_credentials={real_user=slave}} blocked reactor thread for 68502.9us
I20260709 12:25:11.218863  1937 tablet_bootstrap.cc:492] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:11.222970  1938 tablet_bootstrap.cc:492] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:11.223618  1939 tablet_bootstrap.cc:492] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:11.230229  1939 tablet_bootstrap.cc:654] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.231077  1937 tablet_bootstrap.cc:654] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.235153  1938 tablet_bootstrap.cc:654] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.242950  1937 tablet_bootstrap.cc:492] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:11.243487  1937 ts_tablet_manager.cc:1403] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.008s
I20260709 12:25:11.243571  1939 tablet_bootstrap.cc:492] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:11.244139  1939 ts_tablet_manager.cc:1403] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.014s
I20260709 12:25:11.244297  1938 tablet_bootstrap.cc:492] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:11.244825  1938 ts_tablet_manager.cc:1403] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.007s
I20260709 12:25:11.246678  1937 raft_consensus.cc:359] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.247571  1937 raft_consensus.cc:385] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.247144  1939 raft_consensus.cc:359] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:11.247332  1938 raft_consensus.cc:359] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.247942  1937 raft_consensus.cc:740] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.248072  1939 raft_consensus.cc:385] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.248201  1938 raft_consensus.cc:385] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.248462  1939 raft_consensus.cc:740] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.248680  1938 raft_consensus.cc:740] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.248944  1937 consensus_queue.cc:260] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.249326  1939 consensus_queue.cc:260] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:11.249523  1938 consensus_queue.cc:260] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.255100  1939 ts_tablet_manager.cc:1434] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 12:25:11.255945  1848 heartbeater.cc:499] Master 127.22.43.126:38069 was elected leader, sending a full tablet report...
I20260709 12:25:11.257081  1773 heartbeater.cc:499] Master 127.22.43.126:38069 was elected leader, sending a full tablet report...
I20260709 12:25:11.258195  1922 heartbeater.cc:499] Master 127.22.43.126:38069 was elected leader, sending a full tablet report...
I20260709 12:25:11.258658  1938 ts_tablet_manager.cc:1434] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.005s
I20260709 12:25:11.259508  1939 tablet_bootstrap.cc:492] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:11.258668  1937 ts_tablet_manager.cc:1434] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.015s	user 0.014s	sys 0.002s
I20260709 12:25:11.261081  1937 tablet_bootstrap.cc:492] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:11.259721  1938 tablet_bootstrap.cc:492] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:11.267405  1939 tablet_bootstrap.cc:654] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.267733  1937 tablet_bootstrap.cc:654] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.273427  1938 tablet_bootstrap.cc:654] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.287048  1938 tablet_bootstrap.cc:492] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:11.287712  1938 ts_tablet_manager.cc:1403] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.009s
I20260709 12:25:11.290910  1938 raft_consensus.cc:359] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.291826  1938 raft_consensus.cc:385] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.292187  1938 raft_consensus.cc:740] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.293177  1938 consensus_queue.cc:260] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.295846  1938 ts_tablet_manager.cc:1434] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:11.296981  1938 tablet_bootstrap.cc:492] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:11.303902  1938 tablet_bootstrap.cc:654] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.315618  1938 tablet_bootstrap.cc:492] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:11.316196  1938 ts_tablet_manager.cc:1403] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:25:11.319484  1938 raft_consensus.cc:359] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.320290  1938 raft_consensus.cc:385] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.320640  1938 raft_consensus.cc:740] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.321557  1938 consensus_queue.cc:260] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.325719  1938 ts_tablet_manager.cc:1434] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:11.326946  1938 tablet_bootstrap.cc:492] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:11.333659  1938 tablet_bootstrap.cc:654] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.345532  1938 tablet_bootstrap.cc:492] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:11.346189  1938 ts_tablet_manager.cc:1403] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:25:11.349278  1938 raft_consensus.cc:359] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.350124  1945 raft_consensus.cc:493] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.350935  1945 raft_consensus.cc:515] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:11.350304  1938 raft_consensus.cc:385] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.352967  1938 raft_consensus.cc:740] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
W20260709 12:25:11.353555  1923 tablet.cc:2406] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:11.354110  1938 consensus_queue.cc:260] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.354863  1939 tablet_bootstrap.cc:492] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:11.355474  1939 ts_tablet_manager.cc:1403] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.096s	user 0.029s	sys 0.063s
I20260709 12:25:11.356328  1937 tablet_bootstrap.cc:492] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:11.356720  1938 ts_tablet_manager.cc:1434] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:25:11.356891  1937 ts_tablet_manager.cc:1403] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.096s	user 0.040s	sys 0.051s
I20260709 12:25:11.358619  1939 raft_consensus.cc:359] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.359405  1939 raft_consensus.cc:385] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.359722  1939 raft_consensus.cc:740] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.360256  1937 raft_consensus.cc:359] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.361171  1937 raft_consensus.cc:385] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.360740  1939 consensus_queue.cc:260] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.361483  1937 raft_consensus.cc:740] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.362486  1937 consensus_queue.cc:260] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.365028  1937 ts_tablet_manager.cc:1434] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:11.366044  1937 tablet_bootstrap.cc:492] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:11.372243  1945 leader_election.cc:290] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461), 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691)
I20260709 12:25:11.375010  1937 tablet_bootstrap.cc:654] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.388787  1937 tablet_bootstrap.cc:492] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:11.389331  1937 ts_tablet_manager.cc:1403] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 12:25:11.393112  1937 raft_consensus.cc:359] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.394145  1937 raft_consensus.cc:385] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.394526  1937 raft_consensus.cc:740] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.395856  1938 tablet_bootstrap.cc:492] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:11.401573  1939 ts_tablet_manager.cc:1434] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.046s	user 0.019s	sys 0.023s
I20260709 12:25:11.401989  1937 consensus_queue.cc:260] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.402590  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d585333425c4b5ab82e429569429dbc" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
W20260709 12:25:11.404417  1786 leader_election.cc:343] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.406210  1937 ts_tablet_manager.cc:1434] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.003s
I20260709 12:25:11.407300  1937 tablet_bootstrap.cc:492] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:11.408277  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d585333425c4b5ab82e429569429dbc" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:11.404564  1938 tablet_bootstrap.cc:654] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:11.410069  1788 leader_election.cc:343] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.410552  1788 leader_election.cc:304] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3023eed9ad8a425397f8fe0fe260691e; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:11.411815  1952 raft_consensus.cc:2749] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.412410  1939 tablet_bootstrap.cc:492] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:11.414103  1937 tablet_bootstrap.cc:654] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.420337  1939 tablet_bootstrap.cc:654] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.421561  1937 tablet_bootstrap.cc:492] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:11.421644  1938 tablet_bootstrap.cc:492] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:11.422122  1937 ts_tablet_manager.cc:1403] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 12:25:11.422245  1938 ts_tablet_manager.cc:1403] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.000s
I20260709 12:25:11.424960  1937 raft_consensus.cc:359] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.425529  1937 raft_consensus.cc:385] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.426012  1937 raft_consensus.cc:740] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.426085  1939 tablet_bootstrap.cc:492] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:11.425424  1938 raft_consensus.cc:359] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.426578  1938 raft_consensus.cc:385] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.426694  1939 ts_tablet_manager.cc:1403] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:25:11.426935  1938 raft_consensus.cc:740] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.426823  1937 consensus_queue.cc:260] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.427953  1938 consensus_queue.cc:260] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.429533  1937 ts_tablet_manager.cc:1434] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:25:11.430310  1938 ts_tablet_manager.cc:1434] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:25:11.429898  1939 raft_consensus.cc:359] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.430761  1937 tablet_bootstrap.cc:492] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:11.430754  1939 raft_consensus.cc:385] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.431326  1938 tablet_bootstrap.cc:492] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:11.431310  1939 raft_consensus.cc:740] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.432451  1939 consensus_queue.cc:260] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.434684  1939 ts_tablet_manager.cc:1434] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:11.435698  1939 tablet_bootstrap.cc:492] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:11.437978  1938 tablet_bootstrap.cc:654] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.441383  1937 tablet_bootstrap.cc:654] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.442113  1939 tablet_bootstrap.cc:654] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.445523  1943 raft_consensus.cc:493] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.450770  1938 tablet_bootstrap.cc:492] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:11.450529  1943 raft_consensus.cc:515] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.451556  1938 ts_tablet_manager.cc:1403] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:25:11.456279  1938 raft_consensus.cc:359] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.457319  1938 raft_consensus.cc:385] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.457718  1938 raft_consensus.cc:740] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.458751  1938 consensus_queue.cc:260] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.463564  1937 tablet_bootstrap.cc:492] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
W20260709 12:25:11.463413  1694 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:11.464100  1938 ts_tablet_manager.cc:1434] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:25:11.464598  1937 ts_tablet_manager.cc:1403] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.009s
I20260709 12:25:11.465273  1938 tablet_bootstrap.cc:492] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:11.467844  1937 raft_consensus.cc:359] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.468814  1937 raft_consensus.cc:385] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.469244  1937 raft_consensus.cc:740] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.470232  1937 consensus_queue.cc:260] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.473471  1938 tablet_bootstrap.cc:654] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.480340  1937 ts_tablet_manager.cc:1434] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:25:11.481981  1937 tablet_bootstrap.cc:492] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:11.485262  1938 tablet_bootstrap.cc:492] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:11.485924  1938 ts_tablet_manager.cc:1403] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 12:25:11.487063  1943 leader_election.cc:290] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:11.489051  1938 raft_consensus.cc:359] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.489871  1938 raft_consensus.cc:385] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.490259  1938 raft_consensus.cc:740] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.490694  1944 raft_consensus.cc:493] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.491209  1944 raft_consensus.cc:515] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.491291  1938 consensus_queue.cc:260] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.494451  1944 leader_election.cc:290] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:11.495278  1937 tablet_bootstrap.cc:654] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.537511  1938 ts_tablet_manager.cc:1434] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.007s
I20260709 12:25:11.539268  1938 tablet_bootstrap.cc:492] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:11.548157  1943 raft_consensus.cc:493] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.549064  1943 raft_consensus.cc:515] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.552017  1943 leader_election.cc:290] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:11.555922  1937 tablet_bootstrap.cc:492] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:11.559628  1937 ts_tablet_manager.cc:1403] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.078s	user 0.027s	sys 0.037s
I20260709 12:25:11.560220  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfdee33f5a34a64bcd8be53c7111305" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
W20260709 12:25:11.562353  1862 leader_election.cc:343] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.563172  1937 raft_consensus.cc:359] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.563977  1937 raft_consensus.cc:385] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.564242  1937 raft_consensus.cc:740] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.564975  1937 consensus_queue.cc:260] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.557233  1938 tablet_bootstrap.cc:654] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.570638  1952 raft_consensus.cc:493] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.571204  1952 raft_consensus.cc:515] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.572074  1937 ts_tablet_manager.cc:1434] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:11.573191  1937 tablet_bootstrap.cc:492] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:11.575431  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f21bc04ed3443fa62544bd8b7015da" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:11.576169  1897 raft_consensus.cc:2468] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 0.
I20260709 12:25:11.577672  1786 leader_election.cc:304] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:11.578868  1945 raft_consensus.cc:2804] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.579313  1945 raft_consensus.cc:493] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.579720  1945 raft_consensus.cc:3060] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.583009  1952 leader_election.cc:290] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:11.590754  1952 raft_consensus.cc:493] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.591431  1952 raft_consensus.cc:515] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.592855  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f21bc04ed3443fa62544bd8b7015da" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
W20260709 12:25:11.594839  1788 leader_election.cc:343] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.596508  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee7ba822194cd39954dc5330db93ce" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:11.597530  1897 raft_consensus.cc:2468] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 0.
I20260709 12:25:11.598613  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee7ba822194cd39954dc5330db93ce" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:11.599395  1786 leader_election.cc:304] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:11.599587  1748 raft_consensus.cc:2468] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 0.
I20260709 12:25:11.601776  1952 leader_election.cc:290] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:11.602092  1971 raft_consensus.cc:2804] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.588075  1937 tablet_bootstrap.cc:654] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.602917  1971 raft_consensus.cc:493] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.603341  1971 raft_consensus.cc:3060] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.603972  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfdee33f5a34a64bcd8be53c7111305" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:11.604898  1748 raft_consensus.cc:2468] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:11.610634  1862 leader_election.cc:304] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:11.612475  1965 raft_consensus.cc:2804] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.613009  1965 raft_consensus.cc:493] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.613406  1965 raft_consensus.cc:3060] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.620255  1971 raft_consensus.cc:515] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.626231  1944 raft_consensus.cc:493] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.626771  1944 raft_consensus.cc:515] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.627187  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee7ba822194cd39954dc5330db93ce" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:11.627839  1748 raft_consensus.cc:3060] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.627727  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfdee33f5a34a64bcd8be53c7111305" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:11.628846  1944 leader_election.cc:290] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:11.601982  1945 raft_consensus.cc:515] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.631176  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349960d984674a8fae2ad4a7af1b8504" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
W20260709 12:25:11.636268  1862 leader_election.cc:343] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.636430  1748 raft_consensus.cc:2468] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 1.
I20260709 12:25:11.633823  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5243a9642f8f48beaf4d071e7ebd624f" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:11.637769  1788 leader_election.cc:304] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:11.638674  1952 raft_consensus.cc:2804] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.639230  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349960d984674a8fae2ad4a7af1b8504" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
W20260709 12:25:11.640699  1711 leader_election.cc:343] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.640964  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee7ba822194cd39954dc5330db93ce" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:11.644595  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfdee33f5a34a64bcd8be53c7111305" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:11.645222  1896 raft_consensus.cc:3060] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.641569  1971 leader_election.cc:290] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:11.642241  1939 tablet_bootstrap.cc:492] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:11.644456  1938 tablet_bootstrap.cc:492] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:11.647665  1952 raft_consensus.cc:697] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:11.646559  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f21bc04ed3443fa62544bd8b7015da" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:11.648185  1938 ts_tablet_manager.cc:1403] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.109s	user 0.018s	sys 0.055s
I20260709 12:25:11.648634  1895 raft_consensus.cc:3060] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.648898  1952 consensus_queue.cc:237] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.651405  1938 raft_consensus.cc:359] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.652204  1938 raft_consensus.cc:385] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.652501  1938 raft_consensus.cc:740] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.654031  1938 consensus_queue.cc:260] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.654173  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5243a9642f8f48beaf4d071e7ebd624f" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:11.654686  1944 raft_consensus.cc:493] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.655274  1944 raft_consensus.cc:515] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
W20260709 12:25:11.646786  1862 leader_election.cc:343] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.655938  1945 leader_election.cc:290] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:11.656140  1862 leader_election.cc:304] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3; no voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:11.657357  1944 leader_election.cc:290] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:11.657919  1944 raft_consensus.cc:2749] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.658087  1938 ts_tablet_manager.cc:1434] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
W20260709 12:25:11.658555  1713 leader_election.cc:343] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.658692  1896 raft_consensus.cc:2468] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 1.
I20260709 12:25:11.625105  1965 raft_consensus.cc:515] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
W20260709 12:25:11.659457  1713 leader_election.cc:343] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.659417  1938 tablet_bootstrap.cc:492] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:11.660079  1713 leader_election.cc:304] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:11.660627  1897 raft_consensus.cc:2393] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22dd3f8ff6c4462082e1aac34f75757b in current term 1: Already voted for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in this term.
I20260709 12:25:11.653188  1939 ts_tablet_manager.cc:1403] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.218s	user 0.072s	sys 0.106s
I20260709 12:25:11.669042  1965 leader_election.cc:290] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:11.665045  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f21bc04ed3443fa62544bd8b7015da" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:11.673203  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:11.674295  1939 raft_consensus.cc:359] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.675068  1939 raft_consensus.cc:385] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.675453  1939 raft_consensus.cc:740] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.676002  1938 tablet_bootstrap.cc:654] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.676524  1895 raft_consensus.cc:2468] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 1.
I20260709 12:25:11.676707  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfdee33f5a34a64bcd8be53c7111305" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:11.677987  1786 leader_election.cc:304] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:11.679884  1943 raft_consensus.cc:2749] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.679138  1644 catalog_manager.cc:5697] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 1 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:11.680457  1788 leader_election.cc:343] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.680621  1952 raft_consensus.cc:2804] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:11.680154  1862 leader_election.cc:343] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.681941  1952 raft_consensus.cc:697] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:11.682948  1937 tablet_bootstrap.cc:492] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:11.683580  1937 ts_tablet_manager.cc:1403] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.006s
I20260709 12:25:11.683060  1952 consensus_queue.cc:237] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.686412  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:11.687366  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfdee33f5a34a64bcd8be53c7111305" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:11.678959  1939 consensus_queue.cc:260] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.688292  1747 raft_consensus.cc:3060] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.688445  1823 raft_consensus.cc:3060] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.687600  1711 leader_election.cc:304] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:11.687108  1748 raft_consensus.cc:2468] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:11.691265  1937 raft_consensus.cc:359] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.692800  1937 raft_consensus.cc:385] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.693187  1937 raft_consensus.cc:740] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.693374  1862 leader_election.cc:304] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:11.694438  1965 raft_consensus.cc:2804] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.694255  1937 consensus_queue.cc:260] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.694855  1965 raft_consensus.cc:493] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.695225  1965 raft_consensus.cc:3060] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.697131  1937 ts_tablet_manager.cc:1434] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 12:25:11.697896  1823 raft_consensus.cc:2468] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:11.698320  1937 tablet_bootstrap.cc:492] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:11.706646  1939 ts_tablet_manager.cc:1434] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.003s
I20260709 12:25:11.712127  1939 tablet_bootstrap.cc:492] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:11.707175  1938 tablet_bootstrap.cc:492] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:11.707571  1862 leader_election.cc:304] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:11.710606  1747 raft_consensus.cc:2468] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:11.714342  1938 ts_tablet_manager.cc:1403] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.005s
I20260709 12:25:11.714435  1943 raft_consensus.cc:2749] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.714743  1975 raft_consensus.cc:2804] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.715351  1975 raft_consensus.cc:697] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:11.716213  1975 consensus_queue.cc:237] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.710064  1965 raft_consensus.cc:515] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.717312  1938 raft_consensus.cc:359] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:11.718111  1938 raft_consensus.cc:385] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.718405  1938 raft_consensus.cc:740] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.718765  1939 tablet_bootstrap.cc:654] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.719106  1938 consensus_queue.cc:260] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:11.721340  1938 ts_tablet_manager.cc:1434] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:25:11.723898  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:11.726392  1747 raft_consensus.cc:3060] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.724041  1965 leader_election.cc:290] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:11.729007  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
W20260709 12:25:11.731691  1862 leader_election.cc:343] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.734536  1937 tablet_bootstrap.cc:654] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.734494  1975 raft_consensus.cc:493] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.735487  1975 raft_consensus.cc:515] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.738579  1975 leader_election.cc:290] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:11.740911  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:11.741627  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:11.741922  1748 raft_consensus.cc:2468] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:11.743889  1862 leader_election.cc:304] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 
W20260709 12:25:11.745221  1862 leader_election.cc:343] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.746441  1975 raft_consensus.cc:2804] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.747020  1975 raft_consensus.cc:493] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.747541  1975 raft_consensus.cc:3060] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.749406  1747 raft_consensus.cc:2468] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:11.751359  1862 leader_election.cc:304] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:11.752300  1965 raft_consensus.cc:2804] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.752828  1965 raft_consensus.cc:697] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:11.753685  1965 consensus_queue.cc:237] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.753772  1645 catalog_manager.cc:5697] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.756951  1975 raft_consensus.cc:515] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.758728  1939 tablet_bootstrap.cc:492] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:11.759347  1939 ts_tablet_manager.cc:1403] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.005s
I20260709 12:25:11.759958  1975 leader_election.cc:290] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:11.762212  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:11.763115  1747 raft_consensus.cc:3060] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.763201  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
W20260709 12:25:11.765547  1862 leader_election.cc:343] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.768730  1965 raft_consensus.cc:493] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.769088  1937 tablet_bootstrap.cc:492] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:11.769766  1937 ts_tablet_manager.cc:1403] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.000s
I20260709 12:25:11.769228  1965 raft_consensus.cc:515] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.771754  1965 leader_election.cc:290] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:11.772723  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f284b2b727e463d8212164d8ba764e6" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:11.773162  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f284b2b727e463d8212164d8ba764e6" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:11.773460  1748 raft_consensus.cc:2468] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:11.774603  1939 raft_consensus.cc:359] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
W20260709 12:25:11.775079  1862 leader_election.cc:343] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.775380  1939 raft_consensus.cc:385] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.775740  1939 raft_consensus.cc:740] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.775820  1862 leader_election.cc:304] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:11.776633  1965 raft_consensus.cc:2804] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.777004  1965 raft_consensus.cc:493] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.777328  1965 raft_consensus.cc:3060] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.777436  1937 raft_consensus.cc:359] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:11.778220  1937 raft_consensus.cc:385] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.778486  1937 raft_consensus.cc:740] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.778865  1939 consensus_queue.cc:260] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.779194  1937 consensus_queue.cc:260] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:11.781396  1937 ts_tablet_manager.cc:1434] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 12:25:11.782370  1937 tablet_bootstrap.cc:492] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:11.785354  1965 raft_consensus.cc:515] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.786291  1939 ts_tablet_manager.cc:1434] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:25:11.788120  1747 raft_consensus.cc:2468] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:11.788542  1644 catalog_manager.cc:5697] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.789791  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f284b2b727e463d8212164d8ba764e6" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:11.789868  1965 leader_election.cc:290] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:11.789518  1939 tablet_bootstrap.cc:492] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:11.790628  1862 leader_election.cc:304] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:11.791569  1965 raft_consensus.cc:2804] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:11.792058  1862 leader_election.cc:343] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:11.792799  1965 raft_consensus.cc:697] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:11.793553  1965 consensus_queue.cc:237] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.792150  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f284b2b727e463d8212164d8ba764e6" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:11.794467  1748 raft_consensus.cc:3060] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.794597  1646 catalog_manager.cc:5697] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 1 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.789464  1937 tablet_bootstrap.cc:654] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.808686  1748 raft_consensus.cc:2468] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:11.810323  1862 leader_election.cc:304] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:11.812000  1975 raft_consensus.cc:2804] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.812696  1975 raft_consensus.cc:697] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:11.813835  1975 consensus_queue.cc:237] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.819583  1939 tablet_bootstrap.cc:654] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.828532  1939 tablet_bootstrap.cc:492] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:11.829142  1939 ts_tablet_manager.cc:1403] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.003s
I20260709 12:25:11.828737  1646 catalog_manager.cc:5697] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.832285  1937 tablet_bootstrap.cc:492] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:11.832753  1937 ts_tablet_manager.cc:1403] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.002s
I20260709 12:25:11.832631  1939 raft_consensus.cc:359] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.833452  1939 raft_consensus.cc:385] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.833753  1939 raft_consensus.cc:740] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.834620  1939 consensus_queue.cc:260] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.835439  1937 raft_consensus.cc:359] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.836161  1937 raft_consensus.cc:385] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.836406  1937 raft_consensus.cc:740] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.837047  1939 ts_tablet_manager.cc:1434] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:25:11.837049  1937 consensus_queue.cc:260] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.839396  1937 ts_tablet_manager.cc:1434] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:11.838233  1939 tablet_bootstrap.cc:492] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:11.847806  1952 raft_consensus.cc:493] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.848212  1646 catalog_manager.cc:5697] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.848421  1952 raft_consensus.cc:515] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.853088  1952 leader_election.cc:290] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:11.852963  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349960d984674a8fae2ad4a7af1b8504" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:11.853755  1939 tablet_bootstrap.cc:654] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.852996  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349960d984674a8fae2ad4a7af1b8504" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:11.854091  1748 raft_consensus.cc:2468] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 0.
I20260709 12:25:11.854678  1895 raft_consensus.cc:2468] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 0.
I20260709 12:25:11.856058  1788 leader_election.cc:304] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:11.857923  1952 raft_consensus.cc:2804] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:11.858304  1952 raft_consensus.cc:493] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.858645  1952 raft_consensus.cc:3060] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.865461  1939 tablet_bootstrap.cc:492] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:11.866176  1939 ts_tablet_manager.cc:1403] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.004s
I20260709 12:25:11.868227  1952 raft_consensus.cc:515] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.869779  1939 raft_consensus.cc:359] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.870659  1939 raft_consensus.cc:385] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.870772  1952 leader_election.cc:290] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:11.871033  1939 raft_consensus.cc:740] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.871924  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349960d984674a8fae2ad4a7af1b8504" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:11.872257  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349960d984674a8fae2ad4a7af1b8504" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:11.872051  1939 consensus_queue.cc:260] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.872699  1748 raft_consensus.cc:3060] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.872908  1895 raft_consensus.cc:3060] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.875449  1939 ts_tablet_manager.cc:1434] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:25:11.876657  1939 tablet_bootstrap.cc:492] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:11.881167  1895 raft_consensus.cc:2468] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 1.
I20260709 12:25:11.882016  1939 tablet_bootstrap.cc:654] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.882663  1786 leader_election.cc:304] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:11.883919  1952 raft_consensus.cc:2804] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.884681  1952 raft_consensus.cc:697] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:11.885627  1952 consensus_queue.cc:237] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.886354  1748 raft_consensus.cc:2468] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 1.
I20260709 12:25:11.892972  1939 tablet_bootstrap.cc:492] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:11.893509  1939 ts_tablet_manager.cc:1403] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:25:11.895778  1939 raft_consensus.cc:359] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.896364  1939 raft_consensus.cc:385] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.896616  1939 raft_consensus.cc:740] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.897387  1939 consensus_queue.cc:260] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.899611  1939 ts_tablet_manager.cc:1434] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:25:11.898921  1646 catalog_manager.cc:5697] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 1 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.900761  1939 tablet_bootstrap.cc:492] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:11.906248  1939 tablet_bootstrap.cc:654] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:11.910809  1939 tablet_bootstrap.cc:492] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:11.911253  1939 ts_tablet_manager.cc:1403] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:25:11.914031  1939 raft_consensus.cc:359] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.914783  1939 raft_consensus.cc:385] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.915086  1939 raft_consensus.cc:740] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.915812  1939 consensus_queue.cc:260] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:11.917337  1939 ts_tablet_manager.cc:1434] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:12.016724  1943 raft_consensus.cc:493] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.017282  1943 raft_consensus.cc:515] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:12.019155  1943 leader_election.cc:290] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:12.020030  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d585333425c4b5ab82e429569429dbc" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:12.020244  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d585333425c4b5ab82e429569429dbc" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:12.020748  1823 raft_consensus.cc:2468] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 0.
I20260709 12:25:12.020959  1895 raft_consensus.cc:2468] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 0.
I20260709 12:25:12.021761  1713 leader_election.cc:304] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:12.022655  1943 raft_consensus.cc:2804] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:12.022955  1943 raft_consensus.cc:493] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.023208  1943 raft_consensus.cc:3060] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.025833  1952 raft_consensus.cc:493] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.026432  1952 raft_consensus.cc:515] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.028198  1952 leader_election.cc:290] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:12.029150  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5243a9642f8f48beaf4d071e7ebd624f" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:12.029394  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5243a9642f8f48beaf4d071e7ebd624f" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:12.029809  1748 raft_consensus.cc:2468] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 0.
I20260709 12:25:12.030215  1895 raft_consensus.cc:2468] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 0.
I20260709 12:25:12.029829  1943 raft_consensus.cc:515] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:12.031148  1788 leader_election.cc:304] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:12.031976  1952 raft_consensus.cc:2804] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:12.032426  1943 leader_election.cc:290] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 election: Requested vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:12.032438  1952 raft_consensus.cc:493] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.033133  1952 raft_consensus.cc:3060] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.033061  1823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d585333425c4b5ab82e429569429dbc" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:12.033604  1945 raft_consensus.cc:493] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.034000  1823 raft_consensus.cc:3060] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.033627  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d585333425c4b5ab82e429569429dbc" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:12.034607  1895 raft_consensus.cc:3060] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.034358  1945 raft_consensus.cc:515] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.036790  1945 leader_election.cc:290] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:12.038856  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:12.038836  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:12.040560  1748 raft_consensus.cc:2393] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3023eed9ad8a425397f8fe0fe260691e in current term 1: Already voted for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in this term.
I20260709 12:25:12.041818  1788 leader_election.cc:304] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3023eed9ad8a425397f8fe0fe260691e; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:12.042052  1823 raft_consensus.cc:2468] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 1.
I20260709 12:25:12.042052  1895 raft_consensus.cc:2468] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 1.
I20260709 12:25:12.043181  1945 raft_consensus.cc:3060] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.043432  1713 leader_election.cc:304] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:12.044682  1943 raft_consensus.cc:2804] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:12.045142  1943 raft_consensus.cc:697] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 1 LEADER]: Becoming Leader. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Running, Role: LEADER
I20260709 12:25:12.045344  1952 raft_consensus.cc:515] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.046074  1943 consensus_queue.cc:237] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:12.048849  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5243a9642f8f48beaf4d071e7ebd624f" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:12.049525  1748 raft_consensus.cc:3060] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.052172  1945 raft_consensus.cc:2749] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.056035  1646 catalog_manager.cc:5697] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b reported cstate change: term changed from 0 to 1, leader changed from <none> to 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:12.056563  1748 raft_consensus.cc:2468] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 1.
I20260709 12:25:12.057088  1952 leader_election.cc:290] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:12.057987  1788 leader_election.cc:304] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:12.058331  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5243a9642f8f48beaf4d071e7ebd624f" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:12.058987  1952 raft_consensus.cc:2804] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:12.059013  1895 raft_consensus.cc:3060] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.059746  1952 raft_consensus.cc:697] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:12.060730  1952 consensus_queue.cc:237] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.068729  1895 raft_consensus.cc:2468] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 1.
I20260709 12:25:12.071070  1646 catalog_manager.cc:5697] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 1 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.092900  1952 consensus_queue.cc:1048] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.100731  1945 raft_consensus.cc:493] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.101248  1945 raft_consensus.cc:515] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.103521  1945 leader_election.cc:290] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:12.104647  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:12.105018  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:12.105979  1748 raft_consensus.cc:2393] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3023eed9ad8a425397f8fe0fe260691e in current term 1: Already voted for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in this term.
I20260709 12:25:12.106982  1788 leader_election.cc:304] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3023eed9ad8a425397f8fe0fe260691e; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:12.107853  1945 raft_consensus.cc:3060] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.113540  1952 consensus_queue.cc:1048] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:12.115962  1945 raft_consensus.cc:2749] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.118986  1747 raft_consensus.cc:3060] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.128367  1945 consensus_queue.cc:1048] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.139540  1975 consensus_queue.cc:1048] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.141870  1945 consensus_queue.cc:1048] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.161907  1965 consensus_queue.cc:1048] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.220295  1897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d"
dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
mode: GRACEFUL
new_leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:35730
I20260709 12:25:12.220866  1897 raft_consensus.cc:606] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Received request to transfer leadership to TS 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:12.226714  1897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088"
dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
mode: GRACEFUL
new_leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:35730
I20260709 12:25:12.227259  1897 raft_consensus.cc:606] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Received request to transfer leadership to TS 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:12.241532  1823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70f21bc04ed3443fa62544bd8b7015da"
dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
mode: GRACEFUL
new_leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:58218
I20260709 12:25:12.242161  1823 raft_consensus.cc:606] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Received request to transfer leadership to TS 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:12.254514  1897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecfdee33f5a34a64bcd8be53c7111305"
dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
mode: GRACEFUL
new_leader_uuid: "3023eed9ad8a425397f8fe0fe260691e"
 from {username='slave'} at 127.0.0.1:35730
I20260709 12:25:12.255133  1897 raft_consensus.cc:606] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Received request to transfer leadership to TS 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:12.307447  1965 consensus_queue.cc:1048] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.312003  1965 consensus_queue.cc:1048] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:12.312323  1945 raft_consensus.cc:493] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.313021  1945 raft_consensus.cc:515] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.315061  1944 consensus_queue.cc:1048] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:12.315557  1945 leader_election.cc:290] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:12.316993  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f284b2b727e463d8212164d8ba764e6" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:12.316993  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f284b2b727e463d8212164d8ba764e6" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:12.322873  1786 leader_election.cc:304] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3023eed9ad8a425397f8fe0fe260691e; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:12.324105  1945 raft_consensus.cc:2749] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:12.330838  1975 raft_consensus.cc:993] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3: : Instructing follower 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:12.332247  1965 raft_consensus.cc:1081] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Signalling peer 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:12.332598  1972 consensus_queue.cc:1048] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:12.339293  1823 raft_consensus.cc:3060] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:12.340095  1945 consensus_queue.cc:1048] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:25:12.344065  1747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088"
dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:39524
I20260709 12:25:12.346040  1747 raft_consensus.cc:493] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:12.346618  1747 raft_consensus.cc:3060] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.359678  2013 consensus_queue.cc:1048] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:12.358835  1747 raft_consensus.cc:515] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.364369  1747 leader_election.cc:290] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Requested vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:12.365685  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:12.369009  1821 raft_consensus.cc:3060] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.368878  2013 consensus_queue.cc:1048] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:12.375264  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:12.376282  1895 raft_consensus.cc:3055] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:12.376780  1895 raft_consensus.cc:740] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:12.378293  1895 consensus_queue.cc:260] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.379848  1895 raft_consensus.cc:3060] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.407899  1895 raft_consensus.cc:2468] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:12.408994  1821 raft_consensus.cc:2468] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:12.410804  1713 leader_election.cc:304] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:12.417441  1943 raft_consensus.cc:2804] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.418026  1943 raft_consensus.cc:697] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Becoming Leader. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Running, Role: LEADER
I20260709 12:25:12.418936  1943 consensus_queue.cc:237] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.414384  2013 consensus_queue.cc:1048] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:25:12.410144  1820 raft_consensus.cc:1240] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Rejecting Update request from peer 1f6b91fee1c14f56bf0ded64679b45a3 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:25:12.432420  2014 raft_consensus.cc:993] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3: : Instructing follower 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:12.431057  1646 catalog_manager.cc:5697] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b reported cstate change: term changed from 1 to 2, leader changed from 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67) to 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.432982  2013 raft_consensus.cc:1081] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Signalling peer 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:12.434612  1746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d"
dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:39524
I20260709 12:25:12.435074  1746 raft_consensus.cc:493] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:12.435379  1746 raft_consensus.cc:3060] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.441622  1746 raft_consensus.cc:515] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.443413  1746 leader_election.cc:290] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Requested vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:12.444561  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:12.445263  1897 raft_consensus.cc:3055] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:12.445446  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:12.445600  1897 raft_consensus.cc:740] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:12.446280  1820 raft_consensus.cc:3060] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.446834  1897 consensus_queue.cc:260] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.448378  1897 raft_consensus.cc:3060] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.452677  1945 consensus_queue.cc:1048] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.455340  1820 raft_consensus.cc:2468] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:12.457010  1713 leader_election.cc:304] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:12.457235  1897 raft_consensus.cc:2468] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:12.457829  1943 raft_consensus.cc:2804] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.458410  1943 raft_consensus.cc:697] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Becoming Leader. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Running, Role: LEADER
I20260709 12:25:12.459288  1943 consensus_queue.cc:237] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.470026  1945 consensus_queue.cc:1048] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:12.469663  1643 catalog_manager.cc:5697] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b reported cstate change: term changed from 1 to 2, leader changed from 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67) to 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.537961  1943 consensus_queue.cc:1048] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.552649  2022 consensus_queue.cc:1048] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:12.634711  1972 raft_consensus.cc:993] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e: : Instructing follower 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:12.635182  1945 raft_consensus.cc:1081] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Signalling peer 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:12.636780  1746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70f21bc04ed3443fa62544bd8b7015da"
dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:39512
I20260709 12:25:12.637331  1746 raft_consensus.cc:493] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:12.637609  1746 raft_consensus.cc:3060] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.642989  1746 raft_consensus.cc:515] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.644701  1746 leader_election.cc:290] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Requested vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:12.645677  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f21bc04ed3443fa62544bd8b7015da" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:12.645788  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f21bc04ed3443fa62544bd8b7015da" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:12.646659  1820 raft_consensus.cc:3055] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:12.646673  1897 raft_consensus.cc:3060] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.647200  1820 raft_consensus.cc:740] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:12.648186  1820 consensus_queue.cc:260] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.649632  1820 raft_consensus.cc:3060] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.655275  1897 raft_consensus.cc:2468] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:12.656756  1711 leader_election.cc:304] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 
I20260709 12:25:12.657706  2022 raft_consensus.cc:2804] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.657980  1820 raft_consensus.cc:2468] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:12.658236  2022 raft_consensus.cc:697] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Becoming Leader. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Running, Role: LEADER
I20260709 12:25:12.659251  2022 consensus_queue.cc:237] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.666045  1646 catalog_manager.cc:5697] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b reported cstate change: term changed from 1 to 2, leader changed from 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66) to 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.786394  2014 raft_consensus.cc:993] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3: : Instructing follower 3023eed9ad8a425397f8fe0fe260691e to start an election
I20260709 12:25:12.787004  2013 raft_consensus.cc:1081] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Signalling peer 3023eed9ad8a425397f8fe0fe260691e to start an election
I20260709 12:25:12.788671  1820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecfdee33f5a34a64bcd8be53c7111305"
dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
 from {username='slave'} at 127.0.0.1:58216
I20260709 12:25:12.789408  1820 raft_consensus.cc:493] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:12.789920  1820 raft_consensus.cc:3060] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.795974  1820 raft_consensus.cc:515] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.798372  1820 leader_election.cc:290] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:12.799688  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfdee33f5a34a64bcd8be53c7111305" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:12.800204  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfdee33f5a34a64bcd8be53c7111305" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:12.800470  1746 raft_consensus.cc:3060] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.800904  1897 raft_consensus.cc:3055] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:12.801281  1897 raft_consensus.cc:740] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:12.802255  1897 consensus_queue.cc:260] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.803766  1897 raft_consensus.cc:3060] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.808807  1746 raft_consensus.cc:2468] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
I20260709 12:25:12.810360  1788 leader_election.cc:304] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:12.811180  1952 raft_consensus.cc:2804] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.811458  1897 raft_consensus.cc:2468] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
I20260709 12:25:12.811748  1952 raft_consensus.cc:697] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 2 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:12.812799  1952 consensus_queue.cc:237] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:12.820191  1646 catalog_manager.cc:5697] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 1 to 2, leader changed from 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67) to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 2 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.868774  1820 raft_consensus.cc:1275] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:12.870322  2022 consensus_queue.cc:1048] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:12.887916  1897 raft_consensus.cc:1275] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:12.889464  2025 consensus_queue.cc:1048] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:12.956171  1897 raft_consensus.cc:1275] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:12.957989  2025 consensus_queue.cc:1048] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:12.967598  1820 raft_consensus.cc:1275] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:12.969436  2025 consensus_queue.cc:1048] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:13.166600  1897 raft_consensus.cc:1275] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:13.168264  2025 consensus_queue.cc:1048] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:13.179162  1820 raft_consensus.cc:1275] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:13.180863  1943 consensus_queue.cc:1048] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:13.230014  1897 raft_consensus.cc:1275] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:13.231510  1952 consensus_queue.cc:1048] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:13.240233  1746 raft_consensus.cc:1275] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:13.242053  1972 consensus_queue.cc:1048] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:15.290433  1646 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33002:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:15.292658  1646 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:15.340621  1733 tablet_service.cc:1511] Processing CreateTablet for tablet df0a6095f06948a28ee3f4e2e401ea73 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:15.341296  1811 tablet_service.cc:1511] Processing CreateTablet for tablet df0a6095f06948a28ee3f4e2e401ea73 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:15.341987  1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df0a6095f06948a28ee3f4e2e401ea73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.342590  1887 tablet_service.cc:1511] Processing CreateTablet for tablet df0a6095f06948a28ee3f4e2e401ea73 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:15.343879  1887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df0a6095f06948a28ee3f4e2e401ea73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.345176  1738 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6276e838264723bbcd5df2b72dbff1 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:15.346462  1738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6276e838264723bbcd5df2b72dbff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.342662  1811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df0a6095f06948a28ee3f4e2e401ea73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.348018  1883 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6276e838264723bbcd5df2b72dbff1 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:15.349387  1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6276e838264723bbcd5df2b72dbff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.353385  1879 tablet_service.cc:1511] Processing CreateTablet for tablet 61fdff83dce5446e9c63dcc6e2191596 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:15.354779  1879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61fdff83dce5446e9c63dcc6e2191596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.356781  1809 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6276e838264723bbcd5df2b72dbff1 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:15.358145  1809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6276e838264723bbcd5df2b72dbff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.357734  1882 tablet_service.cc:1511] Processing CreateTablet for tablet 903fc0448df449ec9fd979eead54c858 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:15.361701  1882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903fc0448df449ec9fd979eead54c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.362893  1880 tablet_service.cc:1511] Processing CreateTablet for tablet 98ffdb70cdf64a3281a954965817c84f (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:15.362990  1735 tablet_service.cc:1511] Processing CreateTablet for tablet 61fdff83dce5446e9c63dcc6e2191596 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:15.366233  1880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ffdb70cdf64a3281a954965817c84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.366233  1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61fdff83dce5446e9c63dcc6e2191596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.368968  1884 tablet_service.cc:1511] Processing CreateTablet for tablet c31a931ea91248fd9cade01b9ebe8925 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:15.370456  1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31a931ea91248fd9cade01b9ebe8925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.374171  1885 tablet_service.cc:1511] Processing CreateTablet for tablet f38a8c59ac494bb58212b298ce3f4f90 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:15.375526  1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38a8c59ac494bb58212b298ce3f4f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.380650  1886 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3f655fbf004201a6eee3b3e05af45b (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:15.382689  1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3f655fbf004201a6eee3b3e05af45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.383507  1805 tablet_service.cc:1511] Processing CreateTablet for tablet 61fdff83dce5446e9c63dcc6e2191596 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:15.384953  1805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61fdff83dce5446e9c63dcc6e2191596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.391729  1734 tablet_service.cc:1511] Processing CreateTablet for tablet 903fc0448df449ec9fd979eead54c858 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:15.392459  1808 tablet_service.cc:1511] Processing CreateTablet for tablet 903fc0448df449ec9fd979eead54c858 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:15.393123  1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903fc0448df449ec9fd979eead54c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.393769  1808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903fc0448df449ec9fd979eead54c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.395639  1881 tablet_service.cc:1511] Processing CreateTablet for tablet 3f149c5a493e41b0911fc319323f5570 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:15.396919  1881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f149c5a493e41b0911fc319323f5570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.401252  1812 tablet_service.cc:1511] Processing CreateTablet for tablet 98ffdb70cdf64a3281a954965817c84f (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:15.402676  1812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ffdb70cdf64a3281a954965817c84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.407276  1730 tablet_service.cc:1511] Processing CreateTablet for tablet 98ffdb70cdf64a3281a954965817c84f (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:15.408020  1813 tablet_service.cc:1511] Processing CreateTablet for tablet c31a931ea91248fd9cade01b9ebe8925 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:15.408701  1730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ffdb70cdf64a3281a954965817c84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.409399  1813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31a931ea91248fd9cade01b9ebe8925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.415407  1731 tablet_service.cc:1511] Processing CreateTablet for tablet c31a931ea91248fd9cade01b9ebe8925 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:15.416832  1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31a931ea91248fd9cade01b9ebe8925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.423774  1737 tablet_service.cc:1511] Processing CreateTablet for tablet f38a8c59ac494bb58212b298ce3f4f90 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:15.425239  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38a8c59ac494bb58212b298ce3f4f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.423858  1806 tablet_service.cc:1511] Processing CreateTablet for tablet f38a8c59ac494bb58212b298ce3f4f90 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:15.427282  1806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38a8c59ac494bb58212b298ce3f4f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.455691  1730 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3f655fbf004201a6eee3b3e05af45b (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:15.456099  1807 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3f655fbf004201a6eee3b3e05af45b (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:15.457176  1730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3f655fbf004201a6eee3b3e05af45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.456892  1736 tablet_service.cc:1511] Processing CreateTablet for tablet 3f149c5a493e41b0911fc319323f5570 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:15.457317  1807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3f655fbf004201a6eee3b3e05af45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.458654  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f149c5a493e41b0911fc319323f5570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.459708  1810 tablet_service.cc:1511] Processing CreateTablet for tablet 3f149c5a493e41b0911fc319323f5570 (DEFAULT_TABLE table=soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:15.461329  1810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f149c5a493e41b0911fc319323f5570. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:15.515939  1694 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:15.557994  2043 tablet_bootstrap.cc:492] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:15.562827  2044 tablet_bootstrap.cc:492] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:15.565026  2043 tablet_bootstrap.cc:654] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.570996  2044 tablet_bootstrap.cc:654] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.582197  2045 tablet_bootstrap.cc:492] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:15.589530  2043 tablet_bootstrap.cc:492] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:15.590152  2043 ts_tablet_manager.cc:1403] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.009s
I20260709 12:25:15.590695  2045 tablet_bootstrap.cc:654] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.592166  2044 tablet_bootstrap.cc:492] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:15.592767  2044 ts_tablet_manager.cc:1403] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 12:25:15.593271  2043 raft_consensus.cc:359] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.594190  2043 raft_consensus.cc:385] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.594518  2043 raft_consensus.cc:740] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.595635  2043 consensus_queue.cc:260] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.596298  2044 raft_consensus.cc:359] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.596931  2045 tablet_bootstrap.cc:492] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:15.597201  2044 raft_consensus.cc:385] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.597541  2045 ts_tablet_manager.cc:1403] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:25:15.597648  2044 raft_consensus.cc:740] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.598762  2044 consensus_queue.cc:260] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.601120  2044 ts_tablet_manager.cc:1434] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:25:15.601279  2045 raft_consensus.cc:359] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.602232  2045 raft_consensus.cc:385] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.602571  2045 raft_consensus.cc:740] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.602684  2044 tablet_bootstrap.cc:492] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:15.603570  2045 consensus_queue.cc:260] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.605222  2043 ts_tablet_manager.cc:1434] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:25:15.606225  2045 ts_tablet_manager.cc:1434] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:25:15.607452  2045 tablet_bootstrap.cc:492] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:15.610723  2044 tablet_bootstrap.cc:654] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.614957  2045 tablet_bootstrap.cc:654] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.616971  2043 tablet_bootstrap.cc:492] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:15.632682  2045 tablet_bootstrap.cc:492] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:15.633831  2045 ts_tablet_manager.cc:1403] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.009s
I20260709 12:25:15.636241  2045 raft_consensus.cc:359] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.636847  2045 raft_consensus.cc:385] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.637178  2045 raft_consensus.cc:740] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.637699  2043 tablet_bootstrap.cc:654] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.637986  2045 consensus_queue.cc:260] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.640743  2045 ts_tablet_manager.cc:1434] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:15.641788  2045 tablet_bootstrap.cc:492] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:15.642267  2044 tablet_bootstrap.cc:492] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:15.642854  2044 ts_tablet_manager.cc:1403] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.018s
I20260709 12:25:15.646306  2044 raft_consensus.cc:359] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.647360  2044 raft_consensus.cc:385] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.647814  2044 raft_consensus.cc:740] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.649016  2032 raft_consensus.cc:493] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.648802  2044 consensus_queue.cc:260] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.649537  2032 raft_consensus.cc:515] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.650820  2045 tablet_bootstrap.cc:654] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.652254  2032 leader_election.cc:290] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:15.655854  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:15.657284  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
W20260709 12:25:15.659286  1862 leader_election.cc:343] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:15.673257  1862 leader_election.cc:343] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.676926  2043 tablet_bootstrap.cc:492] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:15.679562  2044 ts_tablet_manager.cc:1434] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.036s	user 0.021s	sys 0.012s
I20260709 12:25:15.679435  1862 leader_election.cc:304] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3; no voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:15.679769  2043 ts_tablet_manager.cc:1403] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.063s	user 0.022s	sys 0.000s
I20260709 12:25:15.680389  2053 raft_consensus.cc:2749] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:15.681845  2044 tablet_bootstrap.cc:492] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:15.681917  2045 tablet_bootstrap.cc:492] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:15.682538  2045 ts_tablet_manager.cc:1403] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.022s
I20260709 12:25:15.683192  2043 raft_consensus.cc:359] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.684026  2043 raft_consensus.cc:385] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.684321  2043 raft_consensus.cc:740] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.685096  2043 consensus_queue.cc:260] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.685871  2045 raft_consensus.cc:359] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.686689  2045 raft_consensus.cc:385] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.686988  2045 raft_consensus.cc:740] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.687748  2045 consensus_queue.cc:260] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.688548  2044 tablet_bootstrap.cc:654] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.690029  2045 ts_tablet_manager.cc:1434] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:15.697002  2045 tablet_bootstrap.cc:492] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:15.700495  2044 tablet_bootstrap.cc:492] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:15.701123  2044 ts_tablet_manager.cc:1403] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:25:15.701191  2049 raft_consensus.cc:493] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.701738  2049 raft_consensus.cc:515] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.704157  2045 tablet_bootstrap.cc:654] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.704619  2044 raft_consensus.cc:359] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.704876  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38a8c59ac494bb58212b298ce3f4f90" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:15.705451  2044 raft_consensus.cc:385] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.706333  2043 ts_tablet_manager.cc:1434] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:25:15.708118  2043 tablet_bootstrap.cc:492] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:15.705039  2049 leader_election.cc:290] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
W20260709 12:25:15.706604  1788 leader_election.cc:343] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.706529  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38a8c59ac494bb58212b298ce3f4f90" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:15.715523  2043 tablet_bootstrap.cc:654] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:15.715561  1786 leader_election.cc:343] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.716337  1786 leader_election.cc:304] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3023eed9ad8a425397f8fe0fe260691e; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:15.717593  2049 raft_consensus.cc:2749] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:15.718676  2044 raft_consensus.cc:740] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.719532  2044 consensus_queue.cc:260] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.721915  2044 ts_tablet_manager.cc:1434] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:25:15.722913  2044 tablet_bootstrap.cc:492] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:15.728727  2044 tablet_bootstrap.cc:654] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.734323  2045 tablet_bootstrap.cc:492] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:15.734333  2043 tablet_bootstrap.cc:492] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:15.734961  2045 ts_tablet_manager.cc:1403] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.011s
I20260709 12:25:15.734966  2043 ts_tablet_manager.cc:1403] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 12:25:15.738298  2045 raft_consensus.cc:359] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.739034  2045 raft_consensus.cc:385] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.739351  2045 raft_consensus.cc:740] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.740212  2045 consensus_queue.cc:260] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.740419  2043 raft_consensus.cc:359] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.742070  2043 raft_consensus.cc:385] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.742375  2043 raft_consensus.cc:740] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.742690  2045 ts_tablet_manager.cc:1434] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:15.743234  2043 consensus_queue.cc:260] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.743816  2045 tablet_bootstrap.cc:492] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:15.752071  2045 tablet_bootstrap.cc:654] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.752561  2044 tablet_bootstrap.cc:492] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:15.753103  2044 ts_tablet_manager.cc:1403] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.030s	user 0.004s	sys 0.022s
I20260709 12:25:15.753942  2043 ts_tablet_manager.cc:1434] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:25:15.756264  2044 raft_consensus.cc:359] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.757092  2044 raft_consensus.cc:385] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.757380  2044 raft_consensus.cc:740] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.758164  2044 consensus_queue.cc:260] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.758950  2049 raft_consensus.cc:493] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.759644  2049 raft_consensus.cc:515] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.760659  2044 ts_tablet_manager.cc:1434] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.002s
I20260709 12:25:15.762048  2044 tablet_bootstrap.cc:492] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:15.762346  2049 leader_election.cc:290] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:15.763149  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f655fbf004201a6eee3b3e05af45b" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:15.763468  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f655fbf004201a6eee3b3e05af45b" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:15.764153  1897 raft_consensus.cc:2468] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 0.
W20260709 12:25:15.765048  1788 leader_election.cc:343] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.765928  1786 leader_election.cc:304] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:15.766335  2043 tablet_bootstrap.cc:492] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:15.767271  2045 tablet_bootstrap.cc:492] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:15.767192  2053 raft_consensus.cc:493] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.767835  2049 raft_consensus.cc:2804] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:15.767855  2053 raft_consensus.cc:515] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.768823  2044 tablet_bootstrap.cc:654] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.768646  2049 raft_consensus.cc:493] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.769645  2049 raft_consensus.cc:3060] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.771366  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df0a6095f06948a28ee3f4e2e401ea73" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:15.772045  2053 leader_election.cc:290] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:15.772095  1746 raft_consensus.cc:2468] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:15.772369  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df0a6095f06948a28ee3f4e2e401ea73" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:15.772976  2045 ts_tablet_manager.cc:1403] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.009s
I20260709 12:25:15.773363  1821 raft_consensus.cc:2468] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:15.773604  1862 leader_election.cc:304] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 
I20260709 12:25:15.774696  2053 raft_consensus.cc:2804] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:15.775049  2053 raft_consensus.cc:493] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.775377  2053 raft_consensus.cc:3060] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.776402  2045 raft_consensus.cc:359] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.777180  2045 raft_consensus.cc:385] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.777498  2045 raft_consensus.cc:740] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.778360  2045 consensus_queue.cc:260] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.780972  2044 tablet_bootstrap.cc:492] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:15.781293  2045 ts_tablet_manager.cc:1434] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:15.781546  2044 ts_tablet_manager.cc:1403] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.012s
I20260709 12:25:15.782454  2045 tablet_bootstrap.cc:492] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:15.789724  2053 raft_consensus.cc:515] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.790213  2044 raft_consensus.cc:359] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.791035  2044 raft_consensus.cc:385] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.791467  2044 raft_consensus.cc:740] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.792002  2043 tablet_bootstrap.cc:654] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.791082  2045 tablet_bootstrap.cc:654] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.792160  2053 leader_election.cc:290] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:15.793488  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df0a6095f06948a28ee3f4e2e401ea73" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:15.794035  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df0a6095f06948a28ee3f4e2e401ea73" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:15.794193  1746 raft_consensus.cc:3060] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.794760  1821 raft_consensus.cc:3060] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.792245  2044 consensus_queue.cc:260] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.798454  2044 ts_tablet_manager.cc:1434] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:25:15.799476  2044 tablet_bootstrap.cc:492] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:15.800096  2031 raft_consensus.cc:493] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.800624  2031 raft_consensus.cc:515] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.802927  2031 leader_election.cc:290] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:15.804790  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6276e838264723bbcd5df2b72dbff1" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:15.805539  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6276e838264723bbcd5df2b72dbff1" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
W20260709 12:25:15.808576  1788 leader_election.cc:343] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:15.809659  1786 leader_election.cc:343] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.810364  1786 leader_election.cc:304] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3023eed9ad8a425397f8fe0fe260691e; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:15.812060  2031 raft_consensus.cc:2749] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:15.826639  1821 raft_consensus.cc:2468] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:15.828735  1862 leader_election.cc:304] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:15.830091  2053 raft_consensus.cc:2804] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:15.830629  2053 raft_consensus.cc:697] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:15.831460  2053 consensus_queue.cc:237] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.833540  2049 raft_consensus.cc:515] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.838760  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f655fbf004201a6eee3b3e05af45b" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:15.839030  2045 tablet_bootstrap.cc:492] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:15.839102  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f655fbf004201a6eee3b3e05af45b" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:15.839797  2045 ts_tablet_manager.cc:1403] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.058s	user 0.025s	sys 0.020s
I20260709 12:25:15.839854  1897 raft_consensus.cc:3060] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:15.840412  1788 leader_election.cc:343] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.843217  2045 raft_consensus.cc:359] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.844017  2045 raft_consensus.cc:385] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.844295  2045 raft_consensus.cc:740] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.845161  2045 consensus_queue.cc:260] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.847947  2045 ts_tablet_manager.cc:1434] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:25:15.848341  2044 tablet_bootstrap.cc:654] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.849288  2031 raft_consensus.cc:493] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.847980  1897 raft_consensus.cc:2468] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 1.
I20260709 12:25:15.849856  2031 raft_consensus.cc:515] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.850711  2043 tablet_bootstrap.cc:492] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:15.851274  2043 ts_tablet_manager.cc:1403] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.030s
I20260709 12:25:15.851097  1786 leader_election.cc:304] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:15.852116  2031 leader_election.cc:290] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:15.852902  2031 raft_consensus.cc:2804] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:15.853452  2031 raft_consensus.cc:697] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:15.854415  2043 raft_consensus.cc:359] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.855195  2043 raft_consensus.cc:385] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.855480  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:15.855482  2043 raft_consensus.cc:740] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
W20260709 12:25:15.857394  1788 leader_election.cc:343] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.857993  2049 leader_election.cc:290] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:15.857651  2043 consensus_queue.cc:260] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.858579  2031 consensus_queue.cc:237] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.863272  2043 ts_tablet_manager.cc:1434] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:25:15.864347  2043 tablet_bootstrap.cc:492] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:15.859546  2045 tablet_bootstrap.cc:492] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:15.864962  2044 tablet_bootstrap.cc:492] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:15.865593  2044 ts_tablet_manager.cc:1403] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.003s
I20260709 12:25:15.869421  2044 raft_consensus.cc:359] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.870366  2044 raft_consensus.cc:385] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.870743  2044 raft_consensus.cc:740] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.871556  2044 consensus_queue.cc:260] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.872709  2045 tablet_bootstrap.cc:654] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.876354  1746 raft_consensus.cc:2468] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:15.876845  2043 tablet_bootstrap.cc:654] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.881397  2044 ts_tablet_manager.cc:1434] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:25:15.882668  2030 raft_consensus.cc:493] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.888309  2030 raft_consensus.cc:515] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.890601  2030 leader_election.cc:290] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:15.886933  1643 catalog_manager.cc:5697] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:15.889990  1644 catalog_manager.cc:5697] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 1 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:15.879973  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:15.891563  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903fc0448df449ec9fd979eead54c858" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:15.894237  1897 raft_consensus.cc:2468] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 0.
W20260709 12:25:15.895462  1713 leader_election.cc:343] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.895903  2044 tablet_bootstrap.cc:492] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:15.897668  1786 leader_election.cc:304] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:15.900388  2031 raft_consensus.cc:2804] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:15.893121  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903fc0448df449ec9fd979eead54c858" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
W20260709 12:25:15.901943  1711 leader_election.cc:343] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.902419  1711 leader_election.cc:304] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:15.903985  2030 raft_consensus.cc:2749] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:15.904266  2044 tablet_bootstrap.cc:654] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.907078  2031 raft_consensus.cc:493] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.907599  2031 raft_consensus.cc:3060] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.916694  2044 tablet_bootstrap.cc:492] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:15.917471  2044 ts_tablet_manager.cc:1403] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 12:25:15.919834  2045 tablet_bootstrap.cc:492] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:15.920447  2045 ts_tablet_manager.cc:1403] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.013s
I20260709 12:25:15.920764  2044 raft_consensus.cc:359] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.921594  2044 raft_consensus.cc:385] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.921906  2044 raft_consensus.cc:740] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.922750  2044 consensus_queue.cc:260] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.925642  2044 ts_tablet_manager.cc:1434] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:15.927047  2044 tablet_bootstrap.cc:492] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:15.928076  2045 raft_consensus.cc:359] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.928930  2045 raft_consensus.cc:385] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.929219  2045 raft_consensus.cc:740] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.930018  2045 consensus_queue.cc:260] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.932678  2045 ts_tablet_manager.cc:1434] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:25:15.935045  2044 tablet_bootstrap.cc:654] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.933748  2045 tablet_bootstrap.cc:492] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:15.947540  2044 tablet_bootstrap.cc:492] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:15.948189  2044 ts_tablet_manager.cc:1403] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:25:15.945344  2031 raft_consensus.cc:515] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.951421  2044 raft_consensus.cc:359] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.952131  2044 raft_consensus.cc:385] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.952220  2043 tablet_bootstrap.cc:492] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:15.953367  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:15.954080  2043 ts_tablet_manager.cc:1403] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.090s	user 0.033s	sys 0.040s
I20260709 12:25:15.955078  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
W20260709 12:25:15.955338  1788 leader_election.cc:343] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:15.952452  2044 raft_consensus.cc:740] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.955763  1895 raft_consensus.cc:3060] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.956578  2044 consensus_queue.cc:260] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.957212  2043 raft_consensus.cc:359] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.958020  2043 raft_consensus.cc:385] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.958313  2043 raft_consensus.cc:740] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.958604  2045 tablet_bootstrap.cc:654] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.959237  2044 ts_tablet_manager.cc:1434] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:25:15.959038  2043 consensus_queue.cc:260] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.960315  2044 tablet_bootstrap.cc:492] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3: Bootstrap starting.
I20260709 12:25:15.961400  2043 ts_tablet_manager.cc:1434] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:15.962589  2043 tablet_bootstrap.cc:492] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:15.970474  2043 tablet_bootstrap.cc:654] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.970865  2031 leader_election.cc:290] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:15.974545  2045 tablet_bootstrap.cc:492] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:15.976711  2053 raft_consensus.cc:493] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.984984  2045 ts_tablet_manager.cc:1403] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.000s
I20260709 12:25:15.984931  2053 raft_consensus.cc:515] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.987407  2053 leader_election.cc:290] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:15.979956  2044 tablet_bootstrap.cc:654] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.989841  2045 raft_consensus.cc:359] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.990178  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ffdb70cdf64a3281a954965817c84f" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:15.990702  2045 raft_consensus.cc:385] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.991106  2045 raft_consensus.cc:740] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.991179  1746 raft_consensus.cc:2468] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:15.992204  2045 consensus_queue.cc:260] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.993085  1862 leader_election.cc:304] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 
I20260709 12:25:15.980315  1895 raft_consensus.cc:2468] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 1.
I20260709 12:25:15.995160  2045 ts_tablet_manager.cc:1434] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:25:15.995959  2053 raft_consensus.cc:493] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.996338  2045 tablet_bootstrap.cc:492] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e: Bootstrap starting.
I20260709 12:25:15.996459  2053 raft_consensus.cc:515] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:15.998562  2053 leader_election.cc:290] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:16.002396  2053 raft_consensus.cc:2804] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.002898  2053 raft_consensus.cc:493] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.003314  2053 raft_consensus.cc:3060] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.004017  1786 leader_election.cc:304] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:16.007815  2030 raft_consensus.cc:493] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.008450  2030 raft_consensus.cc:515] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.007990  2031 raft_consensus.cc:2804] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.010572  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ffdb70cdf64a3281a954965817c84f" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:16.010890  2031 raft_consensus.cc:697] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:16.011302  1821 raft_consensus.cc:2468] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:16.011840  2031 consensus_queue.cc:237] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.013712  2053 raft_consensus.cc:515] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.016049  2053 leader_election.cc:290] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:16.017478  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6276e838264723bbcd5df2b72dbff1" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:16.018357  1821 raft_consensus.cc:2468] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 0.
I20260709 12:25:16.018818  2044 tablet_bootstrap.cc:492] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3: No bootstrap required, opened a new log
I20260709 12:25:16.019389  2044 ts_tablet_manager.cc:1403] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.000s
I20260709 12:25:16.019615  1713 leader_election.cc:304] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:16.021854  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ffdb70cdf64a3281a954965817c84f" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:16.022558  1820 raft_consensus.cc:3060] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.025965  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903fc0448df449ec9fd979eead54c858" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:16.026693  1821 raft_consensus.cc:2468] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:16.028208  2043 tablet_bootstrap.cc:492] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:16.029098  2030 leader_election.cc:290] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.028196  1862 leader_election.cc:304] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:16.030053  2043 ts_tablet_manager.cc:1403] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.068s	user 0.024s	sys 0.037s
I20260709 12:25:16.029714  2030 raft_consensus.cc:2804] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.030678  2030 raft_consensus.cc:493] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.031203  2044 raft_consensus.cc:359] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.032298  2044 raft_consensus.cc:385] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.032635  2044 raft_consensus.cc:740] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.033442  2044 consensus_queue.cc:260] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.031029  2030 raft_consensus.cc:3060] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.034406  2043 raft_consensus.cc:359] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.035742  2032 raft_consensus.cc:2804] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.035981  2043 raft_consensus.cc:385] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.035753  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6276e838264723bbcd5df2b72dbff1" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:16.036688  2043 raft_consensus.cc:740] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.037432  1897 raft_consensus.cc:2468] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 0.
I20260709 12:25:16.036188  2032 raft_consensus.cc:493] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.038522  2032 raft_consensus.cc:3060] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.038167  2043 consensus_queue.cc:260] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.039580  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903fc0448df449ec9fd979eead54c858" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:16.040441  1746 raft_consensus.cc:2468] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:16.034933  1820 raft_consensus.cc:2468] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:16.047914  1862 leader_election.cc:304] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:16.047940  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ffdb70cdf64a3281a954965817c84f" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:16.048843  1747 raft_consensus.cc:3060] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.049207  2043 ts_tablet_manager.cc:1434] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.011s
I20260709 12:25:16.050457  2043 tablet_bootstrap.cc:492] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:16.053030  2044 ts_tablet_manager.cc:1434] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:25:16.053996  2053 raft_consensus.cc:2804] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.058007  2053 raft_consensus.cc:697] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:16.058300  1747 raft_consensus.cc:2468] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:16.059422  2053 consensus_queue.cc:237] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.056951  2043 tablet_bootstrap.cc:654] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.055545  2032 raft_consensus.cc:515] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.062021  2049 raft_consensus.cc:493] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.062618  2049 raft_consensus.cc:515] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.064872  2049 leader_election.cc:290] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
W20260709 12:25:16.067543  1713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:41879, user_credentials={real_user=slave}} blocked reactor thread for 48022.8us
I20260709 12:25:16.071298  2045 tablet_bootstrap.cc:654] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.081382  2030 raft_consensus.cc:515] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.083137  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:16.067873  2032 leader_election.cc:290] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:16.084893  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6276e838264723bbcd5df2b72dbff1" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:16.085566  1897 raft_consensus.cc:3060] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.085994  2030 leader_election.cc:290] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 election: Requested vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.086239  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6276e838264723bbcd5df2b72dbff1" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:16.086906  1820 raft_consensus.cc:3060] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.087486  2043 tablet_bootstrap.cc:492] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:16.088203  2043 ts_tablet_manager.cc:1403] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.001s
W20260709 12:25:16.085705  1788 leader_election.cc:343] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.084975  1643 catalog_manager.cc:5697] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 1 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.094305  2032 raft_consensus.cc:493] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.095130  2032 raft_consensus.cc:515] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.095892  2043 raft_consensus.cc:359] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.096716  2043 raft_consensus.cc:385] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.097003  2043 raft_consensus.cc:740] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.097568  2032 leader_election.cc:290] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:16.097730  2043 consensus_queue.cc:260] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.102267  2043 ts_tablet_manager.cc:1434] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:25:16.103431  2043 tablet_bootstrap.cc:492] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:16.111558  1820 raft_consensus.cc:2468] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 1.
I20260709 12:25:16.123097  1713 leader_election.cc:304] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:16.123267  1897 raft_consensus.cc:2468] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 1.
W20260709 12:25:16.114153  1862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.43.66:41879, user_credentials={real_user=slave}} blocked reactor thread for 65702.3us
I20260709 12:25:16.124224  2030 raft_consensus.cc:2804] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.124787  2030 raft_consensus.cc:697] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 LEADER]: Becoming Leader. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Running, Role: LEADER
I20260709 12:25:16.125669  2030 consensus_queue.cc:237] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.126256  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903fc0448df449ec9fd979eead54c858" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:16.125860  1643 catalog_manager.cc:5697] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.126886  1747 raft_consensus.cc:3060] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.127482  2053 raft_consensus.cc:493] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.127947  2053 raft_consensus.cc:515] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.129563  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38a8c59ac494bb58212b298ce3f4f90" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:16.130379  1821 raft_consensus.cc:2468] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:16.132174  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38a8c59ac494bb58212b298ce3f4f90" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:16.132895  1746 raft_consensus.cc:2468] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:16.134158  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903fc0448df449ec9fd979eead54c858" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:16.135110  2043 tablet_bootstrap.cc:654] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.137697  2053 leader_election.cc:290] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:16.139158  1862 leader_election.cc:304] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 
I20260709 12:25:16.139547  2045 tablet_bootstrap.cc:492] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e: No bootstrap required, opened a new log
I20260709 12:25:16.140072  2045 ts_tablet_manager.cc:1403] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e: Time spent bootstrapping tablet: real 0.144s	user 0.018s	sys 0.000s
I20260709 12:25:16.140985  2053 raft_consensus.cc:2804] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.141402  2053 raft_consensus.cc:493] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.141732  2053 raft_consensus.cc:3060] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.142624  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31a931ea91248fd9cade01b9ebe8925" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b" is_pre_election: true
I20260709 12:25:16.143035  2045 raft_consensus.cc:359] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.145218  1820 raft_consensus.cc:3060] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.143498  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31a931ea91248fd9cade01b9ebe8925" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:16.151520  1747 raft_consensus.cc:2468] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:16.151759  1646 catalog_manager.cc:5697] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b reported cstate change: term changed from 0 to 1, leader changed from <none> to 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65). New cstate: current_term: 1 leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.152851  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:16.153579  1897 raft_consensus.cc:2468] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 0.
I20260709 12:25:16.154488  2053 raft_consensus.cc:515] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.155380  1786 leader_election.cc:304] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:16.156246  2031 raft_consensus.cc:2804] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.156627  2031 raft_consensus.cc:493] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.148123  2045 raft_consensus.cc:385] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.157099  2031 raft_consensus.cc:3060] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.156634  2053 leader_election.cc:290] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:16.157379  2045 raft_consensus.cc:740] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Initialized, Role: FOLLOWER
W20260709 12:25:16.156883  1862 leader_election.cc:343] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.158586  1862 leader_election.cc:304] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 
I20260709 12:25:16.158385  2045 consensus_queue.cc:260] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.159389  1821 raft_consensus.cc:2468] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 0.
I20260709 12:25:16.160899  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38a8c59ac494bb58212b298ce3f4f90" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:16.161751  1747 raft_consensus.cc:3060] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.162266  2053 raft_consensus.cc:2804] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.163479  2053 raft_consensus.cc:697] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:16.164330  2053 consensus_queue.cc:237] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.164610  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38a8c59ac494bb58212b298ce3f4f90" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:16.165479  1821 raft_consensus.cc:3060] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.167927  1862 leader_election.cc:304] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:16.170810  2080 raft_consensus.cc:2804] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.171293  2080 raft_consensus.cc:493] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.171690  2080 raft_consensus.cc:3060] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.174729  2043 tablet_bootstrap.cc:492] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:16.175203  2045 ts_tablet_manager.cc:1434] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.007s
I20260709 12:25:16.175300  2043 ts_tablet_manager.cc:1403] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.003s
I20260709 12:25:16.179541  2043 raft_consensus.cc:359] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.180239  2043 raft_consensus.cc:385] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.180545  2043 raft_consensus.cc:740] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.181268  2043 consensus_queue.cc:260] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.184633  1821 raft_consensus.cc:2468] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:16.189822  2031 raft_consensus.cc:515] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.187736  1747 raft_consensus.cc:2468] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:16.188313  2080 raft_consensus.cc:515] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.195894  1820 raft_consensus.cc:2468] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:16.192792  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:16.196452  2031 leader_election.cc:290] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.193284  1862 leader_election.cc:304] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
W20260709 12:25:16.200600  1788 leader_election.cc:343] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.201326  2032 raft_consensus.cc:2804] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.201828  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31a931ea91248fd9cade01b9ebe8925" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:16.202080  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:16.202682  1746 raft_consensus.cc:3060] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.202711  1897 raft_consensus.cc:3060] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.203083  2030 raft_consensus.cc:493] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.204210  2030 raft_consensus.cc:515] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.206396  2030 leader_election.cc:290] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.207191  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f655fbf004201a6eee3b3e05af45b" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:16.191051  2043 ts_tablet_manager.cc:1434] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:25:16.208081  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f655fbf004201a6eee3b3e05af45b" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:16.208971  1895 raft_consensus.cc:2393] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22dd3f8ff6c4462082e1aac34f75757b in current term 1: Already voted for candidate 3023eed9ad8a425397f8fe0fe260691e in this term.
I20260709 12:25:16.209033  2043 tablet_bootstrap.cc:492] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b: Bootstrap starting.
I20260709 12:25:16.211726  1897 raft_consensus.cc:2468] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 1.
I20260709 12:25:16.210343  1711 leader_election.cc:304] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:16.214205  1746 raft_consensus.cc:2468] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:16.195616  2080 leader_election.cc:290] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:16.214455  1786 leader_election.cc:304] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:16.217110  2032 raft_consensus.cc:697] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:16.219583  2043 tablet_bootstrap.cc:654] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.220160  2032 consensus_queue.cc:237] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.220635  1646 catalog_manager.cc:5697] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.219033  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31a931ea91248fd9cade01b9ebe8925" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:16.222004  1820 raft_consensus.cc:3060] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.222635  1862 leader_election.cc:304] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 
I20260709 12:25:16.216498  2030 raft_consensus.cc:3060] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.223791  2087 raft_consensus.cc:2804] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.224785  2087 raft_consensus.cc:697] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:16.226044  2087 consensus_queue.cc:237] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.233296  2031 raft_consensus.cc:2804] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.236444  2043 tablet_bootstrap.cc:492] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b: No bootstrap required, opened a new log
I20260709 12:25:16.236994  2043 ts_tablet_manager.cc:1403] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.007s
I20260709 12:25:16.239671  2043 raft_consensus.cc:359] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.240319  2030 raft_consensus.cc:2749] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.240353  2043 raft_consensus.cc:385] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.241043  2043 raft_consensus.cc:740] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.241086  2031 raft_consensus.cc:697] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:16.241817  2043 consensus_queue.cc:260] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.242391  2031 consensus_queue.cc:237] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.244022  2043 ts_tablet_manager.cc:1434] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:16.248220  1820 raft_consensus.cc:2468] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:16.255950  1643 catalog_manager.cc:5697] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 1 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.256074  1646 catalog_manager.cc:5697] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.257341  1646 catalog_manager.cc:5697] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 1 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.286371  1897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df0a6095f06948a28ee3f4e2e401ea73"
dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
mode: GRACEFUL
new_leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:35730
I20260709 12:25:16.286880  1897 raft_consensus.cc:606] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Received request to transfer leadership to TS 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:16.294628  1820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596"
dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
mode: GRACEFUL
new_leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:58218
I20260709 12:25:16.295239  1820 raft_consensus.cc:606] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Received request to transfer leadership to TS 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:16.300571  1897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "903fc0448df449ec9fd979eead54c858"
dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
mode: GRACEFUL
new_leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:35730
I20260709 12:25:16.301116  1897 raft_consensus.cc:606] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Received request to transfer leadership to TS 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:16.306054  1897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98ffdb70cdf64a3281a954965817c84f"
dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
mode: GRACEFUL
new_leader_uuid: "3023eed9ad8a425397f8fe0fe260691e"
 from {username='slave'} at 127.0.0.1:35730
I20260709 12:25:16.306528  1897 raft_consensus.cc:606] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Received request to transfer leadership to TS 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:16.311594  1897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c31a931ea91248fd9cade01b9ebe8925"
dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
mode: GRACEFUL
new_leader_uuid: "3023eed9ad8a425397f8fe0fe260691e"
 from {username='slave'} at 127.0.0.1:35730
I20260709 12:25:16.312086  1897 raft_consensus.cc:606] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Received request to transfer leadership to TS 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:16.317443  1897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f38a8c59ac494bb58212b298ce3f4f90"
dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
mode: GRACEFUL
new_leader_uuid: "3023eed9ad8a425397f8fe0fe260691e"
 from {username='slave'} at 127.0.0.1:35730
I20260709 12:25:16.317971  1897 raft_consensus.cc:606] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Received request to transfer leadership to TS 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:16.325771  1820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570"
dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
mode: GRACEFUL
new_leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
 from {username='slave'} at 127.0.0.1:58218
I20260709 12:25:16.326431  1820 raft_consensus.cc:606] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Received request to transfer leadership to TS 1f6b91fee1c14f56bf0ded64679b45a3
I20260709 12:25:16.339308  2030 raft_consensus.cc:493] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.339901  2030 raft_consensus.cc:515] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.341579  2030 leader_election.cc:290] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.342448  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:16.342677  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:16.343588  1897 raft_consensus.cc:2393] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22dd3f8ff6c4462082e1aac34f75757b in current term 1: Already voted for candidate 3023eed9ad8a425397f8fe0fe260691e in this term.
I20260709 12:25:16.344568  1711 leader_election.cc:304] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:16.345317  2030 raft_consensus.cc:3060] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.348915  2087 consensus_queue.cc:1048] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:16.353626  2030 raft_consensus.cc:2749] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.358937  2031 consensus_queue.cc:1048] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:16.363181  2087 consensus_queue.cc:1048] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:16.384851  2087 raft_consensus.cc:993] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3: : Instructing follower 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:16.392040  2087 raft_consensus.cc:1081] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Signalling peer 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:16.390684  2049 consensus_queue.cc:1048] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:16.395161  1747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df0a6095f06948a28ee3f4e2e401ea73"
dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:39524
I20260709 12:25:16.395754  1747 raft_consensus.cc:493] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.396178  1747 raft_consensus.cc:3060] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.405287  1747 raft_consensus.cc:515] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.408213  1747 leader_election.cc:290] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Requested vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.408762  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df0a6095f06948a28ee3f4e2e401ea73" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:16.409461  1897 raft_consensus.cc:3055] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:16.409775  1897 raft_consensus.cc:740] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:16.410833  2064 consensus_queue.cc:1048] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.410846  1897 consensus_queue.cc:260] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.411933  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df0a6095f06948a28ee3f4e2e401ea73" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:16.412669  1820 raft_consensus.cc:3060] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.412756  1897 raft_consensus.cc:3060] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.420369  1897 raft_consensus.cc:2468] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:16.420753  1820 raft_consensus.cc:2468] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:16.421708  1711 leader_election.cc:304] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 
I20260709 12:25:16.423611  2030 raft_consensus.cc:2804] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:16.424113  2030 raft_consensus.cc:697] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Becoming Leader. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Running, Role: LEADER
I20260709 12:25:16.424975  2030 consensus_queue.cc:237] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.434062  2031 consensus_queue.cc:1048] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.435427  1644 catalog_manager.cc:5697] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b reported cstate change: term changed from 1 to 2, leader changed from 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67) to 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.444725  2064 raft_consensus.cc:993] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e: : Instructing follower 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:16.445467  2064 raft_consensus.cc:1081] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Signalling peer 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:16.447201  1748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596"
dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:39512
I20260709 12:25:16.447801  1748 raft_consensus.cc:493] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.448225  1748 raft_consensus.cc:3060] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.456589  1748 raft_consensus.cc:515] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.458978  1748 leader_election.cc:290] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Requested vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.459414  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:16.459822  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:16.460198  1820 raft_consensus.cc:3055] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:16.460718  1820 raft_consensus.cc:740] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:16.460691  1895 raft_consensus.cc:3060] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.461814  1820 consensus_queue.cc:260] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.463274  1820 raft_consensus.cc:3060] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.467703  1895 raft_consensus.cc:2468] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:16.468914  1711 leader_election.cc:304] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 
I20260709 12:25:16.469754  2030 raft_consensus.cc:2804] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:16.469954  1820 raft_consensus.cc:2468] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:16.470397  2030 raft_consensus.cc:697] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Becoming Leader. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Running, Role: LEADER
I20260709 12:25:16.471351  2030 consensus_queue.cc:237] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.478279  1644 catalog_manager.cc:5697] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b reported cstate change: term changed from 1 to 2, leader changed from 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66) to 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.547605  2030 consensus_queue.cc:1048] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.559347  2079 consensus_queue.cc:1048] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.568917  2032 consensus_queue.cc:1048] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.583290  2032 consensus_queue.cc:1048] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:16.591809  2080 raft_consensus.cc:993] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3: : Instructing follower 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:16.592296  2032 raft_consensus.cc:1081] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Signalling peer 22dd3f8ff6c4462082e1aac34f75757b to start an election
I20260709 12:25:16.594635  1748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "903fc0448df449ec9fd979eead54c858"
dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
 from {username='slave'} at 127.0.0.1:39524
I20260709 12:25:16.595261  1748 raft_consensus.cc:493] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.595641  1748 raft_consensus.cc:3060] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.601853  1748 raft_consensus.cc:515] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.603575  1748 leader_election.cc:290] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Requested vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.604561  1821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903fc0448df449ec9fd979eead54c858" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:16.605392  1821 raft_consensus.cc:3060] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.605937  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903fc0448df449ec9fd979eead54c858" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:16.606616  1895 raft_consensus.cc:3055] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:16.606990  1895 raft_consensus.cc:740] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:16.607843  1895 consensus_queue.cc:260] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.608915  2079 raft_consensus.cc:493] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.609161  1895 raft_consensus.cc:3060] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.609460  2079 raft_consensus.cc:515] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.611763  2079 leader_election.cc:290] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.613000  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:16.613420  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570" candidate_uuid: "22dd3f8ff6c4462082e1aac34f75757b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:16.613808  1897 raft_consensus.cc:2393] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22dd3f8ff6c4462082e1aac34f75757b in current term 1: Already voted for candidate 3023eed9ad8a425397f8fe0fe260691e in this term.
I20260709 12:25:16.615844  1711 leader_election.cc:304] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:16.616350  1821 raft_consensus.cc:2468] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:16.617067  2079 raft_consensus.cc:3060] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.617646  1713 leader_election.cc:304] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:16.617813  1895 raft_consensus.cc:2468] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22dd3f8ff6c4462082e1aac34f75757b in term 2.
I20260709 12:25:16.618721  2078 raft_consensus.cc:2804] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:16.619220  2078 raft_consensus.cc:697] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Becoming Leader. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Running, Role: LEADER
I20260709 12:25:16.620054  2078 consensus_queue.cc:237] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.624461  2079 raft_consensus.cc:2749] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.628063  1644 catalog_manager.cc:5697] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b reported cstate change: term changed from 1 to 2, leader changed from 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67) to 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65). New cstate: current_term: 2 leader_uuid: "22dd3f8ff6c4462082e1aac34f75757b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.659372  2032 consensus_queue.cc:1048] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.670800  2032 consensus_queue.cc:1048] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.680024  2087 raft_consensus.cc:993] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3: : Instructing follower 3023eed9ad8a425397f8fe0fe260691e to start an election
I20260709 12:25:16.680555  2032 raft_consensus.cc:1081] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Signalling peer 3023eed9ad8a425397f8fe0fe260691e to start an election
I20260709 12:25:16.682241  1821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98ffdb70cdf64a3281a954965817c84f"
dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
 from {username='slave'} at 127.0.0.1:58216
I20260709 12:25:16.682835  1821 raft_consensus.cc:493] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.683190  1821 raft_consensus.cc:3060] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.688565  1821 raft_consensus.cc:515] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.690536  1821 leader_election.cc:290] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.691432  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ffdb70cdf64a3281a954965817c84f" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:16.691859  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ffdb70cdf64a3281a954965817c84f" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:16.692235  1748 raft_consensus.cc:3060] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.692562  1895 raft_consensus.cc:3055] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:16.692934  1895 raft_consensus.cc:740] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:16.693748  1895 consensus_queue.cc:260] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.695083  1895 raft_consensus.cc:3060] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.698609  1748 raft_consensus.cc:2468] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
I20260709 12:25:16.700091  1788 leader_election.cc:304] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:16.700831  1895 raft_consensus.cc:2468] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
I20260709 12:25:16.700950  2064 raft_consensus.cc:2804] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:16.701613  2064 raft_consensus.cc:697] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 2 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:16.702554  2064 consensus_queue.cc:237] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.703469  2049 consensus_queue.cc:1048] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:16.718333  1644 catalog_manager.cc:5697] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 1 to 2, leader changed from 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67) to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 2 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.719199  2049 consensus_queue.cc:1048] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:16.728749  2049 raft_consensus.cc:993] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e: : Instructing follower 1f6b91fee1c14f56bf0ded64679b45a3 to start an election
I20260709 12:25:16.729252  2049 raft_consensus.cc:1081] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Signalling peer 1f6b91fee1c14f56bf0ded64679b45a3 to start an election
I20260709 12:25:16.731066  1895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570"
dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
 from {username='slave'} at 127.0.0.1:35702
I20260709 12:25:16.731686  1895 raft_consensus.cc:493] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.732133  1895 raft_consensus.cc:3060] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.740681  2032 consensus_queue.cc:1048] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:16.743568  1895 raft_consensus.cc:515] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.746625  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:16.747280  1748 raft_consensus.cc:3060] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.750383  1895 leader_election.cc:290] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:16.750628  1820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f149c5a493e41b0911fc319323f5570" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:16.751449  1820 raft_consensus.cc:3055] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:16.751842  1820 raft_consensus.cc:740] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:16.752730  1820 consensus_queue.cc:260] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.754037  1820 raft_consensus.cc:3060] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.757676  1748 raft_consensus.cc:2468] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 2.
I20260709 12:25:16.759066  1862 leader_election.cc:304] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 
I20260709 12:25:16.759886  2032 raft_consensus.cc:2804] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:16.760596  2032 raft_consensus.cc:697] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:16.760726  1820 raft_consensus.cc:2468] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 2.
I20260709 12:25:16.761942  2032 consensus_queue.cc:237] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.770983  2087 raft_consensus.cc:993] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3: : Instructing follower 3023eed9ad8a425397f8fe0fe260691e to start an election
I20260709 12:25:16.771514  2053 raft_consensus.cc:1081] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Signalling peer 3023eed9ad8a425397f8fe0fe260691e to start an election
I20260709 12:25:16.774219  1821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f38a8c59ac494bb58212b298ce3f4f90"
dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
 from {username='slave'} at 127.0.0.1:58216
I20260709 12:25:16.774852  1821 raft_consensus.cc:493] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.775240  1821 raft_consensus.cc:3060] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.776026  2080 consensus_queue.cc:1048] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:16.782687  1821 raft_consensus.cc:515] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.783819  1820 raft_consensus.cc:1240] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Rejecting Update request from peer 1f6b91fee1c14f56bf0ded64679b45a3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:16.785868  1821 leader_election.cc:290] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.786878  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38a8c59ac494bb58212b298ce3f4f90" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:16.787997  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38a8c59ac494bb58212b298ce3f4f90" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:16.788633  1748 raft_consensus.cc:3060] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.780642  1646 catalog_manager.cc:5697] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 1 to 2, leader changed from 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66) to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.789855  2080 consensus_queue.cc:1048] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.787238  2032 consensus_queue.cc:1059] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:16.794219  1895 raft_consensus.cc:3055] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:16.794781  1895 raft_consensus.cc:740] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:16.797029  1895 consensus_queue.cc:260] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.799172  1895 raft_consensus.cc:3060] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.801669  1748 raft_consensus.cc:2468] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
I20260709 12:25:16.802904  1788 leader_election.cc:304] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:16.804148  2031 raft_consensus.cc:2804] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:16.804687  2031 raft_consensus.cc:697] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 2 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:16.805668  2031 consensus_queue.cc:237] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.812222  1895 raft_consensus.cc:2468] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
W20260709 12:25:16.813064  2080 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:25:16.813995  1821 raft_consensus.cc:1275] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:16.818393  2080 consensus_queue.cc:1048] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:16.817965  1644 catalog_manager.cc:5697] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 1 to 2, leader changed from 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67) to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 2 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.820173  2079 consensus_queue.cc:1048] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:16.830062  1895 raft_consensus.cc:1275] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:16.832085  2079 consensus_queue.cc:1048] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:16.840888  2032 raft_consensus.cc:993] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3: : Instructing follower 3023eed9ad8a425397f8fe0fe260691e to start an election
I20260709 12:25:16.841367  2080 raft_consensus.cc:1081] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Signalling peer 3023eed9ad8a425397f8fe0fe260691e to start an election
I20260709 12:25:16.843165  1820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c31a931ea91248fd9cade01b9ebe8925"
dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
 from {username='slave'} at 127.0.0.1:58216
I20260709 12:25:16.843922  1820 raft_consensus.cc:493] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.844348  1820 raft_consensus.cc:3060] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.851225  1820 raft_consensus.cc:515] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.854244  1820 leader_election.cc:290] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:16.854197  1746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31a931ea91248fd9cade01b9ebe8925" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:16.855551  1746 raft_consensus.cc:3060] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.854897  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31a931ea91248fd9cade01b9ebe8925" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:16.858242  1895 raft_consensus.cc:3055] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:16.858600  1895 raft_consensus.cc:740] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:16.859558  1895 consensus_queue.cc:260] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.861024  1895 raft_consensus.cc:3060] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.862766  1746 raft_consensus.cc:2468] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
I20260709 12:25:16.864039  1788 leader_election.cc:304] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:16.864811  2031 raft_consensus.cc:2804] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:16.865242  2031 raft_consensus.cc:697] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 2 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:16.865998  2031 consensus_queue.cc:237] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:16.867164  1895 raft_consensus.cc:2468] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
I20260709 12:25:16.872676  1643 catalog_manager.cc:5697] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 1 to 2, leader changed from 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67) to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 2 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.940553  1820 raft_consensus.cc:1275] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:16.941800  2078 consensus_queue.cc:1048] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:16.951174  1895 raft_consensus.cc:1275] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:16.954540  2030 consensus_queue.cc:1048] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.046437  1820 raft_consensus.cc:1275] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:17.047657  2030 consensus_queue.cc:1048] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.054993  1895 raft_consensus.cc:1275] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Refusing update from remote peer 22dd3f8ff6c4462082e1aac34f75757b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:17.056394  2078 consensus_queue.cc:1048] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.152707  1746 raft_consensus.cc:1275] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Refusing update from remote peer 1f6b91fee1c14f56bf0ded64679b45a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:17.154066  2032 consensus_queue.cc:1048] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.161768  1820 raft_consensus.cc:1275] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Refusing update from remote peer 1f6b91fee1c14f56bf0ded64679b45a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:17.163475  2032 consensus_queue.cc:1048] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.198118  1895 raft_consensus.cc:1275] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:17.199297  2049 consensus_queue.cc:1048] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.210312  1746 raft_consensus.cc:1275] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:17.214213  2049 consensus_queue.cc:1048] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.252622  1895 raft_consensus.cc:1275] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:17.254033  2049 consensus_queue.cc:1048] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.261687  1746 raft_consensus.cc:1275] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:17.263231  2031 consensus_queue.cc:1048] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.272491  1895 raft_consensus.cc:1275] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:17.273795  2031 consensus_queue.cc:1048] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.284793  1746 raft_consensus.cc:1275] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:17.286305  2049 consensus_queue.cc:1048] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:19.330230  1645 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33002:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:25:19.353493  1645 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33002:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:25:19.458199 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:19.617460  2147 log.cc:927] Time spent T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:25:19.667712  2161 tablet.cc:1724] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:19.668867  2153 log.cc:927] Time spent T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:25:19.698333  1788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34691, user_credentials={real_user=slave}} blocked reactor thread for 69498.9us
W20260709 12:25:19.711226  2141 log.cc:927] Time spent T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:25:19.773383  1821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5243a9642f8f48beaf4d071e7ebd624f"
dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
mode: GRACEFUL
new_leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
 from {username='slave'} at 127.0.0.1:34086
I20260709 12:25:19.775484  1821 raft_consensus.cc:606] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Received request to transfer leadership to TS 1f6b91fee1c14f56bf0ded64679b45a3
I20260709 12:25:19.773353  2168 tablet.cc:1724] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:19.803618  2166 log.cc:927] Time spent T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 12:25:19.804100  2157 log.cc:927] Time spent T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e: Append to log took a long time: real 0.259s	user 0.007s	sys 0.000s
I20260709 12:25:19.808039  2174 tablet.cc:1724] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:19.811049  2167 log.cc:927] Time spent T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
W20260709 12:25:19.815150  2150 log.cc:927] Time spent T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:25:19.814779  2179 tablet.cc:1724] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.822014  2177 tablet.cc:1724] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.834601  2180 tablet.cc:1724] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.857556  2181 tablet.cc:1724] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:19.848857  2169 log.cc:927] Time spent T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:25:19.894726  2185 tablet.cc:1724] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.906013  2182 tablet.cc:1724] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.906280  2187 tablet.cc:1724] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.909025  2186 tablet.cc:1724] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.914106  2184 tablet.cc:1724] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.905045  2161 tablet.cc:1724] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.925926  2185 tablet.cc:1724] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.935640  2177 tablet.cc:1724] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.964922  2187 tablet.cc:1724] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.965246  2186 tablet.cc:1724] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.974117  2182 tablet.cc:1724] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.976557  2168 tablet.cc:1724] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:19.978837  1862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.43.65:34691, user_credentials={real_user=slave}} blocked reactor thread for 55254.2us
I20260709 12:25:19.984126  2185 tablet.cc:1724] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.986824  2186 tablet.cc:1724] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.989223  2181 tablet.cc:1724] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.991438  1745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d"
dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
mode: GRACEFUL
new_leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
 from {username='slave'} at 127.0.0.1:40122
I20260709 12:25:19.996237  1745 raft_consensus.cc:606] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Received request to transfer leadership to TS 1f6b91fee1c14f56bf0ded64679b45a3
I20260709 12:25:19.996096  2161 tablet.cc:1724] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:19.998238 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:19.998888 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:19.998500  2179 tablet.cc:1724] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:20.008579  2187 tablet.cc:1724] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:20.013237  2180 tablet.cc:1724] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:20.022153  2168 tablet.cc:1724] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:20.060738  1644 catalog_manager.cc:6242] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072: soft_deleted_table [id=14b5fe81af894a218d5dc10f27c0a20f] alter complete (version 1)
I20260709 12:25:20.077739  2163 raft_consensus.cc:993] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e: : Instructing follower 1f6b91fee1c14f56bf0ded64679b45a3 to start an election
I20260709 12:25:20.078222  2163 raft_consensus.cc:1081] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Signalling peer 1f6b91fee1c14f56bf0ded64679b45a3 to start an election
I20260709 12:25:20.079669  1896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5243a9642f8f48beaf4d071e7ebd624f"
dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
 from {username='slave'} at 127.0.0.1:35702
I20260709 12:25:20.080192  1896 raft_consensus.cc:493] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:20.080519  1896 raft_consensus.cc:3060] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:20.086686  1896 raft_consensus.cc:515] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:20.088333  1896 leader_election.cc:290] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:20.089200  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5243a9642f8f48beaf4d071e7ebd624f" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:20.089602  1819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5243a9642f8f48beaf4d071e7ebd624f" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:20.089983  1745 raft_consensus.cc:3060] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:20.090348  1819 raft_consensus.cc:3055] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:20.090667  1819 raft_consensus.cc:740] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:20.091447  1819 consensus_queue.cc:260] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:20.092517  1819 raft_consensus.cc:3060] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:20.096119  1745 raft_consensus.cc:2468] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 2.
I20260709 12:25:20.097328  1862 leader_election.cc:304] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b; no voters: 
I20260709 12:25:20.098101  2183 raft_consensus.cc:2804] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:20.098302  1819 raft_consensus.cc:2468] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 2.
I20260709 12:25:20.098481  2183 raft_consensus.cc:697] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:20.099630  2183 consensus_queue.cc:237] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:20.109536  1643 catalog_manager.cc:5697] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 1 to 2, leader changed from 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66) to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.217803  2158 raft_consensus.cc:993] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b: : Instructing follower 1f6b91fee1c14f56bf0ded64679b45a3 to start an election
I20260709 12:25:20.218415  2178 raft_consensus.cc:1081] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Signalling peer 1f6b91fee1c14f56bf0ded64679b45a3 to start an election
I20260709 12:25:20.219878  1896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d"
dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
 from {username='slave'} at 127.0.0.1:35718
I20260709 12:25:20.220419  1896 raft_consensus.cc:493] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:20.220727  1896 raft_consensus.cc:3060] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:20.226649  1896 raft_consensus.cc:515] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:20.228446  1896 leader_election.cc:290] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:20.229339  1745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22dd3f8ff6c4462082e1aac34f75757b"
I20260709 12:25:20.229598  1819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77d4939daabb40dfbc51a37b80bcc27d" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:20.230026  1745 raft_consensus.cc:3055] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:20.230377  1745 raft_consensus.cc:740] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22dd3f8ff6c4462082e1aac34f75757b, State: Running, Role: LEADER
I20260709 12:25:20.230394  1819 raft_consensus.cc:3060] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:20.231149  1745 consensus_queue.cc:260] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:20.232227  1745 raft_consensus.cc:3060] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:20.237725  1819 raft_consensus.cc:2468] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 3.
I20260709 12:25:20.238523  1745 raft_consensus.cc:2468] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 3.
I20260709 12:25:20.239130  1862 leader_election.cc:304] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:20.239856  2183 raft_consensus.cc:2804] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:20.240319  2183 raft_consensus.cc:697] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:20.241127  2183 consensus_queue.cc:237] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:20.248394  1643 catalog_manager.cc:5697] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 2 to 3, leader changed from 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65) to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 3 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.487742  1819 raft_consensus.cc:1275] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Refusing update from remote peer 1f6b91fee1c14f56bf0ded64679b45a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:20.489292  2183 consensus_queue.cc:1048] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:20.502331  1745 raft_consensus.cc:1275] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Refusing update from remote peer 1f6b91fee1c14f56bf0ded64679b45a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:20.505386  2197 consensus_queue.cc:1048] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:20.648218  1745 raft_consensus.cc:1275] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 3 FOLLOWER]: Refusing update from remote peer 1f6b91fee1c14f56bf0ded64679b45a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:20.649317  2197 consensus_queue.cc:1048] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:20.658864  1819 raft_consensus.cc:1275] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Refusing update from remote peer 1f6b91fee1c14f56bf0ded64679b45a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:20.660534  2183 consensus_queue.cc:1048] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:21.000053 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:21.005678 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:21.006250 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:22.007249 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:22.012435 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:22.012938 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:23.014110 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:23.021951 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:23.022627 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:24.023850 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:24.029700 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:24.030164 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:25.031198 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:25.036571 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:25.037168 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:26.038275 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:26.043640 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:26.044071 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:27.044950 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:27.050179 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:27.050668 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:28.052194 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:28.058610 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:28.059033 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:29.060199 22701 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:29.065443 22701 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:29.065836 22701 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:30.127103 22701 tablet_server.cc:179] TabletServer@127.22.43.65:0 shutting down...
W20260709 12:25:30.152163  1862 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260709 12:25:30.164994  1862 consensus_peers.cc:597] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:30.174502  1788 consensus_peers.cc:597] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:30.180938 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:30.182173 22701 tablet_replica.cc:333] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.183897 22701 raft_consensus.cc:2243] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.185094 22701 raft_consensus.cc:2272] T 3f149c5a493e41b0911fc319323f5570 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.217295 22701 tablet_replica.cc:333] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.218793 22701 raft_consensus.cc:2243] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.219898 22701 raft_consensus.cc:2272] T c31a931ea91248fd9cade01b9ebe8925 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.224916 22701 tablet_replica.cc:333] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.226233 22701 raft_consensus.cc:2243] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.227228 22701 raft_consensus.cc:2272] T f38a8c59ac494bb58212b298ce3f4f90 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.232301 22701 tablet_replica.cc:333] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.233474 22701 raft_consensus.cc:2243] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.235216 22701 raft_consensus.cc:2272] T 8f6276e838264723bbcd5df2b72dbff1 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.239204 22701 tablet_replica.cc:333] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
W20260709 12:25:30.239353  1862 consensus_peers.cc:597] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:30.240203 22701 raft_consensus.cc:2243] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.241746 22701 raft_consensus.cc:2272] T 903fc0448df449ec9fd979eead54c858 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.246347 22701 tablet_replica.cc:333] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.247388 22701 raft_consensus.cc:2243] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.248042 22701 raft_consensus.cc:2272] T 77d4939daabb40dfbc51a37b80bcc27d P 22dd3f8ff6c4462082e1aac34f75757b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.252198 22701 tablet_replica.cc:333] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.253181 22701 raft_consensus.cc:2243] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.254029 22701 raft_consensus.cc:2272] T 98ffdb70cdf64a3281a954965817c84f P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.258464 22701 tablet_replica.cc:333] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.259757 22701 raft_consensus.cc:2243] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.260720 22701 raft_consensus.cc:2272] T 1f284b2b727e463d8212164d8ba764e6 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.266067 22701 tablet_replica.cc:333] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.266901 22701 raft_consensus.cc:2243] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.272948 22701 raft_consensus.cc:2272] T 70f21bc04ed3443fa62544bd8b7015da P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.277645 22701 tablet_replica.cc:333] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.278739 22701 raft_consensus.cc:2243] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.280463 22701 raft_consensus.cc:2272] T 9d585333425c4b5ab82e429569429dbc P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.285984 22701 tablet_replica.cc:333] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.287042 22701 raft_consensus.cc:2243] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.288710 22701 raft_consensus.cc:2272] T 506762ba3842492ab6e7f9f128f98088 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.293341 22701 tablet_replica.cc:333] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.294332 22701 raft_consensus.cc:2243] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.295174 22701 raft_consensus.cc:2272] T 349960d984674a8fae2ad4a7af1b8504 P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.299342 22701 tablet_replica.cc:333] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.300285 22701 raft_consensus.cc:2243] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.301340 22701 raft_consensus.cc:2272] T 8e3f655fbf004201a6eee3b3e05af45b P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.305902 22701 tablet_replica.cc:333] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.307022 22701 raft_consensus.cc:2243] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.308015 22701 raft_consensus.cc:2272] T dfee7ba822194cd39954dc5330db93ce P 22dd3f8ff6c4462082e1aac34f75757b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.311861 22701 tablet_replica.cc:333] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.312747 22701 raft_consensus.cc:2243] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.314147 22701 raft_consensus.cc:2272] T 61fdff83dce5446e9c63dcc6e2191596 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.322889 22701 tablet_replica.cc:333] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.323761 22701 raft_consensus.cc:2243] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.324694 22701 raft_consensus.cc:2272] T 5243a9642f8f48beaf4d071e7ebd624f P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.331267 22701 tablet_replica.cc:333] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.332190 22701 raft_consensus.cc:2243] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.332939 22701 raft_consensus.cc:2272] T ecfdee33f5a34a64bcd8be53c7111305 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.337641 22701 tablet_replica.cc:333] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b: stopping tablet replica
I20260709 12:25:30.338877 22701 raft_consensus.cc:2243] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.340378 22701 raft_consensus.cc:2272] T df0a6095f06948a28ee3f4e2e401ea73 P 22dd3f8ff6c4462082e1aac34f75757b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:30.370625  1862 consensus_peers.cc:597] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:30.371907  1862 consensus_peers.cc:597] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:30.383211  1788 consensus_peers.cc:597] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:30.383941  1788 consensus_peers.cc:597] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:30.431345  1788 consensus_peers.cc:597] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:30.456019  1788 consensus_peers.cc:597] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:30.488399  1788 consensus_peers.cc:597] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:30.502604  1788 consensus_peers.cc:597] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:31.245498  2223 raft_consensus.cc:493] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.246146  2223 raft_consensus.cc:515] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.249290  2223 leader_election.cc:290] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:31.252053  1819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
W20260709 12:25:31.257236  1862 leader_election.cc:336] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.257694  1862 leader_election.cc:304] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3; no voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:31.258572  2223 raft_consensus.cc:2749] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:31.276892  2223 raft_consensus.cc:493] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.277405  2223 raft_consensus.cc:515] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.279289  2223 leader_election.cc:290] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:31.281821  1819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
W20260709 12:25:31.283535  1862 leader_election.cc:336] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.283929  1862 leader_election.cc:304] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3; no voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:31.284572  2223 raft_consensus.cc:2749] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:31.321035  1769 debug-util.cc:398] Leaking SignalData structure 0x7b080029dd00 after lost signal to thread 22704
W20260709 12:25:31.322263  1769 debug-util.cc:398] Leaking SignalData structure 0x7b08000a3480 after lost signal to thread 1680
W20260709 12:25:31.323568  1769 debug-util.cc:398] Leaking SignalData structure 0x7b0800146140 after lost signal to thread 1847
I20260709 12:25:31.324287  2223 raft_consensus.cc:493] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
W20260709 12:25:31.324887  1769 debug-util.cc:398] Leaking SignalData structure 0x7b0800137920 after lost signal to thread 1921
I20260709 12:25:31.324970  2223 raft_consensus.cc:515] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.327518  2223 leader_election.cc:290] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:31.329325  2209 raft_consensus.cc:493] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.330004  2209 raft_consensus.cc:515] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:31.332630  1819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df0a6095f06948a28ee3f4e2e401ea73" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:31.332970  2209 leader_election.cc:290] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461), 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691)
W20260709 12:25:31.333226  1862 leader_election.cc:336] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.334293  1862 leader_election.cc:304] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3; no voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:31.335181  2223 raft_consensus.cc:2749] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:31.336217  1890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d585333425c4b5ab82e429569429dbc" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:31.338174  2224 raft_consensus.cc:493] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.338809  2224 raft_consensus.cc:515] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:31.341173  2224 leader_election.cc:290] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691)
I20260709 12:25:31.341740  1819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d585333425c4b5ab82e429569429dbc" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:31.342470  1819 raft_consensus.cc:2468] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
W20260709 12:25:31.342641  1788 leader_election.cc:336] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.343274  1788 leader_election.cc:304] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3023eed9ad8a425397f8fe0fe260691e; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:31.344128  2209 raft_consensus.cc:2749] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:31.343645  1862 leader_election.cc:304] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:31.345144  2224 raft_consensus.cc:2804] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:31.345546  2224 raft_consensus.cc:493] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.346040  2224 raft_consensus.cc:3060] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:31.347935  1862 leader_election.cc:336] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.353665  2224 raft_consensus.cc:515] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:31.355528  2224 leader_election.cc:290] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 election: Requested vote from peers 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879), 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691)
I20260709 12:25:31.356458  1819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d585333425c4b5ab82e429569429dbc" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:31.357198  1819 raft_consensus.cc:3060] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:31.361680  1862 leader_election.cc:336] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.364739  1819 raft_consensus.cc:2468] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 2.
I20260709 12:25:31.365960  1862 leader_election.cc:304] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:31.366788  2224 raft_consensus.cc:2804] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:31.367267  2224 raft_consensus.cc:697] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:31.368224  2224 consensus_queue.cc:237] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } }
I20260709 12:25:31.379375  1643 catalog_manager.cc:5697] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 1 to 2, leader changed from 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65) to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.391518  2209 raft_consensus.cc:493] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.392217  2209 raft_consensus.cc:515] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.394934  2209 leader_election.cc:290] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:31.397305  1890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:31.398041  1890 raft_consensus.cc:2468] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
I20260709 12:25:31.399210  1786 leader_election.cc:304] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
W20260709 12:25:31.399746  1788 leader_election.cc:336] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.399996  2209 raft_consensus.cc:2804] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:31.400473  2209 raft_consensus.cc:493] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.400830  2209 raft_consensus.cc:3060] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.407135  2209 raft_consensus.cc:515] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
W20260709 12:25:31.407521 22701 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1769)
I20260709 12:25:31.408764  2209 leader_election.cc:290] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:31.409798  1890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506762ba3842492ab6e7f9f128f98088" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:31.410519  1890 raft_consensus.cc:3060] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:31.413324  1788 leader_election.cc:336] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.416285  1890 raft_consensus.cc:2468] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 3.
I20260709 12:25:31.417326  1786 leader_election.cc:304] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:31.418133  2209 raft_consensus.cc:2804] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:31.418519  2209 raft_consensus.cc:697] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 3 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:31.419189  2209 consensus_queue.cc:237] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.427172  1643 catalog_manager.cc:5697] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 2 to 3, leader changed from 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65) to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 3 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.428792  2209 raft_consensus.cc:493] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.429376  2209 raft_consensus.cc:515] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.431342  2209 leader_election.cc:290] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:31.433535  1890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df0a6095f06948a28ee3f4e2e401ea73" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:31.434365  1890 raft_consensus.cc:2468] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
I20260709 12:25:31.435592  1786 leader_election.cc:304] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:31.436496  2209 raft_consensus.cc:2804] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:31.436918  2209 raft_consensus.cc:493] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.437301  2209 raft_consensus.cc:3060] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:31.438943  1788 leader_election.cc:336] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.443480  2209 raft_consensus.cc:515] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.445220  2209 leader_election.cc:290] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:31.446310  1890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df0a6095f06948a28ee3f4e2e401ea73" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:31.446867  1890 raft_consensus.cc:3060] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:31.449854  1788 leader_election.cc:336] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.452554  1890 raft_consensus.cc:2468] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 3.
I20260709 12:25:31.453599  1786 leader_election.cc:304] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:31.454288  2209 raft_consensus.cc:2804] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:31.454803  2209 raft_consensus.cc:697] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 3 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:31.455821  2209 consensus_queue.cc:237] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.464993  1643 catalog_manager.cc:5697] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 2 to 3, leader changed from 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65) to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 3 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.490710  2224 raft_consensus.cc:493] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.491451  2224 raft_consensus.cc:515] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.493393  2224 leader_election.cc:290] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:31.495230  1819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f21bc04ed3443fa62544bd8b7015da" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
W20260709 12:25:31.498426  1862 leader_election.cc:336] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.498909  1862 leader_election.cc:304] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3; no voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:31.499673  2224 raft_consensus.cc:2749] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:31.514173  2224 raft_consensus.cc:493] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.514801  2224 raft_consensus.cc:515] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.517083  2224 leader_election.cc:290] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:31.518471  1819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903fc0448df449ec9fd979eead54c858" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
W20260709 12:25:31.520681  1862 leader_election.cc:336] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.521127  1862 leader_election.cc:304] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3; no voters: 22dd3f8ff6c4462082e1aac34f75757b, 3023eed9ad8a425397f8fe0fe260691e
I20260709 12:25:31.522017  2224 raft_consensus.cc:2749] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:31.585031  2209 raft_consensus.cc:493] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.585605  2209 raft_consensus.cc:515] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.587762  2209 leader_election.cc:290] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:31.588991  1890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:31.589784  1890 raft_consensus.cc:2468] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
I20260709 12:25:31.590884  1786 leader_election.cc:304] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:31.591733  2209 raft_consensus.cc:2804] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:25:31.592185  1788 leader_election.cc:336] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.592178  2209 raft_consensus.cc:493] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.592885  2209 raft_consensus.cc:3060] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.604516  2226 raft_consensus.cc:493] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.604645  2209 raft_consensus.cc:515] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.605152  2226 raft_consensus.cc:515] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.607359  2209 leader_election.cc:290] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:31.607504  2226 leader_election.cc:290] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:31.608278  1890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fdff83dce5446e9c63dcc6e2191596" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:31.609477  1890 raft_consensus.cc:3060] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.609993  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6276e838264723bbcd5df2b72dbff1" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
W20260709 12:25:31.612380  1788 leader_election.cc:336] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
W20260709 12:25:31.613027  1788 leader_election.cc:336] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.613456  1788 leader_election.cc:304] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3023eed9ad8a425397f8fe0fe260691e; no voters: 1f6b91fee1c14f56bf0ded64679b45a3, 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:31.614799  2226 raft_consensus.cc:2749] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:31.617076  1890 raft_consensus.cc:2468] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 3.
I20260709 12:25:31.618554  1786 leader_election.cc:304] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:31.619506  2226 raft_consensus.cc:2804] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:31.620180  2226 raft_consensus.cc:697] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 3 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:31.621181  2226 consensus_queue.cc:237] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.631886  1643 catalog_manager.cc:5697] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 2 to 3, leader changed from 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65) to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 3 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.637895  2226 raft_consensus.cc:493] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.638706  2226 raft_consensus.cc:515] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.640079  2209 raft_consensus.cc:493] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.644295  2226 leader_election.cc:290] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:31.640733  2209 raft_consensus.cc:515] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.645525  1890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903fc0448df449ec9fd979eead54c858" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:31.646201  1890 raft_consensus.cc:2468] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
I20260709 12:25:31.647152  1786 leader_election.cc:304] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:31.647920  2226 raft_consensus.cc:2804] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:31.648290  2209 leader_election.cc:290] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:31.648312  2226 raft_consensus.cc:493] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.649014  1890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f21bc04ed3443fa62544bd8b7015da" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" is_pre_election: true
I20260709 12:25:31.649318  2226 raft_consensus.cc:3060] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.649681  1890 raft_consensus.cc:2468] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 2.
W20260709 12:25:31.650292  1788 leader_election.cc:336] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.650908  1786 leader_election.cc:304] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:31.651687  2224 raft_consensus.cc:493] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
W20260709 12:25:31.652280  1788 leader_election.cc:336] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.652350  2224 raft_consensus.cc:515] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.654881  2224 leader_election.cc:290] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:31.651793  2209 raft_consensus.cc:2804] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:31.655526  2209 raft_consensus.cc:493] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.655907  2209 raft_consensus.cc:3060] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.658455  1819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6276e838264723bbcd5df2b72dbff1" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e" is_pre_election: true
I20260709 12:25:31.658632  2226 raft_consensus.cc:515] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.659282  1819 raft_consensus.cc:2468] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 1.
I20260709 12:25:31.662778  2209 raft_consensus.cc:515] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.663954  2226 leader_election.cc:290] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
I20260709 12:25:31.664765  2209 leader_election.cc:290] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67:46461)
W20260709 12:25:31.666121  1788 leader_election.cc:336] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.666826  1862 leader_election.cc:304] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 
I20260709 12:25:31.667665  2224 raft_consensus.cc:2804] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:31.668081  2224 raft_consensus.cc:493] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22dd3f8ff6c4462082e1aac34f75757b)
I20260709 12:25:31.668502  2224 raft_consensus.cc:3060] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:31.668975  1890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903fc0448df449ec9fd979eead54c858" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:31.669608  1890 raft_consensus.cc:3060] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:31.670069  1788 leader_election.cc:336] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.673517  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f21bc04ed3443fa62544bd8b7015da" candidate_uuid: "3023eed9ad8a425397f8fe0fe260691e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f6b91fee1c14f56bf0ded64679b45a3"
I20260709 12:25:31.674294  1896 raft_consensus.cc:3060] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:31.674845  1862 leader_election.cc:336] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.677482  2224 raft_consensus.cc:515] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.678351  1890 raft_consensus.cc:2468] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 3.
I20260709 12:25:31.679581  2224 leader_election.cc:290] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 election: Requested vote from peers 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691), 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879)
I20260709 12:25:31.680474  1786 leader_election.cc:304] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:31.682042  1819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6276e838264723bbcd5df2b72dbff1" candidate_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3023eed9ad8a425397f8fe0fe260691e"
I20260709 12:25:31.682580  1819 raft_consensus.cc:3060] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:31.682617  2209 raft_consensus.cc:2804] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:31.682898  1896 raft_consensus.cc:2468] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3023eed9ad8a425397f8fe0fe260691e in term 3.
I20260709 12:25:31.684803  2209 raft_consensus.cc:697] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 3 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:31.685829  1786 leader_election.cc:304] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
W20260709 12:25:31.687170  1862 leader_election.cc:336] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111)
I20260709 12:25:31.687067  2209 consensus_queue.cc:237] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.688342  2226 raft_consensus.cc:2804] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:31.690945  1819 raft_consensus.cc:2468] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f6b91fee1c14f56bf0ded64679b45a3 in term 2.
I20260709 12:25:31.692723  1862 leader_election.cc:304] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f6b91fee1c14f56bf0ded64679b45a3, 3023eed9ad8a425397f8fe0fe260691e; no voters: 22dd3f8ff6c4462082e1aac34f75757b
I20260709 12:25:31.693679  2224 raft_consensus.cc:2804] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:31.694921  2224 raft_consensus.cc:697] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 LEADER]: Becoming Leader. State: Replica: 1f6b91fee1c14f56bf0ded64679b45a3, State: Running, Role: LEADER
I20260709 12:25:31.697363  2224 consensus_queue.cc:237] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.699406  2226 raft_consensus.cc:697] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 3 LEADER]: Becoming Leader. State: Replica: 3023eed9ad8a425397f8fe0fe260691e, State: Running, Role: LEADER
I20260709 12:25:31.702003  1643 catalog_manager.cc:5697] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 2 to 3, leader changed from 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65) to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 3 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.703907  2226 consensus_queue.cc:237] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } }
I20260709 12:25:31.712832  1646 catalog_manager.cc:5697] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 reported cstate change: term changed from 1 to 2, leader changed from 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65) to 1f6b91fee1c14f56bf0ded64679b45a3 (127.22.43.67). New cstate: current_term: 2 leader_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:31.728195  1643 catalog_manager.cc:5697] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e reported cstate change: term changed from 2 to 3, leader changed from 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65) to 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66). New cstate: current_term: 3 leader_uuid: "3023eed9ad8a425397f8fe0fe260691e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22dd3f8ff6c4462082e1aac34f75757b" member_type: VOTER last_known_addr { host: "127.22.43.65" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.755178  1819 raft_consensus.cc:1275] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Refusing update from remote peer 1f6b91fee1c14f56bf0ded64679b45a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:31.756373  2224 consensus_queue.cc:1048] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:31.772833  1862 consensus_peers.cc:597] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:31.833792  1890 raft_consensus.cc:1275] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:31.835368  2226 consensus_queue.cc:1048] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:31.855517  1890 raft_consensus.cc:1275] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:25:31.857208  1788 consensus_peers.cc:597] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:31.858438  2226 consensus_queue.cc:1048] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:25:31.871709  1788 consensus_peers.cc:597] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:32.015899  1890 raft_consensus.cc:1275] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:32.017465  2238 consensus_queue.cc:1048] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:25:32.030910  1788 consensus_peers.cc:597] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:32.197216  1788 consensus_peers.cc:597] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:32.220858  1788 consensus_peers.cc:597] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:32.233184  1862 consensus_peers.cc:597] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:32.256275  1819 raft_consensus.cc:1275] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Refusing update from remote peer 1f6b91fee1c14f56bf0ded64679b45a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:25:32.257676  2224 consensus_queue.cc:1048] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3023eed9ad8a425397f8fe0fe260691e" member_type: VOTER last_known_addr { host: "127.22.43.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:32.259006  1890 raft_consensus.cc:1275] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:32.261231  2237 consensus_queue.cc:1048] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:32.296078  1890 raft_consensus.cc:1275] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Refusing update from remote peer 3023eed9ad8a425397f8fe0fe260691e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:32.297266  2237 consensus_queue.cc:1048] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f6b91fee1c14f56bf0ded64679b45a3" member_type: VOTER last_known_addr { host: "127.22.43.67" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:25:32.408043 22701 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1769)
W20260709 12:25:32.491395  1862 consensus_peers.cc:597] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:32.631254  1862 consensus_peers.cc:597] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:32.646981  1788 consensus_peers.cc:597] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:32.672148  1788 consensus_peers.cc:597] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:32.707649  1788 consensus_peers.cc:597] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:32.866016  1862 consensus_peers.cc:597] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:32.866483  1862 consensus_peers.cc:597] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:32.907580  1788 consensus_peers.cc:597] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:33.005360  1788 consensus_peers.cc:597] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:33.011657  1788 consensus_peers.cc:597] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:33.040573  1788 consensus_peers.cc:597] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:33.408567 22701 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1769)
W20260709 12:25:34.193748  1862 consensus_peers.cc:597] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:34.337350  1788 consensus_peers.cc:597] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:34.369397  1788 consensus_peers.cc:597] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:34.384826  1788 consensus_peers.cc:597] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:34.409139 22701 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1769)
W20260709 12:25:34.425163  1862 consensus_peers.cc:597] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:34.610387  1788 consensus_peers.cc:597] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:34.636883  1788 consensus_peers.cc:597] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:34.779625 22701 tablet_server.cc:196] TabletServer@127.22.43.65:0 shutdown complete.
I20260709 12:25:34.824615 22701 tablet_server.cc:179] TabletServer@127.22.43.66:0 shutting down...
W20260709 12:25:34.843127  1862 consensus_peers.cc:597] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Couldn't send request to peer 3023eed9ad8a425397f8fe0fe260691e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:34.856772 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:34.857707 22701 tablet_replica.cc:333] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.858811 22701 raft_consensus.cc:2243] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.860545 22701 raft_consensus.cc:2272] T c31a931ea91248fd9cade01b9ebe8925 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.863353 22701 tablet_replica.cc:333] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.863966 22701 raft_consensus.cc:2243] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:34.864444 22701 raft_consensus.cc:2272] T 3f149c5a493e41b0911fc319323f5570 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.866945 22701 tablet_replica.cc:333] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.867540 22701 raft_consensus.cc:2243] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.868386 22701 raft_consensus.cc:2272] T 903fc0448df449ec9fd979eead54c858 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.871116 22701 tablet_replica.cc:333] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.871646 22701 raft_consensus.cc:2243] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.872731 22701 raft_consensus.cc:2272] T df0a6095f06948a28ee3f4e2e401ea73 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.875789 22701 tablet_replica.cc:333] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.876564 22701 raft_consensus.cc:2243] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.877415 22701 raft_consensus.cc:2272] T dfee7ba822194cd39954dc5330db93ce P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.879657 22701 tablet_replica.cc:333] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.880261 22701 raft_consensus.cc:2243] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.881095 22701 raft_consensus.cc:2272] T 8e3f655fbf004201a6eee3b3e05af45b P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.883473 22701 tablet_replica.cc:333] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.884083 22701 raft_consensus.cc:2243] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:34.884665 22701 raft_consensus.cc:2272] T 8f6276e838264723bbcd5df2b72dbff1 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.887336 22701 tablet_replica.cc:333] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.888182 22701 raft_consensus.cc:2243] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.889266 22701 raft_consensus.cc:2272] T f38a8c59ac494bb58212b298ce3f4f90 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.892374 22701 tablet_replica.cc:333] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.893092 22701 raft_consensus.cc:2243] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.893976 22701 raft_consensus.cc:2272] T 70f21bc04ed3443fa62544bd8b7015da P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.896087 22701 tablet_replica.cc:333] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.896603 22701 raft_consensus.cc:2243] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:34.897022 22701 raft_consensus.cc:2272] T 1f284b2b727e463d8212164d8ba764e6 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.899333 22701 tablet_replica.cc:333] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.899813 22701 raft_consensus.cc:2243] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.900570 22701 raft_consensus.cc:2272] T 506762ba3842492ab6e7f9f128f98088 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.902619 22701 tablet_replica.cc:333] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.903097 22701 raft_consensus.cc:2243] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.903860 22701 raft_consensus.cc:2272] T 349960d984674a8fae2ad4a7af1b8504 P 3023eed9ad8a425397f8fe0fe260691e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.905946 22701 tablet_replica.cc:333] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.906455 22701 raft_consensus.cc:2243] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.907186 22701 raft_consensus.cc:2272] T 98ffdb70cdf64a3281a954965817c84f P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.909198 22701 tablet_replica.cc:333] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.909653 22701 raft_consensus.cc:2243] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:34.910091 22701 raft_consensus.cc:2272] T 77d4939daabb40dfbc51a37b80bcc27d P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.912142 22701 tablet_replica.cc:333] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.912587 22701 raft_consensus.cc:2243] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.913348 22701 raft_consensus.cc:2272] T 61fdff83dce5446e9c63dcc6e2191596 P 3023eed9ad8a425397f8fe0fe260691e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.915310 22701 tablet_replica.cc:333] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.915755 22701 raft_consensus.cc:2243] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:34.916121 22701 raft_consensus.cc:2272] T 5243a9642f8f48beaf4d071e7ebd624f P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.918228 22701 tablet_replica.cc:333] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.918684 22701 raft_consensus.cc:2243] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:34.919420 22701 raft_consensus.cc:2272] T ecfdee33f5a34a64bcd8be53c7111305 P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.921408 22701 tablet_replica.cc:333] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e: stopping tablet replica
I20260709 12:25:34.921818 22701 raft_consensus.cc:2243] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:34.922222 22701 raft_consensus.cc:2272] T 9d585333425c4b5ab82e429569429dbc P 3023eed9ad8a425397f8fe0fe260691e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:34.958969 22701 tablet_server.cc:196] TabletServer@127.22.43.66:0 shutdown complete.
I20260709 12:25:35.001263 22701 tablet_server.cc:179] TabletServer@127.22.43.67:0 shutting down...
I20260709 12:25:35.034898 22701 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:35.035624 22701 tablet_replica.cc:333] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.036541 22701 raft_consensus.cc:2243] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:35.037201 22701 raft_consensus.cc:2272] T c31a931ea91248fd9cade01b9ebe8925 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.039875 22701 tablet_replica.cc:333] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.040567 22701 raft_consensus.cc:2243] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:35.041316 22701 raft_consensus.cc:2272] T 903fc0448df449ec9fd979eead54c858 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.043720 22701 tablet_replica.cc:333] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.044281 22701 raft_consensus.cc:2243] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:35.045161 22701 raft_consensus.cc:2272] T 8f6276e838264723bbcd5df2b72dbff1 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.047606 22701 tablet_replica.cc:333] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.048399 22701 raft_consensus.cc:2243] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:35.049058 22701 raft_consensus.cc:2272] T f38a8c59ac494bb58212b298ce3f4f90 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.052565 22701 tablet_replica.cc:333] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.053500 22701 raft_consensus.cc:2243] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:35.053809  1862 consensus_peers.cc:597] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 22dd3f8ff6c4462082e1aac34f75757b (127.22.43.65:34691): Couldn't send request to peer 22dd3f8ff6c4462082e1aac34f75757b. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.65:34691: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:35.054234 22701 raft_consensus.cc:2272] T df0a6095f06948a28ee3f4e2e401ea73 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:35.056504  1862 consensus_peers.cc:597] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Couldn't send request to peer 3023eed9ad8a425397f8fe0fe260691e. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:41879: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:35.057431 22701 tablet_replica.cc:333] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.058297 22701 raft_consensus.cc:2243] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:35.058907 22701 raft_consensus.cc:2272] T dfee7ba822194cd39954dc5330db93ce P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:35.059448  1862 consensus_peers.cc:597] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 -> Peer 3023eed9ad8a425397f8fe0fe260691e (127.22.43.66:41879): Couldn't send request to peer 3023eed9ad8a425397f8fe0fe260691e. Status: Network error: Client connection negotiation failed: client connection to 127.22.43.66:41879: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:35.061578 22701 tablet_replica.cc:333] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.062348 22701 raft_consensus.cc:2243] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:35.062912 22701 raft_consensus.cc:2272] T 8e3f655fbf004201a6eee3b3e05af45b P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.065543 22701 tablet_replica.cc:333] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.066250 22701 raft_consensus.cc:2243] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:35.067206 22701 raft_consensus.cc:2272] T 3f149c5a493e41b0911fc319323f5570 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.069626 22701 tablet_replica.cc:333] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.070307 22701 raft_consensus.cc:2243] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:35.071213 22701 raft_consensus.cc:2272] T 9d585333425c4b5ab82e429569429dbc P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.073519 22701 tablet_replica.cc:333] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.074193 22701 raft_consensus.cc:2243] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:35.074659 22701 raft_consensus.cc:2272] T 70f21bc04ed3443fa62544bd8b7015da P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.076872 22701 tablet_replica.cc:333] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.077453 22701 raft_consensus.cc:2243] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:35.078434 22701 raft_consensus.cc:2272] T 1f284b2b727e463d8212164d8ba764e6 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.080827 22701 tablet_replica.cc:333] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.081455 22701 raft_consensus.cc:2243] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:35.082063 22701 raft_consensus.cc:2272] T 506762ba3842492ab6e7f9f128f98088 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.084465 22701 tablet_replica.cc:333] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.085062 22701 raft_consensus.cc:2243] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:35.085593 22701 raft_consensus.cc:2272] T 349960d984674a8fae2ad4a7af1b8504 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.087934 22701 tablet_replica.cc:333] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.088508 22701 raft_consensus.cc:2243] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:35.089051 22701 raft_consensus.cc:2272] T 98ffdb70cdf64a3281a954965817c84f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.091383 22701 tablet_replica.cc:333] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.091964 22701 raft_consensus.cc:2243] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:35.092859 22701 raft_consensus.cc:2272] T 77d4939daabb40dfbc51a37b80bcc27d P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.095270 22701 tablet_replica.cc:333] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.096027 22701 raft_consensus.cc:2243] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:35.096782 22701 raft_consensus.cc:2272] T 61fdff83dce5446e9c63dcc6e2191596 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.099097 22701 tablet_replica.cc:333] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.099606 22701 raft_consensus.cc:2243] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:35.100450 22701 raft_consensus.cc:2272] T 5243a9642f8f48beaf4d071e7ebd624f P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.102828 22701 tablet_replica.cc:333] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3: stopping tablet replica
I20260709 12:25:35.103302 22701 raft_consensus.cc:2243] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:35.103753 22701 raft_consensus.cc:2272] T ecfdee33f5a34a64bcd8be53c7111305 P 1f6b91fee1c14f56bf0ded64679b45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.153802 22701 tablet_server.cc:196] TabletServer@127.22.43.67:0 shutdown complete.
I20260709 12:25:35.201215 22701 master.cc:562] Master@127.22.43.126:38069 shutting down...
I20260709 12:25:35.234390 22701 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:35.234942 22701 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:35.235246 22701 tablet_replica.cc:333] T 00000000000000000000000000000000 P b70ee03760624d1fbf44651d00f95072: stopping tablet replica
I20260709 12:25:35.256671 22701 master.cc:584] Master@127.22.43.126:38069 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (25008 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (46177 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (408323 ms total)
[  PASSED  ] 8 tests.
I20260709 12:25:35.314541 22701 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2543 messages since previous log ~36 seconds ago
I20260709 12:25:35.314795 22701 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2539 messages since previous log ~36 seconds ago
I20260709 12:25:35.314985 22701 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2544 messages since previous log ~36 seconds ago
I20260709 12:25:35.315208 22701 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:25:35.315403 22701 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:25:35.315645 22701 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~212 seconds ago
I20260709 12:25:35.315929 22701 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 178 messages since previous log ~5 seconds ago
I20260709 12:25:35.316241 22701 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~23 seconds ago
